Camera display system

Abstract

Provided is an image capture and display system capable of appropriately capturing an image of a user while utilizing a configuration that allows the user to visually recognize a virtual image. The camera display system (100) comprises: a display unit (112); an optical system including a first mirror (113a) and a second mirror (113b); a frame (111); a light-transmitting cover (114) having light transmittance and configured to cover at least a portion of an opening of the frame (111); and a driver monitoring camera (120) supported by a supporting body (115) connected to the outside of the frame (111). First light (L1) emitted from the display unit (112) passes through the light-transmitting cover (114) via the optical system and is reflected toward the user side by the windshield (2). The driver monitoring camera (120) reflects second light (L2) from the driver (1) side toward the light-transmitting cover (114) side by the windshield (2), thereby photographing the driver (1) reflected on the light-transmitting cover (114).

Description

Technical Field

[0001] The present disclosure relates to an image capture and display system mounted on a vehicle or the like, for example. Background Art

[0002] Conventionally, a system including a head-up display and a driver monitoring camera has been proposed as a camera display system mounted on a vehicle (e.g., see Patent Document 1). This system allows the driver of the vehicle to visually recognize a virtual image displayed through the windshield by the head-up display, and further, the driver is photographed by the driver monitoring camera.

[0003] (Prior art literature)

[0004] (Patent Document)

[0005] Patent Document 1: U.S. Patent Application Publication No. 2018 / 0037116

[0006] However, the system of Patent Document 1 has a problem in that it is difficult to appropriately capture an image of the driver who is a user of the system. Summary of the Invention

[0007] Therefore, the present disclosure provides an image capture and display system capable of appropriately capturing an image of a user while utilizing a configuration that allows the user to visually recognize a virtual image.

[0008] The imaging display system involved in one form of the present invention comprises: a display unit, which emits a first light representing an image; an optical system, which includes at least one mirror; a frame, which has an opening, and frames the display unit and the optical system; a light-transmitting cover, which is light-transmitting and is configured to cover at least a portion of the opening of the frame; and a camera, which is supported by a supporting body in a manner that covers at least a portion of the light-transmitting cover, and the supporting body is connected to the outer side of the frame, wherein the first light emitted from the display unit passes through the light-transmitting cover via the optical system and is reflected toward the user side by a display medium, and the camera is arranged on a surface of the supporting body on the light-transmitting cover side, and photographs the user reflected on the light-transmitting cover by reflecting the second light from the user side toward the light-transmitting cover side by the display medium.

[0009] Furthermore, the general or specific aspects of the present disclosure may be implemented by a system, method, integrated circuit, computer program, or computer-readable recording medium such as a CD-ROM, or by any combination of such systems, methods, integrated circuits, computer programs, and recording media. Furthermore, the recording medium may be non-transitory.

[0010] The imaging display system of the present disclosure can appropriately capture an image of a user while allowing the user to visually recognize a virtual image.

[0011] More advantages and better effects of one embodiment of the present disclosure can be found in the specification and drawings. The advantages and / or effects involved can be provided by several embodiments and the features described in the specification and drawings, but it is not necessary to provide all advantages and effects in order to obtain one or more of the same features. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1A The configuration of a system conceived according to the prior art is shown.

[0013] Figure 1B An example of a monitoring image captured by a driver monitoring camera of a system conceived in the related art is shown.

[0014] Figure 2A A configuration example of an imaging and display system in an embodiment is shown.

[0015] Figure 2B An example of a monitoring image captured by a driver monitoring camera in the embodiment is shown.

[0016] Figure 3 A configuration example of an imaging and display system in Modification 1 of the embodiment is shown.

[0017] Figure 4 Another configuration example of the imaging and display system in Modification 1 of the embodiment is shown.

[0018] Figure 5 A configuration example of an imaging and display system in a second modification of the embodiment is shown.

[0019] Figure 6 A configuration example of an imaging and display system in Modification 3 of the embodiment is shown.

[0020] Figure 7 A configuration example of an imaging and display system in a fourth modification of the embodiment is shown.

[0021] Figure 8 A configuration example of an imaging and display system in a fifth modification of the embodiment is shown.

[0022] Figure 9 This is a diagram for explaining processing performed by the control unit in the fifth modification of the embodiment.

[0023] Figure 10 Another configuration example of the imaging and display system in Modification 5 of the embodiment is shown.

[0024] Figure 11 This is a flowchart showing the processing operation of the control unit in the fifth modification of the embodiment. DETAILED DESCRIPTION

[0025] (Basic knowledge of the present invention)

[0026] The present inventors have discovered that the above-mentioned Patent Document 1 described in the "Background Art" section has the following problems.

[0027] Figure 1A The configuration of a system envisioned according to Patent Document 1 described above is shown.

[0028] This system 900 includes a head-up display (hereinafter referred to as HUD) 910 and a driver monitoring camera 920 .

[0029] The HUD 910 is a device mounted on a vehicle and includes a housing 911 , a display unit 912 , a first mirror 913 a , a second mirror 913 b , and a light-transmitting cover 914 .

[0030] The image light emitted from the display unit 912 is reflected by the first mirror 913a and the second mirror 913b, passes through the light-transmitting cover 914, and is further reflected by the vehicle's windshield 2 toward the driver 1. Thus, the driver 1 can visually recognize the image of the display unit 912 in the eye box B as a virtual image 3 appearing through the windshield.

[0031] Furthermore, a driver monitoring camera 920 is disposed within the housing 911. Light from the driver 1 side is reflected by the windshield 2 toward the HUD 910 side, passes through the light-transmitting cover 914, and is further reflected by the second mirror 913b toward the first mirror 913a side. This light then passes through, for example, the semi-transparent first mirror 913a and enters the lens of the driver monitoring camera 920. This allows the driver monitoring camera 920 to capture an image of the driver 1.

[0032] However, the light from the driver 1 side is Figure 1A As a result, the brightness of the monitoring image captured by the driver monitoring camera 920 decreases. Furthermore, the imaging range A that can be captured by the driver monitoring camera 920 also decreases.

[0033] Figure 1B An example of a monitoring image captured by the driver monitoring camera 920 is shown.

[0034] As described above, since the imaging range A is small, the driver 1 cannot be shown over a wide area on the monitoring image Pic1 captured by the driver monitoring camera 920. As a result, it is difficult to appropriately monitor the driver 1 using the monitoring image Pic1.

[0035] To address the aforementioned issues, one aspect of the present invention provides an imaging display system comprising: a display unit that emits first light representing an image; an optical system including at least one mirror; a housing having an opening, the housing framing the display unit and the optical system; a light-transmitting cover having light transmission properties and configured to cover at least a portion of the opening of the housing; and a camera supported by a support member connected to the outside of the housing so as to cover at least a portion of the light-transmitting cover. The support member is connected to the outside of the housing. The first light emitted from the display unit passes through the light-transmitting cover via the optical system and is reflected by a display medium toward a user. The camera is disposed on a surface of the support member on the light-transmitting cover side and, by reflecting second light from the user side toward the light-transmitting cover by the display medium, captures an image of the user reflected on the light-transmitting cover. The display medium is, for example, a vehicle windshield.

[0036] Accordingly, the head-up display is composed of a display unit, an optical system, a frame, and a translucent cover. The head-up display allows the user to visually confirm a virtual image that appears through a display medium, and the camera photographs the user reflected in the translucent cover from the outside of the frame of the head-up display. Therefore, since the second light from the user side reaches the camera without passing through the optical system of the head-up display, the camera can use the highly intense second light to photograph the user. As a result, the brightness of the camera image (i.e., the surveillance image) obtained by the camera can be improved. Furthermore, since the camera is outside the frame, even if concentrated light heat is generated by sunlight inside the frame, the camera can be suppressed from being affected by the concentrated light heat, further increasing the degree of freedom in the camera configuration design.

[0037] Furthermore, since the camera can be brought closer to the light-transmitting cover, its imaging range can be expanded. This allows the user to be appropriately photographed in a bright, wide-area environment, while visually confirming the formation of the virtual image. Furthermore, because the camera is positioned on the light-transmitting cover side of a support body that at least partially covers the light-transmitting cover, the support body shields the camera from the user. As a result, the user is unaware that they are being recorded by the camera, allowing them to concentrate on, for example, driving the vehicle.

[0038] For example, a first infrared reflective layer may be laminated on the light-transmitting cover, wherein the first infrared reflective layer has a higher reflectivity for infrared than for visible light and is transparent to visible light, and the camera may be an infrared camera. Infrared light may be, for example, light in the near-infrared region.

[0039] This allows the user to be photographed while suppressing the influence of external light, such as visible light, without reducing the user's visibility of the virtual image.

[0040] Furthermore, a second infrared reflective layer may be laminated on the display medium, wherein the second infrared reflective layer has a higher reflectivity for infrared light than for visible light and is translucent to visible light. For example, the second infrared reflective layer may be composed of two reflective layers, one of which is formed on the user-side surface of the display medium, and the other of which is formed on the surface opposite to the user-side surface of the display medium.

[0041] This allows for more appropriate imaging of the user without reducing the user's visibility of the virtual image, and for example, further suppressing the influence of external light, which is visible light.

[0042] It is also possible that the camera display system further includes an infrared-transmitting portion, which is translucent to infrared rays and has a higher reflectivity or absorption rate to light other than infrared rays than to infrared rays. The camera is an infrared camera, and uses infrared rays that pass through the infrared-transmitting portion from the side of the translucent cover and enter the imaging element inside the camera to photograph the user.

[0043] This can further reduce the influence of external light such as visible light, and more appropriately capture the user. For example, the influence of sunlight can be reduced.

[0044] Furthermore, a low-reflection layer may be formed on at least a portion of the camera, and the low-reflection layer may have a lower reflectivity for visible light than the support.

[0045] Thus, even when the camera is illuminated by external light, such as sunlight, the reflection of visible light from the external light on the camera can be suppressed. As a result, the camera image is less likely to be reflected on the light-transmitting cover. In other words, the camera is less noticeable to the user, improving the visual experience of the outside world.

[0046] Furthermore, the imaging display system may further include a light source supported by the support body and emitting infrared light as a third light, the camera being an infrared camera, and the third light emitted from the light source being reflected by the light-transmitting cover toward the display medium and then reflected by the display medium toward the user. The infrared light may be, for example, light in the near-infrared region.

[0047] Thus, since the user is illuminated by the third light, which is infrared light, the infrared camera can capture the user illuminated by the third light. As a result, a high-brightness camera image can be obtained. Furthermore, like a camera, the support body can shield the light source from the user. Furthermore, since the irradiation range of the third light can be easily adjusted to the camera's imaging range, the light source does not need to emit the third light over a wide range, thereby suppressing the irradiation intensity of the third light.

[0048] It may also be that the camera display system further includes: a driving unit for moving the optical axis of the camera; and a control unit for controlling the driving unit based on a camera image obtained by shooting by the camera, wherein the control unit causes the driving unit to move the optical axis of the camera when the second area in the camera image is in the following position, the second area being an area having higher brightness than the first area in the camera image in which a part of the user is reflected, and the position is a position where the distance between the second area and the first area is less than a predetermined distance.

[0049] Accordingly, when the second area, which is brightly reflected by external light such as sunlight, is close to the first area, the optical axis of the camera is moved. As a result, the possibility of the second area being able to leave the first area can be increased. Therefore, the possibility of preventing the second area from overlapping the first area, which causes a part of the user reflected in the first area to become unclear, can be increased. For example, in the case where a part of the user is both eyes, it is difficult to determine what state the user is in based on the camera image including the unclear first area, such as whether the user is in a sleepy state or in a state of looking elsewhere. However, since the camera display system involved in one form of the present disclosure can suppress the first area from becoming unclear due to the second area overlapping the first area, the user's state can be appropriately monitored.

[0050] It may also be that the camera display system further includes: a second camera, which is different from the first camera serving as the camera; a switching unit, which switches the camera used to photograph the user between the first camera and the second camera; and a control unit, which controls the switching unit based on a camera image obtained by photographing the first camera, wherein the control unit causes the switching unit to switch from the first camera to the second camera when the second area in the camera image is in the following position, the second area being an area having higher brightness than the first area in the camera image in which a part of the user is reflected, and the position being a position where the distance between the second area and the first area is less than a predetermined distance.

[0051] Accordingly, when the second area, which is brightly reflected by external light such as sunlight, is close to the first area, the camera is switched from the first camera to the second camera. Therefore, it is possible to increase the possibility of preventing the second area from overlapping the first area, causing a part of the user reflected in the first area to become unclear. For example, in the case where a part of the user is both eyes, it is difficult to determine what state the user is in based on the camera image including the unclear first area, such as whether the user is sleepy or looking away. However, since the camera display system involved in one form of the present disclosure can suppress the first area from becoming unclear due to the second area overlapping the first area, the user's state can be appropriately monitored.

[0052] Furthermore, these general or specific aspects may be implemented by a system, method, integrated circuit, computer program, or computer-readable recording medium such as a CD-ROM, or by any combination of these. Furthermore, the recording medium may be non-transitory.

[0053] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

[0054] In addition, the embodiments to be described below are all general or specific examples of the present disclosure. The numerical values, shapes, materials, components, configuration positions and connection methods of the components, steps, and the order of the steps shown in the following embodiments are all examples, and their purpose is not to limit the present disclosure. Moreover, for the components of the following embodiments that are not recorded in the independent technical solutions showing the highest concept, they will be described as arbitrary components.

[0055] Furthermore, each figure is a schematic diagram, not a rigorous illustration. Furthermore, in each figure, components of the same structure are given the same symbols. Furthermore, in the following embodiments, expressions such as "approximately the same" will be used. "Approximately the same" does not mean completely identical, but rather substantially the same, that is, it means that there can be an error of a few percent, for example. Furthermore, "approximately the same" means "the same" within the scope of the effect obtained by the present disclosure. Other expressions using "approximately" have the same meaning.

[0056] (Implementation Method)

[0057] Figure 2A A configuration example of an imaging and display system in this embodiment is shown.

[0058] The image capture and display system 100 in the present embodiment is, for example, a system mounted on a vehicle having a windshield 2 , and includes a HUD 110 and a driver monitoring camera 120 .

[0059] The HUD 110 forms a virtual image 3. This virtual image 3 is visually recognized by the driver 1, a user of the image capture and display system 100, by being present, for example, outside the front of the vehicle. The HUD 110 includes a housing 111, a display unit 112, a first mirror 113a, a second mirror 113b, a light-transmitting cover 114, and a support 115.

[0060] The display unit 112 displays an image that is visually recognized by the driver 1 as a virtual image 3. That is, the display unit 112 emits the first light L1 representing the image. The display unit 112 is, for example, an LCD (Liquid Crystal Display). In addition, the display unit 112 may be a device other than an LCD, for example, an organic light emitting diode, a fluorescent display device (i.e., a seven-segment digital tube), or a plasma display. Furthermore, the display unit 112 may also be a projector or a laser scanner. Such a display unit 112 is housed on one side of the bottom surface of the housing 111 and emits the first light L1 toward the upper rear side of the vehicle 10.

[0061] The first mirror 113a and the second mirror 113b constitute an optical system for guiding the first light L1 emitted from the display unit 112 toward the outside of the housing 111. For example, the first light L1 emitted from the display unit 112 is reflected by the first mirror 113a toward the second mirror 113b, and then further reflected by the second mirror 113b toward the outside of the housing 111. In this embodiment, the optical system is composed of two mirrors, the first mirror 113a and the second mirror 113b, but may also include at least one mirror.

[0062] The frame 111 is, for example, a resin molded article and is positioned within the vehicle's instrument panel. The frame 111 has an opening and frames the display unit 112, as well as the first and second mirrors 113a, 113b that constitute the optical system. When the frame 111 is positioned within the instrument panel, the opening faces upward.

[0063] The light-transmitting cover 114 is a light-transmitting cover configured to cover at least a portion of the opening of the frame 111. The light-transmitting cover 114 is formed, for example, from a resin-molded film. This light-transmitting cover 114 functions as a dust cover, preventing dust and dirt from entering the frame 111. Furthermore, the light-transmitting cover 114 is curved so as to be recessed within the frame 111. Consequently, at least a portion of light incident on the light-transmitting cover 114 from the windshield 2 is reflected by the light-transmitting cover 114 toward the support body 115.

[0064] In such a HUD 110, the first light L1 emitted from the display unit 112 passes through the light-transmitting cover 114 via the optical system and is reflected by the windshield 2 toward the driver 1. The windshield 2 is an example of a plate-shaped, light-transmitting display medium. As a result, the driver 1 can visually recognize the image of the display unit 112, which is presented as a virtual image 3 on the front exterior side of the windshield 2 (i.e., the exterior side of the vehicle) due to the reflected first light L1, while viewing the background through the windshield 2.

[0065] Furthermore, the HUD 110 is designed so that the virtual image 3 can be visually recognized within a predetermined viewing window B. The viewing window B is set based on, for example, the eye level and horizontal position of the driver 1. Therefore, the driver 1 visually recognizes the virtual image 3 with both eyes within the viewing window B.

[0066] The support body 115 is a component connected to the outer side of the frame body 111 in a manner that covers at least a portion of the translucent cover 114. Specifically, the support body 115 is formed to stand up from the front upper part of the frame body 111 to the rear upper side in front of the translucent cover 114. Such a support body 115 is also called a frame. And, as mentioned above, the support body 115 is illuminated by the light reflected by the translucent cover 114. The light-receiving surface in the support body 115 is formed so as to be difficult to reflect the light that is irradiated. The light-receiving surface is, for example, dark or black. Accordingly, the scattering of light such as external light can be suppressed. Therefore, the support body 115 is also called a light trap. In addition, the support body 115 can be formed integrally with the frame body 111 of the above-mentioned HUD 110, or can be separated.

[0067] The driver monitoring camera 120 in this embodiment is a camera supported by the support body 115. Specifically, the driver monitoring camera 120 is disposed on the surface of the support body 115 on the side of the light-transmitting cover 114. The driver monitoring camera 120 captures the image of the driver 1 reflected in the light-transmitting cover 114.

[0068] That is, the second light L2 from the driver 1 side is reflected by the windshield 2 toward the light-transmitting cover 114 side. As a result, the light-transmitting cover 114 is illuminated by the second light L2 reflected by the windshield 2. Furthermore, as described above, the light-transmitting cover 114 is curved so as to reflect light toward the support body 115 side. Therefore, the second light L2 is reflected by the light-transmitting cover 114 toward the support body 115 side. Accordingly, the driver monitoring camera 120 supported by the support body 115 receives the second light L2 reflected by the light-transmitting cover 114 and captures the driver 1 reflected by the light-transmitting cover 114. Therefore, the driver 1 can be monitored by the driver monitoring camera 120.

[0069] Here, in this embodiment, the driver monitoring camera 120 is arranged outside the housing 111 of the HUD 110. Therefore, the number of times the second light L2 is reflected or transmitted before reaching the driver monitoring camera 120 from the driver 1 side can be reduced. Figure 2A As shown, the second light L2 is reflected at position p1 of the windshield 2, then reflected at position p2 of the translucent cover 114, before reaching the driver monitoring camera 120. Therefore, the number of reflections or transmissions can be reduced to two. As a result, a decrease in the brightness of the monitoring image (i.e., the captured image) captured by the driver monitoring camera 120 can be suppressed.

[0070] Furthermore, in the present embodiment, since the driver monitoring camera 120 can be arranged near the light-transmitting cover 114 , the imaging range A that can be captured by the driver monitoring camera 120 can be expanded.

[0071] Figure 2B An example of a monitoring image captured by the driver monitoring camera 120 is shown.

[0072] In this embodiment, as described above, since the imaging range A is large, a wide range of the driver 1 can be reflected in the monitoring image Pic2 captured by the driver monitoring camera 120. As a result, the driver 1 can be appropriately monitored based on the monitoring image Pic2.

[0073] As described above, in this embodiment, since the second light L2 from the driver 1 side reaches the driver monitoring camera 120 without passing through the optical system of the HUD 110, the driver monitoring camera 120 can use the highly intense second light L2 to capture the driver 1. As a result, the brightness of the monitoring image Pic2 obtained through this capture can be increased. Furthermore, since the driver monitoring camera 120 is located outside the housing 111, even if concentrated sunlight heat is generated within the housing 111, the effects of this concentrated heat on the driver monitoring camera 120 can be minimized, further increasing the flexibility in the design of the driver monitoring camera 120's placement.

[0074] Furthermore, since the driver monitoring camera 120 can be brought closer to the light-transmitting cover 114, the imaging range A of the driver monitoring camera 120 can be expanded. Therefore, the driver 1 can be appropriately photographed in a bright and wide-range state. Specifically, as described above, the imaging brightness, which is the brightness of the monitoring image Pic2, can be increased. In other words, the imaging brightness can be sufficiently ensured. Furthermore, since the second light L2 from the driver 1 side reaches the driver monitoring camera 120 without passing through the optical system of the HUD 110, the optical system of the HUD 110 is not used for imaging. In other words, the optical system used for imaging can be made simpler. As a result, the imaging resolution, which is the resolution of the monitoring image Pic2, can be improved. Furthermore, since the imaging range A is large, the driver 1 can be photographed even if his body moves.

[0075] Furthermore, since driver monitoring camera 120 is disposed on a surface of support body 115 on the side of light-transmitting cover 114 that covers at least a portion of light-transmitting cover 114, support body 115 can shield driver monitoring camera 120 from the user. As a result, driver 1 is unaware that they are being filmed by driver monitoring camera 120 and can concentrate on, for example, driving the vehicle.

[0076] In addition, in the above example, since the driver monitoring camera 120 is shooting the driver 1 reflected on the curved light-transmitting cover 114, astigmatism or image distortion will occur. However, the occurrence of distortion can be suppressed by image processing or a correction optical system. In addition, the occurrence of astigmatism can be suppressed by a correction optical system. For example, in the correction optical system, the occurrence of astigmatism can be suppressed by optimally adjusting the depth of focus of the driver monitoring camera 120. The adjustment of the depth of focus can also be performed by an aperture or an EODF (Extended Depth of Focus) by inserting a phase object. Accordingly, a monitoring image Pic2 in which astigmatism and distortion are suppressed can be obtained.

[0077] (Variation 1)

[0078] Figure 3 A configuration example of an imaging and display system in Modification 1 of the embodiment is shown.

[0079] like Figure 3 As shown, in the imaging display system 101 of this modified example, a first infrared reflective layer 131 is laminated on the light-transmitting cover 114. This first infrared reflective layer 131 is made of a material that has a higher reflectivity for infrared than for visible light and is translucent for visible light. For example, the first infrared reflective layer 131 is laminated on the upper surface of the light-transmitting cover 114, that is, on the side facing the windshield 2. Alternatively, the first infrared reflective layer 131 may be laminated on the lower surface of the light-transmitting cover 114, that is, on the side opposite the windshield 2. Furthermore, the first infrared reflective layer 131 may be formed of a film.

[0080] Furthermore, the windshield 2 in this modified example is laminated with a second infrared reflective layer 132. This second infrared reflective layer 132 is made of a material that has a higher reflectivity for infrared than for visible light and is translucent for visible light. For example, the second infrared reflective layer 132 is laminated on the inner surface of the windshield 2, that is, on the side facing the driver 1. Alternatively, the second infrared reflective layer 132 may be laminated on the outer surface of the windshield 2, that is, on the side opposite the driver 1. Furthermore, the second infrared reflective layer 132 may be formed of a film.

[0081] Furthermore, the driver monitoring camera 120 in this modification is an infrared camera. In the present disclosure, the infrared light is, for example, light in the near-infrared region, but may also be light in a region other than the near-infrared region.

[0082] According to this, in this modification, the driver 1 is photographed using infrared rays. Therefore, the driver 1 can be photographed while suppressing the influence of external light such as visible light, without reducing the visibility of the virtual image for the driver 1.

[0083] Figure 4 Another configuration example of the imaging and display system in Modification 1 of the embodiment is shown.

[0084] Here, if Figure 4As shown, the second infrared reflective layer 132 may also be composed of two reflective layers, 132a and 132b. One of the reflective layers 132a and 132b, for example, reflective layer 132a, is formed on the driver 1 side (i.e., the inner surface) of the windshield 2. The other of the reflective layers 132a and 132b, for example, reflective layer 132b, is formed on the side of the windshield 2 opposite to the driver 1.

[0085] Thus, since the second infrared reflecting layer 132 is composed of two reflecting layers, namely the reflecting layers 132a and 132b, the thickness of the second infrared reflecting layer 132 can be increased. As a result, the infrared rays included in the sunlight L5 irradiating the outer surface of the windshield 2 can be more effectively reflected, further reducing the influence of the infrared rays included in the sunlight L5 on the imaging of the driver monitoring camera 120.

[0086] (Variation 2)

[0087] Figure 5 A configuration example of an imaging and display system in a second modification of the embodiment is shown.

[0088] The imaging and display system 102 in this modification has the same configuration as the imaging and display system 100 in the above-described embodiment, and further includes an infrared ray transmitting unit 121 .

[0089] The infrared ray transmitting portion 121 has a light transmittance to infrared rays and a property that the reflectivity or absorptivity of light other than infrared rays is higher than that of infrared rays. Figure 5 As shown, it is disposed in front of the driver monitoring camera 120 , that is, between the driver monitoring camera 120 and the light-transmitting cover 114 .

[0090] The driver monitoring camera 120 is an infrared camera as in Modification 1. Therefore, the driver monitoring camera 120 captures the driver 1 using infrared light that passes through the infrared transmitting portion 121 from the light-transmitting cover 114 and enters the imaging element within the driver monitoring camera 120 .

[0091] This can suppress the influence of external light such as visible light, and more appropriately capture the image of the driver 1. For example, the influence of the sunlight L5 can be suppressed.

[0092] In addition, in this modification, the infrared ray transmitting portion 121 is between the driver monitoring camera 120 and the light transmitting cover 114 , but it may be mounted on the driver monitoring camera 120 or retracted into the driver monitoring camera 120 .

[0093] (Variation 3)

[0094] Figure 6 A configuration example of an imaging and display system in Modification 3 of the embodiment is shown.

[0095] The image capture and display system 103 in this modification includes a driver monitoring camera 120 a instead of the driver monitoring camera 120 of the image capture and display system 100 in the above embodiment.

[0096] A low-reflection layer is formed on the surface of the driver monitoring camera 120 a . The low-reflection layer has a lower reflectivity for visible light than the support 115 .

[0097] Therefore, even if the driver monitoring camera 120a is illuminated by visible light, such as sunlight, the intensity of the visible light reflected by the driver monitoring camera 120a, i.e., the external light L4, can be reduced. Consequently, it is difficult for the external light L4 to reach the driver 1. In other words, even if the external light L4 is reflected by the light-transmitting cover 114 toward the windshield 2 and further reflected by the windshield 2 toward the driver 1, it is difficult for the driver 1 to visually recognize the image from the driver monitoring camera 120a. This makes it difficult for the driver 1 to perceive the driver monitoring camera 120a, thereby improving the visual experience of the outside world.

[0098] In addition, in this modification, although the low-reflection layer is formed on the entire surface of the driver monitoring camera 120 a , the low-reflection layer may be formed on at least a portion of the surface.

[0099] (Variation 4)

[0100] Figure 7 A configuration example of an imaging and display system in a fourth modification of the embodiment is shown.

[0101] The imaging and display system 104 in this modification has the same configuration as the imaging and display system 100 in the above-described embodiment, and further includes a light source 140 .

[0102] Light source 140 is supported by support body 115 and emits infrared light as third light L3. Third light L3 emitted from light source 140 is reflected by translucent cover 114 toward windshield 2, and then by windshield 2 toward driver 1. In other words, third light L3, which is infrared light emitted from light source 140, travels from translucent cover 114 along substantially the same optical path as first light L1 emitted from display unit 112, reaching driver 1. Furthermore, driver monitoring camera 120 in this modified example is an infrared camera.

[0103] As a result, since the driver 1 is illuminated by the third light L3, the driver monitoring camera 120 can capture and generate a high-brightness monitoring image Pic2 of the driver 1. Furthermore, since the irradiation range of the third light L3 can be easily adjusted according to the imaging range A of the driver monitoring camera 120, the light source 140 does not need to emit the third light L3 over a wide range, thereby suppressing the irradiation intensity of the third light L3.

[0104] (Variant 5)

[0105] Figure 8 A configuration example of an imaging and display system in a fifth modification of the embodiment is shown.

[0106] The imaging display system 105 in this modification has the same configuration as the imaging display system 100 in the above embodiment, and further includes a driving unit 150 and a control unit 160. Figure 8 In FIG, a portion of the imaging display system 105 is partially shown.

[0107] Such an image capture and display system 105 shifts the image capture range of the driver monitoring camera 120 according to external light.

[0108] Specifically, the driving unit 150 moves the optical axis of the driver monitoring camera 120 by, for example, tilting the driver monitoring camera 120 .

[0109] The control unit 160 controls the driving unit 150 based on the monitoring image Pic2 captured by the driver monitoring camera 120 .

[0110] Figure 9 This is a diagram for explaining processing performed by the control unit 160 .

[0111] When the second area 12 in monitoring image Pic2 is at a position where the distance between the second area 12 and the first area 11 is less than a predetermined distance, control unit 160 causes drive unit 150 to move the optical axis of driver monitoring camera 120. The first area 11 is an area that reflects a portion of the driver 1, for example, both eyes. For example, control unit 160 identifies the first area by performing image processing such as pattern matching on monitoring image Pic2. The second area 12 is an area with higher brightness than the first area 11, for example, an area brightly reflected by sunlight L5. For example, the average brightness of the second area 12 may be higher than the average brightness of the first area 11, or the maximum brightness of the second area 12 may be higher than the maximum brightness of the first area 11. Furthermore, the distance between the first area 11 and the second area 12 may be the shortest distance between the two areas, or the distance between the centers of the two areas.

[0112] Therefore, when the bright second area 12 is close to the first area 11, the control unit 160 causes the drive unit 150 to move the optical axis of the driver monitoring camera 120. Furthermore, if the predetermined distance is zero, the control unit 160 causes the drive unit 150 to move the optical axis of the driver monitoring camera 120 when the bright second area 12 overlaps the first area 11.

[0113] As a result, the optical axis of the driver monitoring camera 120 moves, so that the imaging range A can be shifted to, for example, the imaging range A1 . As a result, the possibility of the second area 12 being able to be separated from the first area 11 can be increased.

[0114] Therefore, the likelihood of preventing the second area 12 from overlapping the first area 11, which would obscure the portion of the driver 1 projected in the first area 11, can be increased. For example, if the driver 1's eyes are partially visible, then based on the monitoring image Pic2 including the obscured first area 11, it would be difficult to determine the driver's 1's condition, such as whether they are drowsy or looking away. However, since the image display system 105 in this modified example can suppress the obscuration of the first area 11 caused by the second area 12 overlapping the first area 11, it is possible to appropriately monitor the driver's 1's condition.

[0115] Furthermore, in the above example, the optical axis of the driver monitoring camera 120 is moved to change the imaging range A to the imaging range A1 . However, switching may be performed between two driver monitoring cameras having different optical axes.

[0116] Figure 10Another configuration example of the imaging and display system 105 in the fifth modification of the embodiment is shown.

[0117] Figure 10 The image capture and display system 105 shown includes two cameras, namely, a driver monitoring camera 120 and a driver monitoring camera 122. That is, the image capture and display system 105 includes the driver monitoring camera 122 having an optical axis different from that of the driver monitoring camera 120.

[0118] and, Figure 10 The imaging display system 105 shown in FIG. 1 includes a switching unit 170 instead of Figure 8 The switching unit 170 switches the camera used to shoot the driver 1 between the driver monitoring camera 120 and the driver monitoring camera 122. Figure 10 In the example of FIG, the control unit 160 controls the switching unit 170 based on the monitoring image Pic2 captured by the driver monitoring camera 120 .

[0119] That is to say, if Figure 9 As shown, when the second area 12 in the monitoring image Pic2 is at the following position, the control unit 160 causes the switching unit 170 to execute the switch from the driver monitoring camera 120 to the driver monitoring camera 122, wherein the position is a position where the distance between the second area 12 and the first area 11 is less than a predetermined distance.

[0120] Therefore, when the bright second area 12 is close to the first area 11, the control unit 160 controls the switching unit 170 to switch the camera used to photograph the driver 1 from the driver monitoring camera 120 to the driver monitoring camera 122. Furthermore, if the predetermined distance is zero, the control unit 160 controls the switching unit 170 to switch the camera used to photograph the driver 1 when the bright second area 12 overlaps the first area 11.

[0121] As a result, the camera is switched, so that the imaging range A can be changed to, for example, the imaging range A1. As a result, the second area 12 in the monitoring image captured by the driver monitoring camera 122 is more likely to be farther away from the first area 11 than the monitoring image Pic2 captured by the driver monitoring camera 120.

[0122] Figure 11 It is a flowchart showing the processing operation of the control unit 160.

[0123] First, the control unit 160 specifies the first area 11 of the monitoring image Pic2 (step S1 ).

[0124] Next, the control unit 160 determines whether or not the second region 12 having a brightness higher than that of the first region 11 exists in the monitoring image Pic2 (step S2 ).

[0125] Here, if the control unit 160 determines that the second area 12 exists ("Yes" in step S2), it further determines whether the second area 12 is located at a distance of 0 or less from the first area 11, that is, whether the second area 12 overlaps the first area 11 (step S3). Here, if the control unit 160 determines that there is an overlap ("Yes" in step S3), Figure 8 In the example of , the driving unit 150 is caused to move the optical axis of the driver monitoring camera 120 (step S4). Figure 10 In the example of , the control unit 160 switches the camera used to photograph the driver 1 from the driver monitoring camera 120 to the driver monitoring camera 122 by controlling the switching unit 170 .

[0126] Next, the control unit 160 determines whether the condition for ending the process of monitoring the driver 1 is met (step S5). For example, when the ignition switch of the vehicle is turned off, the control unit 160 determines that the condition is met. Here, if the control unit 160 determines that the condition is met ("Yes" in step S5), the monitoring process is ended. On the other hand, if it is determined that the condition is not met ("No" in step S5), the control unit 160 repeatedly executes the process from step S1. In addition, when step S1 is repeated, the first area 11 is not determined for the monitoring image Pic2 of the first area 11 that has been determined in the previous step S1, but for the monitoring image Pic2 newly obtained by the driver monitoring camera 120.

[0127] Furthermore, when the optical axis is repeatedly moved by the drive unit 150, the optical axis may move alternately up and down, or may move in only one direction, such as upward or downward. Furthermore, when the camera is switched in step S4 and the process from step S1 is repeated, the processes from steps S1 to S3 are performed on the surveillance image captured by the switched camera. For example, in step S4, after the camera used to capture driver 1 is switched from driver monitoring camera 120 to driver monitoring camera 122, driver monitoring camera 122 replaces driver monitoring camera 120 in capturing the image. Specifically, in step S1, the control unit 160 identifies the first area 11 of the surveillance image captured by driver monitoring camera 122. Then, in the subsequent step S4, the control unit 160 controls the switching unit 170 to switch the camera used to capture driver 1 from driver monitoring camera 122 to driver monitoring camera 120.

[0128] In addition, Figure 10 In the example shown, the camera display system 105 includes two cameras, driver monitoring cameras 120 and 122. However, the system may include three or more driver monitoring cameras and switch between these cameras. For example, the control unit 160 may select the monitoring image of the second area 12 farthest from the first area 11 from the monitoring images of the three or more driver monitoring cameras.

[0129] (Other Modifications)

[0130] While the above description of the imaging display system according to one or more aspects of the present disclosure is based on embodiments and variations thereof, the present disclosure is not limited to these embodiments and variations. Within the scope of the present disclosure, various variations that can be imagined by those skilled in the art are applied to the present embodiment, as well as forms formed by combining constituent elements from different embodiments, are all included within the scope of the present disclosure.

[0131] For example, in the above-described embodiment and various variations, the camera display system includes a driver monitoring camera 120, which is used to record images in order to monitor the driver 1. However, the use of the camera 120 is not limited to monitoring the driver 1; the camera 120 can also be used to record images for other purposes. In this case, the driver monitoring camera 120 is simply used as a camera 120 to record images of the user of the camera display system.

[0132] Furthermore, in the above-described embodiment and various modifications, the imaging display system is mounted on the vehicle, but it does not need to be mounted on the vehicle, and the windshield 2 may be made of any material as long as it functions as a display medium.

[0133] Furthermore, each of the first infrared reflecting layer 131 , the second infrared reflecting layer 132 , and the infrared transmitting portion 121 in the above-described embodiment and the various modifications may be made of a known material.

[0134] Furthermore, while this disclosure describes a camera display system with a HUD using embodiments and variations thereof, this camera display system may not have a HUD. In this case, the camera display system may also be referred to as a camera system. Such a camera system includes a reflector and a driver monitoring camera 120, which is supported by a support 115 configured to cover at least a portion of the reflector. Alternatively, the reflector may be a light-transmitting cover 114, but if it has the function of reflecting light from the windshield 2 side, which serves as a display medium, it may not have the light-transmitting property of the light-transmitting cover 114 for visible light. Furthermore, the driver monitoring camera 120 is disposed on the surface of the support 115 on the reflector side. For example, such a driver monitoring camera 120 reflects light from the user, driver 1, toward the reflector side via the windshield 2, thereby capturing an image of the user reflected on the reflector. Similar to the aforementioned camera display system, such a camera system can appropriately capture an image of the user.

[0135] In addition, each component of the drive unit 150, control unit 160, and switching unit 170 in the above-mentioned modification example 5 can be composed of dedicated hardware, or can be realized by executing a software program suitable for each component. Each component can also be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory. Here, the software that realizes the control unit 160 of the above-mentioned modification example 5 is as follows: Figure 11 The process by which each step of the flowchart shown is executed.

[0136] The image capture display system of the present disclosure is mounted on a vehicle, for example, and can be used as an in-vehicle device that captures an image of the driver while allowing the driver of the vehicle to visually recognize a virtual image.

[0137] Explanation of symbols

[0138] 1 Driver (User)

[0139] 2 Windshield (display medium)

[0140] 100 to 105 Camera display system

[0141] 110 HUD

[0142] 111 frame

[0143] 112 Display unit

[0144] 113a Mirror 1

[0145] 113b Mirror 2

[0146] 114 Translucent Cover

[0147] 115 support body

[0148] 120, 120a, 122 Driver Monitoring Camera (Camera)

[0149] 121 infrared transmission unit

[0150] 131 1st infrared reflection layer

[0151] 132 Second infrared reflection layer

[0152] 132a, 132b reflective layer

[0153] 140 Light Source

[0154] 150 drive unit

[0155] 160 Control Department

[0156] 170 Switching Department

[0157] A, A1 Camera range

[0158] B Window

[0159] L1 First Light

[0160] L2 Second Light

[0161] L3 3rd light

[0162] L4 external light

[0163] L5 Sunlight

[0164] Pic1, Pic2 monitoring images (camera images)

Claims

1. A camera display system, The camera display system comprises: a display unit that emits a first light representing an image; an optical system comprising at least one mirror; a frame having an opening, the frame framing the display unit and the optical system; a light-transmitting cover having light-transmitting properties and configured to cover at least a portion of the opening of the frame; and The camera is supported by a support body in a manner that covers at least a portion of the light-transmitting cover, and the support body is connected to the outer side of the frame body. The first light emitted from the display unit passes through the light-transmitting cover via the optical system and is reflected by the display medium toward the user. The camera is arranged on a surface of the support body facing the light-transmitting cover, and takes a picture of the user reflected on the light-transmitting cover by reflecting the second light from the user side toward the light-transmitting cover by the display medium. in, A low-reflection layer is formed on at least a portion of the camera, and the low-reflection layer has a lower reflectivity for visible light than the support.

2. The imaging display system according to claim 1, A first infrared reflective layer is laminated on the light-transmitting cover. The first infrared reflective layer has a reflectivity higher for infrared rays than for visible light and is translucent for visible light. The camera is an infrared camera.

3. The imaging display system according to claim 2, A second infrared reflective layer is stacked on the display medium. The second infrared reflective layer has a reflectivity higher for infrared rays than for visible light and is translucent for visible light.

4. The imaging display system according to claim 3, The second infrared reflecting layer is composed of two reflecting layers. One of the two reflective layers is formed on the user-side surface of the display medium. The other of the two reflective layers is formed on a surface of the display medium opposite to the user side.

5. The imaging display system according to any one of claims 1 to 4, The imaging display system further includes an infrared ray transmitting portion having a light transmittance to infrared rays and a higher reflectivity or absorptivity to light other than infrared rays than to infrared rays. The camera is an infrared camera that photographs the user using infrared rays that pass through the infrared transmitting portion from the light-transmitting cover and enter an imaging element inside the camera.

6. The imaging display system according to any one of claims 1 to 4, The imaging display system further includes a light source supported by the support body and emitting infrared light as the third light. The camera is an infrared camera, The third light emitted from the light source is reflected by the light-transmitting cover toward the display medium, and is further reflected by the display medium toward the user.

7. The imaging display system according to any one of claims 1 to 4, The camera display system further comprises: a driving unit for moving the optical axis of the camera; and a control unit that controls the driving unit based on a camera image captured by the camera, The control unit causes the driving unit to move the optical axis of the camera when the second area in the camera image is in the following position, wherein the second area is an area with higher brightness compared to the first area in the camera image in which a part of the user is reflected, and the position is a position where the distance between the second area and the first area is less than a predetermined distance.

8. The imaging display system according to any one of claims 1 to 4, The camera display system further comprises: a second camera, different from the first camera; a switching unit for switching a camera used to photograph the user between the first camera and the second camera; and a control unit that controls the switching unit based on a camera image captured by the first camera, The control unit causes the switching unit to execute switching from the first camera to the second camera when the second area in the camera image is in the following position, wherein the second area is an area having higher brightness than the first area in the camera image in which a part of the user is reflected, and the position is a position where the distance between the second area and the first area is less than a predetermined distance.

Images