Imaging system, electronic rearview mirror device and vehicle

Abstract

The invention provides an imaging system, an electronic rearview mirror device and a vehicle. The imaging system is used for vehicle auxiliary imaging, and the imaging system comprises a first subsystem. The first subsystem comprises: a first display assembly configured to display first image information; the first optical structure is configured to adjust the angle of a light beam emitted for displaying the first image information, so that the light beam is projected to the first projection assembly; and the first projection assembly is configured to adjust an optical path of the light beam to enable the light beam to be projected to a first side edge area so as to obtain a first virtual image, and the first side edge area is located on the first side of an observer.

Description

Technical Field

[0001] The present disclosure relates to the technical field of rearview mirrors, and in particular to an imaging system, an electronic rearview mirror device and a vehicle. Background Art

[0002] Existing vehicles are often equipped with electronic rearview mirrors set in pairs. In order to facilitate line connection and driver habits, two in-car display screens are generally set on the inside of the cab door opposite to the electronic rearview mirror, which can provide a wider field of view and clearer images. At the same time, the optimized design can reduce the wind resistance of the car. However, with this setting, the driver needs to lower his head when observing the in-car display screen, which causes the driver to switch his line of sight when observing the in-car display screen and the outside environment. The eyes need to focus when the line of sight switches to the screen, and frequent switching of lines of sight can easily cause visual fatigue. At the same time, because the picture presented on the screen is flat information, the driver cannot judge the distance of the rear vehicle when observing the rearview mirror picture, which brings certain safety hazards.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to those skilled in the art. Summary of the invention

[0004] In one aspect, an imaging system is provided for vehicle auxiliary imaging, wherein the system comprises a first subsystem, wherein the first subsystem comprises:

[0005] a first display component, wherein the first display component is configured to display first image information;

[0006] a first optical structure, wherein the first optical structure is configured to adjust an angle of a light beam emitted for displaying the first image information so as to project the light beam onto a first projection assembly; and

[0007] The first projection component is configured to adjust the optical path of the light beam for displaying the first image information so that it is projected onto a first side area to obtain a first virtual image, wherein the first side area is located on a first side of the observer.

[0008] According to some exemplary embodiments, the first optical structure includes a first reflector, and an angle between the first display component and the first reflector is about 45°; and / or,

[0009] The first projection component includes a first optical waveguide unit; or, the first projection component includes a second reflecting mirror and a first curved mirror.

[0010] According to some exemplary embodiments, the first side edge region includes a portion of the region located in the first side window glass; or, the first side edge region includes a portion of the air region located on a side of the first side window glass away from the observer.

[0011] According to some exemplary embodiments, the first side window glass includes a first side front glass located on the first side of the observer and on the side of the vehicle; or, the first side window glass includes at least a portion of the front windshield located on the first side of the observer.

[0012] According to some exemplary embodiments, the first display component includes a first image processing unit, and the first image processing unit is configured to obtain a first stereoscopic image according to the first image information.

[0013] According to some exemplary embodiments, the imaging system further includes a second subsystem, wherein the second subsystem includes:

[0014] a second display component, the second display component being configured to display second image information;

[0015] a second optical structure, wherein the second optical structure is configured to adjust an angle of a light beam emitted for displaying the second image information so as to project the light beam onto a second projection assembly; and

[0016] The second projection component is configured to adjust the optical path of the light beam for displaying the second image information so that it is projected onto a second side area to obtain a second virtual image, wherein the second side area is located on a second side of the observer.

[0017] According to some exemplary embodiments, the second optical structure includes a third reflector, and an angle between the second display assembly and the third reflector is about 45°; and / or,

[0018] The second projection component includes a second optical waveguide unit; or, the second projection component includes a fourth reflecting mirror and a second curved mirror.

[0019] According to some exemplary embodiments, the second side edge region includes a portion of the region located in the second side window glass; or, the second side edge region includes a portion of the air region located on a side of the second side window glass away from the observer.

[0020] According to some exemplary embodiments, the second side window glass includes a second side front glass located on the second side of the observer and on the side of the vehicle; or, the second side window glass includes at least a portion of the front windshield located on the second side of the observer.

[0021] According to some exemplary embodiments, the second display component includes a second image processing unit, and the second image processing unit is configured to obtain a second stereoscopic image according to the second image information.

[0022] According to some exemplary embodiments, the first display component and the second display component are designed to be separated, and the first projection component and the second projection component are designed to be separated; or,

[0023] The first display component and the second display component are designed in an integrated manner, and the first projection component and the second projection component are designed in an integrated manner.

[0024] According to some exemplary embodiments, the distance between the first virtual image and the observer's eyes is in the range of 0.5-10 meters; and / or,

[0025] The distance between the second virtual image and the observer's eyes is in the range of 0.5-10 meters.

[0026] According to some exemplary embodiments, the maximum display brightness of the first display component is greater than or equal to 5000 nits; and / or,

[0027] The maximum display brightness of the second display component is greater than or equal to 5000 nits.

[0028] According to some exemplary embodiments, the imaging system further includes an eye tracking module, and the eye tracking module is configured to adjust the imaging positions of the first virtual image and the second virtual image according to the height and habitual head turning angle of the observer.

[0029] In another aspect, an electronic rearview mirror device is provided, comprising:

[0030] An imaging system as described in any one of the above items;

[0031] A first camera module is configured to capture an image of a first side of the exterior of the vehicle to obtain first image information;

[0032] A first transmission module, configured to transmit the first image information to a first display component;

[0033] A second camera module is configured to capture an image of a second side of the exterior of the vehicle to obtain second image information; and

[0034] The second transmission module is configured to transmit the second image information to the second display component.

[0035] According to some exemplary embodiments, the first camera module includes a first camera and a second camera, and the distance D1 captured by the first camera and the second camera satisfies: D1=f1*D2 / DIS1,

[0036] Among them, f1 is the focal length of the first camera and the second camera, D2 is the interval distance between the first camera and the second camera, and DIS1 is the difference in pixel positions of the same object in images of two different perspectives of the first camera and the second camera.

[0037] According to some exemplary embodiments, the electronic rearview mirror device further includes: a first dimming module configured to adjust the transparency states of the first side window glass and the second side window glass.

[0038] According to some exemplary embodiments, the electronic rearview mirror device further includes: a second dimming module, wherein the second dimming module is configured to adjust the display brightness of the first display component and the second display component.

[0039] In yet another aspect, a vehicle is provided, comprising:

[0040] The vehicle body; and

[0041] The electronic rearview mirror device as described in any one of the above items, wherein the first camera module and the second camera module are installed outside the vehicle body, and the imaging system is installed inside the vehicle body.

[0042] According to some exemplary embodiments, the vehicle includes a first side window glass and a second side window glass, and at least one of the first side window glass and the second side window glass includes a dimming glass. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The above contents and other purposes, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0044] Figure 1 is a structural block diagram of an imaging system according to an embodiment of the present disclosure;

[0045] Figure 2 is a structural block diagram of a first subsystem according to an embodiment of the present disclosure;

[0046] Figure 3 is a structural block diagram of a first image generation module according to an embodiment of the present disclosure;

[0047] Figure 4 is a schematic diagram of an application scenario of the first subsystem according to an embodiment of the present disclosure;

[0048] Figure 5 is a schematic diagram of the structure of a first subsystem according to some embodiments of the present disclosure;

[0049] Figure 6 is a schematic structural diagram of a first subsystem according to some other embodiments of the present disclosure;

[0050] Figure 7 is a structural block diagram of a first display component according to some embodiments of the present disclosure;

[0051] Figure 8 is a structural block diagram of a second subsystem according to an embodiment of the present disclosure;

[0052] Fig. 9 is a structural block diagram of a second image generation module according to an embodiment of the present disclosure;

[0053] Fig.10 is a schematic diagram of an application scenario of the second subsystem according to an embodiment of the present disclosure;

[0054] Fig.11 is a schematic structural diagram of a second subsystem according to some embodiments of the present disclosure;

[0055] Fig.12 is a structural schematic diagram of a second subsystem according to some other embodiments of the present disclosure;

[0056] Fig.13 is a structural block diagram of a second display component according to some embodiments of the present disclosure;

[0057] Fig.14 is a schematic structural diagram of an imaging system according to some embodiments of the present disclosure;

[0058] Fig.15 is a structural block diagram of an imaging system according to some embodiments of the present disclosure;

[0059] Fig.16 is a structural block diagram of an electronic rearview mirror device according to an embodiment of the present disclosure;

[0060] Fig.17 is a structural block diagram of a first camera module according to an embodiment of the present disclosure; and

[0061] Fig.18 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.

[0062] It should be noted that, for the sake of clarity, in the drawings used to describe the embodiments of the present invention, the sizes of layers, structures or regions may be enlarged or reduced, that is, these drawings are not drawn according to the actual scale. DETAILED DESCRIPTION

[0063] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0064] It should be noted that in the drawings, the size and relative size of the elements may be exaggerated for the purpose of clarity and / or description. Thus, the size and relative size of each element are not necessarily limited to the size and relative size shown in the drawings. In the specification and drawings, the same or similar reference numerals indicate the same or similar parts.

[0065] Unless otherwise defined, the technical terms or scientific terms used in this disclosure should be understood by ordinary technicians in the field. "First", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprising" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects.

[0066] In this document, unless otherwise specified, directional terms such as "upper", "lower", "left", "right", "inner", "outer", etc. are used to indicate the orientation or positional relationship based on the drawings, and are only for the convenience of describing the present disclosure, and do not indicate or imply that the device, element or component referred to must have a specific orientation, be constructed or operate in a specific orientation. It should be understood that when the absolute position of the described object changes, the relative positional relationship they represent may also change accordingly. Therefore, these directional terms should not be understood as limiting the present disclosure.

[0067] As used herein, the terms "substantially," "approximately," "approximately," and other similar terms are used as terms of approximation rather than as terms of degree, and they are intended to account for the inherent deviations in measured or calculated values ​​that would be recognized by one of ordinary skill in the art. Taking into account factors such as process fluctuations, measurement problems, and errors associated with the measurement of a particular quantity (i.e., limitations of the measurement system), "approximately" or "approximately" as used herein include the stated value and mean that the particular value is within an acceptable range of deviation as determined by one of ordinary skill in the art. For example, "approximately" can mean within one or more standard deviations, or within ±10% or ±5% of the stated value.

[0068] Existing electronic rearview mirrors are usually equipped with two dedicated display screens in the car. When the driver looks at the screen to obtain the rearview mirror information, he needs to focus on the screen in the car. When the eyes scan the screen, the eyes need to focus at a close distance, while the focus is farther when looking at the road ahead. Frequent switching of eye focus can easily cause visual fatigue. In addition, the information provided by the screen display in the car is flat information, which has the problem of lack of distance sense compared with traditional rearview mirrors.

[0069] An embodiment of the present disclosure provides an imaging system. Specifically, the imaging system is used for vehicle auxiliary imaging, wherein the imaging system includes a first subsystem. The first subsystem includes: a first display component, the first display component is configured to display first image information; a first optical structure, the first optical structure is configured to adjust the angle of the light beam emitted for displaying the first image information so that it is projected to a first projection component; and a first projection component, configured to adjust the optical path of the light beam for displaying the first image information so that it is projected to a first side area to obtain a first virtual image, wherein the first side area is located on a first side of the observer.

[0070] Through such a design, the image of the electronic rearview mirror can be projected onto the window glass or the air outside the window glass to form a virtual image, which can avoid the driver's focus switching when observing the road ahead and watching the screen display of the rearview mirror, thereby reducing the driver's visual fatigue. At the same time, the image can be projected onto the left and right side window glass or the air outside the window glass, which is more in line with the driver's driving habit of observing the left and right rearview mirrors, and is conducive to improving driving safety and comfort.

[0071] Figure 1 is a structural block diagram of an imaging system according to an embodiment of the present disclosure, Figure 2 is a structural block diagram of a first subsystem according to an embodiment of the present disclosure, Figure 3 is a structural block diagram of a first image generation module according to an embodiment of the present disclosure, Figure 4 It is a schematic diagram of an application scenario of the first subsystem according to an embodiment of the present disclosure.

[0072] For example, in the embodiments of the present disclosure, in combination with reference Figure 1 and Figure 2 , an imaging system 1000 is provided for vehicle auxiliary imaging. The imaging system 1000 may include a first subsystem 100. The first subsystem 100 may include: a first image generation module 11 and a first projection component 12.

[0073] Exemplarily, the first image generating module 11 is configured to emit a light beam for displaying the first image information to display the first image information, and adjust the angle of the light beam emitted for displaying the first image information. The first image information may include image information of a first side outside the vehicle. For example, the first side may be the left or right side of the observer (also referred to as the driver). The first image information may include information such as the road conditions, pedestrians, and other vehicles on the first side outside the vehicle, which may assist the driver in driving safely.

[0074] Exemplarily, the first image information may be acquired by a camera disposed outside the vehicle.

[0075] For example, in conjunction with reference Figure 3 and Figure 4 The first image generation module 11 may include a first display component 111 and a first optical structure 112. The first display component 111 is configured to display the first image information. For example, the first display component 111 may include an in-vehicle display screen. The first optical structure 112 is configured to adjust the angle of the light beam emitted for displaying the first image information so that it is projected onto the first projection component 12.

[0076] Exemplarily, the first optical structure 112 may include a first reflector 1120 .

[0077] For example, refer to Figure 4 , the angle θ1 between the first display component 111 and the first reflector 1120 is about 45°. The first display component 111 can display the image information of the first side of the vehicle exterior collected by the camera in the vehicle, and the light beam emitted from the display screen can change the propagation direction (for example, change 90°) after being reflected by the first reflector 1120, and then the light beam can be projected to the first projection component 12. By adjusting the angle between the first display component 111 and the first reflector 1120, the light beam used to display the first image information can be basically vertically projected into the first projection component 12, and the light beam can be prevented from being refracted at different angles on the surface of the first projection component 12, thereby reducing or eliminating the mutual interference between the light beams in different areas, which is conducive to improving the quality of the display screen.

[0078] Exemplarily, the first projection assembly 12 is configured to adjust the optical path of the light beam (e.g., the light beam displaying the first image information) emitted by the first image generating module 11 so as to project it onto the first side area P1 to obtain a first virtual image. The first side area P1 is located on a first side of the observer 60.

[0079] For example, the first side region P1 may include a portion of the area located in the first side window glass 51; or, the first side region P1 may include a portion of the air area located on the side of the first side window glass 51 away from the observer 60. For example, the external image information on the left side of the driver may be projected onto the window glass on the left side of the driver or into a portion of the air area outside the window glass on the left side, and / or, the external image information on the right side of the driver may be projected onto the window glass on the right side of the driver or into a portion of the air area outside the window glass on the right side, thereby better meeting the driver's driving habit of observing the left and right rearview mirrors and better assisting the driver in driving safely.

[0080] Exemplarily, the first projection assembly 12 may include optical structures such as a reflector and a grating, which may be used to adjust the optical path of the light beam so that the light beam is projected onto the first side area P1.

[0081] For example, the first virtual image may be an image displayed on the first side window glass 51, providing the driver with first image information; or the first virtual image may be an image displayed in the air outside the first side window glass 51, providing the driver with first image information. The observer 60 may observe the first virtual image through the first side window glass 51 or the air outside the first side window glass 51, thereby understanding the road conditions on the first side outside the vehicle, and thus driving more safely.

[0082] Exemplarily, the distance between the first virtual image and the eyes of the observer 60 is in the range of 0.5-10 meters.

[0083] Through such a design, the driver can avoid visual fatigue caused by switching focus when observing the road conditions ahead and watching the images displayed on the rearview mirror screen, which is conducive to improving driving safety and comfort.

[0084] For example, continue to refer to Figure 4 The first side window glass 51 may include a first side front glass 511 located at a first side of the observer 60 and located at a side of the vehicle.

[0085] Exemplarily, the first virtual image may be projected onto the first side front glass 511 (e.g., the left side front glass) or into the air outside the first side front glass 511. The distance between the first virtual image and the driver's eyes may be in the range of 0.5-5 meters. For example, the first virtual image is projected onto the upper area of ​​the electronic rearview mirror camera on the first side.

[0086] Through such a design, the first virtual image can be kept at a certain distance from the human eye, which is convenient for the driver to watch. At the same time, it can be ensured that the first virtual image will not be projected onto the adjacent lane, thereby avoiding interference of the first virtual image by vehicles in the adjacent lane.

[0087] Figure 5 is a schematic structural diagram of a first subsystem according to some embodiments of the present disclosure, Figure 6 is a schematic structural diagram of a first subsystem according to some other embodiments of the present disclosure.

[0088] For example, in some embodiments of the present disclosure, referring to Figure 5 , the first projection assembly 12 may include a first optical waveguide unit 121. For example, the first optical waveguide unit 121 may include optical components such as an incident grating 1211, a semi-transparent and semi-reflective mirror 1212, and an exit grating 1213. The light beam displaying the first image information is first transmitted to the incident grating 1211, and the incident grating 1211 can couple the light into the interior of the waveguide, and then use the refractive index difference between the internal high refractive index core and the external low refractive index cladding to limit the propagation of the light wave inside the waveguide using the principle of total internal reflection. When light is emitted from a high refractive index medium to a low refractive index medium, if the incident angle is greater than the critical angle, the light will be totally reflected at the interface, thereby being limited to propagation inside the waveguide. The light beam is transmitted through the interior of the optical waveguide to the exit grating 1213, and then the light beam is exported through the exit grating 1213.

[0089] Exemplarily, the propagation path of the light beam in the first optical waveguide unit 121 can be adjusted by the shape and size of the first optical waveguide unit. For example, the shape of the first optical waveguide unit can include a straight line, a broken line, a curve, or a combination of multiple shapes.

[0090] The optical path of the light beam can be adjusted by the optical waveguide structure so that the light beam is projected to the first side area P1. The optical waveguide structure is small in size, which is beneficial to reducing the volume of the imaging system and facilitating the design and installation of the imaging system.

[0091] For example, in some embodiments of the present disclosure, referring to Figure 6 , the first projection assembly 12 may include a second reflector 122 and a first curved mirror 123. The light beam emitted by the first display assembly 111 is first reflected by the first reflector 1120 and incident on the second reflector 122, and then changes its propagation direction through reflection by the second reflector 122 and is projected onto the first curved mirror 123, and then is projected onto the first side area P1 through reflection and focusing by the first curved mirror 123. Through the combined design of the second reflector 122 and the first curved mirror 123, the optical path of the light beam can be adjusted so that it is projected onto the first side area P1. The combined structure of the reflector and the curved mirror is simple in design, which can simplify the process and reduce costs.

[0092] Figure 7 is a structural block diagram of a first display component according to some embodiments of the present disclosure.

[0093] For example, in some embodiments of the present disclosure, in combination with reference Figure 4 and Figure 7 , the first display component 111 may include a first image processing unit 1110. The first image processing unit 1110 is configured to obtain a first stereoscopic image based on the first image information. For example, the first image processing unit 1110 may include a 3D display system. For example, the first image processing unit 1110 may display a stereoscopic image using a 3D display method such as a multi-focal plane display, a computational holographic display, or a light field display. The 3D picture displayed by the first display component 111 is projected onto the first side area P1 after passing through the first optical structure 112 and the first projection component 12. When the driver views the first virtual image through the first side window glass, he can see the stereoscopic virtual image projected onto the glass or the air outside the glass, which can better help the driver judge the distance between vehicles and improve driving safety.

[0094] In some embodiments, taking into account the need to achieve real-time high-speed display, but the requirement for picture resolution is relatively low, and in order to achieve low cost, a multi-focal plane display based on a multiplexed optical fuser can be used to achieve 3D display.

[0095] Figure 8 is a structural block diagram of a second subsystem according to an embodiment of the present disclosure, Fig. 9 is a structural block diagram of a second image generation module according to an embodiment of the present disclosure, Fig.10 It is a schematic diagram of an application scenario of the second subsystem according to an embodiment of the present disclosure.

[0096] For example, in the embodiments of the present disclosure, in combination with reference Figure 1 and Figure 8 The imaging system 1000 may further include a second subsystem 200. The second subsystem 200 may include: a second image generating module 21 and a second projection component 22.

[0097] Exemplarily, the second image generating module 21 is configured to: emit a light beam for displaying the second image information to display the second image information, and adjust the angle of the light beam emitted for displaying the second image information. The second image information may include an image of the second side of the exterior of the vehicle. The second side and the first side may be located on the left and right sides of the driver, respectively. For example, the first side may be the left side of the driver, and the second side may be the right side of the driver. Alternatively, the first side may be the right side of the driver, and the second side may be the left side of the driver. The second image information may include information such as the road conditions, pedestrians, and other vehicles on the second side of the exterior of the vehicle, which may assist the driver in driving safely.

[0098] Exemplarily, the second image information may be acquired by a camera disposed outside the vehicle.

[0099] For example, in conjunction with reference Fig. 9 and Fig.10 The second image generation module 21 may include a second display component 211 and a second optical structure 212. The second display component 211 is configured to display the second image information. For example, the second display component 211 may include an in-vehicle display screen. The second optical structure 212 is configured to adjust the angle of the light beam emitted by the second image information so that it is projected onto the second projection component 22.

[0100] Exemplarily, the second optical structure 212 may include a third reflector 2120 .

[0101] For example, refer to Fig.10 , the angle θ2 between the second display component 211 and the third reflector 2120 is about 45°. The second display component 211 can display the image information of the second side of the vehicle outside collected by the camera in the vehicle, and the light beam emitted from the display screen can change the propagation direction (for example, change 90°) after being reflected by the third reflector 2120, and then the light beam can be projected to the second projection component 22. By adjusting the angle between the second display component 211 and the third reflector 2120, the light beam used to display the second image information can be basically vertically injected into the second projection component 22, and the light can be prevented from being refracted at different angles on the surface of the second projection component 22, thereby reducing or eliminating the mutual interference between the light beams in different areas, which is conducive to improving the quality of the display picture. Exemplarily, the second projection component 22 is configured to adjust the optical path of the light beam (for example, the light beam displaying the second image information) emitted by the second image generation module 22, so that it is projected to the second side area P2 to obtain a second virtual image. Wherein, the second side area P2 is located on the second side of the observer.

[0102] Exemplarily, the second side region P2 may include a portion of the area located in the second side window glass 52 ; or, the second side region P2 may include a portion of the air area located on the side of the second side window glass 52 away from the observer 60 .

[0103] Through the combined design of the first subsystem and the second subsystem, external image information on the left side of the driver can be projected to the area on the left side of the driver, and external image information on the right side of the driver can be projected to the area on the right side of the driver. This is more in line with the driver's driving habit of observing the left and right rearview mirrors, and can better assist the driver in driving safely.

[0104] Exemplarily, the second projection assembly 22 may include optical structures such as a reflector and a grating, which may be used to adjust the optical path of the light beam so that the light beam is projected onto the second side area P2.

[0105] Exemplarily, the second virtual image may be an image displayed on the second side window glass 52, providing the driver with second image information; or, the second virtual image may be an image displayed in the air outside the second side window glass 52, providing the driver with second image information.

[0106] Exemplarily, the distance between the second virtual image and the observer's eyes is in the range of 0.5-10 meters.

[0107] Through such a design, the driver can avoid visual fatigue caused by switching focus when observing the road conditions ahead and watching the images displayed on the rearview mirror screen, which is conducive to improving driving safety and comfort.

[0108] For example, refer to Fig.10 The second side window glass 52 may include a second side front glass 521 located at a second side of the observer 60 and at a side of the vehicle.

[0109] Exemplarily, the second virtual image may be projected onto the second side front glass 521 (e.g., the right side front glass) or into the air outside the second side front glass 521. The distance between the second virtual image and the driver's eyes may be in the range of 0.5-5 meters. For example, the second virtual image is projected onto the upper area of ​​the electronic rearview mirror camera on the second side.

[0110] Through such a design, the second virtual image can be kept at a certain distance from the human eye, which is convenient for the driver to watch. At the same time, it can be ensured that the second virtual image will not be projected onto the adjacent lane, thereby avoiding interference of the second virtual image by vehicles in the adjacent lane.

[0111] Fig.11 is a schematic diagram of the structure of the second subsystem according to some embodiments of the present disclosure, Fig.12 is a schematic structural diagram of a second subsystem according to some other embodiments of the present disclosure.

[0112] For example, in some embodiments of the present disclosure, referring to Fig.11 The second projection assembly 22 may include a second optical waveguide unit 221. The structure of the second optical waveguide unit 221 may be similar to that of the first optical waveguide unit 121, and the propagation mode of the light beam in the second optical waveguide unit 221 may be substantially the same as that in the first optical waveguide unit 121, which will not be described in detail.

[0113] The optical path of the light beam can be adjusted by the optical waveguide structure so that it is projected to the second side area. The optical waveguide structure is small in size, which is conducive to reducing the volume of the imaging system and facilitating the design and installation of the imaging system.

[0114] For example, in some embodiments of the present disclosure, referring to Fig.12 , the second projection assembly 22 may include a fourth reflector 222 and a second curved mirror 223. The light beam emitted by the second display assembly 211 is first reflected by the third reflector 2120 to change the propagation direction, and is projected to the fourth reflector 222, and then is reflected by the fourth reflector 222 to change the propagation direction, and is projected to the second curved mirror 223, and then is reflected and focused by the second curved mirror 223 to be projected to the second side area P2. Through the combined design of the fourth reflector 222 and the second curved mirror 223, the optical path of the light beam can be adjusted so that it is projected to the second side area. The combined structure of the reflector and the curved mirror is simple in design, which can simplify the process and reduce costs.

[0115] Fig.13 is a structural block diagram of a second display component according to some embodiments of the present disclosure.

[0116] For example, in some embodiments of the present disclosure, in combination with reference Fig.10 and Fig.13 , the second display component 211 may include a second image processing unit 2110. The second image processing unit 2110 is configured to obtain a second stereoscopic image based on the second image information. For example, the second image processing unit 2110 may include a 3D display system. For example, the second image processing unit 2110 may display a stereoscopic image using a 3D display method such as a multi-focal plane display, a computational holographic display, or a light field display. The 3D picture displayed by the second display component 211 is projected onto the second side area after passing through the second optical structure 212 and the second projection component 22. When the driver views the second virtual image through the second side window glass, he can see the stereoscopic virtual image projected onto the glass or the air outside the glass, which can better help the driver judge the distance between vehicles and improve driving safety.

[0117] In some embodiments of the present disclosure, the virtual image projected by the imaging system may also be projected onto a portion of the left and right sides of the front windshield or into the air region outside a portion of the glass on the left and right sides of the front windshield.

[0118] Fig.14 is a schematic structural diagram of an imaging system according to some embodiments of the present disclosure.

[0119] For example, in the embodiments of the present disclosure, referring to Fig.14, the first side window glass 51 may include at least a portion 512 of the front windshield located on the first side of the observer; and / or, the second side window glass 52 may include at least a portion 522 of the front windshield located on the second side of the observer. For example, the first side window glass 51 may include a portion of the left front of the front windshield, and the second side window glass 52 may include a portion of the right front of the front windshield. That is, the first side edge region P1 may include at least a portion of the area located on the first side of the front windshield; or the first side edge region P1 may include a portion of the air area located on the first side of the front windshield away from the observer. The second side edge region P2 may include at least a portion of the area located on the second side of the front windshield; or the second side edge region P2 may include a portion of the air area located on the second side of the front windshield away from the observer.

[0120] Exemplarily, the first virtual image can be projected onto at least a portion of the glass on the first side of the observer in the front windshield (e.g., a portion of the glass in the left front of the front windshield) or into the air outside. For example, the first virtual image can be projected onto the upper area (e.g., the upper left) of the first side of the front windshield, which can reduce interference with the front field of view.

[0121] For example, the second virtual image can be projected onto at least a portion of the glass on the second side of the observer in the front windshield (e.g., a portion of the glass in the right front of the front windshield) or into the air outside. For example, the second virtual image can be projected onto the upper area (e.g., the upper right) of the second side of the front windshield, which can reduce interference with the front field of view.

[0122] Exemplarily, the distance between the first virtual image and the driver's eyes is within the range of 2-10 meters; and / or the distance between the second virtual image and the driver's eyes is within the range of 2-10 meters.

[0123] Through such a design, mutual interference between the first virtual image and / or the second virtual image and the road condition ahead can be avoided, which is convenient for the driver to watch and helps to improve driving safety and comfort.

[0124] In some embodiments of the present disclosure, at least one of the first side window glass 51 and the second side window glass 52 includes dimming glass. The transparency of the first side window glass 51 and the second side window glass 52 can be adjusted through a control system in the vehicle. For example, when the ambient light is strong, the window glass can be dimmed (i.e., the transparency of the window glass can be lowered), so that the virtual image observed through the window glass can be clearer, which is conducive to improving driving safety.

[0125] In some embodiments of the present disclosure, the maximum display brightness of the first display component 111 is greater than or equal to 5000 nits; and / or the maximum display brightness of the second display component 211 is greater than or equal to 5000 nits. Through such a design, the brightness range of the image displayed by the imaging system can be increased, and the brightness of the virtual image can be adaptively adjusted according to the environment, thereby improving the clarity of the virtual image, so that the driver can observe the image and improve driving safety.

[0126] For example, in some embodiments of the present disclosure, the first display assembly 111 and the second display assembly 211 may be designed in a separate manner, and the first projection assembly 12 and the second projection assembly 22 may be designed in a separate manner. For example, the first display assembly 111 is arranged on the left side of the cockpit in the vehicle, and the second display assembly 211 is arranged on the right side of the cockpit in the vehicle. The positions of the first projection assembly 12 and the second projection assembly 22 may correspond to the first display assembly 111 and the second display assembly 211, for example, the first projection assembly 12 is arranged on the left side of the cockpit in the vehicle, and the second projection assembly 22 is arranged on the right side of the cockpit in the vehicle.

[0127] Through such a design, the imaging system can more conveniently project image information on the left and right sides of the vehicle's exterior onto the left and right window glasses, making it easier for the driver to observe.

[0128] For example, in some embodiments of the present disclosure, the first display component 111 and the second display component 211 may be designed in an integrated manner, and the first projection component 12 and the second projection component 22 may be designed in an integrated manner. With such a design, the volume of the imaging system may be reduced.

[0129] Fig.15 is a structural block diagram of an imaging system according to some embodiments of the present disclosure.

[0130] For example, in the embodiments of the present disclosure, referring to Fig.15 The imaging system 1000 may further include an eye tracking module 300. The eye tracking module 300 is configured to adjust the imaging positions of the first virtual image and the second virtual image according to the height and the habitual head turning angle of the observer. Through such a design, the imaging system can automatically adjust the viewing field to facilitate the driver's observation, thereby improving driving comfort and safety.

[0131] For example, the eye tracking module 300 can detect the eye height of the driver when driving, and adaptively adjust the imaging height of the first virtual image and the second virtual image according to the eye height of the driver. For example, if the driver is tall, the eye tracking module 300 can adaptively move the projection height of the first virtual image and the second virtual image upward according to the detected eye height of the driver, so that it is more convenient for the driver to observe and is conducive to improving driving safety.

[0132] Exemplarily, the eye tracking module 300 can also detect the driver's habitual head turning angle, and adaptively adjust the imaging positions of the first virtual image and the second virtual image according to the driver's habitual head turning angle. For example, when the driver is accustomed to turning his head at a small angle to observe the road conditions, the first virtual image and the second virtual image can be projected to the left front and right front of the front windshield or the corresponding external air. For example, when the driver is accustomed to turning his head at a large angle to observe the road conditions, the first virtual image and the second virtual image can be projected to the left side front glass and the right side front glass or the corresponding external air. Through such a design, the driver can observe the road conditions more comfortably, which is conducive to improving driving comfort and safety.

[0133] Fig.16 is a structural block diagram of an electronic rearview mirror device according to an embodiment of the present disclosure.

[0134] In another aspect, an electronic rearview mirror device 2000 is provided. For example, referring to Fig.16 The electronic rearview mirror device 2000 may include the imaging system 1000 as described in any one of the above items.

[0135] Exemplarily, the electronic rearview mirror device 2000 may further include a first camera module 400 , a first transmission module 500 , a second camera module 600 , and a second transmission module 700 .

[0136] For example, in conjunction with reference Figure 2 and Fig.16 The first camera module 400 is configured to capture an image of a first side of the vehicle exterior to obtain first image information. The first transmission module 500 is configured to transmit the first image information to the first image generation module 11 , for example, to the first display component 111 .

[0137] For example, in conjunction with reference Figure 8 and Fig.16 The second camera module 600 is configured to capture an image of a second side of the vehicle exterior to obtain second image information. The second transmission module 700 is configured to transmit the second image information to the second image generation module 21 , for example, to the second display component 211 .

[0138] Through such a design, image information of the left and right sides of the vehicle can be collected by the camera, and then transmitted to the first image generation module 11 and the second image generation module 21 respectively, so as to facilitate the optical path design of the imaging system and realize the projection of image information of the left and right sides of the vehicle exterior onto the left and right window glasses respectively, so as to avoid visual fatigue caused by focal length switching when the driver observes the road conditions ahead and watches the picture displayed on the rearview mirror screen, which is conducive to improving driving safety and comfort.

[0139] For example, continue to refer to Fig.16 The electronic rearview mirror device 2000 may further include a first dimming module 800. The first dimming module 800 is configured to adjust the transparency of the first side window glass and the second side window glass. For example, when the ambient light is strong, the window glass may be dimmed (i.e., the transparency of the window glass may be lowered), so that the virtual image observed through the window glass may be clearer, which is beneficial to improving driving safety.

[0140] For example, continue to refer to Fig.16 The electronic rearview mirror device 2000 may further include a second dimming module 900. The second dimming module 900 is configured to adjust the display brightness of the first display component and the second display component. For example, when the ambient light is strong, the brightness of the first display component and / or the second display component may be increased, and when the ambient light is dark, the brightness of the first display component and / or the second display component may be decreased to ensure that the projection image is clear, which is more convenient for the driver to observe and is conducive to improving driving safety.

[0141] Exemplarily, the electronic rearview mirror device may first collect 3D image information outside the vehicle, for example, using binocular stereo vision, 3D structured light, time of flight (TOF) and other technologies (or methods) to collect 3D image information, and then project the 3D image information onto the vehicle window glass through the imaging system 1000. When the driver views the virtual image through the vehicle window glass, he can see the three-dimensional virtual image projected onto the glass, which can better help the driver judge the vehicle distance and improve driving safety.

[0142] In some embodiments, the electronic rearview mirror device can use a binocular stereoscopic vision method to collect 3D image information, which can reduce costs while ensuring accuracy.

[0143] Fig.17 is a structural block diagram of a first camera module according to an embodiment of the present disclosure.

[0144] Exemplarily, in an embodiment of the present disclosure, referring to FIGS. 1 to 7, the first camera module 400 may include a first camera 401 and a second camera 402.

[0145] Exemplarily, the first camera 401 and the second camera 402 may be installed on the first side of the exterior of the vehicle. The first camera 401 and the second camera 402 may adopt the same configuration. The distance D1 captured by the first camera 401 and the second camera 402 satisfies: D1=f1*D2 / DIS1. Among them, f1 is the focal length of the first camera 401 and the second camera 402, D2 is the interval distance between the first camera 401 and the second camera 402, and DIS1 is the difference in pixel position of the same object in the images of the first camera 401 and the second camera 402 from two different perspectives. The images captured by the first camera 401 and the second camera 402 can be processed to form a 3D image of the first side of the exterior of the vehicle.

[0146] Exemplarily, the second camera module 402 may also capture an image of the second side of the exterior of the vehicle through two cameras with the same configuration, thereby obtaining a 3D image of the second side of the exterior of the vehicle.

[0147] Through binocular stereo vision, two cameras with the same configuration are set on the left and right electronic rearview mirrors respectively, so as to obtain 3D images of the left and right sides of the vehicle's exterior, so as to form a 3D image on the window glass through the imaging system, which can help the driver better judge the distance between vehicles and improve driving safety.

[0148] Fig.18 is a structural block diagram of a vehicle according to an embodiment of the present disclosure.

[0149] In yet another aspect, an embodiment of the present disclosure provides a vehicle 3000. For example, in conjunction with reference Fig.16 and Fig.18 The vehicle 3000 may include: a vehicle body 1500; and an electronic rearview mirror device 2000 as described in any one of the above items.

[0150] Exemplarily, the vehicle 3000 may include a first side window glass 51 and a second side window glass 52. At least one of the first side window glass 51 and the second side window glass 52 includes dimming glass. The transparency of the first side window glass 51 and the second side window glass 52 may be adjusted by a control system in the vehicle. For example, when the ambient light is strong, the window glass may be dimmed (i.e., the transparency of the window glass may be lowered), so that the virtual image observed through the window glass may be clearer, which is beneficial to improving driving safety.

[0151] Exemplarily, the first camera module 400 and the second camera module 600 may be installed outside the vehicle body 1500, for example, outside the cockpit. The imaging system 1000 may be installed inside the vehicle body 1500, for example, on the left and right sides of the cockpit. It should be understood that the vehicle has the same beneficial effects as the imaging system or electronic rearview mirror device provided in the aforementioned embodiments.

[0152] Although some embodiments of the present general inventive concept have been shown and described, it will be appreciated by those skilled in the art that changes may be made to these embodiments without departing from the principles and spirit of the present general inventive concept, the scope of which is defined by the claims and their equivalents.

Claims

1. An imaging system for vehicle auxiliary imaging, characterized in that: The invention comprises a first subsystem, wherein the first subsystem comprises: a first display component, wherein the first display component is configured to display first image information; a first optical structure, wherein the first optical structure is configured to adjust an angle of a light beam emitted for displaying the first image information so as to project the light beam onto a first projection assembly; and The first projection component is configured to adjust the optical path of the light beam so that it is projected onto a first side area to obtain a first virtual image, wherein the first side area is located on a first side of the observer.

2. The imaging system according to claim 1, wherein: The first optical structure includes a first reflector, and the angle between the first display component and the first reflector is about 45°; and / or, The first projection component includes a first optical waveguide unit; or, the first projection component includes a second reflecting mirror and a first curved mirror.

3. The imaging system according to claim 1 or 2, wherein: The first side edge region includes a portion of the region located in the first side window glass; or, the first side edge region includes a portion of the air region located on a side of the first side window glass away from the observer.

4. The imaging system according to claim 3, wherein: The first side window glass includes a first side front glass located on the first side of the observer and on the side of the vehicle; or, the first side window glass includes at least a portion of the front windshield located on the first side of the observer.

5. The imaging system according to claim 2, wherein: The first display component includes a first image processing unit, and the first image processing unit is configured to obtain a first stereoscopic image according to the first image information.

6. The imaging system according to any one of claims 1 to 5, wherein: The imaging system further includes a second subsystem, wherein the second subsystem includes: a second display component, the second display component being configured to display second image information; a second optical structure, wherein the second optical structure is configured to adjust an angle of a light beam emitted for displaying the second image information so as to project the light beam onto a second projection assembly; and The second projection assembly is configured to adjust the optical path of the light beam for displaying the second image information so that it is projected onto a second side area to obtain a second virtual image, wherein the second side area is located on a second side of the observer.

7. The imaging system according to claim 6, wherein: The second optical structure includes a third reflector, and the angle between the second display component and the third reflector is about 45°; and / or, The second projection component includes a second optical waveguide unit; or, the second projection component includes a fourth reflecting mirror and a second curved mirror.

8. The imaging system according to claim 6 or 7, wherein: The second side edge area includes a portion of the area located in the second side window glass; or, the second side edge area includes a portion of the air area located on the side of the second side window glass away from the observer.

9. The imaging system of claim 8, wherein: The second side window glass includes a second side front glass located on the second side of the observer and on the side of the vehicle; or, the second side window glass includes at least a portion of the front windshield located on the second side of the observer.

10. The imaging system according to claim 6, wherein: The second display component includes a second image processing unit, and the second image processing unit is configured to obtain a second stereoscopic image according to the second image information.

11. The imaging system according to claim 6, wherein: The first display component and the second display component are designed to be separated, and the first projection component and the second projection component are designed to be separated; or, The first display component and the second display component are designed in an integrated manner, and the first projection component and the second projection component are designed in an integrated manner.

12. The imaging system according to any one of claims 6 to 11, wherein: The distance between the first virtual image and the observer's eyes is in the range of 0.5-10 meters; and / or, The distance between the second virtual image and the observer's eyes is in the range of 0.5-10 meters.

13. The imaging system of claim 7, wherein: The maximum display brightness of the first display component is greater than or equal to 5000 nits; and / or, The maximum display brightness of the second display component is greater than or equal to 5000 nits.

14. The imaging system of claim 6, wherein: The imaging system further includes an eye tracking module, which is configured to adjust the imaging positions of the first virtual image and the second virtual image according to the height and habitual head turning angle of the observer.

15. An electronic rearview mirror device, characterized in that: include: The imaging system according to any one of claims 1 to 14; A first camera module is configured to capture an image of a first side of the exterior of the vehicle to obtain first image information; A first transmission module, configured to transmit the first image information to a first display component; A second camera module is configured to capture an image of a second side of the exterior of the vehicle to obtain second image information; and The second transmission module is configured to transmit the second image information to the second display component.

16. The device according to claim 15, wherein: The first camera module includes a first camera and a second camera. The distance D1 photographed by the first camera and the second camera satisfies: D1=f1*D2 / DIS1. Among them, f1 is the focal length of the first camera and the second camera, D2 is the interval distance between the first camera and the second camera, and DIS1 is the difference in pixel positions of the same object in images of two different perspectives of the first camera and the second camera.

17. The device according to claim 15 or 16, wherein: The electronic rearview mirror device further includes a first dimming module configured to adjust the transparency states of the first side window glass and the second side window glass.

18. The device according to claim 17, wherein: The electronic rearview mirror device further includes a second dimming module configured to adjust display brightness of the first display component and the second display component.

19. A vehicle, characterized in that: include: Vehicle body; and The electronic rearview mirror device according to any one of claims 15 to 18, wherein the first camera module and the second camera module are installed outside the vehicle body, and the imaging system is installed inside the vehicle body.

20. The vehicle of claim 19, wherein: The vehicle includes a first side window glass and a second side window glass, and at least one of the first side window glass and the second side window glass includes dimming glass.

Images