Rear-view mirror capable of function switching according to driving environment and control method thereof

Abstract

According to the present invention, disclosed are a rear-view mirror capable of function switching according to the driving environment and a control method thereof. A rear-view mirror according to a preferred embodiment of the present invention receives information about driving mode from a main controller of a vehicle, and operates in a mirror mode or a display mode according to a user's setting while in a manual driving mode, but can adaptively switch the image being output to a display of the rear-view mirror according to the driving environment while in an autonomous driving mode or a semi-autonomous driving mode by assessing the forward field of view situation and outputting an image captured by a rear camera through the display of the rear-view mirror in a situation in which a forward field of view can be secured, and outputting a forward infrared image captured through an infrared camera through the display in a situation in which it is difficult to secure the forward field of view. In addition, when a turn signal is turned on in order to change lanes while the infrared image is being displayed through the display, a rear image captured using the rear camera is output through the display instead of the infrared image. Due to the function switching according to a change in the driving environment, a user can clearly secure a forward field of view even in situations such as nighttime and bad weather, and can check the situation of trailing vehicles when changing lanes, and thus safe driving can be promoted.

Description

Rear-view mirror capable of switching functions according to driving environment and method for controlling the same

[0001] The present invention relates to a rear-view mirror and a method for controlling the same, and more specifically, to a rear-view mirror capable of switching functions according to the driving environment and a method for controlling the same.

[0002] Recently released vehicles are equipped with convenience features that provide drivers with useful information regarding driving. One of these is the digital rear-view mirror. Conventional rear-view mirrors simply displayed the rear view seen through the vehicle's rear window to the driver via a mirror. However, these conventional rear-view mirrors have the disadvantage of failing to function properly when the rear window is covered in dust or snow.

[0003] To overcome these problems, digital rear-view mirrors have been developed and are being supplied. Digital rear-view mirrors install a camera at the rear of the vehicle, capture the rear view, and display it to the driver, thereby enabling the driver to check the situation behind the vehicle. Such conventional digital rear-view mirrors effectively display the situation behind the vehicle.

[0004] However, when driving in autonomous or semi-autonomous driving mode at night or in adverse weather conditions, the driver needs to secure a view of the road ahead and understand the driving situation ahead rather than the rear situation displayed on the conventional digital rear-view mirror, thereby recognizing the possibility of a dangerous situation occurring ahead and switching from autonomous or semi-autonomous driving mode to manual driving mode, but current rear-view mirrors are unable to provide this function.

[0005] In addition, existing rear-view mirrors are not linked to driving modes and can only be operated manually, which had limitations in that it was difficult for the driver to monitor the situation ahead in real time during autonomous driving.

[0006] The problem that the present invention aims to solve is to provide a rear-view mirror capable of switching functions according to driving environments such as night and bad weather, and a method for controlling the same.

[0007] A rear-view mirror according to a preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera that photographs the rear of a vehicle, a front camera that photographs the front of a vehicle, and an infrared camera that photographs the front of a vehicle; a display that outputs an image; a mirror module installed in front of the display module that adjusts reflectivity and transmittance according to a control signal; and a circuit unit including a processor and a memory, wherein the processor receives driving mode setting information from the main controller of the vehicle to identify the driving mode, and if the driving mode is semi-autonomous driving or autonomous driving, determines the situation regarding securing a forward view, and if it is difficult to secure a forward view, outputs an infrared image input from the infrared camera through the display.

[0008] In addition, the processor can determine the situation regarding securing a forward view by using information received from the main controller of the vehicle and a forward image input from the front camera.

[0009] In addition, the processor may determine that it is difficult to secure a forward view when a headlight illumination signal is received from the main controller and it is determined to be night driving, when a rain sensor signal is received from the main controller and it is determined to be rainy, or when the lane or sign recognition rate in the forward image input from the front camera drops below a threshold.

[0010] Additionally, the processor can output a rear image input from a rear camera to the display when the turn signal is turned ON while the infrared image is being output through the display, and output the infrared image to the display again when the turn signal is turned OFF.

[0011] In addition, when the driving mode is manual driving, the processor may operate in a display mode that outputs an image captured by the rear camera through the display according to the user's settings, or in a mirror mode that adjusts the transmittance and reflectivity of the mirror module to reflect the rear view of the vehicle through the mirror module and show it to the user.

[0012] In addition, when the vehicle's driving is finished, the processor may stop outputting the infrared image through the display and output the rear image captured by the rear camera through the display.

[0013] Meanwhile, a rear-view mirror control method according to a preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera that photographs the rear of a vehicle, a front camera that photographs the front of a vehicle, and an infrared camera that photographs the front of a vehicle; a display module that outputs an image; a mirror module installed in front of the display module that controls reflectivity and transmittance according to a control signal; and a circuit unit including a processor and a memory, wherein the processor receives driving mode setting information from a main controller of a vehicle to identify a driving mode; and (b) when the driving mode is semi-autonomous driving or autonomous driving, the processor determines the situation regarding securing a forward view, and when securing a forward view is difficult, outputs an infrared image input from the infrared camera through the display.

[0014] In addition, in step (b) above, the processor can determine the situation regarding securing a forward view using information received from the main controller of the vehicle and a forward image input from the front camera.

[0015] In addition, in step (b) above, the processor may determine that it is difficult to secure a forward view if a headlight illumination signal is received from the main controller and it is determined to be night driving, if a rain sensor signal is received from the main controller and it is determined to be rainy, or if the lane or sign recognition rate in the forward image input from the front camera drops below a threshold.

[0016] Additionally, in step (b) above, the processor can output a rear image input from a rear camera to the display when the turn signal is turned ON while the infrared image is being output through the display, and output the infrared image to the display again when the turn signal is turned OFF.

[0017] Additionally, in step (b) above, when the vehicle's driving is finished, the processor may stop outputting the infrared image through the display and output the rear image captured by the rear camera through the display.

[0018] In addition, a rear-view mirror control method according to another preferred embodiment of the present invention may further include the step of (c) controlling the processor to operate in a display mode in which an image captured by the rear camera is output through the display according to the user's settings, or in a mirror mode in which the rear view of the vehicle is reflected and shown to the user by adjusting the transmittance and reflectivity of the mirror module.

[0019] A rear-view mirror according to a preferred embodiment of the present invention receives information regarding a driving mode from a main controller of a vehicle and operates in a mirror mode or a display mode according to a user's setting in a manual driving mode, but in an autonomous driving mode or a semi-autonomous driving mode, it determines the forward visibility situation and outputs an image captured by a rear camera through the display of the rear-view mirror when a forward visibility is possible, and outputs a forward infrared image captured by an infrared camera through the display when a forward visibility is difficult to secure, thereby adaptively switching the image output on the display of the rear-view mirror according to the driving environment.

[0020] In addition, while the infrared image is being displayed, if the turn signal is activated for a lane change, the rear image captured by the rear camera is output through the display instead of the infrared image.

[0021] Due to the function switching in response to such changes in the driving environment, users can clearly secure a forward view even in situations such as night and bad weather, and check the status of following vehicles when changing lanes, thereby promoting safe driving.

[0022] FIG. 1 is a block diagram illustrating the functional configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0023] FIG. 2 is a drawing illustrating the physical configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0024] FIG. 3 is a flowchart illustrating the overall flow of a rear-view mirror control method according to a preferred embodiment of the present invention.

[0025] Figure 4 is a flowchart illustrating the detailed flow of step S330 of Figure 3.

[0026] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0027] Hereinafter, the aforementioned objects, features, and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings. However, as the present invention is subject to various modifications and may have various embodiments, specific embodiments are illustrated in the drawings and described in detail below.

[0028] Throughout the specification, identical reference numbers indicate identical components in principle. Additionally, components with identical functions within the scope of the same concept appearing in the drawings of each embodiment are described using the same reference numeral.

[0029] When a part of a specification is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0030] If it is determined that a detailed description of known functions or configurations related to the present invention may unnecessarily obscure the essence of the present invention, such detailed description is omitted. Additionally, numbers used in the description of this specification (e.g., 1st, 2nd, etc.) are merely identification symbols to distinguish one component from another.

[0031] FIG. 1 is a block diagram illustrating the functional configuration of a rear-view mirror according to a preferred embodiment of the present invention, and FIG. 2 is a drawing illustrating the physical configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0032] Referring to FIGS. 1 and 2, a rear-view mirror (100) according to a preferred embodiment of the present invention includes a camera module (110), a mirror module (140), a display (130), and a circuit unit (120). The circuit unit (120) includes a processor (121) and a memory (123). The camera module (110) includes a rear camera (111), a front camera (113), and an infrared camera (115). The mirror module (140), the display (130), and the circuit unit (120) are contained in a rear-view mirror housing (190) and installed near the front windshield of a vehicle interior.

[0033] A rear camera (111) is installed on the exterior rear of the vehicle, captures the rear of the vehicle to generate a rear image, and transmits the rear image to a processor (121). The rear camera (111) may be used to have a shooting angle of 120 to 180 degrees so that blind spots can be captured.

[0034] The front camera (113) is installed in an outer housing (190) facing the front of the vehicle and captures the front of the vehicle and outputs the front image to the processor (121). The front camera (113) may be installed inside the outer housing (190) of the rear-view mirror (100) installed in the center of the front windshield of the vehicle, or it may be installed at a separate location from the rear-view mirror (100). However, in a preferred embodiment of the present invention, the front camera (113) is installed inside the outer housing (190). Additionally, the front camera (113) may be implemented as a high-resolution RGB camera that generates a color image.

[0035] An infrared camera (115) is installed in an outer housing (190) facing the front of the vehicle, just like a front camera (113), and captures the front of the vehicle with infrared light and outputs a front infrared image to a processor (121). The infrared camera (115) may be installed inside the outer housing (190) of a rear-view mirror (100) installed in the center of the front windshield, or it may be installed at a separate location from the rear-view mirror (100). However, in a preferred embodiment of the present invention, the infrared camera (115) is installed inside the outer housing (190) and is installed above the front camera (113).

[0036] In addition, in a preferred embodiment of the present invention, a Long Wavelength InfraRed (LWIR) camera is used as the infrared camera (115). An LWIR camera is a type of thermal imaging camera that detects the long wavelength region (about 8 to 14 micrometers) of infrared wavelengths. This camera generates an image by detecting heat (radiant energy) rather than visible light, and is generally used in various fields such as temperature-based surveillance, night vision, industrial diagnostics, and military detection. Since LWIR cameras are widely known in the field of infrared cameras, a detailed description is omitted.

[0037] Meanwhile, the display (130) can be implemented as an LCD module, an OLED module, etc., and is turned on / off according to the control of the processor (121), and receives and outputs a video signal from the processor (121).

[0038] The mirror module (140) contains an EC (Electronic Chromic) film inside and is positioned in front of the display (130). Under the control of the processor (121), the reflectivity and transmittance of the EC film contained in the mirror module (140) are adjusted, and accordingly, the mirror module (140) performs the role of a reflector or transmits an image displayed on the display (130) so that the driver and passengers can see the image on the display (130).

[0039] The memory (123) is implemented as an SSD (Solid State Drive), flash memory, ROM (Read-Only Memory), RAM (Random Access Memory), etc., and can store instructions to be executed by the processor (121), data processed by the processor (121), and various data received from the rear image, front image, infrared image, and vehicle main controller (200).

[0040] The processor (121) can be implemented as a CPU (Central Processing Unit) or a similar device (e.g., MPU (Micro Processing Unit), MCU (Micro Control Unit), etc.) and controls the display (130) and mirror module (140) by executing instructions stored in memory (123), controls the cameras (111~115) to capture images, processes the images captured by the cameras (111~115) to generate images to be output to the display (130), and outputs the generated images through the display (130).

[0041] The processor (121) receives a driving mode set by the user from the vehicle main controller (200), and if the driving mode is manual driving mode, controls the rear-view mirror (100) to operate in display mode or mirror mode. In display mode, the processor (121) outputs an image captured by the rear camera (111) through the display (130), lowers the reflectivity of the mirror module (140) to below a predefined value, and increases the transmittance so that the image output from the display (130) passes through the mirror module (140) and is output to the driver.

[0042] In mirror mode, the processor (121) turns off the display (130) and lowers the transmittance and increases the reflectivity of the mirror module (140) so that light is reflected from the mirror module (140) toward the driver, just like a standard rear-view mirror.

[0043] Meanwhile, the processor (121) determines the situation regarding securing a forward view when the driving mode setting information received from the vehicle main controller (200) is an autonomous driving mode or a semi-autonomous driving mode, and if it is difficult to secure a forward view, outputs an infrared image input from the infrared camera (115) through the display (130).

[0044] A rear-view mirror (100) according to a preferred embodiment of the present invention outputs an infrared image captured using an infrared camera (115) through the display (130) of the rear-view mirror (100) to facilitate the user's forward visibility when it is difficult to secure forward visibility due to nighttime or bad weather while the vehicle is operating in an autonomous driving mode or a semi-autonomous driving mode. As a result, when a dangerous situation occurs in front, the user can recognize it and manually switch the driving mode to respond to the dangerous situation. The unique functions of the present invention will be described later with further reference to FIGS. 3 and 4.

[0045] FIG. 3 is a flowchart illustrating the overall flow of a rear-view mirror control method according to a preferred embodiment of the present invention, and FIG. 4 is a flowchart illustrating the detailed flow of step S330 of FIG. 3.

[0046] With further reference to FIGS. 3 and 4, the function of the rear-view mirror (100) according to a preferred embodiment of the present invention and the method of controlling the rear-view mirror (100) are described. When power is supplied to and the rear-view mirror (100) according to a preferred embodiment of the present invention is driven, the processor (121) receives driving mode setting information from the main controller (200) of the vehicle, and the processor (121) uses this to identify the driving mode set by the user (S310).

[0047] When the driving mode is manual driving mode, the processor (121) controls the rear-view mirror (100) to operate in mirror mode or display mode as described above (S320). Since the mirror mode and display mode have been described above, a detailed explanation is omitted.

[0048] Meanwhile, when the driving mode is an autonomous driving mode or a semi-autonomous driving mode, the processor (121) determines the forward visibility situation and controls it (S330).

[0049] Referring to FIG. 4, step S330 is examined in more detail. When the driving mode is autonomous driving mode or semi-autonomous driving mode, the processor (121) checks whether a forward view can be secured. If it is determined that a forward view can be secured, it proceeds to steps S337 and S339 to capture a rear image with the rear camera (111) and output it to the display (130) (S331).

[0050] Meanwhile, in step S331, as a method for determining whether forward visibility is possible, the processor (121) determines that forward visibility is difficult to secure in situations such as nighttime, bad weather, or a foggy environment. To determine the possibility of securing forward visibility, the processor (121) drives the front camera (113) to receive a forward image from the front camera (113), attempts to recognize lanes and road signs in the forward image, and determines that forward visibility is difficult if the recognition rate of the road and signs falls below a predefined threshold. For example, if visibility is difficult due to thick fog, the recognition rate of forward lanes or road signs decreases.

[0051] Additionally, when the processor (121) receives a headlight illumination signal from the vehicle's main controller (200), it may determine that it is night driving and that it is difficult to secure forward visibility. When the processor (121) receives a rain sensor signal from the vehicle's main controller (200), it may determine that it is currently raining and that it is difficult to secure forward visibility. The processor (121) may also determine that it is difficult to secure visibility in various other ways. For example, instead of a headlight illumination signal, it may receive a signal from an illuminance sensor from the vehicle's main controller (200), and if the illuminance value drops below a threshold, it may determine that it is night driving.

[0052] Meanwhile, in step S331, if the processor (121) determines that it is difficult to secure a forward view, the processor (121) drives the infrared camera (115) to photograph the front with the infrared camera (115) (S333), and outputs the infrared image of the front to the display (130) (S334).

[0053] After that, when a signal to turn on the turn signal is received from the vehicle's main controller (200) while driving (S335), the processor (121) drives the rear camera (111) to capture a rear image (S337), outputs the rear image to the display (130), and proceeds to step S335 (S339).

[0054] Meanwhile, when the rear image is displayed on the display (130) while the turn signal is ON, if a turn signal OFF signal is received from the vehicle's main controller (200) (S335), the processor (121) proceeds to step S333 to photograph the front with the infrared camera (115) (S333) and outputs the infrared image of the front to the display (130) (S334).

[0055] Thus, the present invention outputs an infrared image through the display (130) of the rear-view mirror (100) in situations where visibility is difficult to secure during autonomous driving or semi-autonomous driving, thereby allowing the user to clearly see the situation ahead that is difficult to see with the eyes and to take measures such as changing the driving mode to manual mode by checking the situation ahead.

[0056] In addition, when a turn signal is illuminated for a lane change during autonomous driving or semi-autonomous driving, the present invention drives the rear camera (111) and outputs the rear image captured by the rear camera (111) to the display (130) instead of the infrared image, thereby allowing the user to identify the following vehicle and perform a safe lane change.

[0057] Meanwhile, while the above-described step S330 is being performed, if the vehicle's driving is terminated, the processor may stop outputting the infrared image through the display and output the rear image captured by the rear camera through the display.

[0058] The rear-view mirror control method according to the preferred embodiment of the present invention described so far can be implemented as a computer program that is implemented as computer-executable instructions and stored in a non-transient storage medium.

[0059] Storage media include all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable storage media include ROM, RAM, CD-ROM, and optical data storage devices. Additionally, computer-readable storage media are distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner.

[0060] The present invention has been described above with reference to its preferred embodiments. Those skilled in the art will understand that the present invention may be embodied in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention.

Claims

1. A camera module comprising a rear camera for photographing the rear of a vehicle, a front camera for photographing the front of a vehicle, and an infrared camera for photographing the front of a vehicle; A display that outputs an image; A mirror module installed in front of the above-mentioned display module, which adjusts reflectivity and transmittance according to a control signal; and It includes a circuit section including a processor and memory, and The above processor Receive driving mode setting information from the vehicle's main controller to identify the driving mode, and A rear-view mirror characterized by determining the situation regarding securing a forward view when the driving mode is semi-autonomous driving or autonomous driving, and outputting an infrared image input from the infrared camera through the display when securing a forward view is difficult.

2. In claim 1, the processor A rear-view mirror characterized by determining the situation of securing a forward view using information received from the main controller of the vehicle and a forward image input from the front camera.

3. In Clause 2, the processor A rear-view mirror characterized by determining that it is difficult to secure a forward view when a headlight illumination signal is received from the main controller and it is determined to be night driving, when a rain sensor signal is received from the main controller and it is determined to be rainy, or when the lane or sign recognition rate in the forward image input from the front camera drops below a threshold.

4. In claim 1, the processor A rear-view mirror characterized by outputting a rear image input from a rear camera to the display when the turn signal is turned ON while an infrared image is output through the display, and outputting an infrared image to the display again when the turn signal is turned OFF.

5. In Paragraph 1, When the driving mode is manual driving, the above processor A rear-view mirror characterized by operating in a display mode that outputs an image captured by the rear camera through the display according to the user's settings, or in a mirror mode that adjusts the transmittance and reflectivity of the mirror module to reflect the rear view of the vehicle from the mirror module and show it to the user.

6. In Paragraph 1, A rear-view mirror characterized by the processor stopping the output of an infrared image through the display and outputting a rear image captured by the rear camera through the display when the vehicle's driving ends.

7. A method for controlling a rear-view mirror comprising: a camera module including a rear camera for photographing the rear of a vehicle, a front camera for photographing the front of a vehicle, and an infrared camera for photographing the front of a vehicle; a display module for outputting an image; a mirror module installed in front of the display module for adjusting reflectivity and transmittance according to a control signal; and a circuit unit including a processor and a memory. (a) the processor receiving driving mode setting information from the vehicle's main controller to identify the driving mode; and (b) A rear-view mirror control method characterized by including the step of, when the driving mode is semi-autonomous driving or autonomous driving, the processor determining the situation of securing a forward view, and when it is difficult to secure a forward view, outputting an infrared image input from the infrared camera through the display.

8. In Paragraph 7, A rear-view mirror control method characterized in that, in step (b) above, the processor determines the situation of securing a forward view using information received from the main controller of the vehicle and a forward image input from the front camera.

9. In Paragraph 8, A rear-view mirror control method characterized in that, in step (b) above, the processor determines that it is difficult to secure a forward view when a headlight illumination signal is received from the main controller and it is determined to be night driving, when a rain sensor signal is received from the main controller and it is determined to be rainy, or when the lane or sign recognition rate in the forward image input from the front camera drops below a threshold.

10. In Paragraph 7, In step (b) above, the processor A rear-view mirror control method characterized by outputting a rear image input from a rear camera to the display when the turn signal is turned ON while an infrared image is output through the display, and outputting an infrared image to the display again when the turn signal is turned OFF.

11. In Paragraph 7, A rear-view mirror control method characterized in that, in step (b) above, when the driving of the vehicle is terminated, the processor stops outputting an infrared image through the display and outputs a rear image captured by the rear camera through the display.

12. In Paragraph 7, (c) A rear-view mirror control method characterized by further including the step of, when the driving mode is manual driving, controlling the processor to operate in a display mode that outputs an image captured by the rear camera through the display according to the user's settings, or in a mirror mode that adjusts the transmittance and reflectivity of the mirror module to reflect the rear view of the vehicle and show it to the user.

13. A non-transient recording medium that records the rear-view mirror control method of claim 7 as computer-readable and computer-executable program code.

Images