Digital rear mirror control apparatus of vehicle and control method thereof
The control method for digital rearview mirrors addresses the issue of glare and reduced visibility by using real-time video analysis and illuminance measurements to automatically adjust the brightness, ensuring an optimal rear view for the driver.
Patent Information
- Application Number
- JP2024199278
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-11-14
- Filing Date
- 2024-11-14
- Publication Date
- 2025-06-17
AI Technical Summary
Digital rearview mirrors in vehicles face challenges in adapting to changes in external environments, leading to glare and reduced visual visibility for the driver.
A control method for digital rearview mirrors that involves real-time analysis of video data and illuminance measurements using cameras and sensors. This method divides the video into regions, compares brightness values, and adjusts the brightness automatically to maintain optimal readability and reduce glare.
The solution ensures that the driver has an optimal rear view by automatically adjusting the brightness of the digital rearview mirror in response to changing lighting conditions, thereby reducing glare and improving visual visibility.
Smart Images

Figure 2025090530000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a control device and a control method for a digital rearview mirror of a vehicle that can prevent glare of a driver through video processing.
Background Art
[0002] Generally, in order to provide driving convenience and stability, a left and right side mirror and a rearview mirror are installed on a vehicle to check the state of the rear of the vehicle. Each of these mirrors is adjusted to various angles according to the driver's body shape and driving habits, etc., to ensure a rear view for the driver.
[0003] Conventionally, an analog rearview mirror has operated in a manner of reflecting and showing the situation behind the vehicle, but this method has several limitations. For example, when driving at night and the brightness of the headlights of the vehicle behind is strong, glare occurs, or there is a problem that the rear view is blocked by large cargo or passengers in the rear seat.
[0004] In addition, the rear view that the driver can ensure is limited according to the size and installation position of the rearview mirror, and new technical needs for improving this have arisen.
[0005] In order to solve such problems, a digital rearview mirror has been developed. The digital rearview mirror is a method of directly showing a rear image instead of a conventional reflecting mirror by a camera mounted behind the vehicle capturing an image in real time and outputting it to a display installed inside the vehicle. Thereby, a wide viewing angle can be provided, and visual interference due to light reflection and external objects can be minimized.
[0006] However, since the introduction of digital rearview mirrors, technology for controlling the camera's video to be accurately reflected in real time has become important. For example, there is a need for a technical method that allows the driver to always ensure an optimal rear view by controlling various elements such as the camera's image quality, brightness adjustment, distortion correction, and screen switching speed. Such technology must be designed to exhibit stable performance even in various driving environments such as weather conditions, lighting changes, and vehicle speed.
[0007] That is, the control method of the digital rearview mirror is a technology developed to maximize the safety and convenience of the driver, and includes various technical solutions related to the operation and control of the display for ensuring the rear view.
Summary of the Invention
Problems to be Solved by the Invention
[0008] An object of the present invention is to solve the problem that the digital rearview mirror of a vehicle adapts to changes in the external environment in real time and obstructs the driver's view, such as glare.
[0009] Another object is to improve visual visibility so that the driver can clearly confirm the rear situation in various environments.
[0010] Another object is to sense changes in the illuminance inside and outside the vehicle in real time by a camera and an illuminance sensor mounted on the vehicle, collect data, and improve visual visibility.
[0011] Another object is to analyze the collected video data and automatically adjust the brightness of the video when the brightness is insufficient or excessive, so as to maintain the readability of the screen seen by the driver in an optimal state.
[0012] Another object is to enable the digital rearview mirror to automatically correct the brightness according to various lighting conditions occurring during driving, which helps to ensure the driver's field of view.
[0013] Further, when there is a large difference between the external and internal illuminance (e.g., strong headlights of a following vehicle during night driving), the object is to provide an optimal rear view by automatically adjusting the brightness of the digital rearview mirror.
Means for Solving the Problems
[0014] Various embodiments for solving the problems of the present invention are a method for controlling a digital rearview mirror of a vehicle, including an input step of receiving an input of an external video of the vehicle via a camera provided in the vehicle, a video analysis step of dividing the input video into a plurality of regions according to a preset standard for the input video, a determination step of comparing the brightness value of the region divided in the video analysis step with a preset critical range to determine whether correction of the input video is necessary, and a video processing step of adjusting the brightness of the input video when the brightness value of at least one of the divided regions deviates from the critical range. A method for controlling a digital rearview mirror of a vehicle can be provided.
[0015] The video analysis step can be characterized by dividing a dark region and a bright region in the input video based on at least one of the pixel values of the input video or the pixel distribution (histogram) of the input video.
[0016] After the video analysis step, it further includes an illuminance measurement step of measuring the illuminance inside and outside the vehicle by an illuminance sensor, and the determination step can be characterized by determining whether correction of the input video is necessary based on the measured illuminance and the brightness of the divided region.
[0017] The illuminance measurement step can be characterized by measuring the difference between the amount of light measured by a front illuminance sensor provided in front of the vehicle and the amount of light measured by a rear illuminance sensor provided behind the vehicle.
[0018] When the amount of light measured by the rear illuminance sensor in the illuminance measurement step is greater than the amount of light measured by the front illuminance sensor, the determination step can be performed.
[0019] The digital rearview mirror can be characterized by including a mirror film that outputs an external image of the vehicle by an electrical signal or optically reflects the situation behind the vehicle.
[0020] When the amount of light measured by the rear illuminance sensor in the illuminance measurement step is less than the amount of light measured by the front illuminance sensor, it can be characterized by further including a step of reducing the reflectance of the mirror film.
[0021] The digital rearview mirror can be characterized by including a pixel array layer composed of micro LED elements.
[0022] The video processing step can be characterized by adjusting the brightness of the divided area when the brightness value of at least one of the divided areas deviates from the critical range.
[0023] It can be characterized by further including a video output step of outputting a video with adjusted brightness in the video processing step, an illuminance measurement step of measuring the illuminance inside and outside the vehicle by an illuminance sensor after the video output step, and a brightness adjustment step of adjusting the brightness of the display of the digital rearview mirror based on the measured illuminance.
[0024] The illuminance measurement step can be characterized by measuring the difference between the amount of light measured by a front illuminance sensor provided in front of the vehicle and the amount of light measured by a rear illuminance sensor provided behind the vehicle.
[0025] In the brightness adjustment step, the brightness of the display can be characterized by decreasing when the amount of light measured by the rear illuminance sensor is greater than the amount of light measured by the front illuminance sensor.
[0026] In the brightness adjustment step, when the amount of light measured by the rear illuminance sensor in the illuminance measurement step is less than the amount of light measured by the front illuminance sensor, the brightness of the display can be adjusted by comparing the amount of light measured by the front illuminance sensor with a preset value.
[0027] An exemplary embodiment of the present invention can provide a program stored in a computer-readable recording medium including program code for executing the above-described method for controlling a digital rearview mirror of a vehicle.
[0028] An exemplary embodiment of the present invention can provide a program stored in a computer-readable recording medium including program code for executing the above-described method for controlling a digital rearview mirror of a vehicle.
[0029] An exemplary embodiment of the present invention is a control device for a digital rearview mirror of a vehicle, including a digital rearview mirror that selectively outputs an external video of the vehicle or optically reflects a mirror film of a situation behind the vehicle in response to an electrically input signal selectively, a camera that photographs an external environment of the vehicle, and a video processing device that receives the input of the photographed video and adjusts the brightness. The video processing device divides the video input via the camera into a plurality of regions according to a preset criterion, compares the brightness values of the divided regions with a preset critical range, and can be characterized by determining whether correction of the brightness of the input video is necessary.
[0030] The image processing device can be characterized in that it divides a dark area and a bright area in the input image based on at least one of the pixel values of the input image or the pixel distribution (histogram) of the input image.
[0031] The image processing device further includes a sensor unit including a sensor that measures the illuminance inside and outside the vehicle, and the image processing device can be characterized in that it determines whether correction of the input image is necessary based on the illuminance inside and outside the vehicle measured by the sensor unit and the brightness of the divided area.
[0032] An exemplary embodiment of the present invention is a control device for a digital rearview mirror of a vehicle, including a digital rearview mirror including a pixel array layer composed of micro LED elements, a camera that captures the external environment of the vehicle, a sensor unit including a sensor that measures the illuminance inside and outside the vehicle, and an image processing device that receives the input of the captured image and adjusts the brightness. The image processing device divides the image input via the camera into a plurality of areas according to a preset criterion, compares the brightness values of the divided areas with a preset critical range, and can be characterized in that it determines whether correction of the brightness of the input image is necessary.
[0033] The image processing device can be characterized in that when the brightness value of at least one of the divided areas deviates from the critical range, it adjusts the brightness of the divided areas.
[0034] Each feature of the above-described embodiments can be realized in combination in other embodiments as long as it does not conflict with or is exclusive of other embodiments.
Advantages of the Invention
[0035] According to various embodiments of the present invention, by automatically adjusting the brightness of the digital rearview mirror screen according to changes in the external environment, the driver can always ensure an optimal rear view.
[0036] In addition, the difference in brightness between the inside and outside of the vehicle can be analyzed in real time by a camera and an illuminance sensor, and situations where the screen becomes excessively bright or dark can be prevented.
[0037] Moreover, even under various lighting conditions, by automatically performing brightness correction, the driver can clearly recognize the situation behind regardless of the surrounding environment.
[0038] Also, during night driving, the glare caused by the headlights of the following vehicle can be reduced, minimizing the driver's visual impairment.
[0039] Furthermore, by utilizing a mirror film or a micro LED element, the brightness can be finely adjusted as needed to provide optimal visibility in specific situations.
[0040] The effects of the present invention are not limited to those described above, and other effects not mentioned can be clearly recognized by those of ordinary skill in the art from the following description.
Brief Description of the Drawings
[0041]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Mode for Carrying Out the Invention
[0042] Hereinafter, with reference to the drawings, specific embodiments of the present invention will be described. The following detailed description is provided to assist in a comprehensive understanding of the methods, apparatuses, and / or systems described herein. However, this is merely an example and the present invention is not limited thereto.
[0043] In describing the embodiments of the present invention, when it is determined that a specific description of known techniques related to the present invention may obscure the gist of the present invention, the detailed description thereof will be omitted. Also, the terms described below are terms defined in consideration of the functions in the present invention, and these may vary depending on the intention or convention of the user, operator, etc. Therefore, the definition should be made based on the content throughout this specification.
[0044] The terms used in the detailed description are for the sole purpose of describing embodiments of the present invention and should in no way be construed as limiting. Unless otherwise explicitly stated, singular expressions include the meaning of plural forms.
[0045] In this description, expressions such as "including" or "comprising" are used to indicate a certain characteristic, number, step, operation, element, part thereof, or combination, and should not be construed to exclude the existence or possibility of one or more other characteristics, numbers, steps, operations, elements, part thereof, or combination other than those described.
[0046] Also, when describing the components of embodiments of the present invention, terms such as first, second, A, B, (a), (b), etc. can be used. These terms are for distinguishing the components from other components, and the essence, procedure, order, etc. of the components are not limited by such terms.
[0047] FIG. 1 and FIG. 2 are diagrams showing block diagrams of vehicles according to exemplary embodiments of the present invention. More specifically, FIG. 1 is a block diagram showing a vehicle 2000 equipped with a digital rearview mirror according to an exemplary embodiment, and FIG. 2 is a block diagram showing a control device 2100 of the vehicle in FIG. 1.
[0048] Hereinafter, description will be made with reference to FIGS. 1 and 2.
[0049] A digital rearview mirror 200 according to an exemplary embodiment of the present invention can be mounted on a vehicle 2000, and the vehicle 2000 can include a control device 2100. Here, the vehicle 2000 may be an autonomous driving vehicle. In some embodiments, a component of the digital rearview mirror 200 can be integrated with a component of the control device 2100.
[0050] The control device 2100 can include a controller 2120 including a memory 2122 and a processor 2124, a sensor 2110, a wireless communication device 2130, a LIDAR 2140, and a camera module 2150.
[0051] The controller 2120 can be configured during manufacturing by the vehicle manufacturer or additionally configured after manufacturing for performing autonomous driving functions. Or, the configuration for performing continuous additional functions can be included by upgrading the controller 2120 configured during manufacturing.
[0052] The controller 2120 can transmit control signals to the sensor 2110, the engine 2006, the user interface (UI) 2008, the wireless communication device 2130, the LIDAR 2140, and the camera module 2150 included as other components within the vehicle. Also, although not shown, control signals can also be transmitted to an acceleration device, a braking system, a steering device, or a navigation device related to the running of the vehicle.
[0053] The controller 2120 can control the engine 2006. For example, when the vehicle 2000 senses the speed limit of the road during running, it can control the engine 2006 so that the running speed does not exceed the speed limit, or control the engine 2006 to accelerate the running speed of the vehicle 2000 within a range not exceeding the speed limit. Further, when the environmental sensing modules 2004a, 2004b, 2004c, 2004d sense the environment outside the vehicle and transmit it to the sensor 2110, the controller 2120 can receive this and generate a signal for controlling the engine 2006 or a steering device (not shown) to control the running of the vehicle.
[0054] When there is another vehicle or an obstacle in front of the vehicle, the controller 2120 can control the engine 2006 or the braking system to decelerate the moving vehicle, and in addition to the speed, it can also control the trajectory, the driving route, and the steering angle. Or the controller 2120 can generate necessary control signals according to the recognition information of other external environments such as the driving lane of the vehicle and the traffic signal, and control the driving of the vehicle.
[0055] In addition to generating its own control signals, the controller 2120 can also communicate with surrounding vehicles or a central server, and transfer instructions for controlling peripheral devices based on the received information, thereby controlling the driving of the vehicle.
[0056] Also, when the position of the camera module 2150 is changed or the viewing angle is changed, the controller 2120 may find it difficult to accurately recognize the vehicle or the lane. Therefore, in order to prevent this, the controller 2120 can also generate a control signal to control the camera module 2150 to perform calibration. Therefore, by generating a calibration control signal in the camera module 2150, the controller 2120 can continuously maintain the normal mounting position, direction, viewing angle, etc. of the camera module 2150 even if the mounting position of the camera module 2150 is changed due to vibrations or impacts generated according to the movement of the autonomous driving vehicle 2000. When the pre-stored initial mounting position, direction, viewing angle information of the camera module 2150 and the initial mounting position, direction, viewing angle information of the camera module 2150 measured during the driving of the autonomous driving vehicle 2000 change by more than a critical value, the controller 2120 can generate a control signal to control the calibration of the camera module 2150.
[0057] The controller 2120 can include a memory 2122 and a processor 2124. The processor 2124 can execute the software stored in the memory 2122 according to the control signals of the controller 2120. Specifically, the data and instructions for detecting the field of view video from the video behind the vehicle 2000 are stored in the memory 2122 by the controller 2120, and the instructions can be executed by the processor 2124 to implement one or more of the methods disclosed herein.
[0058] Here, the memory 2122 can be stored in a non-volatile recordable medium executable by the processor 2124. The memory 2122 can store software and data by appropriate internal and external devices. The memory 2122 can be composed of a RAM (random access memory), a ROM (read only memory), a hard disk, and a memory 2122 device connected to a dongle.
[0059] The memory 2122 can store at least an operating system (OS, Operating system), user applications, and executable instructions. The memory 2122 can also store application data and array data structures.
[0060] The processor 2124 is a microprocessor or an appropriate electronic processor, and may be a controller, a microcontroller, or a state machine.
[0061] The processor 2124 can be realized by a combination of computing devices, and the computing devices can be composed of a digital signal processor, a microprocessor, or an appropriate combination thereof.
[0062] In addition, the control device 2100 can monitor the internal and external characteristics of the vehicle 2000 with at least one or more sensors 2110 and sense the state.
[0063] The sensor 2110 can be composed of at least one or more sensing modules 2004, and the sensing module 2004 can be implemented at a specific position of the vehicle 2000 according to the sensing purpose. It can be located at the lower part, rear end, front end, upper end, or side end of the vehicle 2000, and can also be located on internal components of the vehicle or tires, etc.
[0064] Thereby, the sensing module 2004 can sense information related to driving, such as the engine 2006, tires, steering angle, speed, vehicle weight, etc., as internal information of the vehicle. Also, at least one or more sensing modules 2004 can be composed of an acceleration sensor 2110, gyroscope, image sensor 2110, RADAR, ultrasonic sensor, LiDAR sensor, etc., and can sense the movement information of the vehicle 2000.
[0065] The sensing module 2004 can also receive specific data related to the external environmental state, such as the road condition information where the vehicle 2000 is located, surrounding vehicle information, weather, etc., as external information, and sense the vehicle's parameters based on this. The sensed information can be stored in the memory 2122 temporarily or long - term according to the purpose.
[0066] The sensor 2110 can collect and integrate the information of the sensing module 2004 for collecting information generated inside and outside the vehicle 2000.
[0067] The control device 2100 can further include a wireless communication device 2130.
[0068] The wireless communication device 2130 is configured to realize wireless communication between vehicles 2000. For example, it enables the vehicle 2000 to communicate with a user's mobile phone, or other wireless communication devices 2130, other vehicles, a central device (traffic control device), a server, etc. The wireless communication device 2130 can transmit and receive wireless signals according to the connection wireless protocol. The wireless communication protocol may be Wi-Fi, Bluetooth, Long-Term Evolution (LTE), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Global Systems for Mobile Communications (GSM), and the communication protocol is not limited to this.
[0069] Also, the vehicle 2000 can also realize communication between vehicles by the wireless communication device 2130. That is, the wireless communication device 2130 can communicate with other vehicles on the road and other vehicles through vehicle-to-vehicle (V2V) communication. The vehicle 2000 can transmit and receive information such as driving warnings and traffic information through vehicle-to-vehicle communication, and can also request information from other vehicles or receive requests. For example, the wireless communication device 2130 can perform V2V communication with a dedicated short-range communication (DSRC) device or a C-V2V (Celluar-V2V) device. In addition to communication between vehicles, communication between the vehicle and other things (for example, electronic devices carried by pedestrians, etc.) (V2X, Vehicle to Everything communication) can also be realized by the wireless communication device 2130.
[0070] In addition, the control device 2100 can include a LIDAR device 2140. The LIDAR device 2140 can detect objects around the vehicle 2000 during operation using data sensed by a LIDAR sensor. The LIDAR device 2140 transfers the detected information to the controller 2120, and the controller 2120 can operate the vehicle 2000 according to the detected information. For example, when there is a vehicle ahead traveling at a low speed in the detected information, the controller 2120 can instruct the vehicle to reduce its speed via the engine 2006. Or it can instruct the vehicle to reduce its entry speed according to the curvature of the curve the vehicle is entering.
[0071] The control device 2100 can further include a camera module 2150. The controller 2120 can extract object information from the external image captured by the camera module 2150 and enable the controller 2120 to process the information related thereto.
[0072] In addition, the control device 2100 can further include an imaging device for recognizing the external environment. In addition to the LIDAR 2140, RADAR, a GPS device, an odometry device, and other computer vision devices can be used, and these devices can be selected or operate simultaneously as needed to enable more precise sensing.
[0073] The vehicle 2000 can further include a user interface 2008 for user input to the above-mentioned control device 2100. The user interface 2008 can enable the user to input information through appropriate interaction. For example, it can be realized by a touch screen, a keypad, operation buttons, etc. The user interface 2008 transfers the input or command to the controller 2120, and the controller 2120 can perform vehicle control operations as a response to the input or command.
[0074] In addition, the user interface 2008 is a device outside the vehicle 2000 and can communicate with the vehicle 2000 via the wireless communication device 2130. For example, the user interface 2008 can be made interoperable with a mobile phone, a tablet, or other computing devices.
[0075] Furthermore, although the vehicle 2000 has been described as including the engine 2006, it is also possible to include other types of propulsion systems. For example, the vehicle can be operated by electric energy and can be operated via hydrogen energy or a hybrid system combining these. Therefore, the controller 2120 includes a propulsion mechanism by the propulsion system of the vehicle 2000, and control signals thereby can be provided to the configuration of each propulsion mechanism.
[0076] Hereinafter, with reference to FIG. 2, the detailed configuration of the control device 2100 of the vehicle 2000 and the configuration 10 for controlling the digital rearview mirror of the vehicle will be described in more detail.
[0077] The control device 2100 includes a processor 2124. The processor 2124 may be a general-purpose single or multi-chip microprocessor, a dedicated microprocessor, a microcontroller, a programmable gate array, or the like. The processor can also be referred to as a central processing unit (CPU). Also, the processor 2124 can be used in combination with a plurality of processors.
[0078] The control device 2100 also includes a memory 2122. The memory 2122 may be any electronic component capable of storing electronic information. In addition to a single memory, the memory 2122 can also include a combination of memories 2122.
[0079] According to various embodiments, data and instruction words 2122a for detecting a rear view of the vehicle 2000 can also be stored in the memory 2122. When the processor 2124 executes the instruction words 2122a, all or part of the instruction words 2122a and the data 2122b necessary for the execution of the instructions can also be loaded onto the processor 2124 as instruction words 2124a and data 2124b.
[0080] The control device 2100 can also include a transmitter 2130a, a receiver 2130b, or a transceiver 2130c for allowing transmission and reception of signals. One or more antennas 2132a, 2132b can also be electrically connected to the transmitter 2130a, the receiver 2130b, or each transceiver 2130c, and can further include antennas.
[0081] The control device 2100 can also include a digital signal processor (DSP) 2170. Digital signals can be processed by the vehicle quickly via the DSP 2170.
[0082] The control device 2100 can also include a communication interface 2180. The communication interface 2180 can also include one or more ports and / or communication modules for connecting other devices to the control device 2100. The communication interface 2180 can enable interaction between the user and the control device 2100.
[0083] The various components of the control device 2100 can also be connected together by one or more buses 2190, and the buses 2190 can include a power bus, a control signal bus, a status signal bus, a data bus, etc. According to the control of the processor 2124, the components can transmit mutual information via the buses 2190 and perform the intended functions.
[0084] The control device 10 of the digital rearview mirror of a vehicle can include a camera 161, a sensor unit 163, and an image processing device 11. The camera 161 can also be included in a camera module 2150 provided in the vehicle 2000, or can be independently provided to display the external environment of the vehicle on the digital rearview mirror 200. The sensor unit 163 can also be included in a sensor 2110 provided in the vehicle 2000, or can be independently provided to sense the internal and external environments of the vehicle necessary for correcting the screen displayed on the digital rearview mirror 200 by the image processing device 11.
[0085] FIG. 3 and FIG. 4 are diagrams showing a control configuration of a digital rearview mirror of a vehicle according to an exemplary embodiment of the present invention.
[0086] Hereinafter, description will be made with reference to FIGS. 3 and 4.
[0087] The control device 10 of the digital rearview mirror can perform a complex function of having various components cooperate with each other to provide a driver with a rear view in real time and controlling it. Each component plays an independent role and is closely connected to each other, and can help accurately and efficiently show the situation behind when the vehicle is running, and can provide the driver with necessary information among the external environment information as needed.
[0088] Hereinafter, with reference to FIG. 3, each configuration will be described in more detail.
[0089] The camera 161 may be exemplarily mounted behind the vehicle, can capture the situation behind the vehicle in real time, and transfer the video to the data collection unit. The camera 161 senses obstacles behind, road conditions, etc., and makes them visually confirmable by the driver. The camera 161 is connected to the image processing device 11, and the screen of the digital rearview mirror can be adjusted according to the mode selected by the mode selection unit 12.
[0090] The sensor unit 163 can collect or sense data such as illuminance (brightness), vehicle speed, driving distance, and lane change signals, and provide information suitable for the driving environment. Exemplarily, the video processing device 11 can adjust the brightness of the screen displayed on the digital rearview mirror according to the illuminance inside and outside the vehicle and the amount of external light sensed by the sensor unit 163.
[0091] The sensor unit 163 can include an internal illuminance sensor 1631, a front illuminance sensor 1633, a rear illuminance sensor 1635, and an image sensor 1637.
[0092] The internal illuminance sensor 1631 is a sensor that measures the illuminance inside the vehicle. The front illuminance sensor 1633 is a sensor that senses the illuminance in the external environment in front of the vehicle, differentiates between bright daylight during the day and dark environments at night, and enables the screen to be set brighter during the day and darker at night. This sensor allows the digital rearview mirror to respond appropriately according to the time of day and weather conditions.
[0093] The rear illuminance sensor 1635 is a sensor that measures the illuminance of light entering from the rear of the vehicle. When illuminated by the strong headlights or other light sources of the vehicle located behind, it senses this and adjusts the brightness of the screen so that the screen of the digital rearview mirror does not become too bright and interfere with the driver's field of vision, and can enhance the driver's visibility during night driving.
[0094] The image sensor 1637 is a sensor that receives the video input from the external camera of the vehicle and analyzes the brightness state of each area on the screen. When a specific area on the screen is overly bright or dark, it senses this and adjusts the brightness of that area to optimize the overall visibility of the screen. That is, even under non-uniform external lighting conditions via the image sensor 1637, the driver can clearly recognize the situation behind.
[0095] Exemplarily, the video processing device 11 can control the brightness of the digital rearview mirror based on the difference in illuminance between the inside and outside of the vehicle by means of the internal illuminance sensor 1631 and the front illuminance sensor 1633. For example, the screen can be brightened during the day and darkened at night to enhance the driver's visibility.
[0096] In addition, when a strong light source enters from the rear of the vehicle, such as when the headlights of a vehicle located behind illuminate, the video processing device 11 can adjust the brightness of the digital rearview mirror by means of the rear illuminance sensor 1635 to reduce the glare for the driver. In this process, both the internal illuminance and the front illuminance can be considered, and an optimally set brightness can be comprehensively determined.
[0097] The GPS 165 tracks the real-time position of the vehicle to check the current road conditions and driving position. As a result, the driver can receive information suitable for the route and the surrounding situation on the digital rearview mirror.
[0098] The data collection unit 167 can collect and analyze the data collected by the camera 161, the sensor unit 163, the GPS 165, etc. As a result, the video processing device 11 can control the video displayed on the digital rearview mirror in consideration of the vehicle state and the internal and external environments of the vehicle.
[0099] That is, the video processing device 11 can collect data such as the vehicle speed, driving mode, detection of lane change signals, and surrounding environment, and control the digital rearview mirror to display appropriate videos or objects for assisting driving in real time.
[0100] Exemplarily, the video processing device 11 controls the LCD drive circuit 151, the backlight drive circuit 153, etc. based on the information collected by the data collection unit 167 so that the screen is adjusted according to the situation. In addition, it can be connected to a transmission (not shown) and automatically display the rear camera video when the vehicle is reversing.
[0101] The transmission senses the gear state, and the video processing device 11 connected to the transmission automatically outputs the video of the rear camera to the digital rearview mirror when reversing. Exemplarily, when the transmission recognizes the reverse gear, the video processing device 11 causes the video of the rear camera immediately behind to be displayed on the rearview mirror. Here, the LCD drive circuit 151 and the backlight drive circuit 153 can also be interlocked to control so that the screen is clearly displayed.
[0102] The mode selection unit 13 can select any one of the mirror modes a, mirror display modes b, LCD modes c, etc. as shown in FIG. 5, and it goes without saying that the criteria for the selection can be set in various ways according to the above-described configuration. For example, the video processing device 11 can control whether the mirror is converted to a digital rearview mirror or maintained as a general mirror so as to be suitable for the mode selected by the driver via the mode selection unit 13.
[0103] The LC mirror 17 is a mirror having a special structure that can operate as a general mirror and can be converted to a digital display when necessary. The LC mirror 17 is connected to the LC drive circuit 171, can be converted to a digital rearview mirror when necessary, and can accurately provide a rear view.
[0104] Also, the LC drive circuit 171 can be interlocked with the video processing device 11 to control whether the mirror is converted to a digital rearview mirror or maintained as a general mirror according to the mode selected by the driver via the mode selection unit 13, control the LC mirror 17, and adjust the reflectivity of the mirror and screen conversion, etc. via an electrical signal.
[0105] The LCD driving circuit 151 controls the LCD module 15 to show the driver the video input from the rear camera. The LCD driving circuit 151 can play a role in adjusting the brightness, hue, contrast ratio, etc. of the display. The LCD driving circuit 151 works in conjunction with the video processing device 11 to ensure that the video received from the camera 161 is accurately and clearly displayed on the screen, and the video processing device 11 can operate both the LCD driving circuit 151 and the backlight driving circuit 152 to optimize the brightness and quality of the screen.
[0106] The backlight driving circuit 153 controls the backlight that provides light from behind the LCD screen to ensure that the screen maintains an appropriate brightness according to the ambient brightness. Exemplarily, the brightness of the backlight can be automatically adjusted so that the screen can be clearly seen during the day and without glare at night.
[0107] The communication unit 169 is responsible for communication with the vehicle's electronic control unit (ECU) and exchanges information between the digital rearview mirror system and other systems within the vehicle. This enables the digital rearview mirror to operate integrally with other vehicle systems.
[0108] As an example, the communication unit 169 can receive real-time data from the traffic situation API and the meteorological agency API, receive traffic congestion and accident information from the traffic situation API, and help the driver understand the traffic flow on the current driving route. Also, it can receive real-time weather information from the meteorological agency API and automatically adjust the brightness and screen display of the digital rearview mirror according to weather changes to enhance driving safety. Of course, the above-mentioned traffic situation and real-time weather information can also be displayed on the digital rearview mirror.
[0109] Also, as an example, it is connected to the video processing device 11 to exchange various information such as the vehicle's state, driving speed, transmission state, and detection of lane change signals, and thereby can transmit commands related to providing the rear view.
[0110] The LCD module 15 shows the video received from the camera 161 to the driver in real time. The LCD module 15 enables the accurate confirmation of the rear situation or information for the convenience and safety of the driver via a high-resolution screen. In conjunction with the LCD driving circuit 151, the backlight driving circuit 153, and the camera 161, it clearly outputs the rear video, receives commands from the video processing device 11, can provide optimal visibility in various driving environments, and can display various objects for the convenience and safety of the driver.
[0111] With the above configuration, exemplarily, the camera 161 captures the rear video in real time, and this video is transmitted to the data collection unit 167. The sensor unit 163 senses the surrounding environment of the vehicle and provides brightness and distance data, and the GPS 165 provides vehicle position and route information. All this data is transmitted to the video processing device 11, which controls the LCD driving circuit 151 and the backlight driving circuit 153 according to the situation to optimize the screen brightness and video quality. Also, the transmission device 13 can be set to automatically output the rear camera video to the LCD module 15 when reversing, and the mode selection unit 13 can select the mode desired by the driver and transmit a command to the video processing device 11 to selectively display the rear camera video or perform the function of a mirror.
[0112] FIG. 5 is a diagram showing the control modes of the digital rearview mirror of a vehicle according to an exemplary embodiment of the present invention.
[0113] The mirror mode a does not use the digital function and shows the rear situation as a mirror, like a traditional rearview mirror. The digital display disappears, and like a general mirror, it directly reflects the physical situation inside and behind the vehicle. Since it does not depend on the display, it operates regardless of the power supply and electronic system.
[0114] The Mirror display mode b is a hybrid mode that combines the functions of a mirror and a digital display. Even when the digital display is on, it maintains some mirror functions so that the driver can utilize both the mirror's reflection function while viewing the rear situation through the digital screen. This allows for partial confirmation of areas that cannot be captured by the rear camera.
[0115] Exemplarily, in the Mirror display mode b, an object (text) can be presented while maintaining the general mirror reflection function.
[0116] The LCD mode c functions to show the real-time video captured by the rear camera 161 via the LCD display. In this mode, the digital screen is fully utilized, providing the driver with more information than a physical mirror through the wide viewing angle of the rear camera. The LCD mode is useful in dark environments or situations with limited visibility, having the merit that the rear situation can be accurately viewed through the camera video.
[0117] Each of the above modes can be selected by the mode selection unit 13.
[0118] Figures 6 to 8 are diagrams showing the structure of the display according to an exemplary embodiment of the present invention. More specifically, Figure 6 is a diagram showing the laminated structure of the mirror display according to one embodiment, Figure 7 is a diagram showing the laminated structure of the upper polarizing plate L12 of Figure 6, and Figure 8 is a diagram showing the laminated structure of the display to which micro LEDs are applied according to one embodiment.
[0119] First, an explanation will be given with reference to Figures 6 and 7.
[0120] A display according to an exemplary embodiment of the present invention can be formed in a structure in which a coating layer L11, an upper polarizing plate L12, a liquid crystal display panel L13, a lower polarizing plate L14, and a backlight L15 are laminated. Referring to FIG. 7, the upper polarizing plate L12 can be formed in a structure in which a protective layer L121, a TAC (Triacetyl Cellulose) L122, a mirror film L123, a TAC L124, a PVA (Polyvinyl Alcohol) L125, and a TAC L126 are laminated.
[0121] More specifically, the coating layer L11 can mean a layer formed of at least any one of various coating liquids for improving the performance of the display. Exemplarily, it can include an anti-reflective coating (AR Coating), an oleophobic coating, a hydrophobic coating for waterproofing and moisture prevention, a scratch-resistant coating, a UV-blocking coating, and the like.
[0122] The anti-reflective coating reduces the reflection of light that can occur on the display screen, enabling the driver to view the screen more clearly. The oleophobic coating can prevent fingerprints and oil stains from adhering to the surface of the display. The waterproof and moisture-proof coating plays a role in preventing moisture and water droplets from remaining on the surface of the display, and can prevent condensation phenomena caused by moisture inside the vehicle and sudden temperature changes.
[0123] Also, the scratch-resistant coating can protect the display from damage due to external impacts and friction, and play a role in enhancing long-term durability. The UV-blocking coating can prevent the screen from discoloring or being damaged by ultraviolet (UV) light when the display is exposed to sunlight for a long time.
[0124] The upper polarizer L12 is composed of multiple layers to maintain the polarization performance of the display and provide a clear screen for the user in response to the external environment. Each layer performs a specific function, which will be described later with reference to FIG. 7.
[0125] The liquid crystal display panel L13 can clearly display the video received from the rear camera 161 in real time, provide a wide viewing angle, and automatically adjust the brightness according to day and night. In addition, it can prevent glare caused by strong light and accurately transmit the rear situation with high-resolution image quality and fast response speed.
[0126] The lower polarizer L14 can play the role of a filter that controls the vibration direction of light and allows light to pass only in a specific direction in order to optimize the performance of the display. In particular, the lower polarizer L14 allows the light generated from the backlight L15 to pass in a specific direction, operates like the upper polarizer L12, adjusts the transmission and blocking of light, and can provide a clear video for the display.
[0127] In addition, since the LCD panel itself does not emit light, the backlight L15 can provide light from behind the screen to visualize the video. Exemplarily, the backlight L15 can use light-emitting diodes to provide high efficiency and high brightness.
[0128] Exemplarily, the display of this embodiment can apply a mini LED display. In this case, the backlight L15 uses thousands of small mini LED elements as the backlight and can independently control the light for each small area (Local Dimming Zone). In this case, the brightness can be adjusted for each area through a large number of local dimming zones, and the bright and dark parts can be separated and expressed even in a dark scene, improving the driver's visibility.
[0129] On one hand, the upper polarizing plate L12 can form a structure in which a protective layer L121, TAC (Triacetyl Cellulose) L122, a mirror film L123, TAC L124, PVA (Polyvinyl Alcohol) L125, and TAC L126 are laminated between the coating layer L11 and the liquid crystal display panel L13.
[0130] The protective layer L121 protects the polarizing film from physical impacts and scratches, prevents deformation due to moisture and heat, and enhances the durability of the film. Exemplarily, with an ultraviolet (UV) blocking function, the film can be prevented from being damaged or discolored by direct sunlight. Also, while performing the above functions, the protective layer can maintain optical transparency and maintain the sharpness and brightness of the screen.
[0131] The TAC layers L122, L124, and L126 can be sequentially arranged between the mirror film L123 and the PVA layer L125 to protect the mirror film L123 and the PVA layer L125.
[0132] The mirror film L123 plays an important role in providing a reflection function like a common mirror even when the digital display is turned off. The mirror film applied with a half - mirror structure transmits part of the light and reflects part of the light. When the digital display is on, it displays the rear - camera image, and when it is off, it enables the mirror function. Thereby, the digital rear - view mirror can be used as a hybrid device that provides both the function of digital video display and the function of a traditional mirror, and the driver can flexibly utilize the two functions according to the situation. As a result, the mirror film can enhance the multifunctionality of the display and provide a convenient solution that can use both digital and analog functions as needed.
[0133] The TAC layers L122 and L124 are disposed above and below the mirror film L123, protecting the mirror film L123 from moisture, ultraviolet rays, physical impacts, etc., preventing damage, and enhancing the durability of the film. Also, the TAC layers L122 and L124 play a role in maintaining optical transparency without obstructing light transmission, ensuring a clear image quality for the display.
[0134] The PVA layer L125 polarizes light by adjusting the vibration direction of light, allowing light to pass only in a specific direction so that the display can provide a clear image. Through this process, the image received from the rear camera is accurately displayed, reducing glare and improving the driver's field of vision.
[0135] However, since the PVA layer L125 is very sensitive to moisture, ultraviolet rays, and physical impacts, the TAC layers L124 and L126 are required to protect it. The TAC layers L124 and L126 are laminated on the upper and lower parts of the PVA layer L125, serving as a protective film so that the PVA layer L125 is not damaged by the external environment or its function does not decline. The TAC layers L124 and L126 block moisture and ultraviolet rays, protect the PVA layer L125 from physical impacts, and maintain optical transparency to help prevent light from being distorted.
[0136] Due to the above structure, the digital rearview mirror of this embodiment can stably maintain the function of the polarizing film in various environments, providing a clear image quality and excellent visibility.
[0137] FIG. 8 is a diagram showing a laminated structure of a display to which micro LEDs according to an embodiment are applied. The display of this embodiment can include a coating layer L21, a filter layer L22, a light source array layer L23, and an electrode layer L24, and the electrode layer L24 can be connected to a driving circuit 241.
[0138] The coating layer L21 can protect the surface of the display and play a role in protecting other layers from the external environment. This layer can protect the display from scratches and contamination, and may also endow waterproof and antifouling properties. In addition, it can optimize the transmittance of the display so that the screen looks clearer. That is, the coating layer L21 enhances the durability of the display and provides a stable environment for the effective operation of subsequent layers.
[0139] The filter layer L22 can play a role in improving the color reproduction ability of the display by selectively passing or blocking light of specific wavelengths. The filter layer L22 is particularly important for balancing RGB colors, minimizing the reflection of external light, and improving the viewing angle. The filter layer helps the light emitted from the light source array layer to be represented in a more accurate hue, filters the external light transmitted through the coating layer L21 so that it is not reflected, and can enhance the driver's visibility.
[0140] The light source array layer L23 is a layer in which micro-LED pixels are arranged, and each micro-LED pixel can emit light by itself to form a high-resolution image. The light source array layer (micro-LED pixel array layer) L23 can cooperate with the filter layer L22 to determine the hue and brightness shown on the display, receive the signals of the electrode layer L24 and the driving circuit 241 to drive individual pixels, and thereby control the image of the entire screen.
[0141] The electrode layer L24 can play a role in supplying current to the light source array layer L23 and activating each pixel. The electrode layer L23 precisely transmits electricity to specific pixels, turns on or off only the pixels at the desired positions to form an image, and for this purpose, controls the micro-LED pixels according to the signals received from the driving circuit 241.
[0142] The driving circuit 241 is responsible for the overall control of the display system and functions to transmit accurate current and signals to each pixel. This circuit analyzes the image represented on the display, calculates the electrical signals required for each pixel of the image, and transmits them to the electrode layer. The driving circuit directly affects the resolution, brightness, hue representation, etc. of the display, and through signal processing, enables an accurate image to be realized in the light source array layer.
[0143] FIG. 9 and FIG. 10 are flowcharts showing a method for controlling a digital rearview mirror of a vehicle by controlling a video processing apparatus according to an exemplary embodiment of the present invention.
[0144] Hereinafter, a description will be given with reference to FIGS. 9 and 10.
[0145] The control method of the present embodiment can include a video input step (S11), a video analysis and region division step (S13), a video correction presence / absence determination step (S15), a video processing step (S17), and a video output step (S19).
[0146] The video input step (S11) is a step of inputting the environment outside the vehicle to the control device of the digital rearview mirror via the camera 161. The camera 161 can capture the situation around the vehicle and provide the video data required for the digital rearview mirror system. The input video is processed and adjusted in subsequent steps so that the driver can more clearly confirm the situation behind the vehicle or the surrounding environment.
[0147] The video analysis and region division step (S13) is a step of analyzing the video input in the step (S11) based on various criteria and dividing it into a plurality of regions. The video processing apparatus 11 can analyze the video based on the pixel values and histograms of the input video and perform the work of distinguishing bright regions and dark regions. The video processing apparatus 11 can collect the brightness and contrast information at specific positions through the division of regions and utilize them in subsequent video processing operations.
[0148] The step of determining whether image correction is needed (S15) is a step of determining whether image correction is needed according to the external and internal situations of the vehicle. As an example, based on the illuminance inside and outside the vehicle collected by the sensor unit 163, it is determined whether image correction is needed. Subsequently, the brightness of the relevant area can be adjusted in the image processing step (S17), which will be described in more detail later with reference to FIG. 10.
[0149] In the image processing step (S17), for the input image, based on the results of the image analysis and region division step (S13) and the step of determining whether image correction is needed (S15), the brightness of the areas that need correction can be adjusted.
[0150] More specifically, when the brightness value of the divided area deviates from the critical range, the digital rearview mirror 200 can adjust the brightness of that area to clearly represent the situation behind the vehicle. Exemplarily, using the LC mirror 17, according to the electrical signal, the situation behind the vehicle can be optically reflected or displayed via the micro LED pixel array layer L23, and an optimized image can be output.
[0151] Also, this step can be performed by using a Convolutional Neural Network (CNN) to sense and adjust the brightness of specific areas. Specifically, when the situation behind the vehicle is input in real time by the camera 161 connected to the digital rearview mirror, an image containing strong light such as the headlights of the vehicle behind can be input.
[0152] The image processing device 11 can perform a preprocessing process so that the CNN can effectively process the input image. Here, as described above, noise removal, resolution adjustment, hue correction, etc. can be included.
[0153] Also, the preprocessed image of the image processing device 11 can be analyzed for the brightness of the image through processes such as feature extraction, activation function, pooling, and subdivision.
[0154] The feature extraction (Convolution Layer) can sense the features of the rear headlight (specific patterns of the image) using various filters and recognize the shape and edges of the headlight. The activation function (ReLU) introduces non-linearity to maintain only important features, and the pooling (Pooling Layer) can selectively maintain the most important information by reducing the size of the feature map to decrease the computational load and maintaining spatial invariance. The segmentation (Segmentation Layer) can emphasize a specific headlight area to generate a binary mask (Binary Mask) and accurately distinguish the area where strong light is generated.
[0155] As described above, the brightness of the headlight area sensed by the video processing device 11 to which CNN is applied can be selectively adjusted, and furthermore, the visibility of the driver can be improved through post-processing processes such as contrast adjustment and hue correction of the image.
[0156] Also, the control device of the digital rearview mirror collects the vehicle's position data by means of the GPS 165 and the data collection unit 167, and the communication unit 169 enables data exchange with an external system if necessary. With the above configuration, it is also possible to respond in real time to changes in the surrounding situation and illuminance when the vehicle is running, and adjust the video according to the current position of the vehicle and the surrounding environment.
[0157] On the other hand, the video correction presence / absence determination step (S15) can include an illuminance measurement step (S151), a step (S153) of comparing the video brightness data with the measured illuminance, and a step (S155) of determining the presence / absence of glare.
[0158] The illuminance measurement step (S151) is a step of measuring the illuminance inside and outside the vehicle by the sensor unit 163. Exemplarily, when the illuminance value measured by the rear illuminance sensor 1635 is greater than the illuminance value measured by the front illuminance sensor 1633, the video processing device 11 can determine that video correction is necessary. That is, such illuminance measurement data is collected in real time and can be utilized for video correction in the video processing device.
[0159] The step of comparing the brightness data of the video with the measured illuminance (S153) is a step of comparing the brightness value of each area obtained by video analysis with the measured illuminance value. The measured illuminance value can be derived by utilizing the illuminance measured by the internal illuminance sensor 1631, the front illuminance sensor 1633, the rear illuminance sensor 1633, etc. Exemplarily, it can mean the illuminance value measured by the rear illuminance sensor 1635, or the difference between the illuminance value measured by the rear illuminance sensor 1635 and the illuminance value measured by the front illuminance sensor 1633, or the difference between the illuminance value measured by the internal illuminance sensor 1631 and the illuminance values measured by the external illuminance sensors 1633 and 1635.
[0160] That is, as a result of the measurement of the illuminance and the comparison of the brightness data (S153), if there is a possibility of glare occurring, it is determined (S155) that correction is necessary. For example, when the rear illuminance sensor 1635 measures a high value and the front illuminance sensor 1633 measures a relatively low value, reduce the reflectivity of the digital rearview mirror or adjust the brightness so that the driver can clearly see the external situation of the vehicle without feeling glare.
[0161] More specifically, when glare occurs (S155: Yes), the brightness of each area is adjusted in the video processing step (S17). In this step (S17), when the brightness value of a specific area deviates from the critical range, by adjusting the brightness of the area, in the video output (S19) step, the video output to the digital mirror can have better balance in brightness and sharpness. Also, the video processing device 11 can apply various video output modes according to the situation in cooperation with the mode selection unit 13.
[0162] That is, the video corrected in the video processing step (S17) is finally output (S19) via the LCD module or the micro LED display. Here, it is output with the brightness of the display also adjusted, and the final brightness of the display can be set according to the illuminance value measured by the sensor.
[0163] Exemplarily, the LC mirror 17 is composed of a mirror film L23 that can output an external video of the vehicle according to an electrical signal or optically reflect the rear situation. The communication unit 169 transmits and receives data with the system inside the vehicle, and the GPS 165 and the data collection unit 167 collect the position and driving data of the vehicle, and can reflect the environmental changes during the correction of the illuminance and the output of the video. Such elements can select one of various modes according to the situation while assisting the organic operation of the overall system, and can display the rear situation more clearly.
[0164] That is, when an LCD display is applied to the digital mirror, the backlight drive circuit 153 in cooperation with the LCD module 15 can precisely adjust the brightness during output, adjust the reflectivity of the mirror film according to the change in external illuminance, and provide an optimal viewing field for the user. When a micro LED display is applied to the digital mirror, the brightness can be precisely adjusted during output via the electrode layer L24 and the drive circuit 241.
[0165] FIG. 11 and FIG. 12 are diagrams showing an embodiment of the control of a digital rearview mirror of a vehicle according to an exemplary embodiment of the present invention. More specifically, FIG. 11 shows an example in which the object is not clearly displayed on the display 201 or causes glare to the driver by the strong light L generated behind the vehicle by the digital rearview mirror 200a, and FIG. 12 shows an example in which the video input by the control method and apparatus of the present embodiment is adjusted and output, and the light sources L1 and L2 and the object N that was not clearly displayed by the light sources L1 and L2 are displayed.
[0166] FIG. 13 and FIG. 14 are flowcharts showing a method for controlling a digital rearview mirror of a vehicle by controlling a video processing apparatus according to an exemplary embodiment of the present invention, and parts overlapping with the content of the embodiment described with reference to FIGS. 9 and 10 are omitted.
[0167] Referring to FIG. 13, the method for controlling a digital rearview mirror of a vehicle according to the present embodiment can sequentially perform a video input step (S21), a video analysis and region division step (S23), and an illuminance measurement step (S251).
[0168] Also, based on the illuminance measured in the illuminance measurement step (S251), the video processing apparatus 11 compares the amount of light (or illuminance) in the front and rear measured by the front illuminance sensor 1633 and the rear illuminance sensor 1635, and when the amount of rear light is greater than the amount of front light (S253: Yes), for example, the reflectance of the LC mirror 17 is reduced to less than 40% (S257), and the video is output (S29), thereby preventing glare to the driver and improving visibility.
[0169] On the other hand, when the amount of rear light is less than the amount of front light (S253: No), it is determined whether glare has occurred (S255), and after performing video processing (S271), the video can be output to the display (S29). The criterion for determining that glare has occurred in the step (S255) can be based on the illuminance values inside and outside the vehicle measured by the sensor unit 163.
[0170] Referring to FIG. 14, the control method of the digital rearview mirror of the vehicle according to this embodiment can sequentially perform a video input step (S31), a video analysis and region division step (S33), a video processing step (S351), and a video output (S355) step. According to the above control flow, a video adjusted considering various conditions can be output (S355) to the display.
[0171] Also, after the video output (S355) step, the video processing device 11 can measure the illuminance (S371) by the sensor unit 161. The video processing device 11 compares the front and rear light amounts (or illuminances) measured by the front illuminance sensor 1633 and the rear illuminance sensor 1635. When the rear light amount is greater than the front light amount (S373: Yes), the brightness of the display can be decreased (S395).
[0172] On the other hand, when the rear light amount is smaller than the front light amount (S373: No), the video processing device 11 can determine (S375) whether the front light amount is greater than a first set value. When the front light amount measured by the front illuminance sensor 1633 is greater than the first set value (S375: Yes), the video processing device 11 can control to increase the brightness of the display (S391). Exemplarily, the first set value may be a value between 1,000 lux and 2,000 lux.
[0173] In the step (S375), when the front light amount measured by the front illuminance sensor 1633 is not greater than the first set value (S375: NO), a step (S377) of further comparing the light amount measured by the front illuminance sensor 1633 with a second set value can be further performed. Exemplarily, the second set value may be a value between 300 lux and 500 lux.
[0174] In the step (S377), when it is determined (S377: Yes) that the amount of light measured by the front illuminance sensor 1633 is less than the second set value, the video processing apparatus 11 can control to reduce the brightness of the display (S395). When it is determined (S377: No) that the amount of light measured by the front illuminance sensor 1633 is at the same or similar level as the second set value, the video processing apparatus 11 can control to maintain the brightness of the display (S395).
[0175] With such a control method for the digital rearview mirror of a vehicle, the LC mirror 17 to which the LC (Liquid Crystal) method is applied can have a significantly improved response speed compared to the conventional EC (Electronic Chromic) method digital rearview mirror. Thereby, based on the rapid response speed to the change of external lighting, an immediate brightness adjustment is possible, and by quickly preventing the glare of the driver, the visibility can be improved.
[0176] As described above, the present invention has been described centering on its preferred embodiments. All the embodiments and conditional examples disclosed in this specification are described for the purpose of assisting those with ordinary knowledge in the technical field of the present invention to understand the principles and concepts of the present invention. Those skilled in the art can understand that the present invention can be realized in a modified form without departing from the essential characteristics of the present invention.
[0177] Therefore, the disclosed embodiments should be considered from an illustrative perspective rather than a limiting perspective. The scope of the present invention is shown not in the above description but in the claims, and all differences within the equivalent scope should be construed as being included in the present invention.
[0178] On the other hand, the methods according to various embodiments of the present invention described above can be realized by a program and provided to a server or a device. Thereby, each device can access a server or a device in which the program is stored and download the program.
[0179] Also, the methods according to the various embodiments of the present invention described above can be implemented by a program and stored and provided in various non-transitory computer readable media. A non-transitory computer readable medium means a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc. Specifically, the various applications or programs described above can be stored and provided in non-transitory computer readable media such as CDs, DVDs, hard disks, Blu-ray disks, USBs, memory cards, ROMs, etc.
[0180] Furthermore, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and it goes without saying that various modifications can be made by those having ordinary knowledge in the technical field to which the invention pertains without departing from the gist of the invention claimed in the claims. Such modifications should not be individually understood apart from the technical idea and prospect of the present invention.
Explanation of Reference Numerals
[0181] 10 Control device for digital rearview mirror of vehicle 200 Digital rearview mirror
Claims
1. A method for controlling a digital rearview mirror of a vehicle, comprising: receiving an input of an external image of the vehicle via a camera provided in the vehicle; an image analyzing step of dividing the input image into a plurality of regions according to a preset criterion for the input image; a determination step of comparing a brightness value of the divided area in the image analyzing step with a predetermined critical range to determine whether correction of the input image is required; and adjusting brightness of the input image when a brightness value of at least one of the divided areas deviates from the critical range.
2. 2. The method of claim 1, wherein the image analyzing step divides the input image into dark and bright areas based on at least one of a pixel value of the input image or a pixel distribution (histogram) of the input image.
3. After the image analyzing step, the method further includes a step of measuring illuminance inside and outside the vehicle using an illuminance sensor, 3. The method for controlling a digital rearview mirror of a vehicle according to claim 2, wherein the determining step determines whether or not correction of the input image is necessary based on the measured illuminance and the brightness of the divided areas.
4. The illuminance measuring step includes:
4. The method for controlling a digital rearview mirror of a vehicle according to claim 3, further comprising measuring a difference between an amount of light measured by a front illuminance sensor provided in the front of the vehicle and an amount of light measured by a rear illuminance sensor provided in the rear of the vehicle.
5. 5. The method for controlling a digital rearview mirror of a vehicle according to claim 4, wherein the determination step is performed when the amount of light measured from the rear illuminance sensor in the illuminance measurement step is greater than the amount of light measured from the front illuminance sensor.
6. The method for controlling a digital rear-view mirror of a vehicle according to claim 5, wherein the digital rear-view mirror includes a mirror film that outputs an external image of the vehicle according to an electrical signal or optically reflects a situation behind the vehicle.
7. 7. The method for controlling a digital rearview mirror of a vehicle according to claim 6, further comprising the step of: reducing the reflectance of the mirror film when the amount of light measured from the rear illuminance sensor is less than the amount of light measured from the front illuminance sensor in the illuminance measurement step.
8. The method for controlling a digital rear-view mirror of a vehicle according to claim 2 , wherein the digital rear-view mirror includes a pixel array layer composed of micro LED elements.
9. 9. The method of claim 8, wherein the image processing step includes adjusting brightness of at least one of the divided regions when a brightness value of the at least one region deviates from the critical range.
10. an image output step of outputting the image whose brightness has been adjusted in the image processing step; an illuminance measuring step of measuring illuminance inside and outside the vehicle by an illuminance sensor after the image output step; The method for controlling a digital rear-view mirror of a vehicle according to claim 2, further comprising: a brightness adjustment step of adjusting brightness of a display of the digital rear-view mirror based on the measured illuminance.
11. The illuminance measuring step includes: The method for controlling a digital rearview mirror of a vehicle according to claim 10, further comprising measuring a difference between an amount of light measured by a front illuminance sensor provided in the front of the vehicle and an amount of light measured by a rear illuminance sensor provided in the rear of the vehicle.
12. 12. The method for controlling a digital rearview mirror of a vehicle according to claim 11, wherein in the brightness adjusting step, the brightness of the display is decreased when the amount of light measured from the rear illuminance sensor is greater than the amount of light measured from the front illuminance sensor.
13. The brightness adjustment step includes:
13. The method for controlling a digital rearview mirror of a vehicle according to claim 12, wherein, when the amount of light measured by the rear illuminance sensor in the illuminance measurement step is smaller than the amount of light measured by the front illuminance sensor, the amount of light measured by the front illuminance sensor is compared with a preset value, and brightness of the display is adjusted.
14. A program stored on a computer-readable recording medium, the program code being for executing the method for controlling a digital rear-view mirror of a vehicle according to any one of claims 1 to 13.
15. A computer-readable recording medium including a program code for executing the method for controlling a digital rear-view mirror of a vehicle according to any one of claims 1 to 13.
16. A control device for a digital rearview mirror of a vehicle, comprising: a digital rearview mirror including a mirror film that outputs an external image of the vehicle or optically reflects a situation behind the vehicle in response to an electrical signal selectively input thereto; A camera for capturing an image of an external environment of the vehicle; an image processing device that receives the captured image and adjusts the brightness, The image processing device includes: The control device for a digital rearview mirror of a vehicle divides an image input through the camera into a plurality of areas according to a preset criterion, and determines whether or not brightness correction of the input image is required by comparing brightness values of the divided areas with a preset critical range.
17. The image processing device includes:
17. The control device for a digital rearview mirror of a vehicle according to claim 16, wherein the input image is divided into dark and bright areas based on at least one of a pixel value of the input image or a pixel distribution (histogram) of the input image.
18. The vehicle further includes a sensor unit including a sensor for measuring illuminance inside and outside the vehicle, The image processing device includes: The control device for a digital rearview mirror of a vehicle according to claim 17, characterized in that it determines whether or not correction of the input image is necessary based on the illuminance inside and outside the vehicle measured by the sensor unit and the brightness of the divided areas.
19. A control device for a digital rearview mirror of a vehicle, comprising: A digital rear mirror including a pixel array layer composed of micro LED elements; A camera for capturing an image of an external environment of the vehicle; A sensor unit including a sensor for measuring illuminance inside and outside the vehicle; an image processing device that receives the captured image and adjusts the brightness, The image processing device includes: The control device for a digital rearview mirror of a vehicle divides an image input through the camera into a plurality of areas according to a preset criterion, and determines whether or not brightness correction of the input image is required by comparing brightness values of the divided areas with a preset critical range.
20. The image processing device includes: The control device for a digital rearview mirror of a vehicle according to claim 19, further comprising: adjusting brightness of at least one of the divided regions when the brightness value of the at least one of the divided regions deviates from the critical range.