Safe getting-off system and method using rear-view video

Abstract

Disclosed are a safe getting-off system and method using a rear-view video. The present invention detects an object approaching a vehicle from the behind by using a digital rear-view mirror, and if a passenger is getting off the vehicle, displays the approaching object in an area of the rear-view mirror corresponding to the direction of the approaching object, thereby making the passenger of the vehicle to clearly perceive the shape, location, and direction of the approaching object for the passenger to safely get off the vehicle.

Description

Safe disembarkation system and method using rear view video

[0001] The present invention relates to a safe disembarkation system and method, and more specifically, to a safe disembarkation system and method using a rear view image captured using a rear-view mirror.

[0002] Recently released vehicles are equipped with safety exit assist systems.

[0003] Conventional safety exit assist systems have been implemented by detecting objects (e.g., vehicles, bicycles, etc.) approaching from the rear side of the vehicle via sensors and notifying the driver and passenger of the dangerous situation through warning sounds or door locking functions. However, this method relies primarily on auditory alerts or control actions and has limitations in that it fails to provide the driver and passenger with visual information about the surrounding environment.

[0004] Consequently, even after recognizing a warning, users are unable to determine the exact surrounding circumstances, such as which object triggered the warning, its location and distance, or its direction of movement. This results in the inconvenience of having to turn their heads this way and that to visually inspect the exterior of the vehicle. This issue implies that the system's information delivery capabilities are limited, increasing the user's cognitive burden and potentially compromising safety when exiting the vehicle.

[0005] The problem that the present invention aims to solve is to provide a safe disembarkation system and method capable of warning of an object approaching the vehicle from the rear using a digital rear-view mirror.

[0006] A safe exit system using a rear image according to a preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera that photographs the rear of a vehicle; a display module that outputs an image; a mirror module installed in front of the display module that adjusts reflectance and transmittance according to a control signal; and a circuit unit including a processor, a memory, and a communication module. The processor performs (a) a step of investigating gear setting information received from the main controller of the vehicle; and (b) a step of performing a driving process when the gear setting is not in parking (P). In step (b), the processor controls the mirror module to operate in display mode by lowering the reflectance and increasing the transmittance according to the rear-view mirror mode setting and outputting the image input from the rear camera through the display, or to operate in mirror mode by increasing the reflectance and decreasing the transmittance of the mirror module and turning off the display.

[0007] Meanwhile, a safety disembarkation system using a rear view image according to another preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera that captures the rear of a vehicle and an interior camera that captures the interior of a vehicle; a display module that outputs an image; a mirror module installed in front of the display module that controls reflectivity and transmittance according to a control signal; and a circuit unit including a processor, a memory, and a communication module. The processor performs (a) a step of investigating gear setting information received from the main controller of the vehicle; and (d) a step of performing a parking process when the gear setting is parking (P) and the vehicle is in a parking state. In step (d), the processor operates in a mirror mode or a display mode according to the rear-view mirror mode setting. When operating in a display mode, if information indicating that a passenger has been detected in the rear row of the vehicle is input from the main controller of the vehicle, the interior image captured by the interior camera is output through the display. If information indicating that a passenger has been detected in the rear row of the vehicle is not input from the main controller of the vehicle, the image captured by the rear camera is output through the display.

[0008] Additionally, the above-described processor further performs the step of (c) determining whether the vehicle is in a state of preparation for exiting or in a state of parking when the gear setting is in Park (P); and in step (c), the processor may examine door lock information received from the main controller of the vehicle and determine that the vehicle is in a state of preparation for exiting if the door lock is released, and determine that the vehicle is in a state of parking if the door lock is not released.

[0009] In addition, the above-described processor further performs the step of (e) performing a disembarking process when the disembarking preparation state is ready; and in the step (e), the processor operates in mirror mode or display mode depending on the rear-view mirror mode setting, and when operating in display mode, it can output an interior image captured by an interior camera capturing the interior of the vehicle through the display.

[0010] In addition, in step (e) above, rear approach object detection is performed, and when an object approaching from the rear is detected, the area corresponding to the direction in which the object is detected in the display is divided, and an image of the object can be output to the divided area.

[0011] Additionally, in step (e) above, if an object approaching from the rear is detected while the rear-view mirror mode is operating in mirror mode, the processor can control the operation to operate in an intermediate mode by reducing the reflectivity of the mirror module, dividing the area corresponding to the direction in which the object is detected in the display, and outputting an image of the object to the divided area so that it is visible to users through the mirror module.

[0012] In addition, in step (e) above, the processor can recognize an object from an image input from the camera and determine whether the object is approaching, the distance from the object, and the speed of the object based on the change in the size of the recognized object.

[0013] Meanwhile, a safe exit method performed in a rear-view mirror according to a preferred embodiment of the present invention for solving the above-mentioned problem is a safe exit method performed in a rear-view mirror comprising a camera module including a rear camera that photographs the rear of a vehicle, a display module that outputs an image, a mirror module installed in front of the display module that adjusts reflectivity and transmittance according to a control signal, and a circuit unit including a processor, a memory, and a communication module, comprising: (a) a step in which the processor investigates gear setting information received from the main controller of the vehicle; and (b) a step in which, when the gear setting is not in parking (P), the processor performs a driving process; wherein in step (b), the processor can control the mirror module to operate in display mode by lowering the reflectivity and increasing the transmittance of the mirror module and outputting an image input from the camera through the display according to the rear-view mirror mode setting, or to operate in mirror mode by increasing the reflectivity and lowering the transmittance of the mirror module and turning off the display.

[0014] Meanwhile, a safe exit method performed in a rear-view mirror according to a preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera for photographing the rear of a vehicle and an interior camera for photographing the interior of a vehicle; a display module for outputting an image; a mirror module installed in front of the display module for adjusting reflectivity and transmittance according to a control signal; and a circuit unit including a processor, a memory, and a communication module, wherein the method comprises: (a) a step in which the processor examines gear setting information received from the main controller of the vehicle; and (d) a step in which the processor performs a parking process when the gear setting is Park (P) and the vehicle is in a parking state; further comprising, in step (d), the processor operates in a mirror mode or a display mode according to the rear-view mirror mode setting, and when operating in a display mode, if information indicating that a passenger has been detected in the rear row of the vehicle is input from the main controller of the vehicle, the interior image captured by the interior camera is output through the display, and if information indicating that a passenger has been detected in the rear row of the vehicle is not input from the main controller of the vehicle, the image captured by the camera is output through the display.

[0015] Additionally, the safe disembarking method using the rear view described above further includes (c) a step in which, when the gear setting is Park (P), the processor determines whether the vehicle is in a state of preparation for disembarking or in a state of parking; and in step (c), the processor can examine door lock information received from the main controller of the vehicle and determine that the vehicle is in a state of preparation for disembarking if the door lock is released, and determine that the vehicle is in a state of parking if the door lock is not released.

[0016] In addition, the above-described safe disembarking method using the rear view image further includes the step of (e) when the disembarking preparation state is in place, the processor performing a disembarking process, and in step (e), the processor operates in mirror mode or display mode according to the rear-view mirror mode setting, and when operating in display mode, the interior image captured by the interior camera capturing the interior of the vehicle can be output through the display.

[0017] In addition, in step (e) above, rear approach object detection is performed, and when an object approaching from the rear is detected, the area corresponding to the direction in which the object is detected in the display is divided, and an image of the object can be output to the divided area.

[0018] Additionally, in step (e) above, if an object approaching from the rear is detected while the rear-view mirror mode is operating in mirror mode, the processor can control the operation to operate in an intermediate mode by reducing the reflectivity of the mirror module, dividing the area corresponding to the direction in which the object is detected in the display, and outputting an image of the object to the divided area so that it is visible to users through the mirror module.

[0019] In addition, in step (e) above, the processor can recognize an object from an image input from the camera and determine whether the object is approaching, the distance from the object, and the speed of the object based on the change in the size of the recognized object.

[0020] The present invention detects an object approaching a vehicle from the rear using a digital rear-view mirror, and when a passenger is about to exit the vehicle, displays the approaching object in an area of ​​the rear-view mirror corresponding to the direction of the approaching object, thereby enabling the passenger to clearly recognize the shape, location, and direction of the approaching object and allowing the passenger to exit safely.

[0021] FIGS. 1A and FIGS. 1B are drawings illustrating the configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0022] FIG. 2 is a flowchart illustrating the overall function of a safe disembarkation method using a rear view according to a preferred embodiment of the present invention.

[0023] FIG. 3 is a flowchart illustrating a driving process according to a preferred embodiment of the present invention.

[0024] FIG. 4 is a flowchart for performing a parking process according to a preferred embodiment of the present invention.

[0025] FIG. 5 is a flowchart illustrating the unloading preparation process according to a preferred embodiment of the present invention.

[0026] Figure 6 is a drawing illustrating an example of the position and shooting angle of various cameras installed in a vehicle.

[0027] FIG. 7 is a diagram illustrating a method for detecting a rear approaching object according to a preferred embodiment of the present invention.

[0028] FIG. 8 illustrates an example of an image displayed on a rear-view mirror display when an object approaching the vehicle is present, according to a preferred embodiment of the present invention.

[0029] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0030] Hereinafter, the aforementioned objects, features, and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings. However, as the present invention is subject to various modifications and may have various embodiments, specific embodiments are illustrated in the drawings and described in detail below.

[0031] Throughout the specification, identical reference numbers indicate identical components in principle. Additionally, components with identical functions within the scope of the same concept appearing in the drawings of each embodiment are described using the same reference numeral.

[0032] When a part of a specification is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0033] If it is determined that a detailed description of known functions or configurations related to the present invention may unnecessarily obscure the essence of the present invention, such detailed description is omitted. Additionally, numbers used in the description of this specification (e.g., 1st, 2nd, etc.) are merely identification symbols to distinguish one component from another.

[0034] FIGS. 1A and FIGS. 1B are drawings illustrating the configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0035] Referring to FIGS. 1a and 1b, a rear-view mirror (100) according to a preferred embodiment of the present invention includes a camera module (110), a mirror module (140), a display (130), and a circuit unit (120). The circuit unit (120) includes a processor (121), a memory (123), and a communication module (125). The camera module (110) basically includes a rear camera (111) and an interior camera (113), and may further include left and right cameras (hereinafter abbreviated as 'side cameras') (115). The mirror module (140), the display (130), and the circuit unit (120) are contained in a rear-view mirror housing (190) and installed near the front windshield of the vehicle interior.

[0036] The rear camera (111) is installed on the exterior rear of the vehicle, captures the rear of the vehicle to generate a rear image, and transmits the rear image to the processor (121). The rear camera (111) may be used to have a shooting angle of 120 degrees or more so that blind spots can be captured. In particular, if the side cameras (115) are not installed, it is preferable that the rear camera (111) be installed as a camera having a field of view of 180 degrees.

[0037] The interior camera (113) is installed inside the rear-view mirror housing (190) to face the rear seat, and photographs passengers and objects located in the rear seat and outputs them to the processor (121).

[0038] Two side cameras (115) are installed one on each of the left and right sides of the vehicle to photograph the rear side of the vehicle and output it to the processor (121). In a preferred embodiment of the present invention, two side cameras (115) are installed one on each side mirror, but the installation location can be changed.

[0039] For reference, an example of the installation position and shooting angle inside the vehicle of the rear camera (111), interior camera (113), and side cameras (115) is shown in FIG. 6.

[0040] The display (130) can be implemented as an LCD module, an OLED module, etc., and is turned on / off according to the control of the processor (121), and outputs a video signal generated by the processor (121).

[0041] The mirror module (140) contains an EC (Electronic Chromic) film inside and is positioned in front of the display (130). Under the control of the processor (121), the reflectivity and transmittance of the EC film contained in the mirror module (140) are adjusted, and accordingly, the mirror module (140) performs the role of a reflector or transmits an image displayed on the display (130) so that the driver and passengers can see the image on the display (130).

[0042] The memory (123) is implemented as an SSD (Solid State Drive), flash memory, ROM (Read-Only Memory), RAM (Random Access Memory), etc., and can store instructions to be executed by the processor (121), and can store data processed by the processor (121) and rear images.

[0043] The processor (121) can be implemented as a CPU (Central Processing Unit) or a similar device (e.g., MPU (Micro Processing Unit), MCU (Micro Control Unit), etc.) and controls the display (130) and mirror module (140) by executing instructions stored in memory (123), processes the rear image and rear side image to generate an image to be output to the display (130), and outputs the generated image through the display (130).

[0044] The communication module (125) communicates with the main controller (200) of the vehicle and receives vehicle gear setting information (D / R / P), door lock information, seat belt information, passenger detection information, etc. from the main controller (200) of the vehicle and outputs them to the processor (121). In a preferred embodiment of the present invention, the communication module (125) communicates with the main controller (200) of the vehicle based on a CAN or LIN communication protocol, but is not limited thereto.

[0045] FIG. 2 is a flowchart explaining the overall function of a safe disembarking method using a rear view image according to a preferred embodiment of the present invention, FIG. 3 is a flowchart explaining a driving process according to a preferred embodiment of the present invention, FIG. 4 is a flowchart explaining a parking process according to a preferred embodiment of the present invention, and FIG. 5 is a flowchart explaining a disembarking preparation process according to a preferred embodiment of the present invention.

[0046] Hereinafter, with further reference to FIGS. 2 to 5, the functions of a safe disembarkation method using a rear view image and a safe disembarkation system using a rear view image according to a preferred embodiment of the present invention will be explained in more detail.

[0047] First, referring to FIG. 2, the processor (121) receives real-time transmission gear setting information (hereinafter abbreviated as 'gear setting information') from the main controller (200) of the vehicle (S100), and first checks whether the gear setting information is P (Park) (S200).

[0048] If the gear setting information is P(Park), a driving process is performed (S300), and if the gear setting information is not P(Park), the processor (121) checks whether the vehicle is ready to disembark (S400).

[0049] Various methods can be applied to determine whether the vehicle is ready to disembark. In a preferred embodiment of the present invention, the vehicle's door lock information received from the vehicle's main controller (200) is examined to determine whether the vehicle's door lock is unlocked (i.e., if the vehicle's door lock is unlocked from a locked state, it is determined that the passenger has completed preparations for disembarking), but other methods may also be applied.

[0050] If it is determined that the vehicle passenger is not ready to disembark, the processor (121) performs a parking process (S500), and if it is determined that the vehicle passenger is ready to disembark, the processor (121) performs a disembarkation preparation process (S600).

[0051] Referring to FIG. 3, the driving process is described as follows: the processor (121) determines that the vehicle is in motion if the gear setting is not P (Park), which is parking, and checks the display mode (rear-view mirror mode) of the rear-view mirror (S310). In a preferred embodiment of the present invention, the rear-view mirror mode, which can be set by a user using a button or the like, is broadly divided into a display mode and a mirror mode, and further includes an intermediate mode described later as a sub-mode of the mirror mode.

[0052] In display mode, the processor (121) outputs a rear image captured by the rear camera (111) through the display (130), lowers the reflectivity of the mirror module (140) to below a predefined value, and increases the transmittance so that the rear image output from the display (130) passes through the mirror module (140) and is output to the driver.

[0053] In mirror mode, the processor (121) turns off the display (130) and increases the reflectivity of the mirror module (140) so that light is reflected from the mirror module (140) and directed toward the driver, just like a standard rear-view mirror (100).

[0054] In the intermediate mode, the processor (121) turns on the display (130) while operating in mirror mode and lowers the reflectivity of the mirror module (140) to a predefined value, and then displays an image of the rear camera (111) (or both side cameras (115)) through the display (130), thereby controlling the reflection from the mirror module (140) and the image output from the display (130) to be superimposed and displayed to the user.

[0055] Meanwhile, if the mode of the rear-view mirror (100) set by the user in the above-mentioned step S310 is a display mode, the processor (121) lowers the reflectivity of the mirror module (140) and activates the rear camera (111) to output the rear image input from the rear camera (111) through the display (130), thereby operating the rear-view mirror (100) in a display mode (S320).

[0056] Meanwhile, when the mode of the rear-view mirror (100) set by the user is mirror mode, the processor (121) turns off the display (130) and increases the reflectivity of the mirror module (140) to operate the rear-view mirror (100) in mirror mode (S330).

[0057] Referring to FIG. 4, the parking process is described as follows: when the processor (121) determines that the gear setting is Park (P) and that the vehicle is not ready to exit, it checks the rear-view mirror mode (S510).

[0058] When the rear-view mirror mode is mirror mode, as described above, the processor (121) turns off the display (130) and increases the reflectivity of the mirror module (140) to operate the rear-view mirror (100) in mirror mode (S520).

[0059] When the rear-view mirror mode is in display mode, the processor (121) checks whether a passenger in the rear seat has been detected (S530). Various methods may be applied to detect a passenger in the rear seat. For example, a detection sensor capable of detecting a rear seat passenger (e.g., can be implemented as an Ultra-WideBand (UWB) sensor, ultrasonic sensor, infrared sensor, etc.) (not shown) may be installed inside the rear-view mirror (100), and the rear seat passenger may be detected using the detection sensor. However, in a preferred embodiment of the present invention, the rear seat passenger may be identified by receiving passenger detection information indicating whether a passenger is present in the rear seat from the vehicle's main controller (200). At this time, the vehicle's main controller (200) may detect a passenger sitting in the seat using a pressure sensor installed on the vehicle's seat.

[0060] If no passenger is detected in the rear seat, the processor (121) operates the rear-view mirror (100) in display mode (S540). That is, in the same way as in step S320, the processor (121) lowers the reflectivity of the mirror module (140) (i.e., increases the transmittance) and outputs the rear image captured by the rear camera (111) through the display (130).

[0061] When a passenger is detected in the rear seat, the processor (121) operates the rear-view mirror (100) in display mode (S550). However, in the display mode of step S540, the processor (121) activates the interior camera (113) instead of the rear camera (111), and outputs the interior image captured by the interior camera (113) of the passenger in the rear seat through the display (130). Thus, the driver can check the status of the passenger in the rear seat through the rear-view mirror (100).

[0062] Referring to FIG. 5, the disembarkation preparation process is described as follows: when it is determined in step S400 that the disembarkation preparation state is ready, the processor (121) begins detecting an object approaching from the rear, and the object detection is continuously performed until step S690 described later (S610).

[0063] The method by which the processor (121) detects an object approaching from the rear can be applied in various ways. As a simplest example, an approach detection sensor (infrared sensor, radar sensor, Lidar sensor, ultrasonic sensor, etc.) facing the rear side can be installed, and when the state of readiness to disembark is confirmed, the detection sensor can be activated, and an object such as a vehicle approaching from the rear can be detected and the distance measured according to the signal input from the detection sensor.

[0064] However, in a preferred embodiment of the present invention, a separate approach detection sensor is not installed, and an object approaching from the rear is detected using a rear image or a rear-side image input from an existing rear camera (111) or a two-sided camera (115).

[0065] Specifically, the processor (121) recognizes objects by performing image processing on images input from the rear camera (111) (or side cameras (115)) for the purpose of detecting approaching objects. That is, the processor (121) learns typical shapes in advance and recognizes typical objects such as people, bicycles, cars, and motorcycles in the rear images (or rear-side images) input from the rear camera (111) (or side cameras (115)), identifies cars and motorcycles that pose a risk of accidents, and measures the distance according to the size of the identified objects.

[0066] After that, the processor (121) can calculate the distance traveled by the object by measuring the distance of the same object in the rear image (or rear-side image) at regular intervals, and can calculate the speed of the object by dividing this by time.

[0067] FIG. 7 is a diagram illustrating a method for detecting a rear approaching object according to a preferred embodiment of the present invention. Referring to FIG. 7, it is assumed that the image input through the rear camera (111) when the vehicle is stopped is FIG. 7 (a).

[0068] Subsequently, in step S400, if it is determined that the vehicle is ready to disembark, the processor (121) performs image processing on the rear image to recognize an object. As shown in the example illustrated in FIG. 7(b), the processor (121) can recognize that there is a vehicle behind in the rear image and check the distance by comparing the size of the vehicle within the image and store it in memory (123). To this end, the present invention stores a lookup table in memory (123) in advance that defines the correlation between the size of a typical object displayed in the image and the distance, and can simply measure the distance by querying the lookup table for the size of the object recognized in the rear image. Of course, various other methods for measuring distance may also be applied.

[0069] Then, the processor (121) performs object recognition again in the rear image at regular time intervals to check the distance of the object recognized immediately before and compares the distance stored immediately before with the current distance.

[0070] If there is no change in the distance of the recognized object, it is determined that the object is stationary; if there is a change in the distance, it is checked whether the object is approaching or moving away from the vehicle, and for objects approaching the vehicle, the distance traveled is calculated.

[0071] In the example illustrated in FIG. 7(b), the closer the object is to the bottom surface of the image, the closer it is to the vehicle. In FIG. 7(b), when the processor (121) first detects the object, the object (vehicle) is located closer to the top of the image, that is, at a distance from the vehicle, and when the rear image is checked again after a certain time interval, it can be seen that the object (vehicle) is located at a distance closer to the vehicle. The processor (121), having confirmed that the object is approaching, calculates the approach speed of the object by dividing the distance traveled by the object by the time interval.

[0072] The processor (121) classifies the safe disembarkation steps into a predetermined number of steps based on the relationship between the distance to the object and the approach speed, and performs a warning to the driver or disembarking passenger in a different way according to each classification.

[0073] In a preferred embodiment of the present invention, the safety disembarkation stage is classified into three stages (safety, warning, and danger) as shown in Table 1 below, and a warning is performed in a different manner for each stage. In Table 1, the horizontal direction indicates the speed of the object, and the vertical direction indicates the distance from the object.

[0074]

[0075] In the safety stage of Table 1, no special warning is performed, and in the warning stage, as described below, an image of an object approaching from the rear is displayed on the side of the display (130) in the direction corresponding to the object, and in the danger stage, an alarm can be provided with sound while displaying an image of an object approaching from the rear larger than in the warning stage.

[0076] Referring again to FIG. 5, in step S610, after approach object detection is initiated, the processor (121) checks the rear-view mirror mode (S620), and if it is in display mode, operates the rear-view mirror in display mode (S630). At this time, the processor (121) activates the indoor camera (113) and outputs the indoor image captured by the indoor camera (113) through the display (130).

[0077] After that, the processor (121) checks whether there is an approaching object in the rear camera (111) (or both side cameras (115)) as described above (S640), and if there is an approaching object, displays the approaching object on the side corresponding to the direction of the approaching object in the display (130) of the rear-view mirror (100) (S650). FIG. 8 illustrates an example of an image displayed on the display (130) of the rear-view mirror (100) when there is an approaching object.

[0078] Referring to FIG. 8, when there is an object (vehicle) approaching from the left side of the vehicle (see FIG. 8 (a)), the processor (121) divides the left area of ​​the display (130) where the interior image is displayed (see FIG. 8 (b)) and displays the image of the approaching object (vehicle) captured by the rear camera (111) (or left side camera (115)) in the corresponding left area. At this time, if the safety disembarkation stage listed in Table 1 is the 'safe' stage (e.g., when a person walks from the left rear), the divided image may not be displayed; if the safety disembarkation stage is the 'warning' stage, the approaching object may be displayed as shown in FIG. 8; and if the safety disembarkation stage is the 'danger' stage, the display area may be divided into two based on the center of the display (130), the object approaching from the rear may be displayed on the entire left side, and the interior image may be displayed on the remaining right side.

[0079] Additionally, the processor (121) may output a warning alarm sound through the vehicle's main controller (200) and a speaker (not shown) included in the vehicle's speaker or rear-view mirror (100) while indicating an approaching object (S690). At this time, the processor (121) may output a warning alarm sound only when the safe exit stage is in the 'danger' stage, and may output a warning alarm sound when the safe exit stage is in the 'warning' stage and the 'danger' stage, but may output different types of sounds.

[0080] Meanwhile, in step S620, if the rear-view mode is set to mirror mode, the processor (121) operates the rear-view mode to the mirror mode described above (S660) and checks whether there is an approaching object (S670).

[0081] When an approaching object is present, the processor (121) controls the rear-view mirror (100) to operate in an intermediate mode, turns on the display (130), lowers the reflectivity to a predefined value of the mirror module (140) (increases the transmittance), divides the side of the entire area of ​​the display (130) in the direction corresponding to the approaching object (left in the example of FIG. 8), and displays the approaching object in the rear image (or rear side image) in the divided area (S680). At this time, the processor (121) may divide only the side of the entire area of ​​the display (130) according to the safety disembarkation step according to Table 1 described above, or may divide it into two based on the central area, which is the same as the above-described step S650.

[0082] In addition, the processor (121) may display an approaching object and simultaneously output a warning alarm sound through the vehicle's speaker or a speaker included in the rear-view mirror (100) (S690).

[0083] The safe disembarkation method using a rear view image according to the preferred embodiment of the present invention described so far can be implemented as a computer program stored on a non-transient storage medium by being implemented as computer-executable commands.

[0084] Storage media include all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable storage media include ROM, RAM, CD-ROM, and optical data storage devices. Additionally, computer-readable storage media are distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner.

[0085] The present invention has been described above with reference to its preferred embodiments. Those skilled in the art will understand that the present invention may be embodied in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention.

Claims

1. A camera module including a rear camera that photographs the rear of a vehicle; A display module that outputs an image; A mirror module installed in front of the above-mentioned display module, which adjusts reflectivity and transmittance according to a control signal; and It includes a circuit section comprising a processor, memory, and communication modules, and The above processor (a) a step of examining gear setting information received from the vehicle's main controller; and (b) a step of performing a driving process when the gear setting is not Park (P); and A safe disembarkation system using a rear view image, characterized in that, in step (b) above, the processor controls the mirror module to operate in display mode by lowering the reflectivity and increasing the transmittance according to the rear-view mirror mode setting and outputting the image input from the rear camera through the display, or to operate in mirror mode by increasing the reflectivity and decreasing the transmittance of the mirror module and turning off the display.

2. A camera module including a rear camera for photographing the rear of the vehicle and an interior camera for photographing the interior of the vehicle; A display module that outputs an image; A mirror module installed in front of the above-mentioned display module, which adjusts reflectivity and transmittance according to a control signal; and It includes a circuit section comprising a processor, memory, and communication modules, and The above processor (a) a step of examining gear setting information received from the vehicle's main controller; and (d) a step of performing a parking process when the gear setting is Park (P) and the state is in parking; and In step (d) above, the processor operates in mirror mode or display mode depending on the rear-view mirror mode setting, A safe disembarkation system using rear images, characterized in that when operating in display mode, if information indicating that a passenger has been detected in the rear row of the vehicle is input from the main controller of the vehicle, an interior image captured by the interior camera is output through the display, and if information indicating that a passenger has been detected in the rear row of the vehicle is not input from the main controller of the vehicle, an image captured by the rear camera is output through the display.

3. In Paragraph 1 or 2, (c) further performing a step of determining whether the vehicle is in a ready-to-exit state or a park state when the gear setting is Park (P). In step (c) above A safe disembarkation system using a rear view, characterized in that the processor examines door lock information received from the main controller of the vehicle and determines that the vehicle is in a ready-to-disembark state if the door lock is released, and determines that the vehicle is in a parked state if the door lock is not released.

4. In claim 3, the processor (e) If the unloading preparation state is complete, perform the step of performing the unloading process; further, In the above step (e), the processor operates in mirror mode or display mode depending on the rear-view mirror mode setting, A safety disembarkation system using a rear view, characterized by outputting an interior image captured by an interior camera capturing the interior of a vehicle through the display when operating in display mode.

5. In Paragraph 4, A safety disembarkation system using a rear image, characterized in that, in step (e) above, it performs rear approach object detection, and when an object approaching from the rear is detected, it divides an area of ​​the display corresponding to the direction in which the object is detected and outputs an image of the object to the divided area.

6. In Paragraph 5, A safety disembarkation system using a rear image, characterized in that, in step (e) above, when an object approaching from the rear is detected while the rear-view mirror mode is operating in mirror mode, the processor reduces the reflectivity of the mirror module, divides the area corresponding to the direction in which the object is detected in the display, and controls the operation to operate in an intermediate mode by outputting an image of the object to the divided area so that it is transmitted through the mirror module and shown to users.

7. In Paragraph 5, In the above step (e), the processor A safety disembarkation system using rear images, characterized by recognizing an object from an image input from the camera and determining whether the object is approaching, the distance from the object, and the speed of the object based on changes in the size of the recognized object.

8. A safe exit method using a rear-view mirror comprising a camera module including a rear camera for capturing the rear of a vehicle, a display module for outputting an image, a mirror module installed in front of the display module for adjusting reflectivity and transmittance according to a control signal, and a circuit unit including a processor, a memory, and a communication module, wherein (a) a step in which the processor examines gear setting information received from the vehicle's main controller; and (b) a step in which the processor performs a driving process when the gear setting is not Park (P); A safe disembarkation method using a rear view image, characterized in that, in step (b) above, the processor controls the mirror module to operate in display mode by lowering the reflectivity and increasing the transmittance according to the rear-view mirror mode setting and outputting the image input from the camera through the display, or to operate in mirror mode by increasing the reflectivity and decreasing the transmittance of the mirror module and turning off the display.

9. A safe exit method using a rear-view mirror comprising a camera module including a rear camera for photographing the rear of a vehicle and an interior camera for photographing the interior of a vehicle, a display module for outputting an image, a mirror module installed in front of the display module for adjusting reflectivity and transmittance according to a control signal, and a circuit unit including a processor, a memory, and a communication module, wherein (a) a step in which the processor examines gear setting information received from the vehicle's main controller; and (d) further comprising the step of the processor performing a parking process when the gear setting is Park (P) and the state is in a parking state, and In step (d) above, the processor operates in mirror mode or display mode depending on the rear-view mirror mode setting, A safe disembarkation method using a rear view image, characterized in that when operating in display mode, if information indicating that a passenger has been detected in the rear row of the vehicle is input from the main controller of the vehicle, an interior image captured by the interior camera is output through the display, and if information indicating that a passenger has been detected in the rear row of the vehicle is not input from the main controller of the vehicle, an image captured by the camera is output through the display.

10. In Paragraph 8 or 9, (c) further comprising a step of determining whether the processor is in a ready-to-exit state or a park state when the gear setting is in Park (P); and In step (c) above A safe disembarkation method using a rear view, characterized in that the processor examines door lock information received from the main controller of the vehicle and determines that the vehicle is in a state of readiness to disembark if the door lock is released, and determines that the vehicle is in a state of parking if the door lock is not released.

11. In Paragraph 9, (e) When the unloading preparation state is present, the processor further includes the step of performing an unloading process, and In the above step (e), the processor operates in mirror mode or display mode depending on the rear-view mirror mode setting, A safe exit method using a rear view, characterized by outputting an interior image captured by an interior camera capturing the interior of a vehicle through the display when operating in display mode.

12. In Paragraph 11, A safe disembarkation method using a rear image, characterized in that, in step (e) above, detection of a rear approaching object is performed, and when an object approaching from the rear is detected, an area corresponding to the direction in which the object is detected is divided among the displays, and an image of the object is output to the divided area.

13. In Paragraph 12, A safe disembarkation method using a rear view image, characterized in that, in step (e) above, when an object approaching from the rear is detected while the rear-view mirror mode is operating in mirror mode, the processor reduces the reflectivity of the mirror module, divides the area corresponding to the direction in which the object is detected in the display, and controls the operation to operate in an intermediate mode by outputting an image of the object to the divided area so that it is transmitted through the mirror module and shown to users.

14. In Paragraph 12, In the above step (e), the processor A safe disembarkation method using a rear view image, characterized by recognizing an object from an image input from the camera and determining whether the object is approaching, the distance from the object, and the speed of the object based on changes in the size of the recognized object.

Images