Safe boarding and alighting system and method using rear-view mirror

Abstract

According to the present invention, disclosed are a safe boarding and alighting system and method using a rear-view mirror. A safe boarding and alighting system using a rear-view mirror according to the present invention, comprises: a rear camera photographing a rear side of a vehicle to output a rear image; an indoor camera photographing the inside of the vehicle around a central passage of the vehicle to output an indoor image; and an external camera photographing an object approaching from a rear side of the vehicle to output an external image. While driving, the rear image is output through the rear-view mirror. When a door of the vehicle is opened, the object approaching from the rear side of the vehicle is idenitified by using the external image to output a warning alarm to the rear-view mirror to ensure the safety of a passenger inside the vehicle and a passenger boarding or alighting.

Description

Safe boarding and alighting system and method using a rear-view mirror

[0001] The present invention relates to a safe boarding and alighting system and method, and more specifically, to a safe boarding and alighting system and method using a rear-view mirror.

[0002] Recently released vehicles are equipped with convenience features that provide drivers with useful information regarding driving. One of these is the digital rear-view mirror. Conventional rear-view mirrors simply performed the function of displaying the rear view seen through the vehicle's rear window to the driver via a mirror. However, these conventional rear-view mirrors have the disadvantage of failing to function properly when the rear window is heavily dusty or covered in snow.

[0003] To overcome these problems, digital rear-view mirrors have been developed and are being supplied. Digital rear-view mirrors install a camera at the rear of the vehicle and capture the rear view of the vehicle through the camera, displaying it to the driver, thereby enabling the driver to check the situation behind the vehicle.

[0004] However, while these conventional digital rear-view mirrors effectively show the situation behind the vehicle, they do not provide warnings about objects (cars, motorcycles, etc.) approaching the vehicle while driving or stopped, so they have the disadvantage of not being able to prevent collision accidents with approaching objects when getting out of the vehicle.

[0005] In particular, this problem is significant in large vehicles, such as large buses, where many people frequently get on and off.

[0006] The problem that the present invention aims to solve is to provide a safe boarding and alighting system and method using a rear-view mirror that is installed in a large vehicle, such as a bus, where a large number of passengers frequently board and alight, and can ensure the safety of passengers inside the vehicle and passengers boarding and alighting.

[0007] A safe boarding and alighting system using a rear-view mirror according to a preferred embodiment of the present invention for solving the above-mentioned problem comprises: a camera module including a rear camera that photographs the rear of a vehicle; a display module that outputs an image; a mirror module installed in front of the display module that adjusts reflectivity and transmittance according to a control signal; and a circuit unit including a processor and a memory, wherein the processor performs the steps of: (a) receiving door opening information from the main controller of the vehicle to check whether the vehicle door is open; (b) if the vehicle door is not open, receiving driving information from the main controller of the vehicle to check whether the vehicle is in motion; and (c) if the vehicle is in motion, lowering the reflectivity of the mirror module and outputting a rear image input from the rear camera through the display module to pass through the mirror module and output to the driver.

[0008] In addition, a safety boarding and alighting system using a rear-view mirror according to another preferred embodiment of the present invention further includes an interior camera that photographs the interior of the vehicle centered on the central passage of the vehicle, and the processor further performs the step of (d) when the vehicle is not moving while the vehicle’s door is not open, the processor checks for a standing passenger from an image input from the interior camera, and if there is a standing passenger, lowers the reflectivity of the mirror module and outputs the rear image input from the rear camera and the interior camera image through the display.

[0009] In addition, in step (d) above, if there is no standing passenger, the processor can increase the reflectivity of the mirror module and turn off the display to switch the rear-view mirror to mirror mode.

[0010] Additionally, the camera module further includes a door camera installed to photograph the vehicle's door and an external camera installed to photograph the side and rear of the vehicle, and (e) if the vehicle's door is open, the processor may further perform the step of outputting the rear image, the door image captured by the door camera, and the external image captured by the external camera together through the display.

[0011] In addition, the processor may further perform the step of (f) if the vehicle door is opened, the processor detects an object approaching from the rear side using the external image, and if an object approaching from the rear side is detected, outputs a warning alarm through the display.

[0012] In addition, in step (f) above, the processor can compare an image from a predetermined time ago with a current image among the external images to designate an area occupied by a recognized object as a region of interest, and apply the image of the region of interest to an Optical Flow algorithm to determine whether an object inside the image of the region of interest is approaching a vehicle with an open door.

[0013] In addition, the processor may further perform the step of (g) if the vehicle door is opened, the processor may use the door image to count the passengers boarding and alighting, respectively, to calculate the number of passengers currently on the vehicle and display it through the display.

[0014] In addition, in step (g) above, the processor designates an area corresponding to the door passageway among the door images as a region of interest, and forms an object frame by identifying a moving area in pixel units by comparing the current image and the previous image at regular time intervals, and classifies the passenger as a boarding passenger if the object frame moves in the direction of the vehicle's interior when it moves out of the region of interest, and classifies the passenger as a disembarking passenger if the object frame moves in the direction of the vehicle's exterior when it moves out of the region, thereby counting the number of passengers boarding.

[0015] Meanwhile, a safe boarding and alighting method using a rear-view mirror according to a preferred embodiment of the present invention for solving the above-mentioned problem is a safe boarding and alighting method using a rear-view mirror performed in a safe boarding and alighting system using a rear-view mirror comprising a camera module including a rear camera that photographs the rear of a vehicle, a display module that outputs an image, a mirror module installed in front of the display module that adjusts reflectivity and transmittance according to a control signal, and a circuit unit including a processor and a memory, comprising: (a) a step in which the processor receives door opening information from the main controller of the vehicle and checks whether the door of the vehicle is open; (b) a step in which, if the door of the vehicle is not open, the processor receives driving information from the main controller of the vehicle and checks whether the vehicle is in motion; and (c) a step in which, if the vehicle is in motion, the processor lowers the reflectivity of the mirror module and outputs a rear image input from the rear camera through the display module and transmits it through the mirror module to the driver.

[0016] Additionally, the camera module further includes an interior camera that films the interior of the vehicle centered on the central passage of the vehicle, and a safe boarding and alighting method using a rear-view mirror according to another preferred embodiment of the present invention may further include the step of (d) when the vehicle is not in motion with the vehicle door not open, the processor checks for a standing passenger from an image input from the interior camera, and if there is a standing passenger, lowers the reflectivity of the mirror module and outputs the rear image input from the rear camera and the interior camera image through the display.

[0017] In addition, in step (d) above, if there is no standing passenger, the processor can increase the reflectivity of the mirror module and turn off the display to switch the rear-view mirror to mirror mode.

[0018] Additionally, the camera module further includes a door camera installed to photograph the door of a vehicle and an external camera installed to photograph the side and rear of the vehicle, and a safe boarding and alighting method using a rear-view mirror according to another preferred embodiment of the present invention may further include the step of (e) if the door of the vehicle is opened, the processor outputting the rear image, the door image captured by the door camera, and the external image captured by the external camera together through the display.

[0019] In addition, a safe boarding and alighting method using a rear-view mirror according to another preferred embodiment of the present invention may further include the step of (f) if the vehicle door is opened, the processor detects an object approaching from the rear side using the external image, and if an object approaching from the rear side is detected, outputs a warning alarm through the display.

[0020] In addition, in step (f) above, the processor can compare an image from a predetermined time ago with a current image among the external images to designate an area occupied by a recognized object as a region of interest, and apply the image of the region of interest to an Optical Flow algorithm to determine whether an object inside the image of the region of interest is approaching a vehicle with an open door.

[0021] In addition, a safe boarding and alighting method using a rear-view mirror according to another preferred embodiment of the present invention may further include the step of (g) if the door of the vehicle is opened, the processor counts the passengers boarding and alighting respectively using the door image to calculate the number of passengers currently in the vehicle and displays it through the display.

[0022] In addition, in step (g) above, the processor designates an area corresponding to the door passageway among the door images as a region of interest, and forms an object frame by identifying a moving area in pixel units by comparing the current image and the previous image at regular time intervals, and classifies the passenger as a boarding passenger if the object frame moves in the direction of the vehicle's interior when it moves out of the region of interest, and classifies the passenger as a disembarking passenger if the object frame moves in the direction of the vehicle's exterior when it moves out of the region, thereby counting the number of passengers boarding.

[0023] The safety boarding and alighting system using a rear-view mirror according to the present invention includes a rear camera that captures the rear of the vehicle and outputs a rear image, an interior camera that captures the interior of the vehicle centered on the central passageway and outputs an interior image, and an exterior camera that captures an object approaching from the side rear of the vehicle and outputs an exterior image. During driving, the rear image is output through the rear-view mirror, and when the vehicle's doors are open, the exterior image is used to identify an object approaching from the side rear of the vehicle and outputs a warning alarm to the rear-view mirror, thereby ensuring the safety of passengers inside the vehicle and passengers boarding and alighting.

[0024] FIGS. 1A and FIGS. 1B are drawings illustrating the configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0025] FIG. 2 is a drawing illustrating the installation locations of cameras according to a preferred embodiment of the present invention.

[0026] FIG. 3 is a flowchart illustrating a safe boarding and alighting method using a rear-view mirror according to a preferred embodiment of the present invention.

[0027] Figure 4a is a drawing showing an example of a rear view image displayed on a rear-view mirror.

[0028] FIG. 4b is a diagram illustrating an example of an image displayed on a rear-view mirror when a standing passenger is detected.

[0029] FIG. 4c is a drawing illustrating an example of an image displayed on a rear-view mirror when a vehicle door is opened.

[0030] FIG. 5 is a diagram illustrating an example of a process for detecting a standing passenger according to a preferred embodiment of the present invention.

[0031] FIG. 6 is a diagram illustrating the process of detecting an approaching object according to a preferred embodiment of the present invention.

[0032] FIG. 7 is a diagram illustrating the process of counting passengers getting on and off according to a preferred embodiment of the present invention.

[0033] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0034] Hereinafter, the aforementioned objects, features, and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings. However, as the present invention is subject to various modifications and may have various embodiments, specific embodiments are illustrated in the drawings and described in detail below.

[0035] Throughout the specification, identical reference numbers indicate identical components in principle. Additionally, components with identical functions within the scope of the same concept appearing in the drawings of each embodiment are described using the same reference numeral.

[0036] When a part of a specification is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0037] If it is determined that a detailed description of known functions or configurations related to the present invention may unnecessarily obscure the essence of the present invention, such detailed description is omitted. Additionally, numbers used in the description of this specification (e.g., 1st, 2nd, etc.) are merely identification symbols to distinguish one component from another.

[0038]

[0039] FIGS. 1A and FIGS. 1B are drawings illustrating the configuration of a rear-view mirror according to a preferred embodiment of the present invention.

[0040] Referring to FIGS. 1a and 1b, a rear-view mirror (100) according to a preferred embodiment of the present invention includes a camera module (110), a mirror module (140), a display (130), and a circuit unit (120). The circuit unit (120) includes a processor (121) and a memory (123). The camera module (110) includes a rear camera (111), a door camera (115), an interior camera (113), and an exterior camera (117). The mirror module (140), the display (130), and the circuit unit (120) are contained in a rear-view mirror housing (190) and installed near the front windshield of the vehicle interior.

[0041]

[0042] FIG. 2 is a diagram illustrating the installation locations of cameras according to a preferred embodiment of the present invention. With further reference to FIG. 2, the locations and functions of the cameras according to a preferred embodiment of the present invention will be described.

[0043] A rear camera (111) is installed on the exterior rear of the vehicle, captures the rear of the vehicle to generate a rear image, and transmits the rear image to a processor (121). The rear camera (111) may be used to have a shooting angle of 120 to 180 degrees so that blind spots can be captured.

[0044] The interior camera (113) is installed in a position capable of capturing multiple seats of a large vehicle and outputs the captured image to a processor (121). The interior camera (113) may be installed inside the outer housing (190) of a rear-view mirror (100) installed in the center of the front windshield, or it may be installed in a separate position from the rear-view mirror (100).

[0045] The door camera (115) is installed inside the large vehicle so as to face the vehicle's door, and captures the sight of passengers boarding the vehicle and disembarking from the vehicle and outputs it to the processor (121).

[0046] An external camera (117) is installed on the side where the vehicle's entrance door is installed, and photographs an object approaching from the rear side of the vehicle and outputs it to a processor (121). In a preferred embodiment of the present invention, the external camera (117) is installed together with the side mirror, but there is no restriction on the installation location as long as it is configured to photograph the rear side.

[0047] Meanwhile, the display (130) can be implemented as an LCD module, an OLED module, etc., and is turned on / off according to the control of the processor (121), and outputs a video signal generated by the processor (121).

[0048] The mirror module (140) contains an EC (Electronic Chromic) film inside and is positioned in front of the display (130). Under the control of the processor (121), the reflectivity and transmittance of the EC film contained in the mirror module (140) are adjusted, and accordingly, the mirror module (140) performs the role of a reflector or transmits an image displayed on the display (130) so that the driver and passengers can see the image on the display (130).

[0049] The memory (123) is implemented as an SSD (Solid State Drive), flash memory, ROM (Read-Only Memory), RAM (Random Access Memory), etc., and can store instructions to be executed by the processor (121), data processed by the processor (121), and rear video, interior video, exterior video, and door video.

[0050] The processor (121) can be implemented as a CPU (Central Processing Unit) or a similar device (e.g., MPU (Micro Processing Unit), MCU (Micro Control Unit), etc.) and controls the display (130) and mirror module (140) by executing instructions stored in memory (123), processes images captured by the cameras (111~117) to generate an image to be output to the display (130), and outputs the generated image through the display (130).

[0051] The processor (121) controls the rear-view mirror (100) to operate in display mode or mirror mode. In display mode, the processor (121) outputs images captured by cameras (111 to 117) through the display (130), lowers the reflectivity of the mirror module (140) to below a predefined value, and increases the transmittance so that the images output from the display (130) pass through the mirror module (140) and are output to the driver.

[0052] In mirror mode, the processor (121) turns off the display (130) and increases the reflectivity and decreases the transmittance of the mirror module (140) so that light is reflected from the mirror module (140) toward the driver, just like a standard rear-view mirror.

[0053] In a preferred embodiment of the present invention, the processor (121) operates the rear-view mirror (100) in mirror mode only when no standing passenger is detected while the vehicle is not in motion, and in display mode otherwise.

[0054] Meanwhile, the processor (121) detects an object approaching from the side and rear of the vehicle using an image input from an external camera (117), displays the appearance of the approaching object through the display (130), and outputs a warning to the driver.

[0055] The processor (121) calculates the number of passengers inside the vehicle by counting passengers boarding the vehicle and passengers alighting from the vehicle using the image input from the door camera (115), and outputs the number of passengers through the display (130).

[0056] The processor (121) checks whether the passenger is standing using the video input from the indoor camera (113), outputs the number of standing passengers through the display (130), and outputs the video input from the indoor camera (113) through the display (130).

[0057] In addition, the processor (121) communicates with the vehicle's main controller (200) according to a predetermined communication protocol (CAN communication / LIN communication) and receives door opening information and driving information (e.g., transmission gear setting information) from the vehicle's main controller (200).

[0058]

[0059] FIG. 3 is a flowchart illustrating a safe boarding and alighting method using a rear-view mirror (100) according to a preferred embodiment of the present invention, FIG. 4a illustrates an example of a rear view image displayed on a rear-view mirror, FIG. 4b illustrates an example of an image displayed on a rear-view mirror when a standing passenger is detected, and FIG. 4c illustrates an example of an image displayed on a rear-view mirror when the vehicle door is opened.

[0060] In addition, FIG. 5 is a drawing illustrating the process of detecting a standing passenger according to a preferred embodiment of the present invention, FIG. 6 is a drawing illustrating the process of detecting an approaching object according to a preferred embodiment of the present invention, and FIG. 7 is a drawing illustrating the process of counting passengers getting on and off according to a preferred embodiment of the present invention.

[0061] Hereinafter, with further reference to FIGS. 3 to 7, the functions of a safe boarding and alighting method using a rear-view mirror (100) and a safe boarding and alighting system using a rear-view mirror (100) according to a preferred embodiment of the present invention will be explained in more detail.

[0062] First, referring to FIG. 3, the processor (121) of the rear-view mirror according to a preferred embodiment of the present invention checks whether the door is currently open based on door opening information received from the main controller (200) of the vehicle (S310).

[0063] If the door is not open, the processor (121) checks the transmission gear setting information input from the vehicle's main controller (200) to determine if the vehicle is in motion (S320), and if it is in motion, operates the rear-view mirror (100) in display mode and outputs the image captured by the rear camera (111) exclusively to the display (130) (S330).

[0064] FIG. 4a is a diagram illustrating an example of a rear view image displayed on a rear-view mirror (100) while driving. Referring to FIG. 4a, the total number of passengers (401) currently on board the vehicle and the number of standing passengers (402) can be displayed on the rear-view mirror (100) along with the rear view image. Additionally, when the processor (121) receives vehicle speed information from the vehicle's main controller (200), it can output the vehicle speed information together.

[0065] If, in step S320, it is determined that the vehicle is not in motion (i.e., stopped or parked), the processor (121) checks whether there is a standing passenger in the interior image input from the interior camera (113) (S340).

[0066] FIG. 5 is a drawing illustrating an example of a process for detecting a standing passenger according to a preferred embodiment of the present invention. Referring further to FIG. 5, an example is described in which an interior camera (113) is installed so as to be visible in the central aisle toward the seat and, as described above, can be installed to be included inside the housing (190) of the rear-view mirror (100).

[0067] A processor (121) that receives an image captured by an indoor camera (113) designates an area corresponding to the central passage of a large vehicle, such as a bus, as a Region of Interest (ROI), and identifies movement at the pixel level by comparing the previous image and the current image at regular time intervals.

[0068] After that, the processor (121) identifies the area where the pixel moves to form an object frame, such as a green box, and continuously compares the previous image with the current image to track the object frame by frame, and identifies an object moving inside the central aisle ROI as a standing passenger. The processor (121) stops tracking objects that move out of the central aisle ROI, and when a standing passenger is detected, it warns the driver that there is a standing passenger by outputting the image of the standing passenger in a part area (403) of the display (130), as shown in FIG. 4b.

[0069] If, in step S340, there is a standing passenger, the processor (121) controls the rear-view mirror (100) to operate in display mode, outputting the rear image input from the rear camera (111) to the entire area of ​​the display (130), while outputting the image of the standing passenger input from the interior camera (113) to a part area (403) of the display (130) (S350) (see FIG. 4b). At this time, as described above, the processor (121) can count the number of standing passengers and display it on the display (130).

[0070] If there are no standing passengers in step S340, the processor (121) switches the rear-view mirror (100) to mirror mode, turns off the display (130), and displays the reflected image to the driver through the mirror module (140) (S360).

[0071] Meanwhile, when it is confirmed that the door is opened in step S310, the processor (121) operates the rear-view mirror (100) in display mode to output the rear image input from the rear camera (111) through the display (130), and as shown in FIG. 4c, displays the door image (404) input from the door camera (115) in a part area of ​​the display (130), and displays the external image (405) input from the external camera (117) in a part area of ​​the display (130) (S370).

[0072] After that, the processor (121) detects an object approaching from the rear side using an external image input from an external camera (117), and when an object approaching from the rear side is detected, the processor (121) outputs a warning alarm through the display (130) (S380).

[0073] At this time, the warning alarm may be displayed as a line of a specific color (e.g., red) around the external image (405) displayed in a part of the display (130), or a warning sound may be output through a speaker (not shown) included inside the rear-view mirror (100) or a speaker installed in the vehicle. In addition, the warning alarm may be performed by displaying the external image that was displayed in a part of the display across the entire display area.

[0074] Then, the processor (121) uses the door image input from the door camera (115) to count the passengers boarding and disembarking respectively, calculates the number of passengers currently on board the vehicle, and displays it through the display (130) (S390).

[0075] FIG. 6 is a diagram illustrating the process of detecting an approaching object according to a preferred embodiment of the present invention. With further reference to FIG. 6, step S380 is described in detail. When the door of a vehicle is opened, the processor (121) compares the image from a predetermined time ago with the current image in the image input from the external camera (117) and designates the area occupied by the recognized object (car, motorcycle, etc.) as a Region of Interest (ROI), as shown in the green box. The processor (121) applies the image of the ROI to an Optical Flow algorithm to determine whether an object inside the ROI is approaching the vehicle with the currently opened door. If it is determined that the object is approaching, the approaching object is displayed in a part area (405) of the display (130), as shown in FIG. 4c.

[0076] FIG. 7 is a diagram illustrating the process of counting passengers getting on and off according to a preferred embodiment of the present invention. With further reference to FIG. 7, step S390 is described in detail. When the vehicle door is opened, the processor (121) designates an area corresponding to the door passage among the images input from the door camera (115) as a Region of Interest (ROI), and identifies movement in pixel units by comparing the current image with the previous image at regular time intervals.

[0077] After that, the processor (121) identifies the area of ​​pixel movement to form an initial object frame as indicated by the green box in FIG. 7, and continuously compares the previous image with the current image to track the object frame by frame. Depending on the direction of movement of the frame, if an object moving out of the ROI moves in the inward direction (upward) of the vehicle, the passenger is classified as a boarding passenger, and if it moves in the outward direction (leftward) of the vehicle, the passenger is classified as a disembarking passenger to calculate the number of passengers.

[0078]

[0079] The safe disembarkation method using a rear view image according to the preferred embodiment of the present invention described so far can be implemented as a computer program stored on a non-transient storage medium by being implemented as computer-executable commands.

[0080] Storage media include all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable storage media include ROM, RAM, CD-ROM, and optical data storage devices. Additionally, computer-readable storage media are distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner.

[0081] The present invention has been described above with reference to its preferred embodiments. Those skilled in the art will understand that the present invention may be embodied in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention.

Claims

1. A camera module including a rear camera that photographs the rear of a vehicle; A display module that outputs an image; A mirror module installed in front of the above-mentioned display module, which adjusts reflectivity and transmittance according to a control signal; and It includes a circuit section including a processor and memory, and The above processor (a) A step of receiving door opening information from the vehicle's main controller and checking whether the vehicle's door is open; (b) If the vehicle’s door is not open, a step of receiving driving information from the vehicle’s main controller to check whether the vehicle is in motion; (c) A safe boarding / alighting system using a rear-view mirror, characterized by performing the step of lowering the reflectivity of the mirror module when the vehicle is in motion, and outputting a rear image input from the rear camera through the display module to pass through the mirror module and output it to the driver.

2. In Paragraph 1, The above camera module further includes an interior camera that films the interior of the vehicle centered on the central aisle of the vehicle, and (d) If the vehicle is not moving while the doors are closed, A safe boarding and alighting system using a rear-view mirror, characterized in that the processor further performs the step of confirming a standing passenger from an image input from the interior camera, and if there is a standing passenger, lowering the reflectivity of the mirror module and outputting the rear image input from the rear camera and the interior camera image through the display.

3. In Paragraph 2, In step (d) above, A safe boarding and alighting system using a rear-view mirror, characterized in that the processor increases the reflectivity of the mirror module and turns off the display to switch the rear-view mirror to mirror mode when there is no standing passenger.

4. In Paragraph 1, The above camera module further includes a door camera installed to photograph the vehicle's door and an external camera installed to photograph the side and rear of the vehicle. (e) If the vehicle door is opened, the processor further performs the step of outputting the rear image, the door image captured by the door camera, and the external image captured by the external camera together through the display; characterized by a safe boarding and alighting system using a rear-view mirror.

5. In Paragraph 4, (f) A safe boarding / alighting system using a rear-view mirror, characterized in that if the vehicle door is opened, the processor detects an object approaching from the rear side using the external image, and if an object approaching from the rear side is detected, outputs a warning alarm through the display.

6. In Paragraph 5, In the above step (f), the processor A safety boarding / alighting system using a rear-view mirror, characterized by designating an area occupied by a recognized object as a region of interest by comparing an image from a predetermined time prior with a current image among the above external images, and applying an image of the region of interest to an Optical Flow algorithm to determine whether an object inside the image of the region of interest is approaching a vehicle with a currently open door.

7. In Paragraph 4, (g) A safe boarding and alighting system using a rear-view mirror, characterized in that if the vehicle door is opened, the processor further performs the step of counting passengers boarding and passengers alighting using the door image to calculate the number of passengers currently in the vehicle and displaying it through the display.

8. In Paragraph 7, In step (g) above, the processor A safe boarding and alighting system using a rear-view mirror, characterized by designating an area corresponding to the door passageway in the above door image as a region of interest, comparing the current image and the previous image at regular time intervals to identify the movement area in pixel units and forming an object frame, classifying the passenger as a boarding passenger if the object frame moves in the direction of the vehicle's interior, and classifying the passenger as a disembarking passenger if the object frame moves in the direction of the vehicle's exterior, and counting the number of passengers boarding.

9. A safe boarding and alighting method using a rear-view mirror, performed in a safe boarding and alighting system using a rear-view mirror, comprising: a camera module including a rear camera for photographing the rear of a vehicle; a display module for outputting an image; a mirror module installed in front of the display module for adjusting reflectivity and transmittance according to a control signal; and a circuit unit including a processor and a memory. (a) A step in which the processor receives door opening information from the vehicle's main controller and checks whether the vehicle's door is open; (b) if the vehicle door is not open, the processor receives driving information from the vehicle's main controller to check whether the vehicle is in motion; and (c) A safe method for boarding and alighting using a rear-view mirror, characterized in that, when the vehicle is in motion, the processor lowers the reflectivity of the mirror module and outputs a rear image input from the rear camera through the display module to pass through the mirror module and output it to the driver.

10. In Paragraph 9, The above camera module further includes an interior camera that films the interior of the vehicle centered on the central aisle of the vehicle, and (d) If the vehicle is not moving while the doors are closed, A safe boarding and alighting method using a rear-view mirror, characterized by further including the step of the processor identifying a standing passenger from an image input from the interior camera, and if there is a standing passenger, lowering the reflectivity of the mirror module and outputting the rear image input from the rear camera and the interior camera image through the display.

11. In Paragraph 10, In step (d) above, A safe boarding and alighting method using a rear-view mirror, characterized in that the processor increases the reflectivity of the mirror module and turns off the display to switch the rear-view mirror to mirror mode when there is no standing passenger.

12. In Paragraph 9, The above camera module further includes a door camera installed to photograph the vehicle's door and an external camera installed to photograph the side and rear of the vehicle. (e) a step in which, if the vehicle door is opened, the processor outputs the rear image, the door image captured by the door camera, and the external image captured by the external camera together through the display; further comprising a safe boarding and alighting method using a rear-view mirror.

13. In Paragraph 12, (f) A safe boarding and alighting method using a rear-view mirror, characterized by further including the step of, if the vehicle door is opened, the processor detecting an object approaching from the rear side using the external image, and if an object approaching from the rear side is detected, outputting a warning alarm through the display.

14. In Paragraph 13, In the above step (f), the processor A safe boarding and alighting method using a rear-view mirror, characterized by designating an area occupied by a recognized object as a region of interest by comparing an image from a predetermined time prior with a current image among the above external images, and applying the image of the region of interest to an Optical Flow algorithm to determine whether an object inside the image of the region of interest is approaching a vehicle with a currently open door.

15. In Paragraph 12, (g) A safe boarding and alighting method using a rear-view mirror, characterized in that if the vehicle door is opened, the processor further includes the step of counting passengers boarding and passengers alighting using the door image to calculate the number of passengers currently in the vehicle and displaying it through the display.

16. In Paragraph 15, In step (g) above, the processor A safe boarding and alighting method using a rear-view mirror, characterized by designating an area corresponding to the door passageway among the above door images as a region of interest, forming an object frame by identifying a movement area in pixel units by comparing the current image and the previous image at regular time intervals, classifying the passenger as a boarding passenger if the object frame moves in the direction of the vehicle's interior, and classifying the passenger as a disembarking passenger if the object frame moves in the direction of the vehicle's exterior, thereby counting the number of passengers boarding.

Images