Digital rear-view mirror device for detecting rear lateral side vehicle or available parking area based on rear video image of vehicle, and operating method thereof

Abstract

To provide a digital rear-view mirror device for detecting a rear lateral side vehicle or an available parking area based on rear video images of a vehicle, and an operating method thereof.SOLUTION: A digital rear-view mirror device according to the present disclosure is configured to: acquire rear video images of a vehicle; analyze the rear video images to detect a rear lateral side vehicle within an adjacent distance from the vehicle; and output information to warn of a collision with the rear lateral side vehicle. The digital rear-view mirror device according to the present disclosure is also configured to: acquire the rear video images of the vehicle; analyze the rear video images to detect at least one available parking area for the vehicle when the vehicle is in a backward traveling mode; and define the available parking area in the rear video images.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a digital rear mirror (DRM) device for detecting a rear-side vehicle or a parking area based on a rear image of a vehicle, and an operating method thereof. Related Art

[0002] Generally, vehicles are equipped with a rear-side safety system that monitors rear-side vehicles using radar sensors. For example, the rear-side safety system includes a blind-spot collision warning (BCW) system, a blind-spot collision-avoidance assist (BCA) system, and the like. The blind-spot collision warning system provides information about rear-side vehicles to the driver. Specifically, when there is a rear-side vehicle within an adjacent distance or when a rear-side vehicle approaches at high speed, the rear collision warning system displays warning information on a vehicle, such as a side mirror, a head-up display (HUD), a meter panel, or the like. The blind-spot collision-avoidance assist system controls the vehicle to prevent a collision with a rear-side vehicle when the vehicle changes lanes.

[0003] In such a rear-side safety system, malfunction occurs due to the surrounding environment by the radar sensor. Also, when the rear bumper of the vehicle is damaged, the radar sensor may be damaged or the position of the radar sensor may be changed, so that the rear-side safety system does not operate properly.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present disclosure provides a digital rear mirror device for detecting a rear-side vehicle or a parking area based on a rear image of a vehicle, and an operating method thereof.

Means for Solving the Problems

[0005] In the present disclosure, a method for operating a digital rearview mirror device of a vehicle may include the steps of acquiring a rearview image of the vehicle, analyzing the rearview image to detect a rear-side vehicle within an adjacent distance from the vehicle, and outputting information for warning of a collision with the rear-side vehicle.

[0006] In the present disclosure, a method for operating a digital rearview mirror device of a vehicle may include the steps of acquiring a rearview image of the vehicle, analyzing the rearview image to detect at least one parkable area for the vehicle during a reverse driving mode of the vehicle, and defining the parkable area within the rearview image.

[0007] In the present disclosure, a digital rearview mirror device of a vehicle includes a digital rearview mirror module and a processor configured to be connected to the digital rearview mirror module, acquire a rearview image during running of the vehicle, and display the rearview image on the digital rearview mirror module. The processor may be configured to analyze the rearview image, detect a rear-side vehicle within an adjacent distance from the vehicle, and output information for warning of a collision with the rear-side vehicle.

[0008] In the present disclosure, a digital rearview mirror device of a vehicle includes a digital rearview mirror module and a processor configured to be connected to the digital rearview mirror module, acquire a rearview image during running of the vehicle, and display the rearview image on the digital rearview mirror module. The processor may be configured to analyze the rearview image during a reverse driving mode of the vehicle, detect at least one parkable area for the vehicle, and define the parkable area within the rearview image.

Advantages of the Invention

[0009] According to the present disclosure, the digital rearview mirror device can ensure the safety of the rear side of the vehicle while providing the rear view of the vehicle. Specifically, the digital rearview mirror device monitors the safety of the rear side of the vehicle by analyzing the rear video to detect the rear side vehicle. This enables the digital rearview mirror device to monitor the rear side vehicle regardless of the radar sensor. Therefore, the digital rearview mirror device can prevent a collision between the vehicle and the rear side vehicle by warning the driver of the collision with the rear side vehicle or causing the vehicle to avoid changing lanes to an adjacent lane where the rear side vehicle is located. On the other hand, the digital rearview mirror device additionally monitors the safety of the rear during the reverse driving mode of the vehicle by analyzing the rear video to detect a parking available area. Therefore, the digital rearview mirror device can assist the parking of the vehicle by notifying the driver of the parking available area or causing the vehicle to execute parking in the parking available area.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying out the Invention

[0011] Hereinafter, various embodiments of the present specification will be described with reference to the accompanying drawings.

[0012] FIG. 1 is a block diagram showing the configuration of a video processing system 10 in various embodiments.

[0013] Referring to FIG. 1, the video processing system 10 may include a camera device 20 and a digital mirror device 100. The video processing system 10 may be attached to a vehicle. In some embodiments, at least one other component may be added to the video processing system 10.

[0014] The camera device 20 may acquire video information regarding the surrounding environment of the vehicle. In some embodiments, the camera device 20 may store the video information in a memory within the camera device 20. The video information may include a rear view of the vehicle. For this purpose, the camera device 20 may include a rear camera device attached to the rear side of the vehicle so as to face the rear of the vehicle. In some embodiments, the video information may further include at least one of a front view or a side view of the vehicle. In such a case, the camera device 20 may further include at least one of a front camera device attached to the front side of the vehicle so as to face the front of the vehicle, or a side camera device attached to both side surfaces of the vehicle so as to face both sides of the vehicle.

[0015] For example, the camera device 20 may include at least one of one or more lenses, an image sensor, a flash, and an image signal processor (ISP). For example, some of the one or more lenses of the camera device 20 may have the same lens characteristics (e.g., angle of view, focal length, autofocus, f number, or optical zoom). The one or more lenses may include a light source lens or a telephoto lens. For example, the image sensor may obtain an image corresponding to a subject by converting light emitted or reflected from the subject and transmitted through one or more lenses into an electrical signal. According to one embodiment, the image sensor may include, for example, one image sensor selected from among image sensors having different attributes such as an RGB sensor, a BW (black and white) sensor, an IF sensor, or a UV sensor, a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes. Each image sensor included in the image sensor may be realized using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. For example, the flash may include one or more light emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp.

[0016] The digital rearview mirror device 100 may display video information acquired by the camera device 20. For this purpose, the digital rearview mirror device 100 may be connected to the camera device 20. Specifically, the digital rearview mirror device 100 may include a digital rearview mirror module 110. The digital rearview mirror module 110 may operate in at least one of a mirror mode or a display mode to provide a rear view of the vehicle. In the mirror mode, the digital rearview mirror module 110 may directly project the rear view of the vehicle. In the display mode, the digital rearview mirror module 110 may provide a rear view of the vehicle by displaying a rear video of the vehicle acquired by the camera device 20. For this purpose, the digital rearview mirror module 110 may be disposed within the driver's forward view range.

[0017] The camera device 20 and the digital rearview mirror device 100 may be communicably connected by wire or wirelessly. In some embodiments, the camera device 20 and the digital rearview mirror device 100 may be connected via a communication cable. In one embodiment, the camera device 20 and the digital rearview mirror device 100 may communicate in an analog manner. The analog manner may include, for example, AHD (analog high definition). In other embodiments, the camera device 20 and the digital rearview mirror device 100 may communicate in a digital manner. For example, the digital manner may include a serial transmission manner. In such a case, the camera device 20 may include a serializer, and the digital rearview mirror device 100 may include a deserializer. However, it is not limited thereto, and the camera device 20 and the digital rearview mirror device 100 may also be connected via an in-vehicle network communication (e.g., CAN communication). The camera device 20 and the digital rearview mirror device 100 may include various communication chips.

[0018] The digital rearview mirror device 100 may analyze the rear view of the vehicle acquired from the camera device 20. According to various embodiments, the digital rearview mirror device 100 may analyze the rear view to monitor the rear side vehicles of the vehicle. According to one embodiment, the digital rearview mirror device 100 may analyze the rear view to monitor the rear side vehicles while monitoring the rear side vehicles using a radar sensor. According to other embodiments, the digital rearview mirror device 100 may analyze the rear view to monitor the rear side vehicles without performing the monitoring of the rear side vehicles using a radar sensor. According to various embodiments, the digital rearview mirror device 100 may analyze the rear view to monitor the parking available area of the vehicle.

[0019] FIG. 2 is a flowchart showing the signal flow for preventing a collision of a vehicle in the video processing system 10 in various embodiments. FIGS. 3A and 3B are exemplary diagrams for explaining the characteristics of the operation for detecting the rear side vehicles of the vehicle of the digital rearview mirror device 100 in various embodiments.

[0020] Referring to FIG. 2, at step 210, the camera device 20 may capture the rear view of the vehicle. At this time, the camera device 20 may capture the rear view at any angle. The angle of the camera device 20 may be default or initially set by the user and may be changeable by the user. Here, the rear view may have the resolution and size determined by the camera device 20. Next, at step 220, the camera device 20 may transmit the rear view to the digital rearview mirror device 100. Thereby, the digital rearview mirror device 100 can receive the rear view from the camera device 20.

[0021] Next, at stage 230, the digital rearview mirror device 100 may analyze the rearview video to detect a rear-side vehicle 311 within an adjacent distance from the vehicle. The rear-side vehicle 311 means another vehicle that precedes in an adjacent lane to the lane in which the vehicle is traveling, and the adjacent lane may include at least one of the left lane or the right lane. The adjacent distance may indicate a distance range with a high possibility of collision with respect to the vehicle. For example, the adjacent distance may be 2 to 3 m, but is not limited thereto. The adjacent distance may be default-set or initially set by the user and may be changeable by the user.

[0022] According to various embodiments, the digital rearview mirror device 100 may display the rearview video through the digital rearview mirror module 110. At this time, as shown in FIGS. 3a and 3b, the digital rearview mirror device 100 may display a field-of-view video 310 detected from the rearview video through the digital rearview mirror module 110. The field-of-view video 310 may be at least a part of the rearview video. Here, the resolution of the field-of-view video 310 may be the same as or lower than the resolution of the rearview video. On the other hand, the size of the field-of-view video 310 may be the same as or smaller than the size of the rearview video. The digital rearview mirror module 110 may have a display screen 320 for displaying the field-of-view video 310. Here, the size of the field-of-view video 310 may be converted, for example, enlarged to the size of the display screen 320.

[0023] According to various embodiments, the digital mirror device 100 may analyze the rear view while displaying the rear view through the digital mirror module 110. At this time, as shown in FIGS. 3a and 3b, the digital mirror device 100 may use the field of view image 310 to determine whether there is a rear-side vehicle 311 within the adjacent distance from the vehicle. For this purpose, the adjacent distance may be defined by reference lines 331, 333, and 335 within the display screen 320. Here, the reference lines 331, 333, and 335 are set with respect to one edge 321, 323, 325 of the display screen 320, and the adjacent distance may correspond to the distance between the corresponding edge 321, 323, 325 and the reference lines 331, 333, 335. That is, the farther the adjacent distance is, the farther the reference lines 331, 333, 335 are set from the corresponding edge 321, 323, 325, and the closer the adjacent distance is, the closer the reference lines 331, 333, 335 are set to the corresponding edge 321, 323, 325. Further, the reference lines 331, 333, 335 may be set within the display screen 320 according to the angle of the camera device 20 that captures the rear view. Therefore, in order to determine whether there is a rear-side vehicle 311 within the adjacent distance from the vehicle, the digital mirror device 100 may detect the recognition point 313 of the rear-side vehicle 311 within the field of view image 310 and determine whether there is a recognition point 313 between the corresponding edge 321, 323, 325 and the reference lines 331, 333, 335. Here, the recognition point 313 may be one of the middle of the rear-side vehicle 311, the vehicle number plate, the front bumper, or the headlight.

[0024] According to one embodiment, as shown in FIG. 3a, the reference line 331 may be set with respect to the lower edge 321 of the display screen 320. At this time, the reference line 331 may be a horizontal line. In such a case, the digital mirror device 100 may determine whether there is a recognition point 313 of at least one rear-side vehicle 311 in the left or right lane between the lower edge 321 and the reference line 331.

[0025] According to another embodiment, as shown in FIG. 3b, the reference lines 333 and 335 may include at least one of a first reference line 333 set with respect to the left edge 323 of the display screen 320 or a second reference line 335 set with respect to the right edge 325 of the display screen 320. At this time, the first reference line 333 and the second reference line 335 may each be a vertical line. In such a case, the digital rearview mirror device 100 may determine whether there is a recognition point 313 of the rear-side vehicle 311 in the left lane between the left edge 323 and the first reference line 333. Alternatively or additionally, the digital rearview mirror device 100 may determine whether there is a recognition point 313 of the rear-side vehicle 311 in the right lane between the right edge 325 and the second reference line 335.

[0026] Next, at step 240, the digital rearview mirror device 100 may output information for warning of a collision with the rear-side vehicle 311. At this time, the digital rearview mirror device 100 may output the information while displaying a rearview image through the digital rearview mirror module 110. Thereby, the driver of the vehicle can control the vehicle based on the information. As a result, a collision with the rear-side vehicle 311 against the vehicle can be prevented. Here, the information may be provided by at least one of visual information or auditory information. The visual information may include, for example, at least one of text, an icon, an indicator, a symbol, or an image. The auditory information may include, for example, at least one of voice or a notification sound.

[0027] According to one embodiment, the digital rearview mirror device 100 may output the information as visual information. Specifically, the digital rearview mirror device 100 may output the information as visual information through the digital rearview mirror module 110 or output the information as visual information through another display module. For example, the digital rearview mirror device 100 may display the information within the field-of-view image 310 through the digital rearview mirror module 110. According to other embodiments, the digital rearview mirror device 100 may output the information as auditory information.

[0028] According to some embodiments, at stage 250, the digital mirror device 100 may transmit a signal to the vehicle to block a lane change to an adjacent lane where the rear-side vehicle 311 is present. Thereby, the vehicle can avoid a lane change to the adjacent lane based on the signal. For example, the vehicle may not respond to the driver's control for a lane change and may automatically avoid a lane change. As a result, a collision with the rear-side vehicle 311 against the vehicle can be prevented.

[0029] FIG. 4 is a flowchart showing the signal flow for parking execution of a vehicle in the video processing system 10 in various embodiments. FIG. 5 is an exemplary diagram for explaining the characteristics of the operation for detecting the parking available area of the vehicle of the digital mirror device 100 in various embodiments.

[0030] Referring to FIG. 4, at stage 400, the digital mirror device 100 may confirm the reverse driving mode of the vehicle. Specifically, while the reverse driving mode of the vehicle is maintained, the digital mirror device 100 may continuously confirm the reverse driving mode of the vehicle.

[0031] Next, at stage 410, the camera device 20 may capture a rear view image of the vehicle. At this time, the camera device 20 may capture a rear view image at any angle. The angle of the camera device 20 may be default or initially set by the user and may be changeable by the user. Here, the rear view image may have a resolution and size determined by the camera device 20. Next, at stage 420, the camera device 20 may transmit the rear view image to the digital mirror device 100. Thereby, the digital mirror device 100 can receive the rear view image from the camera device 20.

[0032] Next, at step 430, the digital rearview mirror device 100 may analyze the rear video to detect at least one parkable area 513. Specifically, the digital rearview mirror device 100 may detect an empty space in the rear video and detect a parkable area 513 within the empty space. At this time, the digital rearview mirror device 100 may detect a parkable area 513 within an adjacent distance from the vehicle. Here, the adjacent distance may be equal to or greater than the length of the vehicle. For example, the adjacent distance may be 2 to 5 m, but is not limited thereto. The adjacent distance may be default-set or initially set by the user and may be changeable by the user.

[0033] According to various embodiments, the digital rearview mirror device 100 may display the rear video through the digital rearview mirror module 110. At this time, as shown in FIG. 5, the digital rearview mirror device 100 may display a field-of-view video 510 detected from the rear video through the digital rearview mirror module 110. The field-of-view video 510 may be at least a part of the rear video. Here, the resolution of the field-of-view video 510 may be the same as or lower than the resolution of the rear video. On the other hand, the size of the field-of-view video 510 may be the same as or smaller than the size of the rear video. The digital rearview mirror module 110 may have a display screen 520 for displaying the field-of-view video 510. Here, the size of the field-of-view video 510 may be converted, for example, enlarged to the size of the display screen 520.

[0034] According to various embodiments, the digital mirror device 100 may analyze a rear video while displaying the rear video through the digital mirror module 110. Specifically, as shown in FIG. 5, the digital mirror device 100 may use the field-of-view video 510 to identify an obstacle 511 within an adjacent distance from the vehicle. For this purpose, the adjacent distance may be defined by a reference line 531 within the display screen 520. Here, the reference line 531 is set with respect to the lower edge 521 of the display screen 520, and the adjacent distance may correspond to the distance between the lower edge 521 and the reference line 531. That is, the farther the adjacent distance is, the farther the reference line 531 is set from the lower edge 521, and the closer the adjacent distance is, the closer the reference line 531 is set to the lower edge 521. Further, the reference line 531 may be set within the display screen 520 according to the angle of the camera device 20 that captures the rear video. Accordingly, the digital mirror device 100 can identify the obstacle 511 between the lower edge 521 and the reference line 531 within the field-of-view video 510. Here, the obstacle 511 may include at least one of a vehicle, a pillar, a wall, a human, an animal, or another object. Thereby, the digital mirror device 100 can detect a free space without the obstacle 511 within the field-of-view video 510.

[0035] According to various embodiments, the digital mirror device 100 may detect a parkable area 513 within the available space. According to one embodiment, the digital mirror device 100 may identify the ground parking lines within the available space and detect the parkable area 513 within the available space based on the parking lines. Additionally, the digital mirror device 100 may identify the ground parkable information (e.g., information such as a light vehicle can park, a disabled vehicle can park, a female vehicle can park, etc.) within the available space and, together with the parking lines, detect the parkable area 513 within the available space based on the parkable information. As an example, when the parkable information is identified within the available space, the digital mirror device 100 may detect the parkable information by the parking lines around the parkable information. As another example, the digital mirror device 100 may detect the parkable area 513 where there is parkable information matched to the vehicle. According to still other embodiments, the digital mirror device 100 may detect the parkable area 513 within the available space based on the size of the available space, the size of the vehicle, and a predetermined parking interval. According to yet other embodiments, the digital mirror device 100 may identify the ground parking lines within the available space and detect the parkable area 513 within the available space based on the parking lines, the size of the available space, the size of the vehicle, and the parking interval.

[0036] Next, at step 440, the digital mirror device 100 may define the parkable area 513 within the rearview video. At this time, while displaying the rearview video through the digital mirror module 110, the digital mirror device 100 may display the parkable area 513 within the rearview video. Here, the digital mirror module 110 may display the two-dimensional ground of the parkable area 513 with lines or colors, or display the three-dimensional space of the parkable area 513 with lines or colors. For example, as shown in FIG. 5, the digital mirror device 100 may display the parkable area 513 within the field-of-view video 510 through the digital mirror module 110. Thereby, the driver of the vehicle can control the vehicle to park in the parkable area 513.

[0037] According to some embodiments, at stage 450, the digital mirror device 100 may transmit a signal to the vehicle to perform parking in the parking available area 513. Specifically, the digital mirror device 100 may transmit a signal to the vehicle based on the selection of the parking available area 513. Thereby, the vehicle can perform parking in the parking available area 513 based on the signal. For example, as shown in FIG. 5, the digital mirror device 100 may display a pointer 515 in any parking available area 513. When there are multiple parking available areas 513, the digital mirror device 100 may display the pointer 515 in one of the parking available areas 513. Here, the pointer 515 may be moved between the parking available areas 513 by the driver of the vehicle. Therefore, the digital mirror device 100 can select the parking available area 513 according to the position of the pointer 515. That is, the digital mirror device 100 can select the parking available area 513 where the pointer 515 finally locates. Next, the digital mirror device 100 may generate a signal based on the selected parking available area 513 and transmit the signal to the vehicle.

[0038] FIG. 6 is a block diagram showing the configuration of the digital mirror device 100 in various embodiments.

[0039] Referring to FIG. 6, the digital rearview mirror device 100 may be mounted inside the vehicle together with the camera device 20 and communicably connected to the camera device 20. Specifically, the digital rearview mirror device 100 may include at least one of a digital rearview mirror module 110, a display module 610, an input module 620, a sensor module 630, a communication module 640, an interface module 650, an audio output module 660, a memory 670, or a processor 680. In some embodiments, at least one of the components of the digital rearview mirror device 100 may be omitted, or at least one other component (e.g., a notification module such as an LED (light emitting diode) lamp) may be added. In some embodiments, at least two of the components of the digital rearview mirror device 100 may be implemented as one integrated circuit. In one embodiment, the components of the digital rearview mirror device 100 may be integrated and configured as a single unit. In such a case, the components of the digital rearview mirror device 100 may be housed within a single housing. In other embodiments, the components of the digital rearview mirror device 100 may be distributed and configured in at least two units.

[0040] The digital rearview mirror module 110 may be configured to provide a rear view of the vehicle. For this purpose, the digital rearview mirror module 110 may be disposed within the driver's forward field of view. In some embodiments, the digital rearview mirror module 110 may be assembled with the touch circuity of the input module 620 and implemented as a touch screen. In some embodiments, the digital rearview mirror module 110 may display video information received from the processor 680. The digital rearview mirror module 110 may have display screens 320, 520 of a predetermined resolution and size. The digital rearview mirror module 110 may be housed within a housing such that the display screens 320, 520 are exposed to the outside. In various embodiments, the digital rearview mirror module 110 may operate as at least one of a mirror mode or a display mode. In the mirror mode, the digital rearview mirror module 110 may directly project a rear view of the vehicle by utilizing the reflection of light. In the display mode, the digital rearview mirror module 110 may display a rear video received from the processor 680 to provide a rear view of the vehicle. In various embodiments, the digital rearview mirror module 110 may have an anti-glare function that is activated by an applied voltage. For this reason, the digital rearview mirror module 110 may be implemented, for example, by an electronic chromic (EC) method or a liquid crystal (LC) method.

[0041] The display module 610 may display video information received from the processor 680. For example, the display module 610 may include at least one of a head-up display, a meter panel display, or a side mirror. In some embodiments, the display module 610 may be assembled with the touch circuity of the input module 620 and implemented as a touch screen.

[0042] The input module 620 may receive signals used for at least one component of the digital mirror device 100. The input module 620 may include, for example, at least one of at least one button (also called a key), a keyboard, a keypad, a mouse, a joystick, or a microphone. For example, the button(s) may be arranged on at least one edge of the digital mirror module 110. Here, the button(s) may include at least one of a physical button or a touch button. In some embodiments, the input module 620 may include a touch circuit assembled with at least one of the digital mirror module 110 or the display module 610.

[0043] The sensor module 630 may generate electrical signals or data values corresponding to the operating state inside the digital mirror device 100 (e.g., power or temperature) or the external environmental state. The sensor module 630 may include, for example, at least one of a GPS (global positioning system) sensor, a motion sensor (also called a gesture sensor), a proximity sensor, a touch sensor, a radar sensor, a LIDAR sensor, a movement sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor (e.g., a G-sensor), an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0044] The communication module 640 may perform communication with an external device. The communication module 640 may establish a communication channel between the digital mirror device 100 and the external device and perform communication with the external device via the communication channel. Here, the external device may include at least one of a satellite, a base station, a server, or another electronic device (for example, used by a driver). The communication module 640 may include at least one of a wired communication module or a wireless communication module. The wired communication module may be connected to the external device by wire and communicate by wire. The wireless communication module may include at least one of a short-range communication module or a long-range communication module. The short-range communication module may communicate with the external device by a short-range communication method. For example, the short-range communication method may include at least one of Bluetooth (registered trademark), Wi-Fi direct, NFC communication (Near Field Communication), or infrared communication (IrDA: infrared data association). The long-range communication module may communicate with the external device by a long-range communication method. Here, the long-range communication module may communicate with the external device via a network. For example, the network may include at least one of a cellular network, the Internet, or a computer network such as a LAN (local area network) or a WAN (wide area network).

[0045] According to various embodiments, at least one of the communication module 620, the sensor module 630, or the communication module 640 may generate a user input. In one embodiment, any sensor of the input module 620 or the sensor module 630 may generate a user input based on a signal directly input from the user. In other embodiments, the communication module 640 may generate a user input based on a signal input from an electronic device used by the user.

[0046] The interface module 650 may be provided for connection with an external device. Specifically, the interface module 650 may support a specified protocol for wired or wireless connection with the external device. Here, the external device may include at least one of a vehicle or the camera device 20. In one embodiment, when communicating with the camera device 20 in an analog manner, the interface module 650 may receive video information from the camera device 20 and convert it from an analog signal to digital data. In other embodiments, when communicating with the camera device 20 in a digital manner, the interface module 650 may receive video information from the camera device 20 and convert it from serial data to parallel data. In such a case, the interface module 650 may be implemented as a deserializator.

[0047] The audio output module 660 may output an audio signal generated from the digital rearview mirror device 100. For example, the audio output module 650 may include at least one of a speaker or a receiver. In one embodiment, a speaker may include at least one voice coil that provides vibration by a diaphragm and a magnet that forms a magnetic field. When an electric current flows through the voice coil, a magnetic field formed by the voice coil interacts with a magnetic field formed by the magnet to vibrate the voice coil. A diaphragm connected to the voice coil vibrates based on the vibration of the voice coil. The speaker outputs an audio signal based on the vibration of the diaphragm.

[0048] Memory 670 may store various data used by at least one component of digital mirror device 100. For example, memory 670 may include at least one of a volatile memory or a non-volatile memory. The data may include at least one program and associated input data or output data. The program may be stored in memory 670 as software including at least one instruction, and may include, for example, at least one of an operating system, middleware, or an application. Memory 670 may include at least one of a first memory built into digital mirror device 100 or a second memory removable with respect to digital mirror device 100.

[0049] According to various embodiments, memory 670 may store a database in which different adjacent distances and the positions of different reference lines 331, 333, 335, 531 within display screens 320, 520 are respectively mapped. According to some embodiments, memory 670 may store a database in which different adjacent distances and the positions of different reference lines 331, 333, 335, 531 within display screens 320, 520 for different combinations of angles of camera device 20 that captures rear images are respectively mapped. For example, memory 670 may store a database related to a collision with a rear side vehicle 311 of a vehicle as shown in Table 1 below, and may store a database related to parking within a vacant space of a vehicle as shown in Table 2 below. Here, the values in Table 1 and Table 2 are merely exemplary, and the adjacent distances in Table 1 and the adjacent distances in Table 2 may be different or the same.

[0050] [Table 1]

[0051] [Table 2]

[0052] Processor 680 may control at least one component of the digital mirror device 100. Thereby, processor 680 may execute data processing or operations. For example, the hardware for processing data may include an ALU (arithmetic and logic unit), an FPU (floating point unit), an FPGA (field programmable gate array), a CPU (central processing unit), and / or an AP (application processor). Processor 680 may have the structure of a single-core processor or may have the structure of a multi-core processor such as a dual core, quad core, hexa core, or octa core. Processor 680 may execute instructions stored in memory 670.

[0053] According to various embodiments, processor 680 may acquire a rear view image of the vehicle from camera device 20 through interface module 650. Processor 680 may display the rear view image through digital mirror module 110. At this time, processor 680 may display the field of view images 310, 510 detected from the rear view image on the display screens 320, 520 of digital mirror module 110.

[0054] According to various embodiments, processor 680 may analyze the rear view image and detect a rear side vehicle 311 within an adjacent distance from the vehicle. The adjacent distance may indicate a distance range with a high possibility of collision with the vehicle. For this purpose, corresponding adjacent distances and reference lines 331, 333, 335 may be set. Processor 680 may associate the adjacent distance with the reference lines 331, 333, 335 based on the database in memory 670. The adjacent distance may be set by default or by the user and may be changeable by the user.

[0055] As a result, the processor 680 may output information for warning of a collision with the rear-side vehicle 311. Thereby, the driver of the vehicle can control the vehicle based on the information. Consequently, a collision of the vehicle with the rear-side vehicle 311 can be prevented. Here, the information may be provided by at least one of visual information or auditory information. According to one embodiment, the processor 680 may output the information as visual information through the digital rearview mirror module 110, or may output the information as visual information through the display module 610. According to other embodiments, the processor 680 may output the information as auditory information through the audio output module 660.

[0056] According to some embodiments, the processor 680 may transmit, to the vehicle through the interface module 650, a signal for blocking a lane change to an adjacent lane where the rear-side vehicle 311 is located. Thereby, the vehicle can avoid a lane change to the adjacent lane based on the signal. Consequently, a collision of the vehicle with the rear-side vehicle 311 can be prevented.

[0057] According to various embodiments, the processor 680 may analyze a rear video to detect at least one parkable area 513. Specifically, the processor 680 may detect a free space in the rear video and detect the parkable area 513 within the free space. At this time, the digital rearview mirror device 100 may detect the parkable area 513 within an adjacent distance from the vehicle. For this purpose, corresponding adjacent distance and reference line 531 may be set. The processor 680 may associate the adjacent distance with the reference line 531 based on the database of the memory 670. The adjacent distance may be equal to or greater than the length of the vehicle. The adjacent distance may be default or initially set by the user and may be changeable by the user.

[0058] Thereby, the processor 680 may define a parkable area 513 within the rear video. At this time, the processor 680 may display the parkable area 513 within the rear video while displaying the rear video through the digital mirror module 110. Thereby, the driver of the vehicle can control the vehicle to park in the parkable area 513.

[0059] According to some embodiments, the processor 680 may transmit, to the vehicle, a signal for performing parking in the parkable area 513 through the interface module 650. Specifically, the processor 680 may transmit a signal to the vehicle based on the selection of the parkable area 513. Thereby, the vehicle can perform parking in the parkable area 513 based on the signal. For example, the processor 680 may display a pointer 515 in any parkable area 513 through the digital mirror module 110. Here, the pointer 515 may be movable. Accordingly, the processor 680 may check the position of the pointer 515 based on user input and select the parkable area 513 at the corresponding position. That is, the processor 680 can finally select the parkable area 513 where the pointer 515 is located. Next, the processor 680 may generate a signal based on the selected parkable area 513 and transmit the signal to the vehicle.

[0060] FIG. 7 is a flowchart showing an operation method for detecting a rear side vehicle 311 of a vehicle of the digital mirror device 100 in various embodiments.

[0061] Referring to FIG. 7, at step 710, the digital mirror device 100 may acquire a rear view image of the vehicle. For this purpose, the interface module 650 may be communicably connected to the camera device 20, either wired or wirelessly. Specifically, the camera device 20 may capture a rear view image of the vehicle. At this time, the camera device 20 may capture the rear view image at any angle. The angle of the camera device 20 may be initially set by default or by the user, and may be changeable by the user. Here, the rear view image may have a resolution and size determined by the camera device 20. Therefore, by the camera device 20 transmitting the rear view image to the digital mirror device 100, the processor 680 can acquire the rear view image from the camera device 20 through the interface module 650.

[0062] According to various embodiments, the processor 680 may display the rear view image on the digital mirror module 110. For example, as shown in FIGS. 3a and 3b, the digital mirror device 100 may display a field of view image 310 detected from the rear view image through the digital mirror module 110. The field of view image 310 may be at least a part of the rear view image. Here, the resolution of the field of view image 310 may be the same as or lower than the resolution of the rear view image. On the other hand, the size of the field of view image 310 may be the same as or smaller than the size of the rear view image. The digital mirror module 110 may have a display screen 320 for displaying the field of view image 310. Here, the size of the field of view image 310 may be converted, for example, enlarged to the size of the display screen 320. That is, the processor 680 can display the rear view image on the display screen 320.

[0063] Next, at step 720, step 730, and step 740, the digital mirror device 100 may analyze the rear video to detect a rear-side vehicle 311 within an adjacent distance from the vehicle. The rear-side vehicle 311 means another vehicle that precedes in an adjacent lane to the lane in which the vehicle is traveling, and the adjacent lane may include at least one of the left lane or the right lane. The adjacent distance may indicate a distance range with a high possibility of collision with the vehicle. For example, the adjacent distance may be 2 to 3 m, but is not limited thereto.

[0064] According to various embodiments, the adjacent distance may be preset. The adjacent distance may be defined by reference lines 331, 333, 335 within the display screen 320. That is, the corresponding adjacent distance and reference lines 331, 333, 335 may be set. Here, the reference lines 331, 333, 335 are set with respect to one edge 321, 323, 325 of the display screen 320, and the adjacent distance may correspond to the distance between the corresponding edge 321, 323, 325 and the reference lines 331, 333, 335. That is, the farther the adjacent distance is, the farther the reference lines 331, 333, 335 are set from the corresponding edge 321, 323, 325, and the closer the adjacent distance is, the closer the reference lines 331, 333, 335 may be set to the corresponding edge 321, 323, 325. Further, the reference lines 331, 333, 335 may be set within the display screen 320 according to the angle of the camera device 20 that captures the rear video.

[0065] According to one embodiment, as shown in FIG. 3a, the reference line 331 may be set with respect to the lower edge 321 of the display screen 320. At this time, the reference line 331 may be a horizontal line. According to other embodiments, as shown in FIG. 3b, the reference lines 333, 335 may include at least one of a first reference line 333 set with respect to the left edge 323 of the display screen 320 or a second reference line 335 set with respect to the right edge 325 of the display screen 320. At this time, the first reference line 333 and the second reference line 335 may each be a vertical line.

[0066] At this time, the adjacent distance may be default or initially set by the user. Also, the adjacent distance may be changeable by the user. For example, the processor 680 may associate the adjacent distance with the reference lines 331, 333, 335 based on the database in the memory 670, whereby the processor 680 may set one of the adjacent distance or the reference lines 331, 333, 335 in response to the setting of the other one of the adjacent distance or the reference lines 331, 333, 335.

[0067] First, at step 720, the digital rearview mirror device 100 may recognize at least one rear-side vehicle 311 from the rearview image. The rear-side vehicle 311 means another vehicle that precedes in the adjacent lane of the lane in which the vehicle is traveling, and the adjacent lane may include at least one of the left lane or the right lane. Specifically, as shown in FIGS. 3a and 3b, the processor 680 may recognize the rear-side vehicle 311 from the field-of-view image 310.

[0068] Next, at step 730, the digital rearview mirror device 100 may detect the recognition point 313 of the rear-side vehicle 311 in the rearview image. Specifically, as shown in FIGS. 3a and 3b, the processor 680 may detect the recognition point 313 of the rear-side vehicle 311 in the field-of-view image 310. Here, the recognition point 313 may be one of the middle of the rear-side vehicle 311, the vehicle number plate, the front bumper, or the headlight.

[0069] Next, at step 740, the digital rearview mirror device 100 may determine whether there is a corresponding recognition point 313 between one edge 321, 323, 325 and the reference line 331, 333, 335 on the display screen 320. Specifically, the processor 680 may determine whether there is a corresponding recognition point 313 between the corresponding edge 321, 323, 325 of the reference line 331, 333, 335 and the reference line 331, 333, 335. According to one embodiment, as shown in FIG. 3a, when the reference line 331 is set with respect to the lower edge 321, the processor 680 may determine whether there is a recognition point 313 of at least one rear-side vehicle 311 in the left or right lane between the lower edge 321 and the reference line 331. According to another embodiment, as shown in FIG. 3b, when the reference lines 333, 335 include at least one of the first reference line 333 set with respect to the left edge 323 of the display screen 320 or the second reference line 335 set with respect to the right edge 325 of the display screen 320, the processor 680 determines whether there is a recognition point 313 of the rear-side vehicle 311 in the left lane between the left edge 323 and the first reference line 333, and alternatively or additionally, the processor 680 may determine whether there is a recognition point 313 of the rear-side vehicle 311 in the right lane between the right edge 325 and the second reference line 335.

[0070] Next, at step 750, the digital rearview mirror device 100 may output information for warning of a collision with the rear-side vehicle 311. Specifically, the processor 680 may output information while displaying the rear video on the digital rearview mirror module 110. Thereby, the driver of the vehicle can control the vehicle based on the information. As a result, a collision with the rear-side vehicle 311 against the vehicle can be prevented. Here, the information may be provided by at least one of visual information or auditory information. The visual information may include, for example, at least one of text, an icon, an indicator, a symbol, or an image. The auditory information may include, for example, at least one of voice or a notification sound.

[0071] According to one embodiment, the processor 680 may output information as visual information. Specifically, the processor 680 may output information as visual information through the digital mirror module 110 or through the display module 610. As an example, the processor 680 may display information within the field of view video 310 through the digital mirror module 110. As another example, the processor 680 may display the field of view video 310 through the digital mirror module 110 and, separately therefrom, display information through the display module 610. According to other embodiments, the processor 680 may output information as auditory information through the audio output module 660.

[0072] According to some embodiments, at step 760, the digital mirror device 100 may transmit a signal to the vehicle to block a lane change into an adjacent lane where there is a rear-side vehicle 311. Specifically, the processor 680 may transmit a signal to the vehicle through the interface module 650. Thereby, the vehicle can avoid a lane change into the adjacent lane based on the signal. For example, the vehicle may not respond to the driver's control for a lane change and can automatically avoid a lane change. As a result, a collision with the rear-side vehicle 311 with respect to the vehicle can be prevented.

[0073] FIG. 8 is a flowchart showing an operation method for detecting a parking available area 513 of a vehicle of the digital mirror device 100 in various embodiments.

[0074] Referring to FIG. 8, at step 810, the digital mirror device 100 may check the reverse driving mode of the vehicle. For this purpose, the interface module 650 may be communicably connected to the vehicle by wire or wirelessly. Specifically, the processor 680 may check the reverse driving mode of the vehicle through the interface module 650. While the reverse driving mode of the vehicle is maintained, the processor 680 may continuously check the reverse driving mode of the vehicle.

[0075] Next, at step 820, the digital mirror device 100 may acquire a rear view image of the vehicle. For this purpose, the interface module 650 may be communicably connected to the camera device 20, either wired or wirelessly. Specifically, the camera device 20 may capture a rear view image of the vehicle. At this time, the camera device 20 may capture the rear view image at any angle. The angle of the camera device 20 may be initially set by default or by the user and may be changeable by the user. Here, the rear view image may have a resolution and size determined by the camera device 20. Therefore, by the camera device 20 transmitting the rear view image to the digital mirror device 100, the processor 680 can acquire the rear view image from the camera device 20 through the interface module 650.

[0076] According to various embodiments, the processor 680 may display the rear view image through the digital mirror module 110. For example, as shown in FIG. 5, the digital mirror device 100 may display a field of view image 510 detected in the rear view image through the digital mirror module 110. The field of view image 510 may be at least a part of the rear view image. Here, the resolution of the field of view image 510 may be the same as or lower than the resolution of the rear view image. On the other hand, the size of the field of view image 510 may be the same as or smaller than the size of the rear view image. The digital mirror module 110 may have a display screen 320 for displaying the field of view image 510. Here, the size of the field of view image 510 may be converted, for example, enlarged to the size of the display screen 320. That is, the processor 680 can display the rear view image on the display screen 320.

[0077] Next, at step 830 and step 840, the digital mirror device 100 may analyze the rear video to detect at least one parkable area 513. Specifically, the processor 680 may detect an empty space in the rear video and detect the parkable area 513 within the empty space. At this time, the digital mirror device 100 may detect the parkable area 513 within the adjacent distance from the vehicle. Here, the adjacent distance may be equal to or greater than the length of the vehicle. For example, the adjacent distance may be 2 to 5 m, but is not limited thereto. The adjacent distance may be set by default or by the user and may be changeable by the user.

[0078] According to various embodiments, the adjacent distance may be preset. The adjacent distance may be defined by the reference line 531 within the display screen 520. That is, the corresponding adjacent distance and the reference line 531 may be set. Here, as shown in FIG. 5, the reference line 531 is set with respect to the lower edge 521 of the display screen 520 and may be a horizontal line. The adjacent distance may correspond to the distance between the lower edge 521 and the reference line 531. That is, the farther the adjacent distance, the farther the reference line 531 is set from the lower edge 521, and the closer the adjacent distance, the closer the reference line 531 is set to the lower edge 521. Further, the reference line 531 may be set within the display screen 520 according to the angle of the camera device 20 that captures the rear video.

[0079] At this time, the adjacent distance may be set by default or by the user. Further, the adjacent distance may be changeable by the user. For example, the processor 680 may associate the adjacent distance with the reference line 531 based on the database of the memory 670, whereby the processor 680 may set the other one of the adjacent distance or the reference line 531 corresponding to the setting of one of the adjacent distance or the reference line 531.

[0080] First, at step 830, the digital rearview mirror device 100 may identify an empty space within the rear video. Specifically, as shown in FIG. 5, the processor 680 may utilize the field-of-view video 510 to identify an obstacle 511 within an adjacent distance from the vehicle. The processor 680 may identify the obstacle 511 between the lower edge 521 and the reference line 531 within the field-of-view video 510. Here, the obstacle 511 may include at least one of a vehicle, a pillar, a wall, a human, an animal, or other objects. Thereby, the processor 680 can detect an empty space without the obstacle 511 within the field-of-view video 510.

[0081] Next, at step 840, the digital rearview mirror device 100 may detect a parkable area 513 within the empty space. According to one embodiment, the processor 680 may identify the ground parking line within the empty space and detect the parkable area 513 within the empty space based on the parking line. Additionally, the processor 680 may identify ground parkable information (e.g., information such as light vehicle parkable, disabled vehicle parking possibility, female vehicle parking possibility, etc.) within the empty space and, together with the parking line, detect the parkable area 513 within the empty space based on the parkable information. As an example, when parkable information is identified within the empty space, the processor 680 may detect the parkable information by the parking lines around the parkable information. As another example, the processor 680 may detect a parkable area 513 where there is parkable information matched to the vehicle. According to other embodiments, the processor 680 may detect the parkable area 513 within the empty space based on the size of the empty space, the size of the vehicle, and a predetermined parking interval. According to still other embodiments, the processor 680 may identify the ground parking line within the empty space and detect the parkable area 513 within the empty space based on the parking line, the size of the empty space, the size of the vehicle, and the parking interval.

[0082] Next, at step 850, the digital mirror device 100 may define a parking available area 513 in the rear view. Specifically, while displaying the rear view through the digital mirror module 110, the processor 680 may display the parking available area 513 in the rear view. Here, the processor 680 may display the two-dimensional ground of the parking available area 513 with lines or colors, or display the three-dimensional space of the parking available area 513 with lines or colors. For example, as shown in FIG. 5, the processor 680 may display the parking available area 513 in the field of view image 510 through the digital mirror module 110. Thereby, the driver of the vehicle can control the vehicle to park in the parking available area 513.

[0083] According to some embodiments, at step 860, the digital mirror device 100 may select the parking available area 513. For this purpose, as shown in FIG. 5, the processor 680 may display a pointer 515 in any parking available area 513. When there are multiple parking available areas 513, the processor 680 may display the pointer 515 in one of the parking available areas 513. Here, the pointer 515 may be moved between the parking available areas 513 based on user input. Therefore, the processor 680 may check the position of the pointer 515 based on user input and select the corresponding parking available area 513. That is, the processor 680 can finally select the parking available area 513 where the pointer 515 is located.

[0084] Next, at step 870, the digital mirror device 100 may transmit a signal to the vehicle to execute parking in the parking available area 513. Specifically, the processor 680 may generate a signal to execute parking in the selected parking available area 513. Also, the processor 680 may transmit the signal to the vehicle through the interface module 650. Thereby, the vehicle can execute parking in the parking available area 513 based on the signal.

[0085] According to the present disclosure, the digital rearview mirror device 100 can ensure the rear safety of the vehicle while providing a rear view of the vehicle. Specifically, the digital rearview mirror device 100 monitors the rear-side safety of the vehicle by analyzing the rear video to detect the rear-side vehicle 311. This enables the digital rearview mirror device 100 to monitor the rear-side vehicle 311 regardless of whether a radar sensor is included in the digital rearview mirror device 100 or whether the radar sensor is utilized. Therefore, the digital rearview mirror device 100 can prevent a collision between the vehicle and the rear-side vehicle by warning the driver of a collision with the rear-side vehicle 311 or causing the vehicle to avoid changing lanes to an adjacent lane where the rear-side vehicle 311 is located. On the other hand, the digital rearview mirror device 100 additionally monitors the rear safety in the reverse driving mode of the vehicle by analyzing the rear video to detect the parking available area 513. Therefore, the digital rearview mirror device 100 can assist in parking the vehicle by notifying the driver of the parking available area 513 or causing the vehicle to perform parking in the parking available area 513.

[0086] In short, the present disclosure provides a digital rearview mirror device 100 and an operation method thereof for detecting a rear-side vehicle 311 or a parking available area 513 based on a rear video of a vehicle.

[0087] In the present disclosure, an operation method of a digital rearview mirror device 100 of a vehicle may include a step of acquiring a rear video of the vehicle (step 710), a step of analyzing the rear video to detect a rear-side vehicle 311 within an adjacent distance from the vehicle (steps 720, 730, 740), and a step of outputting information for warning of a collision with the rear-side vehicle 311 (step 750).

[0088] According to various embodiments, the operation method of the digital mirror device 100 further includes a step (step 760) of transmitting a signal to the vehicle to block a lane change to an adjacent lane where the rear-side vehicle 311 is located, whereby the vehicle can avoid a lane change to the adjacent lane based on the signal.

[0089] According to various embodiments, the operation method of the digital mirror device 100 further includes a step of displaying a rear-view image on the display screen 320, and the adjacent distance may correspond to the distance between the reference lines 331, 333, 335 set with respect to one edge 321, 323, 325 of the display screen 320 within the display screen 320.

[0090] According to various embodiments, the step of detecting the rear-side vehicle 311 (step 720, step 730, step 740) may include a step (step 720, step 730) of detecting the recognition point 313 of the rear-side vehicle 311 between the corresponding edges 321, 323, 325 and the reference lines 331, 333, 335.

[0091] According to various embodiments, the reference lines 331, 333, 335 may be set within the display screen 320 according to the angle of the camera device 20 that captures the rear-view image, together with the adjacent distance.

[0092] According to various embodiments, the recognition point 313 may be one of the middle of the rear-side vehicle 311, the vehicle number plate, the front bumper, or the headlight.

[0093] According to various embodiments, the adjacent distance may be set by default or initially by the user and may be changeable by the user.

[0094] According to various embodiments, the corresponding information may include at least one of visual information or auditory information.

[0095] According to various embodiments, the method of operating the digital mirror device 100 may further include, when the vehicle is in the reverse driving mode, analyzing the rear view image to detect at least one parking available area 513 for the vehicle (steps 830 and 840), and defining the parking available area 513 in the rear view image (step 850).

[0096] According to various embodiments, the method of operating the digital mirror device 100 may further include, when the parking available area 513 is selected (step 860), transmitting a signal for executing parking in the parking available area 513 to the vehicle (step 870), whereby the vehicle can execute parking in the parking available area 513 based on the signal.

[0097] In the present disclosure, the method of operating the digital mirror device 100 of the vehicle may include obtaining a rear view image of the vehicle (step 820), analyzing the rear view image to detect at least one parking available area 513 of the vehicle when the vehicle is in the reverse driving mode (steps 830 and 840), and defining the parking available area 513 in the rear view image (step 850).

[0098] According to various embodiments, the method of operating the digital mirror device 100 may further include transmitting a signal for executing parking in the parking available area 513 to the vehicle based on the selection of the parking available area 513 (step 860) (step 870), whereby the vehicle can execute parking in the parking available area 513 based on the signal.

[0099] According to various embodiments, the steps of detecting the parking available area 513 (steps 830 and 840) may include identifying an empty space and a parking line in the rear view image (steps 830 and 840), and detecting the parking available area 513 in the empty space based on the parking line (step 840).

[0100] According to various embodiments, the step of detecting the parking available area 513 (step 830, step 840) may include the step of identifying an empty space in the rear view (step 830), and the step of detecting the parking available area 513 within the empty space based on the size of the empty space, the size of the vehicle, and a predetermined parking interval (step 840).

[0101] According to various embodiments, the step of defining the parking available area 513 (step 850) may include the step of displaying the parking available area 513 in the rear view while displaying the rear view.

[0102] In the present disclosure, the digital rearview mirror device 100 of a vehicle includes a digital rearview mirror module 110, and a processor 680 connected to the digital rearview mirror module 110 to acquire a rear view during running of the vehicle and configured to display the rear view on the digital rearview mirror module 110. The processor 680 may be configured to analyze the rear view, detect a rear side vehicle 311 within an adjacent distance from the vehicle, and output information for warning of a collision with the rear side vehicle 311.

[0103] According to various embodiments, the processor 680 is configured to transmit a signal to the vehicle to block a lane change to an adjacent lane where the rear side vehicle 311 is present, whereby the vehicle can avoid a lane change to the adjacent lane based on the signal.

[0104] According to various embodiments, the digital rearview mirror module 110 has a display screen 320 for displaying a rear view, and the adjacent distance may correspond to a distance between reference lines 331, 333, 335 set with respect to one edge 321, 323, 325 of the display screen 320 within the display screen 320.

[0105] According to various embodiments, the processor 680 may be configured to detect a recognition point 313 of the rear side vehicle 311 between the corresponding edge 321, 323, 325 and the reference lines 331, 333, 335.

[0106] According to various embodiments, the reference lines 331, 333, 335 may be set in the display screen 320 according to the angle of the camera device 20 that captures the rear video, together with the adjacent distance.

[0107] According to various embodiments, the recognition point 313 may be one of the center of the rear-side vehicle 311, the vehicle number plate, the front bumper, or the headlight.

[0108] According to various embodiments, the adjacent distance may be set by default or by the user, and may be changeable by the user.

[0109] According to various embodiments, the corresponding information may include at least one of visual information or auditory information.

[0110] According to various embodiments, the processor 680 may be configured to analyze the rear video and detect at least one parkable area 513 for the vehicle, and define the parkable area 513 in the rear video when the vehicle is in the reverse driving mode.

[0111] According to various embodiments, when the parkable area 513 is selected, the processor 680 may be configured to transmit a signal to the vehicle to execute parking in the parkable area 513, whereby the vehicle can execute parking in the parkable area 513 based on the signal.

[0112] In the present disclosure, the digital rearview mirror device 100 of the vehicle includes a digital rearview mirror module 110 and a processor 680 connected to the digital rearview mirror module 110 to acquire a rear video during the running of the vehicle and display the rear video on the digital rearview mirror module 110. The processor 680 may be configured to analyze the rear video and detect at least one parkable area 513 for the vehicle, and define the parkable area 513 in the rear video when the vehicle is in the reverse driving mode.

[0113] According to various embodiments, the processor 680 is configured to transmit a signal to the vehicle for performing parking in the parkable area 513 based on the selection of the parkable area 513, whereby the vehicle can perform parking in the parkable area 513 based on the signal.

[0114] According to various embodiments, the processor 680 may be configured to identify free space and parking lines in the rear view image and detect the parkable area 513 from within the free space based on the parking lines.

[0115] According to various embodiments, the processor 680 may be configured to identify free space in the rear view image and detect the parkable area 513 within the free space based on the size of the free space, the size of the vehicle, and a predetermined parking interval.

[0116] According to various embodiments, the processor 680 may be configured to display the parkable area 513 within the rear view image while displaying the rear view image.

[0117] FIG. 9 is a block diagram showing a vehicle 2000 equipped with the video processing system 10 in various embodiments. FIG. 10 is a block diagram showing the control device 2100 of the vehicle of FIG. 9.

[0118] Referring to FIGS. 9 and, the video processing system 10 according to various embodiments may be mounted on the vehicle 2000, and the vehicle 2000 may include a control device 2100. At this time, the vehicle 2000 may be an autonomous vehicle. In some embodiments, at least one component of the video processing system 10 may be integrated with at least one component of the control device 2100.

[0119] The control device 2100 may include a controller 2120 including a memory 2122 and a processor 2124, a sensor 2110, a wireless communication device 2130, a LIDAR 2140, and a camera module 2150.

[0120] The controller 2120 may be configured when manufactured by the vehicle manufacturer, or may be additionally configured to execute the autonomous driving function after manufacture. Or, it may include a configuration for executing a continuous additional function by upgrading the controller 2120 configured at the time of manufacture.

[0121] The controller 2120 may transmit a control signal to the sensor 2110, the engine 2006, the user interface (UI) 2008, the wireless communication device 2130, the LIDAR 2140, and the camera module 2150 included as other components in the vehicle. Also, although not shown in the figure, the control signal may also be transmitted to an acceleration device, a brake system, a steering device, or a navigation device related to the running of the vehicle.

[0122] The controller 2120 may control the engine 2006. For example, when the vehicle 2000 senses the speed limit of the road during running, the controller 2120 may control the engine 2006 so that the running speed does not exceed the speed limit, or may control the engine 2006 so that the running speed of the vehicle 2000 accelerates within a range not exceeding the speed limit. Additionally, when the sensing modules 2004a, 2004b, 2004c, 2004d sense the environment outside the vehicle and transmit it to the sensor 2110, the controller 2120 may receive this and generate a signal for controlling the engine 2006 or the steering device (not shown) to control the running of the vehicle.

[0123] When there is another vehicle or an obstacle in front of the vehicle, the controller 2120 may control the engine 2006 or the brake system so that the running vehicle decelerates. In addition to the speed, it may also control the trajectory, the running route, and the steering angle. Or, the controller 2120 may generate a necessary control signal according to the recognition information of other external environments such as the running lane or the running signal of the vehicle to control the running of the vehicle.

[0124] In addition to generating its own control signals, the controller 2120 can also control the running of the vehicle by communicating with surrounding vehicles or a central server and sending commands for controlling peripheral devices based on the received information.

[0125] Also, when the position of the camera module 2150 is changed or the viewing angle is changed, the controller 2120 may generate a control signal to control the execution of calibration of the camera module 2150 to prevent the vehicle or lane from not being accurately recognized. Therefore, the controller 2120 can cause the camera module 2150 to generate a calibration control signal, so that even if the mounting position of the camera module 2150 is changed due to vibrations or impacts generated by the movement of the autonomous vehicle 2000, the normal mounting position, direction, viewing angle, etc. of the camera module 2150 can be continuously maintained. The controller 2120 may generate a control signal to execute calibration of the camera module 2150 when the pre-stored initial mounting position, direction, viewing angle information of the camera module 2120 and the initial mounting position, direction, viewing angle information of the camera module 2120 measured during the running of the autonomous vehicle 2000 differ by more than a threshold value.

[0126] The controller 2120 may include a memory 2122 and a processor 2124. The processor 2124 may execute the software stored in the memory 2122 according to the control signals of the controller 2120. Specifically, the controller 2120 stores data and commands for detecting a field-of-view video from the rear video of the vehicle 2000 in the memory 2122, and the commands may be executed by the processor 2124 to implement one or more methods disclosed herein.

[0127] At this time, the memory 2122 may be stored in a non-volatile recording medium executable by the processor 2124. The memory 2122 may store software and data through appropriate internal and external devices. The memory 2122 may be composed of a RAM (random access memory), a ROM (read only memory), a hard disk, and a memory 2122 device connected to a dongle.

[0128] The memory 2122 may store at least an operating system (OS), user applications, and executable instructions. The memory 2122 may also store application data and array data structures.

[0129] The processor 2124 is a microprocessor or an appropriate electronic processor, and may be a controller, a microcontroller, or a state machine.

[0130] The processor 2124 may be realized by a combination of computing devices, and the computing devices may be a digital signal processor, a microprocessor, or an appropriate combination thereof.

[0131] In addition, the control device 2100 may monitor the internal and external characteristics of the vehicle 2000 by at least one or more sensors 2110 to sense the state.

[0132] The sensor 2110 may be composed of at least one or more sensing modules 2004, and the sensing module 2004 may be realized at a specific position of the vehicle 2000 according to the purpose of sensing. It may be located at the lower part, rear end, front end, upper part, or side end of the vehicle 2000, or may be located on internal components or tires of the vehicle.

[0133] As a result, the sensing module 2004 can sense information related to driving, such as the engine 2006, tires, steering angle, speed, and vehicle weight, as internal information of the vehicle. Also, at least one or more sensing modules 2004 may be composed of an acceleration sensor 2110, a gyroscope, an image sensor 2110, RADAR, an ultrasonic sensor, a LiDAR sensor, etc., and may sense the movement information of the vehicle 2000.

[0134] As external information, the sensing module 2004 can also receive specific data related to the external environmental state, such as the road condition information where the vehicle 2000 is located, information on surrounding vehicles, and weather, and sense the vehicle parameters based on this. The sensed information may be stored in the memory 2122 temporarily or long - term according to the purpose.

[0135] The sensor 2110 may integrate and collect the information of the sensing module 2004 for collecting the information generated inside and outside the vehicle 2000.

[0136] The control device 2100 may further include a wireless communication device 2130.

[0137] The wireless communication device 2130 is configured to realize wireless communication between vehicles 2000. For example, it enables the vehicle 2000 to communicate with the user's mobile phone, or other wireless communication devices 2130, other vehicles, a central device (traffic control device), a server, etc. The wireless communication device 2130 may transmit and receive wireless signals according to a connection wireless protocol. The wireless communication protocol may be Wi - Fi, Bluetooth, Long - Term Evolution (LTE), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Global Systems for Mobile Communications (GSM), but the communication protocol should not be limited to these.

[0138] In addition, the vehicle 2000 can also realize communication between vehicles through the wireless communication device 2130. That is, the wireless communication device 2130 may execute communication with other vehicles on the road and other vehicles by vehicle-to-vehicle (V2V) communication. The vehicle 2000 may transmit and receive information such as driving warnings and traffic information through vehicle-to-vehicle communication, and it is also possible to request information from other vehicles or receive requests. For example, the wireless communication device 2130 may execute V2V communication with a dedicated short-range communication (DSRC) device or a C-V2V (Cellular-V2V) device. In addition to vehicle-to-vehicle communication, communication between the vehicle and other things (for example, electronic devices carried by pedestrians, etc.) (V2X, Vehicle to Everything communication) may also be realized through the wireless communication device 2130.

[0139] In addition, the control device 2100 may include a LIDAR device 2140. The LIDAR device 2140 may use data sensed through a LIDAR sensor to detect objects around the vehicle 2000 during operation. The LIDAR device 2140 transmits the detected information to the controller 2120, and the controller 2120 may operate the vehicle 2000 based on the detected information. For example, when there is a vehicle traveling at a low speed as detected information, the controller 2120 may instruct to reduce the speed of the vehicle through the engine 2006. Or, it may instruct to reduce the entry speed according to the curvature of the curve that the vehicle enters.

[0140] The control device 2100 may further include a camera module 2150. The controller 2120 may extract object information from an external image captured by the camera module 2150 and have the controller 2120 process information related thereto.

[0141] In addition, the control device 2100 may further include an imaging device for recognizing the external environment. In addition to the LIDAR 2140, RADAR, GPS devices, an odometry device, and other computer vision devices may be used, and these devices may be selected as needed or operate simultaneously to enable more precise sensing.

[0142] The vehicle 2000 may further include a user interface 2008 for user input to the above-described control device 2100. The user interface 2008 may allow the user to input information through appropriate interaction. For example, it may be implemented by a touch screen, keypad, operation buttons, etc. The user interface 2008 may send an input or command to the controller 2120, and the controller 2120 may execute a control operation of the vehicle in response to the input or command.

[0143] Also, the user interface 2008 may be a device external to the vehicle 2000 and may communicate with the vehicle 2000 through the wireless communication device 2130. For example, the user interface 2008 may be capable of interlocking with a mobile phone, tablet, or other computer device.

[0144] Furthermore, although the vehicle 2000 has been described as including the engine 2006, it is also possible to include other types of propulsion systems. For example, the vehicle may be driven by electric energy or may be driven by a hydrogen energy or a hybrid system combining these. Therefore, the controller 2120 may include a propulsion mechanism corresponding to the propulsion system of the vehicle 2000 and may provide a control signal corresponding thereto to the configuration of each propulsion mechanism.

[0145] Hereinafter, with reference to FIG. 10, the detailed configuration of the control device 2100 of the vehicle 2000 will be described in more detail.

[0146] The control device 2100 includes a processor 2124. The processor 2124 may be a general-purpose single or multi-chip microprocessor, a dedicated microprocessor, a microcontroller, a programmable gate array, or the like. The processor is also referred to as a central processing unit (CPU). Also, the processor 2124 can be used by a combination of multiple processors.

[0147] The control device 2100 includes a memory 2122. The memory 2122 may be any electronic component capable of storing electronic information. The memory 2122 may also include a combination of memories in addition to a single memory.

[0148] According to various embodiments, the data and instruction words 2122a of the vehicle 2000 may be stored in the memory 2122. When the processor 2124 executes the instruction words 2122a, all or part of the instruction 2122a and the data 2122b required for the execution of the instruction may be loaded 2124a, 2124b onto the processor 2124.

[0149] The control device 2100 may include a transmitter 2130a, a receiver 2130b, or a transceiver 2130c for allowing transmission and reception of signals. One or more antennas 2132a, 2132b may be electrically connected to the transmitter 2130a, the receiver 2130b, or each transceiver 2130c, and may additionally include an antenna.

[0150] The control device 2100 may include a digital signal processor (DSP) 2170. Through the DSP 2170, the vehicle may be enabled to process digital signals quickly.

[0151] The control device 2100 may include a communication interface 2180. The communication interface 2180 may include one or more ports and / or communication modules for connecting other devices to the control device 2100. The communication interface 2180 may enable interaction between the user and the control device 2100.

[0152] The various components of the control device 2100 may be connected via one or more buses 2190, and the buses 2190 may include a power bus, a control signal bus, a status signal bus, a data bus, etc. According to the control of the processor 2124, the components may transmit mutual information via the buses 2190 and execute the intended functions.

[0153] The devices described above may be implemented by hardware components, software components, and / or combinations of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, an FPGA (field programmable gate array), a PLU (programmable logic unit), a microprocessor, or various devices capable of executing instructions and responding. The processing device may execute an operating system (OS) and one or more software applications running on the OS. Also, the processing device may access data, record, manipulate, process, and generate data in response to the execution of the software. For the sake of convenience of understanding, although it may be described as if one processing device is used, those skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Also, other processing configurations, such as parallel processors, are possible.

[0154] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device independently or collectively. Software and / or data may be embodied in any kind of machine, component, physical device, computer recording medium, or device for interpretation by a processing device or for providing instructions or data to the processing device. Software may be distributed and recorded or executed in a distributed state on a computer system connected by a network. Software and data may be recorded on one or more computer-readable recording media.

[0155] The method according to an embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. At this time, the medium may be one that continuously records a program executable by a computer, or may be one that temporarily records it for execution or download. Also, the medium may be various recording or storage means in the form of a combination of single or multiple hardware, and may be a medium directly connected to a certain computer system, or may exist distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy (registered trademark) disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to record program instructions such as ROMs, RAMs, and flash memories. Also, as examples of other media, it includes application stores that distribute applications, and recording media and storage media managed by sites, servers, etc. that supply and distribute other various software.

[0156] The various embodiments of this specification and the terms used herein are not intended to limit the technology described herein to specific embodiments, but should be understood to include various modifications, equivalents, and / or alternatives of the corresponding embodiments. In connection with the description of the drawings, similar reference numerals are used for similar components. Singular expressions may include plural expressions unless the context clearly dictates otherwise. In this specification, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the listed items. Expressions such as "first", "second", "the first", or "the second" modify the corresponding components regardless of order or importance and are only used to distinguish one component from another, not to limit the component. When a certain (e.g., first) component is described as being "functionally or communicatively connected" or "connected" to another (e.g., second) component, the certain component may be directly connected to the other component or may be connected via another component (e.g., a third component).

[0157] The term "module" as used herein includes units composed of hardware, software, or firmware and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. A module may be an integrally configured component or the smallest unit or a part thereof that executes one or more functions. For example, a module may be configured as an ASIC (application-specific integrated circuit).

[0158] According to various embodiments, each of the described components (e.g., modules or programs) may include one or more objects. According to various embodiments, one or more of the above-described components or steps may be omitted, or one or more different components or steps may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated as one component. In such a case, the integrated component may perform one or more functions of each of the plurality of components in the same or similar manner as those performed by the corresponding component among the plurality of components before integration. According to various embodiments, the steps performed by a module, program, or other component may be performed sequentially, in parallel, iteratively, or heuristically, or one or more of the steps may be performed in a different order, omitted, or one or more different steps may be added.

Description of Signs

[0159] 10: Video processing system 20: Camera device 100: Digital mirror device 110: Digital mirror module

Claims

1. A method for operating a digital rear-mirror device for a vehicle, comprising: acquiring a rear image of the vehicle; analyzing the rear image to detect a vehicle within a proximate distance from the vehicle; and outputting information for warning the driver of a collision with the vehicle behind the vehicle; Including, A method for operating a digital rear-view mirror device.

2. transmitting a signal to the vehicle to block a lane change into an adjacent lane in which the rear vehicle is located; whereby the vehicle avoids the lane change into the adjacent lane based on the signal. A method for operating a digital rear-mirror device according to claim 1.

3. displaying the rear image on a display screen. Further comprising: The adjacent distance corresponds to a distance between a reference line set in the display screen relative to one edge of the display screen. A method for operating a digital rear-mirror device according to claim 1.

4. The step of detecting a rear side vehicle includes: detecting a recognition point of the rear side vehicle between the edge and the reference line; Including, A method for operating a digital rear-mirror device according to claim 3.

5. The reference line is set within the display screen according to the adjacent distance and the angle of a camera device that captures the rear image. A method for operating a digital rear-mirror device according to claim 3.

6. The recognition point is one of the center of the rear side vehicle, a vehicle license plate, a front bumper, or a headlight. A method for operating a digital rear-mirror device according to claim 4.

7. The adjacent distance is initially set by default or by a user and is changeable by the user. A method for operating a digital rear-mirror device according to claim 1.

8. The information includes at least one of visual information or audio information. A method for operating a digital rear-mirror device according to claim 1.

9. analyzing the rear image when the vehicle is in a reverse driving mode to detect at least one available parking area for the vehicle; and defining the parking area within the rear view; Further comprising: A method for operating a digital rear-mirror device according to claim 1.

10. transmitting a signal to the vehicle to park in the available parking area when the available parking area is selected. whereby the vehicle executes parking in the parking area based on the signal. A method for operating a digital rear-mirror device according to claim 9.

11. A method for operating a digital rear-mirror device for a vehicle, comprising: acquiring a rear image of the vehicle; analyzing the rear image when the vehicle is in a reverse driving mode to detect at least one available parking area for the vehicle; and defining the available parking area within the rear view; Including, A method for operating a digital rear-view mirror device.

12. transmitting a signal to the vehicle to park in the available parking area based on the selection of the available parking area. whereby the vehicle executes parking in the parking area based on the signal. A method for operating a digital rear-mirror device according to claim 11.

13. The step of detecting an available parking area includes: identifying vacant spaces and parking lines within the rear image; and detecting the available parking area within the vacant space based on the parking lines; Including, A method for operating a digital rear-mirror device according to claim 11.

14. The step of detecting an available parking area includes: identifying empty space within the rear image; and detecting the available parking area within the vacant space based on a size of the vacant space, a size of the vehicle, and a predetermined parking interval; Including, A method for operating a digital rear-mirror device according to claim 11.

15. The step of defining the available parking area comprises: and displaying the available parking area within the rear image while displaying the rear image. Including, A method for operating a digital rear-mirror device according to claim 11.

16. A digital rear-view mirror device for a vehicle, comprising: Digital rear-view mirror module, and a processor configured to couple to the digital rear-view mirror module, acquire a rear view image while the vehicle is moving, and display the rear view image on the digital rear-view mirror module; Including, The processor, Analyzing the rear image to detect a vehicle behind the vehicle within a proximate distance; The vehicle is configured to output information for warning of a collision with the rear side vehicle. Digital rear-view mirror device.

17. The processor, a signal for blocking a lane change to an adjacent lane in which the rear vehicle is located is transmitted to the vehicle, whereby the vehicle avoids the lane change to the adjacent lane based on the signal; 17. The digital rear-mirror device according to claim 16.

18. the digital rear-mirror module has a display screen for displaying the rear image; the adjacent distance corresponds to a distance between a reference line set in the display screen relative to one edge of the display screen, 17. The digital rear-mirror device according to claim 16.

19. The processor, configured to detect a recognition point of the rear side vehicle between the edge and the reference line; 19. The digital rear-mirror device according to claim 18.

20. The reference line is set within the display screen according to the adjacent distance and the angle of a camera device that captures the rear image.

19. The digital rear-mirror device according to claim 18.

21. The recognition point is one of the following: the center of the rear side vehicle, a vehicle license plate, a front bumper, or a headlight; 21. The digital rear-mirror device according to claim 20.

22. The adjacent distance is initially set by default or by a user and is changeable by the user.

17. The digital rear-mirror device according to claim 16.

23. The information includes at least one of visual information or audio information.

17. The digital rear-mirror device according to claim 16.

24. The processor, When the vehicle is in a reverse driving mode, the rear image is analyzed to detect at least one available parking area for the vehicle; configured to define the available parking area within the rear view; 17. The digital rear-mirror device according to claim 16.

25. The processor, When the available parking area is selected, a signal for executing parking in the available parking area is transmitted to the vehicle, so that the vehicle executes parking in the available parking area based on the signal.

25. The digital rear-mirror device according to claim 24.

26. A digital rear-view mirror device for a vehicle, comprising: Digital rear-view mirror module, and a processor connected to the digital rear-view mirror module and configured to acquire a rear view image while the vehicle is moving and display the rear view image on the digital rear-view mirror module; Including, The processor, When the vehicle is in a reverse driving mode, the rear image is analyzed to detect at least one available parking area for the vehicle; and defining the available parking area within the rear image. Digital rear-view mirror device.

27. The processor, a signal for executing parking in the available parking area is transmitted to the vehicle based on the selection of the available parking area, whereby the vehicle executes parking in the available parking area based on the signal; 27. The digital rear-mirror device according to claim 26.

28. The processor, Identifying vacant spaces and parking lines in the rear image; The parking system is configured to detect the available parking area within the vacant space based on the parking lines.

27. The digital rear-mirror device according to claim 26.

29. The processor, Identifying an open space within the rear image; configured to detect the available parking area within the vacant space based on a size of the vacant space, a size of the vehicle, and a predetermined parking interval; 27. The digital rear-mirror device according to claim 26.

30. The processor, The vehicle is configured to display the available parking area within the rear image while displaying the rear image.

27. The digital rear-mirror device according to claim 26.

Images