Driver assistance system including a camera based on dual video signal output

Abstract

The present invention provides a driver assistance system comprising: a camera unit configured at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle and outputting dual image signals; an around-view monitoring unit configured to receive a first image signal, which is one of the dual image signals, from the camera unit, and formed to generate a composite image of surrounding images centered on the vehicle in a preset manner based on the first image signal, and to transmit the composite image to a head unit module equipped in the vehicle; and an autonomous driving computing unit configured to receive a second image signal, which is the other of the dual image signals, from the camera unit, and to determine driving control of the vehicle in a preset manner based on the second image signal.

Description

Technology Field

[0001] The present invention relates to a driver assistance system comprising a camera based on dual video signal output. Background Technology

[0002] Recently, detection means capable of detecting obstacles are being installed for various purposes, such as detecting obstacles in the surroundings and blind spots including the rear of transportation equipment like vehicles, capturing traffic accident scenes, and securing data in the event of theft.

[0003] For example, the detection means may include a camera capable of taking images, an ultrasonic sensor capable of detecting obstacles located at the rear, front, or side.

[0004] Recently, the development and commercialization of smart vehicles are actively underway to enhance the safety and convenience of drivers and pedestrians. Smart vehicles are state-of-the-art automobiles that integrate Information and Communication Technology (IT), providing optimal traffic efficiency not only through the introduction of advanced systems within the vehicle itself but also through integration with intelligent transportation systems.

[0005] Specifically, intelligent vehicles maximize the safety and convenience of drivers, passengers, and pedestrians by performing autonomous driving functions, adaptive cruise control (ACC), obstacle detection, collision detection, providing precise maps, setting routes to destinations, and providing locations of key places.

[0006] The Around View Control System is attracting attention as one of the devices designed to maximize the safety and convenience of drivers, passengers, and pedestrians. The Around View Control System utilizes cameras to provide an around-view image centered on the vehicle, allowing the driver to control vehicle operations while monitoring the vehicle's surroundings in real time through the around-view video.

[0007] In addition, Advanced Driver Assistance Systems (ADAS) have recently been receiving significant attention, and many global automotive companies as well as research institutions are investing heavily in them, considering them a key future technology.

[0008] However, from the perspective of individual vehicles, the cameras or sensor devices required for the surround view control system and the advanced driver assistance system are currently configured separately and controlled through distinct logic; consequently, problems are continuously being raised regarding their inefficiency and low economic viability, not only in terms of operation but also in terms of cost. Prior art literature

[0009] Korean Registered Patent No. 10-2508984 The problem to be solved

[0010] The objective of the present invention, aimed at solving the aforementioned problems, is to propose a driver assistance system that improves the overall economic efficiency of the vehicle by applying a camera unit capable of integrating an around-view system and an autonomous driving system, thereby not only stabilizing the overall system but also reducing the number of camera units installed.

[0011] The technical problems to be solved in the various embodiments are not limited to those mentioned above, and other unmentioned technical problems may be considered by those skilled in the art from the various embodiments described below. means of solving the problem

[0012] The present invention provides a driver assistance system comprising: a camera unit configured at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle and outputting dual image signals; an around-view monitoring unit configured to receive a first image signal, which is one of the dual image signals, from the camera unit, and formed to generate a composite image of surrounding images centered on the vehicle in a preset manner based on the first image signal, and to transmit the composite image to a head unit module equipped in the vehicle; and an autonomous driving computing unit configured to receive a second image signal, which is the other of the dual image signals, from the camera unit, and to determine driving control of the vehicle in a preset manner based on the second image signal.

[0013] In addition, the camera unit may include a splitter board that splits the image signal acquired from the camera unit into the first image signal and the second image signal to output a dual image signal.

[0014] In addition, the camera unit may be composed of first to Nth camera units provided at preset locations on the vehicle to cover the entire surroundings of the vehicle.

[0015] In addition, the first and second video signals branched by the splitter board may be mutually identical video signals.

[0016] In addition, the first to Nth camera units can be connected in parallel to the around-view monitoring unit and the autonomous driving computation unit, respectively.

[0017] In addition, the M camera unit is provided on the rear side of the vehicle, and when a reverse signal is input, the same video signal is transmitted to the around-view monitoring unit and the autonomous driving computing unit, thereby controlling the reverse movement of the vehicle from the autonomous driving computing unit and providing a composite image from the around-view monitoring unit.

[0018] In addition, the camera unit may include an LVDS (Low-Voltage Differential Signaling) driver and be configured to transmit an LVDS video signal to the splitter board through the LVDS driver.

[0019] In addition, the splitter board may include a FAKRA connector connected to the around-view monitoring unit and the autonomous driving computation unit, respectively; and a serializer element. Effects of the invention

[0020] By applying a camera unit capable of integrating an around-view system and an autonomous driving system, the present invention can not only stabilize the overall system but also reduce the number of camera units installed, thereby improving the overall economic efficiency of the vehicle.

[0021] The effects obtainable from various embodiments are not limited to those mentioned above, and other unmentioned effects can be clearly derived and understood by a person skilled in the art based on the detailed description below. Brief explanation of the drawing

[0022] Other aspects, features, and benefits of specific preferred embodiments of the present invention, as described above, will become more apparent from the following description in conjunction with the accompanying drawings. FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention. FIG. 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention. FIG. 3 is a diagram showing the operation of individual components during the forward driving mode of a driver assistance system according to one embodiment of the present invention. FIG. 4 is a diagram showing the operation of individual components during reverse driving mode of a driver assistance system according to one embodiment of the present invention. FIG. 5 is a diagram showing that the operation of a first type camera unit and a second type camera unit is distinguished in a driver assistance system according to an embodiment of the present invention. FIG. 6 is a block diagram of a camera unit of a driver assistance system according to one embodiment of the present invention. It should be noted that in the drawings above, similar reference numbers are used to illustrate identical or similar elements, features, and structures. Specific details for implementing the invention

[0023] The present invention is susceptible to various modifications and may have various embodiments; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the invention to specific embodiments, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each drawing.

[0024] Terms such as first, second, A, B, etc., may be used to describe various components, but the components should not be limited by these terms. The terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of multiple related described items or any of the multiple related described items.

[0025] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0026] The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "having" are intended to specify the presence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0027] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0028] Hereinafter, a driver assistance system according to an embodiment of the present invention will be described with reference to the drawings.

[0029] FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention, and FIG. 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention.

[0030] Referring to FIGS. 1 and 2, the driver assistance system largely includes first to N camera units. FIG. 1 illustrates a configuration including first to fourth camera units (111, 112, 113, 114) as an example, but the value of N can be designed differently depending on the size, shape, use, model, etc. of the vehicle.

[0031] The camera unit (110) can be positioned at a preset location on the vehicle to capture images of the vehicle's surroundings in real time. Referring to FIG. 2, it is provided at the front, right side, left side, and rear of the vehicle, respectively, to monitor and sense the entire surroundings of the vehicle.

[0032] Each camera unit (110) includes a splitter board unit (1111, 1121, 1131, 1141). In this invention, the second camera unit (112) among these is described as an example.

[0033] The second camera unit (112) includes a second splitter board (1121) and is configured to output a dual video signal using the second splitter board (1121).

[0034] As shown in FIG. 2, the first to fourth camera units (111, 112, 113, 114) can be circuit-designed to be connected in parallel to the around-view monitoring unit (120) and the autonomous driving computation unit (130), respectively.

[0035] The second splitter (distributor) board (1121) is configured to split the video signal obtained from the second camera unit (112) into a first video signal and a second video signal, and then output them as a dual video signal.

[0036] Dual video signals mean that the first and second video signals are output independently of each other. As shown in FIG. 2, it can be seen that each camera unit (111, 112, 113, 114) transmits the first video signal and the second video signal independently to the around-view monitoring unit (120) and the autonomous driving computation unit (130). By doing so, the stability of the two systems—the system provided to the head unit module (140) through the around-view monitoring unit (120) and the system computed through the autonomous driving computation unit (130)—can be enhanced.

[0037] To explain more specifically, the second splitter board (1121) may include an LVDS driver (not shown). LVDS (Low Voltage Differential Signaling) is a digital signal transmission method that uses low-voltage differential signals and can generally be implemented using a digital signal processing IC (Integrated Circuit). Referring first to FIG. 6, the process of outputting dual video signals through the second splitter board (1121) can be observed.

[0038] LVDS video signals can be enhanced and shaped primarily through driver and filter circuits. In this case, the aforementioned LVDS driver amplifies the current or voltage, and the filter performs the role of filtering out unnecessary noise. Additionally, to output dual LVDS video signals, a diffractor or splitter can be used to duplicate the signal, thereby allowing a single LVDS video signal to be split into two.

[0039] At this time, the first and second video signals branched by the second splitter board (1121) can be composed of mutually identical video signals. That is, it means that the signal is duplicated and transmitted. Referring to FIG. 6, the second splitter board (1121) shows that the same signal can be duplicated and branched into two through a serializer element.

[0040] The first video signal and the second video signal branched through the second splitter (distributor) board section (1121) can be transmitted via at least one of hard wire or CAN (Controller Area Network) communication.

[0041] The around-view monitoring unit (120) includes a first video signal receiving unit (121) and a composite image generating unit (122).

[0042] The first video signal receiving unit (121) is configured to receive a first video signal, which is an LVDS video signal, from the camera unit (110). That is, the video signal transmitted from the camera unit (110) to the around-view monitoring unit (120) can be defined as the first video signal.

[0043] The composite image generation unit (122) generates a composite image of surrounding images centered on the vehicle based on a plurality of first image signals. At this time, the composite image may be configured in a planar form viewed from above. The around-view monitoring unit (120) is not always active and may be activated only in a specific control mode.

[0044] FIG. 3 is a drawing showing the operation of individual components in a forward driving mode of a driver assistance system according to one embodiment of the present invention, and FIG. 4 is a drawing showing the operation of individual components in a reverse driving mode of a driver assistance system according to one embodiment of the present invention.

[0045] Referring to FIGS. 3 and 4, as an example, the around-view monitoring unit (120) can be activated in reverse driving mode (a concept including parking mode, etc.). This is because the obstacle detection performed through the around-view monitoring unit (120) and the obstacle detection logic performed through the autonomous driving computation unit (130) can be designed differently. Since the around-view monitoring unit (120) generates a composite image targeting a static object, whereas the autonomous driving computation unit (130) is likely to perform detection targeting a dynamic object, the logic optimized for their purposes and targets can be distinguished from one another.

[0046] As another variation, the autonomous driving computation unit (130) can be activated in reverse driving mode to perform autonomous parking.

[0047] When a reverse signal is input to the M camera unit located at the rear of the vehicle (by the integrated ECU (150)), the same video signal is transmitted to the around-view monitoring unit (120) and the autonomous driving computation unit (130), thereby controlling the reverse movement of the vehicle by the autonomous driving computation unit (130) and providing a composite image by the around-view monitoring unit (120).

[0048] Looking at the example in FIG. 2, the second camera unit (112) is a camera provided on the rear side, and unlike the first, third, and fourth camera units (111, 113, 114), the second camera unit (112) can be operated as described above.

[0049] However, even if the around view monitoring unit (120) is in forward driving mode, if it is determined that the vehicle is currently in parking mode, the around view monitoring unit (120) may be activated. In addition to parking mode, if it is determined that there is a need to provide an around view to the vehicle's occupants (including the driver), the around view monitoring unit (120) may be operated regardless of forward / reverse driving mode.

[0050] The autonomous driving computation unit (130) includes a second video signal receiving unit (131) and a driving control computation unit (132).

[0051] The second video signal receiving unit (131) is configured to receive the second video signal, which is the other of the dual video signals, from the camera unit (110). Referring again to FIG. 1, for example, the LVDS video signal transmitted from the second splitter (distributor) board unit (1121) of the second camera unit (112) to the autonomous driving computation unit (130) can be defined as the 'second video signal'.

[0052] The driving control calculation unit (132) is configured to calculate the autonomous driving control command of the vehicle according to a preset method. As an example, the driving control calculation unit (132) may be configured to perform environment model (E / M) encoding to enable autonomous driving of the vehicle.

[0053] The environment model may refer to a model corresponding to surrounding environment data utilizing vehicle sensors (speed, location, direction, vehicle status) and autonomous driving sensors (V2X, cameras, etc.). In particular, network adaptation technology is essential to overcome communication environment limitations in order to implement autonomous driving, and includes uplink and downlink technologies as well as autonomous driving technology.

[0054] Among these, uplink technology is responsible for transmitting video and sensing signals, while downlink technology is responsible for generating and transmitting vehicle control commands from a remote location.

[0055] Using this environment model encoding, an trajectory for the vehicle's autonomous driving waypoints is generated, and the vehicle is configured to move along the said trajectory. At this time, the driving control operation unit (132) can detect an event situation and perform driving control corresponding to the event situation.

[0056] As an example, driving control to avoid collisions can be calculated by detecting cases such as a vehicle in an adjacent lane suddenly changing lanes and cutting in, or a preceding vehicle suddenly stopping. That is, in forward driving mode, a second video signal can be utilized to monitor surrounding vehicles centered on the target vehicle in real time and to detect changes in their speed.

[0057] The driving control calculation unit (132) can be connected to the vehicle's integrated ECU (150) to control the vehicle. The integrated ECU (150) is configured to be connected to and control all means for vehicle control. It can be connected to and control steering means, driving means (including engine and motor), braking means, sensing means, etc.

[0058] As an example, the integrated ECU (150) can perform the integration and processing of sensor information. The integrated ECU (150) effectively integrates and processes information collected from various sensors used in autonomous driving. These sensors include radar, LiDAR, cameras, ultrasonic sensors, etc.

[0059] Additionally, the integrated ECU (150) is configured to monitor the driving environment and control driving assistance functions. It detects other vehicles, pedestrians, obstacles, etc., while driving, analyzes them in real time, controls driving assistance functions, and assists the driver by automatically adjusting braking, steering, or acceleration when necessary. For example, Advanced Cruise Control (ACC) and Lane Departure Warning and Correction may be included here.

[0060] Additionally, the integrated ECU (150) can also perform collision avoidance, impact mitigation, and parking assistance functions. It can be designed to control the collision avoidance system, detect the possibility of a collision and warn the driver, or, if necessary, automatically activate braking means to avoid a collision. For parking assistance functions, the ECU can monitor the surrounding environment and control parking steering, parking detection, and automatic parking functions. Additionally, the integrated ECU (150) can perform the role of communicating with other systems in the vehicle and sharing information.

[0061] The head unit module (140) is typically located in the center of the vehicle and can be designed to be easily accessible to the driver and passengers. The head unit module (140) includes a display (141), a video signal receiving unit (142), and a control signal transmitting unit (143).

[0062] The head unit module (140) can provide a composite image to an occupant (including the driver and passenger) by receiving the composite image from the aforementioned around-view monitoring unit (120) and transmitting it to a display (141). A signal for the composite image is received through a video signal receiving unit (142), and the occupant is configured to be able to operate a control signal transmitting unit (143).

[0063] FIG. 5 is a diagram showing that the operation of a first type camera unit and a second type camera unit is distinguished in a driver assistance system according to an embodiment of the present invention.

[0064] Referring to FIG. 5, the camera unit equipped in the vehicle is shown in an embodiment classified into a first type and a second type. The first type camera unit (110a) refers to a camera unit equipped with a splitter board, and the second type camera unit (110b) refers to a camera unit not equipped with a splitter board.

[0065] The second type camera unit (110b) is configured to transmit a video signal by being connected to either the autonomous driving computation unit (130) or the around-view monitoring unit (120).

[0066] That is, a driver assistance system according to one embodiment of the present invention can be implemented as a system in which both the first and second type camera units (110a, 110b) are optimally mixed.

[0067] Meanwhile, such driver assistance systems may be configured to be connected to a user terminal for monitoring and control. The user terminal may include a communication-enabled desktop computer, laptop computer, notebook, smartphone, tablet PC, mobile phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant), etc.

[0068] The preferred embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the computer-readable medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software.

[0069] Examples of computer-readable media may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions may include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The aforementioned hardware devices may be configured to operate as at least one software module to perform the operation of the present invention, and vice versa.

[0070] In addition, the above-described method or device may be implemented by combining all or part of its configuration or function, or by implementing it separately.

[0071] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as described in the following claims.

Claims

Claim 1 A driver assistance system comprising: a camera unit provided at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle and outputting dual video signals; an around-view monitoring unit configured to receive a first video signal, which is one of the dual video signals, from the camera unit, and formed to generate a composite image of surrounding images centered on the vehicle in a preset manner based on the first video signal, and to transmit the composite image to a head unit module provided in the vehicle; and an autonomous driving computing unit configured to receive a second video signal, which is the other of the dual video signals, from the camera unit, and to determine driving control of the vehicle in a preset manner based on the second video signal; wherein the camera unit comprises a splitter board portion that splits the video signal acquired from the camera unit into the first video signal and the second video signal to output dual video signals; The camera unit comprises first to Nth camera units provided at preset locations of the vehicle to cover the entire surroundings of the vehicle, the first and second image signals branched by the splitter board are mutually identical image signals, the first to Nth camera units are respectively connected in parallel to the surround view monitoring unit and the autonomous driving computation unit, and the driver assistance system comprises an Mth camera unit provided on the rear side of the vehicle;The M-camera unit includes, when a reverse signal is input, the same video signal is transmitted to the around-view monitoring unit and the autonomous driving computation unit, thereby controlling the reverse operation of the vehicle from the autonomous driving computation unit and providing a composite image from the around-view monitoring unit; the camera unit includes an LVDS (Low-Voltage Differential Signaling) driver and is configured to transmit an LVDS video signal to the splitter board unit through the LVDS driver; the splitter board unit includes a FAKRA connector connected to the around-view monitoring unit and the autonomous driving computation unit, respectively; and a serializer element; A driver assistance system comprising: an around-view monitoring unit that is activated to generate the composite image when it is determined that the vehicle is in parking mode or that there is a request for around-view provision, even if the vehicle is in forward driving mode; and an autonomous driving computation unit that detects event situations including lane changes or stops of surrounding vehicles based on the second image signal and computes driving control commands for collision avoidance. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete

Images