Dual image signal output-based driver assistance system comprising camera

Abstract

The present invention provides a driver assistance system comprising: a camera unit which is provided at a preset position of a vehicle such that images of the surroundings of a vehicle can be captured in real time, and which outputs dual image signals; an around view monitoring unit for receiving, from the camera unit, a first image signal, which is any one of the dual image signals, generating a composite image of the images of the surroundings of the vehicle at the center in a preset scheme on the basis of the first image signal, and transmitting the composite image to a head unit module provided in the vehicle; and an autonomous driving calculation unit for receiving, from the camera unit, a second image signal, which is the other of the dual image signals, and determining driving control of the vehicle in a preset scheme on the basis of the second image signal.

Description

Driver assistance system including a camera based on dual video signal output

[0001] The present invention relates to a driver assistance system including a camera based on dual image signal output.

[0002] This invention was developed based on the project titled "Development of Cloud-Based Cause Analysis Technology through Transmission of Abnormal Driving Data" (Project Number: RS-202300232046, Project Name: Autonomous Driving Technology Development Innovation Project, Central Administrative Agency / Specialized Institution: Ministry of Science and ICT / National IT Industry Promotion Agency)

[0003] Recently, detection devices capable of detecting obstacles are being installed for various purposes, such as detecting obstacles in the surroundings and blind spots, including the rear of transportation devices such as vehicles, filming traffic accidents, and securing data in the event of theft.

[0004] For example, the detection means may include a camera capable of taking pictures, an ultrasonic sensor capable of detecting obstacles located at the rear, front, or side, etc.

[0005] Recently, the development and commercialization of intelligent vehicles (Smart Vehicles) are actively underway to ensure the safety and convenience of drivers and pedestrians. Smart vehicles are cutting-edge vehicles that integrate information and communication technology (IT). They offer optimal transportation efficiency not only through the introduction of advanced systems within the vehicle itself, but also through integration with intelligent transportation systems.

[0006] Specifically, intelligent vehicles maximize the safety and convenience of drivers, passengers, and pedestrians by performing autonomous driving functions, adaptive cruise control (ACC), obstacle detection, collision detection, providing precise maps, setting routes to destinations, and providing locations for key locations.

[0007] As a device designed to maximize the safety and convenience of drivers, passengers, and pedestrians, the around-view control system is attracting attention. The around-view control system uses a camera to provide an around-view image centered on the vehicle, allowing the driver to control vehicle operations while viewing the surroundings in real time.

[0008] In addition, Advanced Driver Assistance Systems (ADAS) have recently been receiving significant attention, and many global automobile companies as well as research institutes are investing heavily in them, considering them to be a key future technology.

[0009] However, from the perspective of individual vehicles, the cameras and sensor devices required for the around-view control device and the advanced driver assistance system are each configured separately and controlled through separate logic, which is highly inefficient and uneconomical not only in terms of operation but also in terms of cost.

[0010] The purpose of the present invention to solve the above problems is to propose a driver assistance system that can reduce the number of camera units installed as well as stabilize the overall system by applying a camera unit that can be combined with an around view system and an autonomous driving system, thereby improving the overall economy of the vehicle.

[0011] The technical tasks to be achieved in various embodiments are not limited to those mentioned above, and other technical tasks not mentioned can be considered by a person having ordinary skill in the art from the various embodiments described below.

[0012] The present invention provides a driver assistance system, comprising: a camera unit that is installed at a preset location of a vehicle to capture a surrounding image of the vehicle in real time and outputs a dual image signal; an around view monitoring unit that is configured to receive a first image signal, which is one of the dual image signals, from the camera unit, and generate a composite image of a surrounding image centered on the vehicle in a preset manner based on the first image signal, and transmit the composite image to a head unit module installed in the vehicle; and an autonomous driving operation unit that is configured to receive a second image signal, which is the other of the dual image signals, from the camera unit, and determine driving control of the vehicle in a preset manner based on the second image signal.

[0013] In addition, the camera unit may include a splitter board that splits the image signal obtained from the camera unit into the first image signal and the second image signal to output a dual image signal.

[0014] Additionally, the camera unit may be configured with first to Nth camera units installed at preset locations of the vehicle to cover the entire periphery of the vehicle.

[0015] Additionally, the first and second video signals split by the splitter board may be identical video signals.

[0016] Additionally, the first to Nth camera units may be connected in parallel to the around view monitoring unit and the autonomous driving operation unit, respectively.

[0017] In addition, the M camera unit is installed on the rear side of the vehicle, and when a reverse signal is input, the same image signal is transmitted to the around view monitoring unit and the autonomous driving operation unit, so that the reverse operation of the vehicle is controlled from the autonomous driving operation unit, and a composite image can be provided from the around view monitoring unit.

[0018] In addition, the camera unit may include an LVDS (Low-Voltage Differential Signaling) driver and be configured to transmit an LVDS image signal to the splitter board unit through the LVDS driver.

[0019] In addition, the splitter board unit may include a FAKRA connector connected to the around view monitoring unit and the autonomous driving operation unit, respectively; and a serializer element.

[0020] The present invention applies a camera unit that can be combined with an around-view system and an autonomous driving system, thereby stabilizing the overall system and reducing the number of camera units to be installed, thereby improving the overall economic efficiency of the vehicle.

[0021] The effects that can be obtained from various embodiments are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly derived and understood by a person having ordinary skill in the art based on the detailed description below.

[0022] Other aspects, features and advantages of the above-described specific preferred embodiments of the present invention will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0023] FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention.

[0024] Figure 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention.

[0025] FIG. 3 is a drawing showing the operation of individual components in a forward driving mode of a driver assistance system according to one embodiment of the present invention.

[0026] FIG. 4 is a drawing showing the operation of individual components in a reverse driving mode of a driver assistance system according to one embodiment of the present invention.

[0027] FIG. 5 is a drawing showing that the operations of a first type camera unit and a second type camera unit are distinguished in a driver assistance system according to one embodiment of the present invention.

[0028] Figure 6 is a block diagram of a camera unit of a driver assistance system according to one embodiment of the present invention.

[0029] It should be noted that throughout the drawings, like reference numerals are used to illustrate identical or similar elements, features and structures.

[0030] The present invention is susceptible to various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention. Throughout the description of each drawing, similar reference numerals have been used to designate similar components.

[0031] Terms such as "first," "second," "A," and "B" may be used to describe various components, but the components should not be limited by these terms. The terms are used solely to distinguish one component from another. For example, without departing from the scope of the present invention, the first component could be referred to as the "second component," and similarly, the second component could also be referred to as the "first component." The term "and / or" includes any combination of multiple related items or any one of multiple related items.

[0032] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0033] The terminology used in this application is only used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that the terms "comprise" or "have" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0034] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0035] Hereinafter, a driver assistance system according to one embodiment of the present invention will be described with reference to the drawings.

[0036] FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention, and FIG. 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention.

[0037] Referring to FIGS. 1 and 2, the driver assistance system largely includes first to N camera units. As an example, FIG. 1 illustrates a configuration including first to fourth camera units (111, 112, 113, 114), but the N value may be designed differently depending on the size, shape, purpose, model, etc. of the vehicle.

[0038] The camera unit (110) can be positioned at a preset location on the vehicle to enable real-time capture of the vehicle's surroundings. Referring to FIG. 2, the camera unit (110) is positioned at the front, right, left, and rear of the vehicle, respectively, to monitor and sense the entire surroundings of the vehicle.

[0039] Each camera unit (110) includes a splitter board unit (1111, 1121, 1131, 1141). In this application, the second camera unit (112) is described as an example.

[0040] The second camera unit (112) includes a second splitter (distributor) board (1121) and is configured to output dual image signals using the second splitter (distributor) board (1121).

[0041] As illustrated in FIG. 2, the first to fourth camera units (111, 112, 113, 114) can be designed in circuit to be connected in parallel to the around view monitoring unit (120) and the autonomous driving operation unit (130), respectively.

[0042] The second splitter (distributor) board (1121) is configured to split the image signal acquired from the second camera unit (112) into a first image signal and a second image signal, and then output them as a dual image signal.

[0043] Dual video signals mean that the first and second video signals are output independently. As illustrated in FIG. 2, each camera unit (111, 112, 113, 114) can be seen to independently transmit the first and second video signals to the around-view monitoring unit (120) and the autonomous driving operation unit (130). This allows for enhancing the stability of the system provided to the head unit module (140) through the around-view monitoring unit (120) and the two systems operated through the autonomous driving operation unit (130).

[0044] To be more specific, the second splitter (distributor) board unit (1121) may include an LVDS driver (not shown). LVDS (Low Voltage Differential Signaling) is a digital signal transmission method that uses a low voltage differential signal, and can generally be implemented using a digital signal processing IC (Integrated Circuit). Referring first to FIG. 6, the process of outputting a dual video signal through the second splitter (distributor) board unit (1121) can be confirmed.

[0045] LVDS video signals can be amplified and shaped primarily through driver and filter circuits. The aforementioned LVDS driver amplifies current or voltage, while the filter filters out unnecessary noise. Furthermore, to output LVDS video signals in dual channels, a diffractor or splitter can be used to duplicate the signal, thereby splitting a single LVDS video signal into two.

[0046] At this time, the first and second video signals branched by the second splitter board (1121) can be composed of identical video signals. That is, the signal is copied and transmitted. Referring to Fig. 6, the second splitter board (1121) shows that the same signal can be copied and branched into two through a serializer element.

[0047] The first video signal and the second video signal branched through the second splitter (distributor) board (1121) can be transmitted through at least one of hard wire or CAN (Controller Area Network) communication.

[0048] The around view monitoring unit (120) includes a first image signal receiving unit (121) and a synthetic image generating unit (122).

[0049] The first video signal receiving unit (121) is configured to receive the first video signal, which is an LVDS video signal, from the camera unit (110). That is, the video signal transmitted from the camera unit (110) to the around view monitoring unit (120) can be defined as the first video signal.

[0050] The composite image generation unit (122) generates a composite image of the surrounding images centered on the vehicle based on multiple first image signals. The composite image may be configured as a plane view of the vehicle from above. The around-view monitoring unit (120) is not always activated and may only be activated in a specific control mode.

[0051] FIG. 3 is a drawing showing the operation of individual components in a forward driving mode of a driver assistance system according to one embodiment of the present invention, and FIG. 4 is a drawing showing the operation of individual components in a reverse driving mode of a driver assistance system according to one embodiment of the present invention.

[0052] Referring to FIGS. 3 and 4, as an example, the around view monitoring unit (120) can be activated in reverse driving mode (including parking mode, etc.). This is because the obstacle detection logic performed by the around view monitoring unit (120) and the obstacle detection logic performed by the autonomous driving operation unit (130) can be designed differently. While the around view monitoring unit (120) generates a synthetic image targeting a static object, the autonomous driving operation unit (130) is likely to perform detection targeting a dynamic object, and therefore, the logic optimized for their purposes and targets can be differentiated from each other.

[0053] As another variation, the autonomous driving operation unit (130) may be activated and set to perform autonomous parking even in reverse driving mode.

[0054] The M camera unit installed on the rear side of the vehicle transmits the same image signal to the around view monitoring unit (120) and the autonomous driving operation unit (130) when a reverse signal is input (by the integrated ECU (150)), so that the reverse operation of the vehicle is controlled by the autonomous driving operation unit (130) and a composite image can be provided by the around view monitoring unit (120).

[0055] Referring to the example of Fig. 2, the second camera unit (112) is a camera provided on the rear side, and unlike the first, third and fourth camera units (111, 113, 114), the second camera unit (112) can be operated as described above.

[0056] However, even in forward driving mode, the around view monitoring unit (120) may be activated if it is determined that the current vehicle is in parking mode. In addition to parking mode, if it is determined that it is necessary to provide an around view to the vehicle's passengers (including the driver), the around view monitoring unit (120) may be operated regardless of the forward or reverse driving mode.

[0057] The autonomous driving operation unit (130) includes a second image signal receiving unit (131) and a driving control operation unit (132).

[0058] The second video signal receiving unit (131) is configured to receive the second video signal, which is another of the dual video signals, from the camera unit (110). Referring again to FIG. 1, taking the example of the second camera unit (112), the LVDS video signal transmitted from the second splitter (distributor) board unit (1121) of the second camera unit (112) to the autonomous driving operation unit (130) can be defined as the 'second video signal'.

[0059] The driving control calculation unit (132) is configured to calculate autonomous driving control commands for the vehicle according to a preset method. As an example, the driving control calculation unit (132) may be configured to perform environmental model (E / M) encoding to enable autonomous driving of the vehicle.

[0060] An environmental model can refer to a model of the surrounding environment data using vehicle sensors (speed, position, direction, vehicle status) and autonomous driving sensors (V2X, cameras, etc.). In particular, network adaptation technology is essential to overcome the communication environment to implement autonomous driving, including uplink and downlink technologies, as well as autonomous driving technology.

[0061] Among these, uplink technology is responsible for transmitting video signals and sensing signals, and downlink technology is responsible for generating and transmitting vehicle control commands from a remote location.

[0062] Using this environmental model encoding, a trajectory for the vehicle's autonomous driving waypoints is generated, and the vehicle is configured to move along the trajectory. At this time, the driving control computation unit (132) can detect event situations and perform driving control in response to the event situations.

[0063] For example, collision avoidance control can be calculated by detecting situations such as a vehicle in an adjacent lane suddenly changing lanes and cutting in, or a preceding vehicle suddenly stopping. In other words, in forward driving mode, a second video signal can be utilized to monitor surrounding vehicles in real time, focusing on the target vehicle, and detect changes in their speed.

[0064] The driving control operation unit (132) is connected to the vehicle's integrated ECU (150) and can control the vehicle. The integrated ECU (150) is configured to be connected to all means for vehicle control and control them. It can be connected to and control steering means, driving means (including an engine and motor), braking means, sensing means, etc.

[0065] As an example, the integrated ECU (150) can integrate and process sensor information. The integrated ECU (150) effectively integrates and processes information collected from various sensors used in autonomous driving. These sensors include radar, LiDAR, cameras, and ultrasonic sensors.

[0066] Additionally, the integrated ECU (150) is configured to monitor the driving environment and control driving assistance functions. It detects other vehicles, pedestrians, obstacles, etc. during driving, analyzes them in real time, controls driving assistance functions, and automatically adjusts braking, steering, or acceleration when necessary to support the driver. Examples of these functions include Advanced Cruise Control (ACC), Lane Departure Warning and Correction (LDW).

[0067] Additionally, the integrated ECU (150) can also perform collision avoidance and impact mitigation functions, as well as parking assistance functions. It can be designed to control the collision avoidance system, detect the possibility of a collision, warn the driver, or automatically apply braking if necessary to avoid a collision. For parking assistance functions, the ECU can monitor the surrounding environment and control parking steering, parking detection, and automatic parking functions. Furthermore, the integrated ECU (150) can communicate and share information with other systems within the vehicle.

[0068] The head unit module (140) is typically located in the center of the vehicle and may be designed to be easily accessible to the driver and passengers. The head unit module (140) includes a display (141), a video signal receiving unit (142), and a control signal transmitting unit (143).

[0069] The head unit module (140) receives a composite image from the above-described around view monitoring unit (120) and transmits it to the display (141), thereby providing it to the occupants (including the driver and passengers). The signal for the composite image is received through the image signal receiving unit (142), and the occupants are configured to be able to operate the control signal transmitting unit (143).

[0070] FIG. 5 is a drawing showing that the operations of a first type camera unit and a second type camera unit are distinguished in a driver assistance system according to one embodiment of the present invention.

[0071] Referring to Fig. 5, the camera unit equipped in the vehicle shows an embodiment that is divided into a first type and a second type. The first type camera unit (110a) refers to a camera unit equipped with a splitter (distributor) board, and the second type camera unit (110b) refers to a camera unit that does not have a splitter (distributor) board.

[0072] The second type camera unit (110b) is configured to be connected to either the autonomous driving operation unit (130) or the around view monitoring unit (120) and transmit a video signal.

[0073] That is, the driver assistance system according to one embodiment of the present invention can be implemented as a system in which both the first and second type camera units (110a, 110b) are optimally mixed.

[0074] Meanwhile, such a driver assistance system may be configured to be connected to a user terminal and monitored and controlled. The user terminal may include a communication-capable desktop computer, laptop computer, notebook, smart phone, tablet PC, mobile phone, smart watch, smart glass, e-book reader, portable multimedia player (PMP), portable game console, navigation device, digital camera, digital multimedia broadcasting (DMB) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant), etc.

[0075] The preferred embodiments of the present invention described above may be implemented in the form of program commands that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the computer-readable medium may be those specifically designed and constructed for the present invention, or may be known and usable by those skilled in the art of computer software.

[0076] Examples of computer-readable media may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions may include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate with at least one software module to perform the operations of the present invention, and vice versa.

[0077] Additionally, the above-described method or device may be implemented by combining all or part of its configuration or function, or may be implemented separately.

[0078] Although the present invention has been described above with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various modifications and changes may be made to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below.

Claims

1. As a driver assistance system, A camera unit installed at a preset location of the vehicle to enable real-time recording of surrounding images of the vehicle and outputting dual image signals; An around view monitoring unit configured to receive a first image signal, which is one of the dual image signals, from the camera unit, and generate a composite image of the surrounding images centered on the vehicle in a preset manner based on the first image signal, and transmit the composite image to a head unit module equipped in the vehicle; and An autonomous driving operation unit configured to receive a second image signal, which is another of the dual image signals, from the camera unit, and determines driving control of the vehicle in a preset manner based on the second image signal; Driver assistance systems.

2. In paragraph 1, The above camera unit, A splitter board section that splits the image signal acquired from the camera unit into the first image signal and the second image signal to output a dual image signal; Driver assistance systems.

3. In paragraph 2, The above camera unit, Consisting of first to Nth camera units installed at preset locations of the vehicle to cover the entire surroundings of the vehicle, Driver assistance systems.

4. In paragraph 2, The first and second video signals split by the splitter board are, The video signals are identical to each other, Driver assistance systems.

5. In paragraph 3, The above first to Nth camera units, Connected in parallel to the above-mentioned around view monitoring unit and autonomous driving operation unit, respectively. Driver assistance systems.

Images