Driver assistance system based on splitter board

Abstract

The present invention provides a driver assistance system based on a splitter board, comprising: a camera unit provided at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle; a splitter board connected to the camera unit, which receives an image signal acquired from the camera unit and splits it into a first image signal and a second image signal; an around-view monitoring unit configured to receive the first image signal from the splitter board, which generates a composite image of surrounding images centered on the vehicle in a preset manner based on the first image signal, and which transmits the composite image to a head unit module provided in the vehicle; and an autonomous driving computation unit configured to receive the second image signal from the splitter board, which determines driving control of the vehicle in a preset manner based on the second image signal.

Description

Technology Field

[0001] The present invention relates to a driver assistance system based on a splitter board. Background Technology

[0002] Recently, detection means capable of detecting obstacles are being installed for various purposes, such as detecting obstacles in the surroundings and blind spots including the rear of transportation equipment like vehicles, capturing traffic accident scenes, and securing data in the event of theft.

[0003] For example, the detection means may include a camera capable of taking images, an ultrasonic sensor capable of detecting obstacles located at the rear, front, or side.

[0004] Recently, the development and commercialization of smart vehicles are actively underway to enhance the safety and convenience of drivers and pedestrians. Smart vehicles are state-of-the-art automobiles that integrate Information and Communication Technology (IT), providing optimal traffic efficiency not only through the introduction of advanced systems within the vehicle itself but also through integration with intelligent transportation systems.

[0005] Specifically, intelligent vehicles maximize the safety and convenience of drivers, passengers, and pedestrians by performing autonomous driving functions, adaptive cruise control (ACC), obstacle detection, collision detection, providing precise maps, setting routes to destinations, and providing locations of key places.

[0006] The Around View Control System is attracting attention as one of the devices designed to maximize the safety and convenience of drivers, passengers, and pedestrians. The Around View Control System utilizes cameras to provide an around-view image centered on the vehicle, allowing the driver to control vehicle operations while monitoring the vehicle's surroundings in real time through the around-view video.

[0007] In addition, Advanced Driver Assistance Systems (ADAS) have recently been receiving significant attention, and many global automotive companies as well as research institutions are investing heavily in them, considering them a key future technology.

[0008] However, from the perspective of individual vehicles, the camera or sensor devices required for the surround view control system and the advanced driver assistance system are currently configured separately and controlled through distinct logic; consequently, the problem of being highly inefficient in terms of both operation and cost is continuously being raised. Prior art literature

[0009] Korean Registered Patent No. 10-2508984 The problem to be solved

[0010] The objective of the present invention, which aims to solve the aforementioned problems, is to propose a driver assistance system that improves the overall economic efficiency of the vehicle by simultaneously connecting an around-view system and an autonomous driving system using a camera unit already installed in the vehicle, thereby not only stabilizing the overall system but also reducing the number of camera units required for installation.

[0011] The technical problems to be solved in the various embodiments are not limited to those mentioned above, and other unmentioned technical problems may be considered by those skilled in the art from the various embodiments described below. means of solving the problem

[0012] The present invention provides a driver assistance system based on a splitter board, comprising: a camera unit provided at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle; a splitter board connected to the camera unit, which receives an image signal acquired from the camera unit and splits it into a first image signal and a second image signal; an around-view monitoring unit configured to receive the first image signal from the splitter board, which generates a composite image of surrounding images centered on the vehicle in a preset manner based on the first image signal, and which transmits the composite image to a head unit module provided in the vehicle; and an autonomous driving computation unit configured to receive the second image signal from the splitter board, which determines driving control of the vehicle in a preset manner based on the second image signal.

[0013] In addition, the camera unit may be composed of first to Nth camera units provided at preset locations on the vehicle to cover the entire surroundings of the vehicle.

[0014] In addition, the splitter board can split the image signal acquired from some of the camera units among the first to N camera units into the first and second image signals.

[0015] In addition, the first and second video signals branched by the splitter board may be mutually identical video signals.

[0016] In addition, the splitter board is independently provided to each of the first to Nth camera units, and the first to Nth camera units can be connected in parallel to the around-view monitoring unit and the autonomous driving computation unit.

[0017] In addition, the M camera unit is provided on the rear side of the vehicle, and when a reverse signal is input, the same video signal is transmitted to the around-view monitoring unit and the autonomous driving computing unit, thereby controlling the reverse movement of the vehicle from the autonomous driving computing unit and providing a composite image from the around-view monitoring unit.

[0018] In addition, the camera unit may include an LVDS (Low-Voltage Differential Signaling) driver and be configured to transmit an LVDS video signal to the splitter board through the LVDS driver.

[0019] In addition, the splitter board may include a FAKRA connector connected to the around-view monitoring unit and the autonomous driving computation unit, respectively; a de-serializer element; and a serializer element. Effects of the invention

[0020] The present invention utilizes a camera unit already installed in a vehicle to simultaneously connect an around-view system and an autonomous driving system, thereby not only stabilizing the overall system but also reducing the number of camera units required for installation, which can improve the overall economic efficiency of the vehicle.

[0021] The effects obtainable from various embodiments are not limited to those mentioned above, and other unmentioned effects can be clearly derived and understood by a person skilled in the art based on the detailed description below. Brief explanation of the drawing

[0022] Other aspects, features, and benefits of specific preferred embodiments of the present invention, as described above, will become more apparent from the following description in conjunction with the accompanying drawings. FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention. FIG. 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention. FIG. 3 is a diagram showing the operation of individual components during the forward driving mode of a driver assistance system according to one embodiment of the present invention. FIG. 4 is a diagram showing the operation of individual components during reverse driving mode of a driver assistance system according to one embodiment of the present invention. FIG. 5 is a block diagram of a splitter board of a driver assistance system according to one embodiment of the present invention. FIG. 6 is a block diagram showing a configuration in which a splitter board is connected to each camera unit in a driver assistance system according to one embodiment of the present invention. It should be noted that in the drawings above, similar reference numbers are used to illustrate identical or similar elements, features, and structures. Specific details for implementing the invention

[0023] The present invention is susceptible to various modifications and may have various embodiments; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the invention to specific embodiments, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each drawing.

[0024] Terms such as first, second, A, B, etc., may be used to describe various components, but the components should not be limited by these terms. The terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of multiple related described items or any of the multiple related described items.

[0025] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0026] The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "having" are intended to specify the presence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0027] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0028] Hereinafter, a driver assistance system according to an embodiment of the present invention will be described with reference to the drawings.

[0029] FIG. 1 is a block diagram of a driver assistance system according to one embodiment of the present invention, and FIG. 2 is a conceptual diagram of a driver assistance system according to one embodiment of the present invention.

[0030] Referring to FIGS. 1 and 2, the driver assistance system largely includes first to N camera units. FIG. 1 illustrates a configuration including first to fourth camera units (111, 112, 113, 114) as an example, but the value of N can be designed differently depending on the size, shape, use, model, etc. of the vehicle.

[0031] The camera unit (110) can be positioned at a preset location on the vehicle to capture images of the vehicle's surroundings in real time. Referring to FIG. 2, it is provided at the front, right side, left side, and rear of the vehicle, respectively, to monitor and sense the entire surroundings of the vehicle.

[0032] Each camera unit (110) is electrically connected to a splitter board (160). The camera unit (110) is configured to transmit video information captured in real time to the splitter board (160) in a state where it is encoded into a preset video signal. In this invention, the second camera unit (112) is described as an example.

[0033] The second camera unit (112) is connected to a splitter board (160). It is configured to output dual video signals using the splitter board (160).

[0034] The splitter board (160) is configured to split the video signal obtained from the second camera unit (112) into a first video signal and a second video signal, and then output them as a dual video signal.

[0035] Dual video signals mean that the first and second video signals are output independently of each other. As shown in FIG. 2, it can be seen that each camera unit (111, 112, 113, 114) transmits the first video signal and the second video signal independently to the around-view monitoring unit (120) and the autonomous driving computation unit (130). By doing so, the stability of the two systems—the system provided to the head unit module (140) through the around-view monitoring unit (120) and the system computed through the autonomous driving computation unit (130)—can be enhanced.

[0036] More specifically, the splitter board (160) may include an LVDS driver (not shown). LVDS (Low Voltage Differential Signaling) is a digital signal transmission method that uses low-voltage differential signals and can generally be implemented using a digital signal processing IC (Integrated Circuit). Referring first to FIGS. 5 and 6, the process of outputting dual video signals through the splitter board (160) can be observed.

[0037] FIG. 5 is a block diagram of a splitter board of a driver assistance system according to one embodiment of the present invention, and FIG. 6 is a block diagram showing a configuration in which a splitter board is connected to each camera unit in a driver assistance system according to one embodiment of the present invention.

[0038] Referring to FIG. 6, each of the first and second camera units (111, 112) includes an LVDS driver (111a, 112a), and the LVDS driver (111a, 112a) is connected to the first and second splitter boards (161, 162). By applying the splitter boards (161, 162) to the locations of each camera unit (111, 112) in this way, the camera units (111, 112) can be configured to be connected in parallel.

[0039] LVDS video signals can be enhanced and shaped primarily through driver and filter circuits. In this case, the aforementioned LVDS driver amplifies the current or voltage, and the filter performs the role of filtering out unnecessary noise. Additionally, to output dual LVDS video signals, a diffractor or splitter can be used to duplicate the signal, thereby allowing a single LVDS video signal to be split into two.

[0040] At this time, the first and second video signals branched by the splitter board (160) can be composed of mutually identical video signals. That is, it means that the signal is duplicated and transmitted. Referring to FIG. 5, the splitter board (160) shows that the same signal can be duplicated and branched into two through a serializer element. The serializer element is connected to a de-serializer element and can form a circuit connection with a PMIC, PoC Filter, etc.

[0041] The first video signal and the second video signal branched through the splitter (distributor) board (160) can be transmitted via at least one of hard wire or CAN (Controller Area Network) communication.

[0042] The around-view monitoring unit (120) includes a first video signal receiving unit (121) and a composite image generating unit (122).

[0043] The first video signal receiving unit (121) is configured to receive a first video signal, which is an LVDS video signal, from a splitter board (160). That is, the video signal transmitted from the splitter board (160) to the around-view monitoring unit (120) can be defined as the first video signal.

[0044] The composite image generation unit (122) generates a composite image of surrounding images centered on the vehicle based on a plurality of first image signals. At this time, the composite image may be configured in a planar form viewed from above. The around-view monitoring unit (120) is not always active and may be activated only in a specific control mode.

[0045] FIG. 3 is a drawing showing the operation of individual components in a forward driving mode of a driver assistance system according to one embodiment of the present invention, and FIG. 4 is a drawing showing the operation of individual components in a reverse driving mode of a driver assistance system according to one embodiment of the present invention.

[0046] Referring to FIGS. 3 and 4, as an example, the around-view monitoring unit (120) can be activated in reverse driving mode (a concept including parking mode, etc.). This is because the obstacle detection performed through the around-view monitoring unit (120) and the obstacle detection logic performed through the autonomous driving computation unit (130) can be designed differently. Since the around-view monitoring unit (120) generates a composite image targeting a static object, whereas the autonomous driving computation unit (130) is likely to perform detection targeting a dynamic object, the logic optimized for their purposes and targets can be distinguished from one another.

[0047] As another variation, the autonomous driving computation unit (130) can be activated in reverse driving mode to perform autonomous parking.

[0048] When a reverse signal is input to the M camera unit located at the rear of the vehicle (by the integrated ECU (150)), the same video signal is transmitted to the around-view monitoring unit (120) and the autonomous driving computation unit (130), thereby controlling the reverse movement of the vehicle by the autonomous driving computation unit (130) and providing a composite image by the around-view monitoring unit (120).

[0049] Looking at the example in FIG. 2, the second camera unit (112) is a camera provided on the rear side, and unlike the first, third, and fourth camera units (111, 113, 114), the second camera unit (112) can be operated as described above. In other words, this means that the activation of the splitter board (160) can be selectively operated depending on the position of the camera unit (112) and the operating mode of the vehicle.

[0050] However, even if the around view monitoring unit (120) is in 'forward execution mode', the around view monitoring unit (120) can be activated if it is determined that the vehicle is currently in parking mode. In addition to parking mode, if it is determined that there is a need to provide an around view to the vehicle's occupants (including the driver), the around view monitoring unit (120) can be operated regardless of forward / reverse mode.

[0051] The autonomous driving computation unit (130) includes a second video signal receiving unit (131) and a driving control computation unit (132).

[0052] The second video signal receiving unit (131) is configured to receive the second video signal, which is the other of the dual video signals, from the camera unit (110).

[0053] Referring again to FIG. 1, the LVDS video signal transmitted from the splitter (distributor) board (160) to the autonomous driving computation unit (130) can be defined as the 'second video signal'.

[0054] The driving control calculation unit (132) is configured to calculate the autonomous driving control command of the vehicle according to a preset method. As an example, the driving control calculation unit (132) may be configured to perform environment model (E / M) encoding to enable autonomous driving of the vehicle.

[0055] The environment model may refer to a model corresponding to surrounding environment data utilizing vehicle sensors (speed, location, direction, vehicle status) and autonomous driving sensors (V2X, cameras, etc.). In particular, network adaptation technology is essential to overcome communication environment limitations in order to implement autonomous driving, and includes uplink and downlink technologies as well as autonomous driving technology.

[0056] Among these, uplink technology is responsible for transmitting video and sensing signals, while downlink technology is responsible for generating and transmitting vehicle control commands from a remote location.

[0057] Using this environment model encoding, an trajectory for the vehicle's autonomous driving waypoints is generated, and the vehicle is configured to move along the said trajectory. At this time, the driving control operation unit (132) can detect an event situation and perform driving control corresponding to the event situation.

[0058] As an example, driving control to avoid collisions can be calculated by detecting cases such as a vehicle in an adjacent lane suddenly changing lanes and cutting in, or a preceding vehicle suddenly stopping. That is, in forward driving mode, a second video signal can be utilized to monitor surrounding vehicles centered on the target vehicle in real time and to detect changes in their speed.

[0059] The driving control calculation unit (132) can be connected to the vehicle's integrated ECU (150) to control the vehicle. The integrated ECU (150) is configured to be connected to and control all means for vehicle control. It can be connected to and control steering means, driving means (including engine and motor), braking means, sensing means, etc.

[0060] As an example, the integrated ECU (150) can perform the integration and processing of sensor information. The integrated ECU (150) effectively integrates and processes information collected from various sensors used in autonomous driving. These sensors include radar, LiDAR, cameras, ultrasonic sensors, etc.

[0061] Additionally, the integrated ECU (150) is configured to monitor the driving environment and control driving assistance functions. It detects other vehicles, pedestrians, obstacles, etc., while driving, analyzes them in real time, controls driving assistance functions, and assists the driver by automatically adjusting braking, steering, or acceleration when necessary. For example, Advanced Cruise Control (ACC) and Lane Departure Warning and Correction may be included here.

[0062] Additionally, the integrated ECU (150) can also perform collision avoidance, impact mitigation, and parking assistance functions. It can be designed to control the collision avoidance system, detect the possibility of a collision and warn the driver, or, if necessary, automatically activate braking means to avoid a collision. For parking assistance functions, the ECU can monitor the surrounding environment and control parking steering, parking detection, and automatic parking functions. Additionally, the integrated ECU (150) can perform the role of communicating with other systems in the vehicle and sharing information.

[0063] The head unit module (140) is typically located in the center of the vehicle and can be designed to be easily accessible to the driver and passengers. The head unit module (140) includes a display (141), a video signal receiving unit (142), and a control signal transmitting unit (143).

[0064] The head unit module (140) can provide a composite image to an occupant (including the driver and passenger) by receiving the composite image from the aforementioned around-view monitoring unit (120) and transmitting it to a display (141). A signal for the composite image is received through a video signal receiving unit (142), and the occupant is configured to be able to operate a control signal transmitting unit (143).

[0065] Referring to FIG. 6, each camera unit (111, 112) is configured to be connected to a splitter board (161, 162). Although it is shown in a separated state in FIG. 6, depending on the designer's choice, the splitter board (161, 162) may be physically embedded within each camera unit (111, 112).

[0066] Meanwhile, such driver assistance systems may be configured to be connected to a user terminal for monitoring and control. The user terminal may include a communication-enabled desktop computer, laptop computer, notebook, smartphone, tablet PC, mobile phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant), etc.

[0067] The preferred embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the computer-readable medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software.

[0068] Examples of computer-readable media may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions may include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The aforementioned hardware devices may be configured to operate as at least one software module to perform the operation of the present invention, and vice versa.

[0069] In addition, the above-described method or device may be implemented by combining all or part of its configuration or function, or by implementing it separately.

[0070] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as described in the following claims.

Claims

Claim 1 A driver assistance system based on a splitter board, comprising: a camera unit provided at a preset location of the vehicle to enable real-time capture of surrounding images of the vehicle; a splitter board connected to the camera unit, which receives an image signal acquired from the camera unit and splits it into a first image signal and a second image signal; an around-view monitoring unit configured to receive the first image signal from the splitter board, which generates a composite image of surrounding images centered on the vehicle in a preset manner based on the first image signal, and which transmits the composite image to a head unit module provided in the vehicle; and an autonomous driving computing unit configured to receive the second image signal from the splitter board, which determines driving control of the vehicle in a preset manner based on the second image signal. The camera unit comprises first to Nth camera units provided at preset locations of the vehicle to cover the entire surroundings of the vehicle, and the splitter board branches a video signal acquired from some of the first to Nth camera units into a first and a second video signal, and furthermore, the first and second video signals branched by the splitter board are mutually identical video signals, and the splitter board is independently provided to each of the first to Nth camera units, and the first to Nth camera units are connected in parallel to the surround view monitoring unit and the autonomous driving computation unit, and the driver assistance system comprises an Mth camera unit provided on the rear side of the vehicle;A driver assistance system comprising: a camera unit, wherein when a reverse signal is input, the same video signal is transmitted to the around-view monitoring unit and the autonomous driving computation unit, thereby controlling the reverse movement of the vehicle by the autonomous driving computation unit and providing a composite image from the around-view monitoring unit; wherein the camera unit includes an LVDS (Low-Voltage Differential Signaling) driver and transmits an LVDS video signal to the splitter board through the LVDS driver; and wherein the splitter board includes a FAKRA connector connected to the around-view monitoring unit and the autonomous driving computation unit, respectively; a de-serializer element; and a serializer element. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete

Images