Vehicle warning device and vehicle auxiliary line adjustment device

Abstract

To improve an alarm section when an obstacle appears in a dead angle area when a vehicle turns.SOLUTION: There is provided a vehicle alarm device and a vehicle auxiliary line adjustment device. The vehicle alarm device comprises: an image capturing device; a vehicle control signal capturing device; and a processor. The image capturing device captures an image outside a vehicle. The vehicle control signal capturing device captures a direction change signal of the vehicle. The processor regulates first and second auxiliary lines, determines whether a target object of the image contacts an alarm section formed between the first and second auxiliary lines, and generates an alarm signal according to determination. The processor further dynamically adjusts the first auxiliary line and / or the second auxiliary line according to the direction change signal to adjust the alarm section.SELECTED DRAWING: None

Description

[Technical Field]

[0001] The present invention relates to a vehicle warning device, and more particularly to a vehicle warning device and a vehicle auxiliary line adjustment device associated with a vehicle auxiliary line. [Background technology]

[0002] In a conventional vehicle warning system, a warning area having a fixed preset range is displayed on a display device, and an image of the area behind the vehicle is displayed on the display device, and whether to generate and transmit a warning is determined depending on whether an object in the image is within the warning area. Summary of the Invention [Problem to be solved by the invention]

[0003] However, since the range of the conventional warning area is fixed, it is difficult for the conventional warning area to cover the blind spot area that is generated when the vehicle turns. In other words, when obstacles appear in the blind spot area when the vehicle is turning, it is difficult to detect these obstacles using the conventional warning area. Therefore, there is a need to improve the conventional warning area. [Means for solving the problem]

[0004] To solve at least the above-mentioned problems, one embodiment of the present invention provides a vehicle alarm system. According to one embodiment of the present invention, there is provided a vehicle warning device comprising: an image capturing device disposed on a vehicle and configured to capture an image of an area outside the vehicle; a vehicle control signal capturing device configured to capture a direction change signal for the vehicle; and a processor electrically connected to the image capturing device and the vehicle control signal capturing device, wherein the processor is configured to define a first auxiliary line and a second auxiliary line to form a warning area between the first auxiliary line and the second auxiliary line; identify a target object in the image; determine whether the target object is in contact with the warning area defined by the first auxiliary line and the second auxiliary line; and generate a warning signal if it is determined that the target object is in contact with the warning area, and the processor is further configured to dynamically adjust the first auxiliary line and / or the second auxiliary line in accordance with the direction change signal to adjust the warning area.

[0005] To solve at least the above problem, the present invention further provides a vehicle auxiliary line adjustment device. A vehicle assistance line adjustment apparatus according to one embodiment of the present invention includes a vehicle control signal acquisition device configured to acquire a vehicle direction change signal, and a processor electrically connected to the vehicle control signal acquisition device, wherein the processor is configured to define a first assistance line and a second assistance line to form a warning area between the first assistance line and the second assistance line, and dynamically adjust the first assistance line and / or the second assistance line according to the direction change signal to adjust the warning area.

[0006] As described above, the vehicle warning device and vehicle auxiliary line adjustment device according to the present invention dynamically adjust the first auxiliary line and the second auxiliary line depending on whether one or more steering wheels (wheels) of the vehicle are rotating, thereby dynamically changing the effective range of the warning area formed between the first auxiliary line and the second auxiliary line. Therefore, regardless of whether the vehicle is stationary or moving, the vehicle warning device and vehicle auxiliary line adjustment device according to the present invention can dynamically adjust the warning area to cover all blind spot areas of the vehicle as long as one or more steering wheels of the vehicle are turned. The vehicle warning device and vehicle auxiliary line adjustment device according to the present invention can effectively overcome the above-mentioned problems.

[0007] The above is not intended to limit the present invention, but merely to generally explain the technical problems that the present invention can solve, the technical means that the present invention can adopt, and the technical effects that the present invention can achieve, and to provide a preliminary understanding of the present invention to those skilled in the art. Those skilled in the art can further understand the details of various embodiments of the present invention from the accompanying drawings and the following description of the embodiments. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram illustrating the configuration of a vehicle warning device and a vehicle auxiliary line adjustment device according to some embodiments of the present invention. [Figure 2A] FIG. 10 is a schematic diagram illustrating a method for dynamically adjusting vehicle assistance lines in accordance with various embodiments of the present invention. [Figure 2B] FIG. 10 is a schematic diagram illustrating a method for dynamically adjusting vehicle assistance lines in accordance with various embodiments of the present invention. [Figure 2C] FIG. 10 is a schematic diagram illustrating a method for dynamically adjusting vehicle assistance lines in accordance with various embodiments of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] The present invention will now be described with reference to several embodiments. However, these embodiments are not intended to limit the invention to be practiced solely in accordance with the operations, environments, applications, structures, flow processes or steps described herein. Elements irrelevant to the present invention may be omitted from the drawing but may be implied in the accompanying drawings. In the accompanying drawings, the dimensions and scales between individual elements are provided for illustrative purposes only and are not intended to limit the present invention. Unless otherwise specified, in the following description, the same (or similar) reference numerals may correspond to the same (or similar) elements. Unless otherwise specified, the number of each element described below may be one or more, but may be implemented.

[0010] The terminology used in the present disclosure is for the purpose of describing embodiments only and is not intended to be limiting of the invention. Unless the context clearly dictates otherwise, the singular forms "a / an / one" are intended to include the plural forms as well. Terms such as "comprise" and "comprise" indicate the presence of features, integers, steps, operations, elements and / or components described herein, but do not exclude the presence of one or more other features, integers, steps, operations, elements, components and / or combinations thereof. The term "and / or" includes any and all combinations of one or more of the associated listed items.

[0011] Unless the context dictates otherwise, descriptors such as "first auxiliary line," "second auxiliary line," "first subsection," "second subsection," and "third subsection" are used merely to distinguish the elements preceded by such descriptor, and such descriptors should not be construed as indicating a sequence.

[0012] FIG. 1 is a schematic diagram showing the configuration of a vehicle alarm device 1 according to the present invention. The contents shown in FIG. 1 are merely illustrative of some embodiments of the present invention and are not intended to limit the scope of the claimed invention.

[0013] Referring to Figure 1, a vehicle alarm device 1 according to an embodiment of the present invention may comprise an image capturing device 100, a vehicle control signal capturing device 200, a processor 300, a storage device 400, and other elements. The processor 300 is electrically connected to the image capturing device 100 , the vehicle control signal capturing device 200 and the storage device 400 .

[0014] The image capture device 100 may be positioned on a vehicle to capture an image V1 of the exterior of the vehicle. The images V1 may be images or images within a video taken in different directions, for example images or images within a video taken in front, behind and to the sides of the vehicle.

[0015] The vehicle control signal capturing device 200 may be electrically connected to the vehicle's vehicle control unit C10 and may be configured to capture all vehicle control signals from the vehicle control unit C10, including the direction change signal S1 related to the rotation of the vehicle's steering wheel.

[0016] For example, the vehicle control signal capturing device 200 receives signals from the vehicle control unit C10 via a CAN (Controller Area Network), a LIN (Local Interconnect Network), a UART (Universal Asynchronous Receiver / Transmitter), or an I / O (Interface). 2 A direction change signal S1 related to the rotation of the steering wheel of the vehicle can be received through an Inter-Integrated Circuit (C).

[0017] The processor 300 may be a microprocessor or microcontroller capable of signal processing or the like. A microprocessor or microcontroller is a type of programmable integrated circuit capable of operation, storage, output / input, etc. Furthermore, a microprocessor or microcontroller may receive and process various coded instructions to perform various logical and arithmetic operations and output corresponding operation results.

[0018] The processor 300 may be programmed to perform various operations or programs within the vehicle alarm device 1 . The processor 300 may be configured to define a first auxiliary line and a second auxiliary line and to form a warning area between the first auxiliary line and the second auxiliary line. For example, the processor 300 may define the first and second auxiliary lines according to the size of the vehicle and the installation position of the image capturing device 100 . The processor 300 may be further configured to transmit data of the first auxiliary line and the second auxiliary line to the display device 500 and display the first auxiliary line and the second auxiliary line on the display device 500.

[0019] The warning area between the first auxiliary line and the second auxiliary line may be a single area or may be further divided into multiple areas. For example, the processor 300 may divide the warning area into at least two sub-areas, with different sub-areas corresponding to different danger levels.

[0020] The processor 300 may be further configured to identify one or more target objects in the image V1 and determine whether the one or more target objects are in contact with the warning area defined by the first auxiliary line and the second auxiliary line. Image V1 may contain multiple objects within it, and the target object is the only object used to determine whether the warning zone is touching. In other words, the processor 300 does not need to make a determination for every object in the image V1. In some embodiments, the processor 300 may identify one or more target objects from the image V1 through a neural network model and then make a decision about only the one or more target objects.

[0021] Neural network models are object recognition models that are pre-generated through machine learning and training. The machine training process may use neural network algorithms such as subpixel multiple filtering, convolution, linear equalization correction, and adaptive pooling.

[0022] In some embodiments, the processor 300 may identify one or more target objects from the image V1 by comparing the objects in the image V1 with a target object database, and then make a decision about only the one or more target objects.

[0023] For example, processor 300 may identify a person or a vehicle in image V1 as a target object and identify other objects in image V1 (e.g., weeds, fast-flying paper, or birds) as general objects, and then determine only whether the person or vehicle in image V1 is in contact with the warning area formed between the first auxiliary line and the second auxiliary line.

[0024] When the processor 300 determines that a particular target object is in contact with the warning area, the processor 300 generates a warning signal.

[0025] In some embodiments, the processor 300 is further configured to transmit an alert signal to the display device 500 , another display device (not shown), and / or an alert device 600 .

[0026] For example, the warning device 600 may be an optical warning device or an audible warning device, where an optical warning device may be, for example, a warning lamp on the vehicle, while an audible warning device may be, for example, a speaker on the vehicle (which provides a warning by sound or voice). The other display device may be one of a variety of portable devices or a variety of cloud devices.

[0027] In some embodiments, before identifying one or more target objects from image V1, processor 300 may also perform image pre-processing on image V1.

[0028] For example, the processor 300 may perform image preprocessing such as cropping, enlarging or reducing the image V1, or adjusting the contrast and resolution of the image V1 in advance, according to the current light brightness inside and outside the vehicle, the specifications of the display device 500, and / or the display positions of the first and second auxiliary lines on the screen of the display device 500, etc.

[0029] The storage device 400 may be configured to store data generated by the vehicle alarm device 1 or data transmitted from outside the vehicle alarm device 1 . For example, the storage device 400 may be configured to store the image V1, data relating to the first and second auxiliary lines, a target object database, and the like.

[0030] The storage device 400 may comprise a primary memory (also called a main memory or internal memory), and the processor 300 may directly read instruction sets stored in the primary memory and execute these instruction sets when necessary. The storage device 400 may optionally include secondary memory (also called external memory or auxiliary memory) that may transmit data to the primary memory through a data buffer.

[0031] The secondary memory may be, for example, but not limited to, a hard disk, an optical disk, etc. Storage device 400 may optionally comprise tertiary memory, ie, a storage device that may be plugged directly into the computer or may be removable from the computer, such as a portable hard disk. The storage device 400 may also optionally comprise a cloud storage unit.

[0032] This will be explained with reference to Figures 2A, 2B and 2C. The processor 300 may also be configured to dynamically adjust the first auxiliary line and / or the second auxiliary line according to the direction change signal S1 captured by the vehicle control signal capturing device 200 to adjust the warning area.

[0033] 2A-2C are schematic diagrams illustrating methods for dynamically adjusting vehicle assistance lines according to various embodiments of the present invention. The contents shown in Figures 2A to 2C are merely illustrative of some embodiments of the present invention and are not intended to limit the scope of the present invention.

[0034] Referring first to FIG. 2A, it is assumed that a first auxiliary line A1, a second auxiliary line A2 and a warning area B are displayed on the display device 500, and the warning area B includes a first sub-area B10, a second sub-area B20 and a third sub-area B30.

[0035] Furthermore, the first sub-area B10 is the area closest to vehicle C, while the third sub-area B30 is the farthest from vehicle C, and therefore the first sub-area B10 corresponds to the highest danger level, while the third sub-area B30 corresponds to the lowest danger level.

[0036] In some embodiments, the processor 300 may mark the coverage areas of the three sub-zones in different colors on the display device 500 to represent different risk levels. For example, the coverage areas of the first sub-area B10, the second sub-area B20 and the third sub-area B30 are filled in red, yellow and green, respectively.

[0037] When the display device 500 indicates that the target object T in the image V1 is touching the warning area B, this means that the processor 300 determines a danger level corresponding to the sub-area of ​​the warning area B that the target object T is touching and generates a corresponding warning signal.

[0038] For example, the first sub-zone B10 is the closest zone to vehicle C, so vehicle C is more likely to be in contact with the first sub-zone B10. Thus, if the processor 300 determines that the target object T in the image V1 is in contact with or appears within the first sub-area B10, the alarm signal S2 generated by the processor 300 causes the display device 500 and / or the alarm device 600 to issue an alarm in the form of an emergency alarm sound, flashing light and / or voice, etc.

[0039] If the processor 300 determines that the target object T in the image V1 is in contact with or appears within the second sub-area B20, the alarm signal S2 generated by the processor 300 causes the display device 500 and / or the alarm device 600 to issue an alarm in the form of a steady alarm sound, a flashing light and / or a voice, etc. This is because the second sub-zone B20 is some distance away from the vehicle C.

[0040] If the processor 300 determines that the target object T in the image V1 is in contact with or appears within the third sub-area B30, the alarm signal S2 generated by the processor 300 causes the display device 500 and / or the alarm device 600 to issue an alarm in the form of a gentle alarm sound, a flashing light and / or a voice, etc. 1, since the third sub-zone B30 is still far from the vehicle C.

[0041] 2B, when the vehicle C is about to turn left around a curve, or when the driver needs to turn left to reverse the vehicle C, the vehicle control signal capturing device 200 can capture a direction change signal S1 of the vehicle C from the vehicle control unit C10 and send the direction change signal S1 to the processor 300.

[0042] Then, the processor 300 may dynamically adjust the first auxiliary line A1 and / or the second auxiliary line A2 according to the direction change signal S1, and dynamically present the adjusted result on the display device 500. As shown in FIG. 2B, when the driver turns the steering wheel to the left, the processor 300 dynamically adjusts the first auxiliary line A1 and the second auxiliary line A2 from the original straight line to a curve to the left, and presents the adjusted first auxiliary line A1 and the second auxiliary line A2 on the display device 500 so that the measurement effective range of the auxiliary lines can cover the blind spot area when the vehicle C is turning.

[0043] In some embodiments, the processor 300 may further present the first auxiliary line A1 and the second auxiliary line A2 on the display device 500 before the adjustment (eg, shown as dotted lines in FIG. 2B).

[0044] Similarly, when the driver turns the steering wheel to the right, the processor 300 can dynamically adjust the first auxiliary line A1 and the second auxiliary line A2 from the original straight line to a curve to the right, and present the adjusted first auxiliary line A1 and the second auxiliary line A2 on the display device 500.

[0045] In some embodiments, rather than adjusting the first auxiliary line A1 and the second auxiliary line A2 in FIG. 2B to the leftward curve, the processor 300 may shift the first auxiliary line A1 to the left or rotate it counterclockwise without changing its axis, and shift the second auxiliary line A2 to the right or rotate it clockwise without changing its axis, so that the warning area B is expanded to cover the blind spot area when the vehicle C is turning.

[0046] In some embodiments, while adjusting the first auxiliary line A1 and the second auxiliary line A2 in FIG. 2B to curve to the left, the processor 300 may simultaneously shift the first auxiliary line A1 that curves to the left to the left or rotate it counterclockwise without changing the axis of the first auxiliary line A1 that curves to the left, and shift the second auxiliary line A2 that curves to the left to the right or rotate it clockwise without changing the axis of the second auxiliary line A2 that curves to the left.

[0047] Referring again to Figure 2C, in some embodiments of the present invention, when the driver turns the steering wheel to the left, the processor 300 may dynamically adjust only one of the first auxiliary line A1 and the second auxiliary line A2 from the original straight line to a curve to the left.

[0048] For example, only the first auxiliary line A1 may be adjusted to curve to the left, while the second auxiliary line A2 remains straight, thereby ensuring that the measurement range of the auxiliary lines can cover the blind spot areas in front or behind the vehicle C.

[0049] Similarly, when the driver turns the steering wheel to the right, the processor 300 may dynamically adjust only one of the first auxiliary line A1 and the second auxiliary line A2 from the original straight line to a curve to the right. For example, only the second auxiliary line A2 is adjusted to curve to the right, while the first auxiliary line A1 remains straight.

[0050] In some embodiments, rather than adjusting the first auxiliary line A1 in FIG. 2C to the leftward curve, the processor 300 may shift the first auxiliary line A1 to the left or rotate the first auxiliary line A1 counterclockwise without changing its axis, so that the warning area B is expanded to cover the blind spot area as the vehicle C turns.

[0051] In some embodiments, while adjusting the first auxiliary line A1 in FIG. 2C to a left-leaning curve, the processor 300 may simultaneously shift the left-leaning curved first auxiliary line A1 to the left or rotate the left-leaning curved first auxiliary line A1 counterclockwise without changing its axis.

[0052] In some embodiments, the processor 300 may comprise a first processor and a second processor.

[0053] The storage device 400 may comprise a first storage device and a second storage device. The first processor, the first storage device and the vehicle control signal capturing device 200 may be combined into a vehicle auxiliary line adjustment device.

[0054] The first processor is electrically connected to the vehicle control signal acquisition device 200 and is configured to define a first auxiliary line and a second auxiliary line and to form a warning area between the first auxiliary line and the second auxiliary line. The first processor is further configured to dynamically adjust the first auxiliary line and / or the second auxiliary line according to the direction change signal S1 to adjust the warning area.

[0055] The first storage device is configured to store data of the first auxiliary line and the second auxiliary line.

[0056] Further, the second processor is configured to identify a target object in the image V1 and determine whether the target object in the image V1 is in contact with a warning area defined by the first auxiliary line and the second auxiliary line defined by the first processor.

[0057] If the second processor determines that the target object is in contact with the warning area, it generates an alarm signal S2 and transmits the alarm signal S2 to the display device 500 and / or the warning device 600.

[0058] The second processor is further configured to transmit data of the image V1 and the first and second auxiliary lines defined by the first processor to the display device 500. Furthermore, the second processor is further configured to perform image pre-processing on the image V1.

[0059] The above-described embodiments are merely examples for explaining the present invention and are not intended to limit the scope of the claims. Any other embodiments resulting from modifications, changes, adjustments and integration of the above-described embodiments are all intended to be included within the scope of the present invention, unless it is difficult for a person skilled in the art to contemplate them. The scope of the invention claimed is to be determined by the claims that follow.

Claims

1. A vehicle alarm device, comprising: an image capture device disposed on the vehicle and configured to capture images of an exterior of the vehicle; a vehicle control signal capturing device configured to capture a direction change signal of the vehicle; a processor electrically connected to the image capture device and the vehicle control signal capture device, the processor comprising: defining a first auxiliary line and a second auxiliary line on the image to form a warning area between the first auxiliary line and the second auxiliary line; using an image judgment on the image to identify a target object within the image; determining whether the target object is in contact with the warning area defined by the first auxiliary line and the second auxiliary line; configured to generate an alarm signal when determining that the target object is in contact with the alarm zone; The vehicle warning device, wherein the processor is further configured to dynamically adjust the first auxiliary line and / or the second auxiliary line according to the direction change signal to adjust the warning area.

2. The vehicle warning device according to claim 1 , wherein the processor defines the first auxiliary line and the second auxiliary line according to a size of the vehicle and an installation position of the image capturing device.

3. The vehicle warning device according to claim 1 , further comprising a storage device configured to store data of the first auxiliary line and the second auxiliary line.

4. The vehicle control signal capturing device may be a CAN (Controller Area Network), a LIN (Local Interconnect Network), a UART (Universal Asynchronous Receiver / Transmitter), or an I ２ 2. The vehicle warning device according to claim 1, wherein the vehicle direction change signal is received through an Inter-Integrated Circuit (IC).

5. 2. The vehicle warning system of claim 1, wherein the warning zone includes at least two sub-zones, each sub-zone corresponding to a different danger level.

6. 2. The vehicle warning device according to claim 1, wherein the image is a rear image of the vehicle.

7. 2. The vehicle warning system of claim 1, wherein the processor identifies the target object from the image by a neural network model.

8. The vehicle warning device of claim 1 , wherein the processor is further configured to perform image pre-processing on the image.

9. 2. The vehicle warning system of claim 1, wherein the processor is further configured to transmit the warning signal to a display device and / or a warning device.

10. 10. The vehicle alarm system according to claim 9, wherein the alarm device is a light alarm device or a sound alarm device.

11. 2. The vehicle warning device according to claim 1, wherein the processor further transmits data of the image, the first auxiliary line, and the second auxiliary line to a display device.

12. A vehicle assistance line adjustment device, the vehicle assistance line adjustment device comprising: a vehicle control signal capturing device configured to capture a vehicle direction change signal; a processor electrically connected to the vehicle control signal capturing device; The processor: defining a first auxiliary line and a second auxiliary line on an image of an exterior of the vehicle captured by an image capturing device to form a warning area between the first auxiliary line and the second auxiliary line; configured to dynamically adjust the first auxiliary line and / or the second auxiliary line according to the direction change signal to adjust the warning area; Vehicle auxiliary line adjustment device.

13. The vehicle assistance line adjusting device according to claim 12, wherein the processor defines the first assistance line and the second assistance line according to a size of the vehicle and an installation position of an image capturing device.

14. The vehicle assistance line adjustment device according to claim 12 , further comprising: a storage device configured to store data of the first assistance line and the second assistance line.

15. The vehicle control signal capturing device may be a CAN (Controller Area Network), a LIN (Local Interconnect Network), a UART (Universal Asynchronous Receiver / Transmitter), or an I ２ 13. The vehicle auxiliary line adjusting device according to claim 12, wherein the vehicle direction change signal is received through an Inter-Integrated Circuit (IC).

16. The vehicle assistance line adjusting device according to claim 12, wherein the warning zone includes at least two sub-zones, each sub-zone corresponding to a different danger level.

Images