Rear-loading lane and obstacle detection device and use method

By using a retrofitted lane and obstacle detection device, and leveraging the powerful computing capabilities of camera modules and chips, the installation difficulties of ADAS systems on older vehicles have been solved, resulting in reduced costs, wider applicability, and improved driving safety and experience.

CN118907135APending Publication Date: 2024-11-08GONGZHI YUKONG TECH (SUZHOU) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410958459.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing ADAS systems struggle to detect lanes and obstacles in older vehicles or vehicles without the necessary interfaces, leading to installation difficulties and high costs.

Method used

An aftermarket lane and obstacle detection device is provided, comprising a camera module, motherboard, chip, alarm device, user interaction button and memory card interface. By integrating the powerful computing power of the camera module and chip, it can achieve accurate detection and alarm of lane lines and obstacles, reducing the dependence on the vehicle's original sensor system.

Benefits of technology

This reduces deployment costs, enabling ADAS technology to be widely adopted in mid-to-low-end vehicles, simplifies the installation process, enhances applicability and compatibility, and improves driving safety and experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118907135A_ABST
    Figure CN118907135A_ABST
Patent Text Reader

Abstract

The invention discloses an after-loading lane and obstacle detection device and a use method. The after-loading lane and obstacle detection device comprises a device shell, a camera module arranged in the device shell, a mainboard arranged in the device shell, a chip arranged in the mainboard, an alarm device arranged on one side of the device shell, a user interaction button and a memory card interface. The camera module is fixedly installed at the top of the device shell, the mainboard is integrated in the camera module, the chip is integrated on the mainboard, a neural network model is arranged in the mainboard, and the alarm device, the user interaction button and the memory card interface are all arranged on one side of the device shell; under the condition of not depending on an original complex sensor system of a vehicle, accurate detection and alarm of lane lines and obstacles can be completed only by depending on powerful computing power of a camera module and a chip integrated with the vehicle, so that the deployment cost of a traditional ADAS is reduced, and the vehicle does not need to provide extra interfaces, cameras, radars and other expensive sensor equipment any more.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of obstacle detection, and in particular to a rear-mounted lane and obstacle detection device and a use method thereof. Background Art

[0002] With the rapid development of autonomous driving technology, advanced driver assistance systems (ADAS) have become an indispensable part of modern cars. ADAS integrates multiple sensors, such as cameras, radars, and lidars, to achieve real-time monitoring and analysis of the vehicle's surroundings, thereby providing functions such as lane keeping, collision warning, and obstacle detection, significantly improving driving safety and comfort.

[0003] In the traditional ADAS implementation, the ADAS controller is installed on the experimental vehicle as the core processing unit and connected to the vehicle's multiple cameras, radars and other sensors through complex wiring harnesses. Although this tightly coupled system architecture can provide high-precision environmental perception capabilities, it also has significant limitations.

[0004] In the existing technology, the ADAS controller needs to be tightly integrated with the vehicle's original sensor system, which requires the vehicle to provide sufficient interface support, including electrical interface, data interface, and physical installation location. For older models or vehicles that do not have corresponding interfaces, it becomes particularly difficult to implement ADAS functions.

[0005] Therefore, it is necessary to improve a rear-mounted lane and obstacle detection device and a method of use in the prior art to solve the above problems. Summary of the invention

[0006] The present invention overcomes the deficiencies of the prior art and provides a rear-mounted lane and obstacle detection device and a use method.

[0007] To achieve the above-mentioned object, the technical solution adopted by the present invention is: a rear-mounted lane and obstacle detection device and a method of use, comprising: a device housing, a camera module arranged in the device housing, a mainboard arranged in the device housing, a chip arranged in the mainboard, an alarm device arranged on one side of the device housing, a user interaction button and a memory card interface;

[0008] The camera module is fixedly mounted on the top of the device housing, the main board is integrated in the camera module, the chip is integrated on the main board, a neural network model is arranged in the main board, the alarm device, the user interaction button and the memory card interface are all arranged on one side of the device housing, and the alarm device, the user interaction button and the memory card interface are all electrically connected to the main board;

[0009] A memory card is arranged in the memory card interface, the alarm device is a speaker, and a temperature sensor is arranged in the camera module.

[0010] In a preferred embodiment of the present invention, the temperature sensor is disposed inside the device housing, and the temperature sensor is electrically connected to the mainboard.

[0011] In a preferred embodiment of the present invention, a wireless communication module is disposed on the mainboard, and the wireless communication module is electrically connected to the mainboard.

[0012] In a preferred embodiment of the present invention, the camera module is connected to the mainboard via an HDMI or USB data transmission interface.

[0013] In a preferred embodiment of the present invention, a power management module is provided on the mainboard for receiving external power input and providing a stable power supply for the camera module, the alarm device and the user interaction button.

[0014] In a preferred embodiment of the present invention, an indicator light is provided on one side of the device housing, and the indicator light is electrically connected to the mainboard.

[0015] In a preferred embodiment of the present invention, a wireless communication module is provided in the housing of the device, and the wireless communication module includes: Wi-Fi or Bluetooth, and the wireless communication module is electrically connected to the mainboard.

[0016] In a preferred embodiment of the present invention, a method for using a rear-mounted lane and obstacle detection device comprises the following steps:

[0017] S1: Start the camera module and the chip on the mainboard;

[0018] S2: The camera module collects video data in front of the vehicle and sends it to the chip;

[0019] S3: Preprocess the video data and feed it into the neural network model;

[0020] S4: The neural network model extracts and calibrates features from video data to detect lane lines and obstacles.

[0021] S5: When lane deviation or obstacles exceeding a preset threshold are detected, a warning prompt is issued to the driver through a warning device.

[0022] In a preferred embodiment of the present invention, in said S4, it also includes the step of updating the neural network model or adjusting the alarm threshold through the memory card interface.

[0023] In a preferred embodiment of the present invention, in S4, the detection is started, stopped or the alarm threshold is adjusted by user interaction through buttons.

[0024] The present invention solves the defects existing in the background technology and has the following beneficial effects:

[0025] (1) The present invention provides a rear-mounted lane and obstacle detection device and a method of use, which can accurately detect lane lines and obstacles and issue warnings without relying on the vehicle's original complex sensor system, relying only on the powerful computing power of its own integrated camera module and chip, thereby reducing the deployment cost of traditional ADAS (advanced driver assistance system) and no longer requiring the vehicle to provide additional expensive sensor equipment such as additional interfaces, cameras, radars, etc. The significant reduction in cost makes this technology easier to popularize, not only limited to high-end models, but can cover a wider range of consumer groups, including mid- and low-end models, thereby improving the overall safety of road traffic.

[0026] (2) The present invention does not rely on the vehicle's CAN bus or other specific interfaces, making the installation process extremely simple. Users do not need to perform complex modifications or upgrades on the vehicle. They only need to fix the device in a suitable position on the vehicle and connect it to a power source to put it into use immediately. This not only simplifies the installation process and reduces installation costs, but also enhances the applicability of the device, making it easy to adapt to vehicles of different brands and models. The flexibility and compatibility of the device itself provide great convenience for automobile manufacturers, aftermarket service providers and individual users, further promoting the popularization and application of lane and obstacle detection technology.

[0027] (3) In the present invention, by integrating advanced neural network models and efficient algorithm processing, it is possible to capture and analyze video data in front of the vehicle in real time and accurately, quickly identify lane lines and obstacles, and immediately issue a clear warning prompt to the driver through the horn when potential danger is detected. The instant feedback mechanism provides the driver with valuable early warning information, which helps them to react in advance and avoid accidents. The high-precision detection and stable performance of the device also enhance the driver's confidence and sense of security during driving, improving the overall driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 It is a structural schematic diagram of a preferred embodiment of the present invention;

[0030] Figure 2 It is a schematic diagram of a preferred embodiment of the present invention;

[0031] In the figure: 1. Camera module; 2. Main board; 3. Chip; 4. User interaction button; 5. Memory card interface; 6. Alarm device. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0033] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0034] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the scope of protection of the present application. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the invention, unless otherwise specified, "multiple" means two or more.

[0035] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood by specific circumstances.

[0036] like Figure 1As shown, a rear-mounted lane and obstacle detection device and a method of use thereof include: a device housing, a camera module 1 disposed in the device housing, a mainboard 2 disposed in the device housing, a chip 3 disposed in the mainboard 2, an alarm device 6 disposed on one side of the device housing, a user interaction button 4, and a memory card interface 5;

[0037] The camera module 1 is fixedly mounted on the top of the device housing, the mainboard 2 is integrated in the camera module 1, the chip 3 is integrated on the mainboard 2, a neural network model is arranged in the mainboard 2, an alarm device 6, a user interaction button 4 and a memory card interface 5 are arranged on one side of the device housing, and the alarm device 6, the user interaction button 4 and the memory card interface 5 are all electrically connected to the mainboard 2; a memory card is arranged in the memory card interface 5, the alarm device 6 is a speaker, and a temperature sensor is arranged in the camera module 1;

[0038] The temperature sensor is arranged inside the device shell, and the temperature sensor is electrically connected to the main board 2. A wireless communication module is arranged on the main board 2, and the wireless communication module is electrically connected to the main board 2. The camera module 1 is connected to the main board 2 via HDMI and USB data transmission interfaces. A power management module is arranged on the main board 2 for receiving external power input and providing a stable power supply for the camera module 1, the alarm device 6 and the user interaction button 4. An indicator light is arranged on one side of the device shell, and the indicator light is electrically connected to the main board 2. A wireless communication module is arranged inside the device shell, and the wireless communication module includes: Wi-Fi or Bluetooth, and the wireless communication module is electrically connected to the main board 2:

[0039] It should be noted that: the camera module 1 can capture clear images of the lane and the road ahead, providing a basis for subsequent intelligent analysis;

[0040] The camera module combines the processing power of chip 3 and the built-in neural network model. The device can accurately identify lane lines, traffic signs and obstacles ahead in real time, and maintain high sensitivity and accuracy even in complex and changing road environments.

[0041] When lane departure is detected or there is potential danger ahead, the high-volume, high-definition speaker built into the device housing will immediately sound a loud alarm, quickly attracting the driver's attention and ensuring that the driver can take timely measures to avoid accidents. This not only increases the driver's alertness, but also significantly reduces the risk of traffic accidents caused by negligence.

[0042] In addition, the device body fully considers the user experience, and through the setting of the user interaction button 4, the driver only needs to press the button to easily complete the settings adjustment, record viewing and other operations;

[0043] Installing a memory card in the memory card interface 5 provides the user with sufficient storage space, allowing the driver to save important driving records at any time.

[0044] In terms of environmental adaptability, the built-in temperature sensor can monitor the temperature changes inside the device in real time to ensure that the device can work normally under extreme weather conditions. At the same time, the power management module can further optimize the energy utilization efficiency of the device, extend battery life, and reduce the inconvenience caused by frequent charging for users.

[0045] The device is also equipped with an advanced wireless communication module that supports Wi-Fi or Bluetooth connection, allowing drivers to easily connect the device to other smart devices such as smartphones and in-car navigation systems to achieve remote transmission and sharing of data.

[0046] like Figure 1-Figure 2 As shown, a method for using a rear-mounted lane and obstacle detection device comprises the following steps:

[0047] S1: Start the camera module 1 and the chip 3 on the main board 2;

[0048] S2: The camera module 1 collects the video data in front of the vehicle and sends it to the chip 3;

[0049] S3: Preprocess the video data and feed it into the neural network model;

[0050] S4: The neural network model extracts and calibrates features from video data to detect lane lines and obstacles.

[0051] S5: When lane deviation or obstacles exceeding a preset threshold are detected, a warning prompt is issued to the driver through the warning device 6.

[0052] In S4, it also includes the step of updating the neural network model or adjusting the alarm threshold through the memory card interface 5, and starting, stopping detection or adjusting the alarm threshold through user interaction through buttons.

[0053] It should be noted that: S1: Start the camera module 1 and the chip 3 on the main board 2. The camera module 1 is activated and is ready to capture video data of the road ahead. The chip 3, as the core of data processing, is ready to receive and process the video data. The chip 3 is a Rockchip SOC, which provides 3TOPS computing power.

[0054] S2: The camera module 1 starts to collect video data in front of the vehicle and transmits it to the chip 3 in real time;

[0055] This step is the basis for subsequent processing and analysis. The quality and clarity of video data directly affect the accuracy of the final detection results.

[0056] S3: After receiving the video data, chip 3 will pre-process it;

[0057] This step includes operations such as denoising, contrast enhancement, and resolution adjustment, aiming to optimize the quality of video data and provide a better data source for subsequent feature extraction and calibration.

[0058] S4: The preprocessed video data is sent to the neural network model for further processing. The neural network model uses its powerful feature extraction capability to extract the key features of lane lines and obstacles from the video data and calibrate them. Then, the model will perform real-time detection of lane lines and obstacles based on these feature information to determine whether there is lane deviation or obstacles exceeding the preset threshold.

[0059] S5: When lane deviation or obstacles exceeding the preset threshold are detected, the system will immediately trigger the alarm mechanism and send a sound alarm to the driver through the alarm device. At the same time, the device also provides user interaction functions. The driver can start, stop detection or adjust the alarm threshold through buttons to achieve personalized settings and adjustments. In addition, if the neural network model needs to be updated to adapt to the new road environment or improve detection performance, the driver can operate through the memory card interface.

[0060] Embodiment 1:

[0061] The camera module 1 is fixedly mounted on the top of the device housing, and the camera lens is ensured to face the front of the vehicle to obtain the best field of view; the mainboard 2 is integrated into the device housing, and the Rockchip SOC is securely mounted on the mainboard; a speaker, a user interaction button 4, and a memory card interface 5 are installed on one side of the device housing, and their electrical connection with the mainboard 2 is ensured to be correct; a memory card is inserted into the memory card interface 5 to provide sufficient storage space for the system; a temperature sensor is installed inside the device housing to monitor the internal temperature changes in real time.

[0062] Load and configure the neural network model on the Rockchip SOC to ensure that the model can accurately identify lane lines and obstacles; set up Bluetooth to ensure that the device can connect to smart devices such as smartphones and car navigation systems.

[0063] S1: Press the start button on the user interaction button 4, the camera module 1 is activated and starts to capture video data of the road ahead. The Rockchip SOC is also started and is ready to receive and process the video data from the camera module 1.

[0064] S2: Camera module 1 continuously collects video data in front of the vehicle and transmits it to Rockchip SOC in real time through the USB data transmission interface. Video data is captured continuously to ensure no omissions, providing a complete data source for subsequent processing.

[0065] S3: After receiving the video data, Rockchip SOC immediately performs denoising, contrast enhancement, and resolution adjustment to optimize the video data quality. The pre-processed video data is clearer and facilitates subsequent feature extraction and calibration.

[0066] S4: The video data after denoising, contrast enhancement and resolution adjustment is sent to the neural network model for further processing. The neural network model uses its powerful feature extraction capability to extract the key features of lane lines and obstacles from the video data and calibrate them. Based on the extracted feature information, the model detects the status of lane lines and obstacles in real time and determines whether there is lane deviation.

[0067] S5: When the neural network model detects lane deviation, the main board 2 immediately triggers the warning mechanism and sends a loud alarm to the driver through the horn. After hearing the alarm, the driver can take quick measures to avoid potential danger.

[0068] The above is based on the ideal embodiment of the present invention. Through the above description, relevant personnel can make various changes and modifications without departing from the technical concept of the present invention. The technical scope of the present invention is not limited to the content in the specification, and the technical scope must be determined according to the scope of the claims.

Claims

1. A rear-mounted lane and obstacle detection device, comprising: a device housing, a camera module (1) arranged in the device housing, a mainboard (2) arranged in the device housing, a chip (3) arranged in the mainboard (2), an alarm device (6) arranged on one side of the device housing, a user interaction button (4) and a memory card interface (5), It is characterized by: The camera module (1) is fixedly mounted on the top of the device housing, the main board (2) is integrated in the camera module (1), the chip (3) is integrated on the main board (2), a neural network model is arranged in the main board (2), the alarm device (6), the user interaction button (4) and the memory card interface (5) are all arranged on one side of the device housing, and the alarm device (6), the user interaction button (4) and the memory card interface (5) are all electrically connected to the main board (2); A memory card is arranged in the memory card interface (5), the alarm device (6) is a speaker, and a temperature sensor is arranged in the camera module (1).

2. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: The temperature sensor is arranged inside the device housing, and the temperature sensor is electrically connected to the mainboard (2).

3. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: A wireless communication module is provided on the main board (2), and the wireless communication module is electrically connected to the main board (2).

4. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: The camera module (1) and the mainboard (2) are connected via HDMI and USB data transmission interfaces.

5. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: The main board (2) is provided with a power management module for receiving external power input and providing a stable power supply for the camera module (1), the alarm device (6) and the user interaction button (4).

6. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: An indicator light is provided on one side of the device housing, and the indicator light is electrically connected to the mainboard (2).

7. The rear-mounted lane and obstacle detection device according to claim 1, characterized in that: A wireless communication module is arranged in the housing of the device. The wireless communication module includes Wi-Fi or Bluetooth. The wireless communication module is electrically connected to the mainboard (2).

8. A method for using a rear-mounted lane and obstacle detection device according to any one of claims 1 to 7, characterized in that: The following steps are involved: S1: Start the camera module (1) and the chip (3) on the main board (2); S2: The camera module (1) collects video data in front of the vehicle and sends it to the chip (3); S3: Preprocess the video data and feed it into the neural network model; S4: The neural network model extracts and calibrates features from video data to detect lane lines and obstacles. S5: When lane deviation or obstacles exceeding a preset threshold are detected, a warning prompt is issued to the driver through the warning device (6).

9. The method for using the rear-mounted lane and obstacle detection device according to claim 8, characterized in that: In the S4, it also includes the step of updating the neural network model or adjusting the alarm threshold through the memory card interface (5).

10. The method for using the rear-mounted lane and obstacle detection device according to claim 8, characterized in that: In S4, the detection is started or stopped or the alarm threshold is adjusted by user interaction through buttons.