New energy automobile vision system and detection method

Abstract

The invention discloses a new energy automobile visual system which comprises a plurality of imaging assemblies arranged on an automobile and a processing center connected to an automobile center console, the processing center is further connected with a cloud service platform, and an image processing module, a data fusion module and a feedback module are arranged in the processing center. And the image processing module is used for collecting feedback pictures of a plurality of imaging components. Compared with the prior art, the new energy automobile vision system and the detection method have the advantages that data support and decision output are provided for automobile intelligent driving.

Description

Technical Field

[0001] The present invention relates to the field of new energy vehicles, and in particular to a new energy vehicle vision system and a detection method. Background Art

[0002] Visual methods are divided into active vision and passive vision. Active vision refers to an observation method in which the observer can actively adjust the observation scene or the observer's own parameters, while the opposite is passive vision.

[0003] With the development of new energy vehicles and intelligent driving, automotive vision systems are needed for driving assistance;

[0004] Because the accuracy and reliability of the car's vision system directly affect the safety and operability of the car; in order to obtain high-precision surrounding intelligence in real time while the car is driving, it is necessary to use an active vision system to acquire and process images. Summary of the invention

[0005] The technical problem to be solved by the present invention is to overcome the above technical defects and provide a new energy vehicle vision system and detection method that provides data support and decision output for intelligent driving of the vehicle.

[0006] In order to solve the above technical problems, the technical solution provided by the present invention is: a new energy vehicle visual system, including multiple imaging components arranged on the vehicle and a processing center connected to the vehicle center console, the processing center is also connected to a cloud service platform, and the processing center is provided with an image processing module, a data fusion module and a feedback module, and the image processing module includes feedback pictures collected from multiple imaging components.

[0007] Preferably, the imaging assembly includes a front camera, a rear camera, and side cameras arranged on four sides of the car.

[0008] Preferably, the image processing module includes image filtering and image enhancement for the data transmitted by the imaging component, and the feedback module collects the output data of the image processing module for pedestrian detection, traffic signal detection, traffic light detection, lane line detection, and lane fence detection.

[0009] Preferably, the data fusion module includes acquiring feedback module data and simultaneously connecting to acquire vehicle motion data for data fusion, including a time synchronization unit, a space registration unit, and a target fusion unit;

[0010] The time synchronization unit includes obtaining time information of vehicle motion sensors, vehicle-mounted radars, and imaging components, and comparing and adjusting through timestamps;

[0011] The spatial registration unit includes converting the vehicle motion data into a coordinate system;

[0012] The target fusion unit includes merging and processing the output information of the time synchronization unit and the space configuration unit, including target recognition matching and attribute fusion, and the attribute fusion includes speed, direction, and size.

[0013] Preferably, the processing center includes outputting decision information, and the decision information includes scenario analysis and control instruction generation.

[0014] Preferably, the cloud service platform includes uploading and downloading of image information of the imaging component.

[0015] Another aspect of the present invention discloses: a detection method of a new energy vehicle visual system comprises the following steps:

[0016] Step 1: Start the new energy vehicle vision system and perform a power-on test on the imaging component;

[0017] Step 2: The imaging component obtains vehicle information and transmits it to the processing center;

[0018] Step 3: The image processing module receives the image data from the imaging component, performs image filtering and image enhancement processing to improve the image quality and recognition accuracy, and the feedback module uses the output data of the image processing module to feedback the key information in the collected data;

[0019] Step 4: The data fusion module obtains the data from the feedback module, and simultaneously connects to obtain the vehicle's motion data, and outputs the fused data to the processing center;

[0020] Step 5: The processing center makes autonomous driving decisions or provides safety warnings to the driver based on the results of data fusion.

[0021] The advantages of the present invention compared with the prior art are: in the present invention, through targeted settings, a processing center connected to other electronic systems in the car can process, fuse, and feedback features of image data, thereby facilitating the combination of information output control instructions and scene information analysis and other functions to meet the use of new energy smart cars and the use needs of smart racks. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a structural diagram of a new energy vehicle vision system. DETAILED DESCRIPTION

[0023] The following is combined with Figure 1 The present invention is described in further detail.

[0024] Combined with Figure 1As shown, a new energy vehicle visual system includes multiple imaging components arranged on the vehicle and a processing center connected to the vehicle center console. The processing center is also connected to a cloud service platform. The processing center is provided with an image processing module, a data fusion module and a feedback module. The image processing module includes feedback images collected from multiple imaging components.

[0025] In one embodiment, the imaging assembly includes a front camera, a rear camera, and a side camera arranged on four sides of the car.

[0026] For ease of use, the image processing module includes image filtering and image enhancement for the data transmitted by the imaging component. The feedback module collects the output data of the image processing module for pedestrian detection, traffic signal detection, traffic light detection, lane line detection, and lane fence detection. Through the recognition and detection of various features, it is convenient for subsequent feature fusion and use.

[0027] In the specific implementation of the present invention, the data fusion module includes obtaining feedback module data and simultaneously connecting to obtain vehicle motion data for data fusion, including a time synchronization unit, a spatial alignment unit, and a target fusion unit; the time synchronization unit includes obtaining time information of vehicle motion sensors, vehicle-mounted radars, and imaging components, and comparing and adjusting through timestamps; the spatial alignment unit includes converting vehicle motion data into a coordinate system; the target fusion unit includes merging the output information of the time synchronization unit and the spatial configuration unit, including target recognition matching and attribute fusion, and attribute fusion includes speed, direction, and size.

[0028] The contents not described in detail in this specification belong to the prior art known to professional and technical personnel in this field.

[0029] The processing center includes outputting decision information, which includes scene analysis and control instruction generation. When in use, the cloud service platform includes uploading and downloading image information of the imaging component.

[0030] When the present invention is used, the new energy vehicle visual system is started to ensure that all imaging components (front camera, rear camera, side camera) are working normally, and the imaging components collect image data around the vehicle in real time and transmit it to the processing center, where the image processing module receives the image data from the imaging components, performs image filtering and image enhancement processing to improve image quality and recognition accuracy. The filtering processing can remove noise and interference in the image, and the enhancement processing can improve the contrast and clarity of the image.

[0031] During target detection and recognition, the feedback module uses the output data of the image processing module to perform pedestrian detection, traffic signal detection, lane line detection, lane fence detection, etc. By applying deep learning algorithms or traditional image processing techniques, the feedback module can accurately identify targets in the image and extract their key features.

[0032] The data fusion module obtains the data from the feedback module and simultaneously connects to obtain the vehicle's motion data (such as speed, acceleration, steering angle, etc.);

[0033] The time synchronization unit ensures the temporal consistency of all data, and the spatial registration unit converts all data into a unified coordinate system;

[0034] The time synchronization unit ensures the temporal consistency of all data, and the spatial registration unit converts all data into a unified coordinate system;

[0035] The processing center makes autonomous driving decisions or provides safety warnings to the driver based on the results of data fusion. If potential danger or abnormal situation is detected, the system will alert the driver through sound, light, etc., or automatically take avoidance measures.

[0036] The processing center uploads part of the data to the cloud service platform for remote monitoring, software updates, data analysis and optimization, etc. The cloud service platform can train and optimize deep learning models to continuously improve the recognition accuracy and response speed of the visual system.

[0037] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited by the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements all fall within the scope of the present invention to be protected.

[0038] The scope of the present invention is defined by the appended claims and their equivalents, and therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the present invention but merely represents selected embodiments of the present invention.

[0039] Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative work shall fall within the scope of protection of the present invention.

[0040] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0041] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0042] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may include the first and second features being in direct contact, or may include the first and second features not being in direct contact but being in contact through another feature between them. Moreover, a first feature being "above", "above" and "above" a second feature includes the first feature being directly above and obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" and "below" a second feature includes the first feature being directly below and obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0043] The present invention and its embodiments are described above, and such description is not restrictive. The drawings show only one embodiment of the present invention, and the actual structure is not limited thereto. In short, if ordinary technicians in the field are inspired by it, without departing from the purpose of the invention, they can design a structure and embodiment similar to the technical solution without creativity, which should belong to the protection scope of the present invention.

Claims

1. A new energy vehicle vision system, characterized in that: The system comprises a plurality of imaging components arranged on a car and a processing center connected to a center console of the car. The processing center is also connected to a cloud service platform. An image processing module, a data fusion module and a feedback module are arranged in the processing center. The image processing module comprises feedback pictures collected from a plurality of imaging components.

2. A new energy vehicle visual system according to claim 1, characterized in that: The imaging assembly includes a front camera, a rear camera, and side cameras arranged on four sides of the car.

3. A new energy vehicle visual system according to claim 1 or 2, characterized in that: The image processing module includes image filtering and image enhancement for the data transmitted by the imaging component, and the feedback module collects the output data of the image processing module for pedestrian detection, traffic signal detection, traffic light detection, lane line detection, and lane fence detection.

4. A new energy vehicle visual system according to claim 3, characterized in that: The data fusion module includes obtaining feedback module data and simultaneously connecting to obtain vehicle motion data for data fusion, including a time synchronization unit, a spatial registration unit, and a target fusion unit; The time synchronization unit includes obtaining time information of vehicle motion sensors, vehicle-mounted radars, and imaging components, and comparing and adjusting through timestamps; The spatial registration unit includes converting the vehicle motion data into a coordinate system; The target fusion unit includes merging and processing the output information of the time synchronization unit and the space configuration unit, including target recognition matching and attribute fusion, and the attribute fusion includes speed, direction, and size.

5. A new energy vehicle visual system according to claim 4, characterized in that: The processing center includes outputting decision information, and the decision information includes scenario analysis and control instruction generation.

6. A new energy vehicle visual system according to any one of claims 1 to 5, characterized in that: The cloud service platform includes uploading and downloading image information of imaging components.

7. A detection method for a new energy vehicle visual system, applied to the new energy vehicle visual system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step 1: Start the new energy vehicle vision system and perform a power-on test on the imaging component; Step 2: The imaging component obtains vehicle information and transmits it to the processing center; Step 3: The image processing module receives the image data from the imaging component, performs image filtering and image enhancement processing to improve the image quality and recognition accuracy, and the feedback module uses the output data of the image processing module to feedback the key information in the collected data; Step 4: The data fusion module obtains the data from the feedback module, and simultaneously connects to obtain the vehicle's motion data, and outputs the fused data to the processing center; Step 5: The processing center makes autonomous driving decisions or provides safety warnings to the driver based on the results of data fusion.

Images