Heterogeneous computing architecture camera system and image processing method

Abstract

The invention provides a heterogeneous computing architecture camera system and an image processing method, the system comprises an image acquisition device and an image processing host, the image acquisition device comprises an image sensor and a field programmable gate array module, and the field programmable gate array module receives data output by the image sensor for preprocessing; the imageprocessing host comprises a central processing unit and an image processor, and the image processing host receives the preprocessed data output by the field programmable gate array module. The methodcomprises the steps that an image sensor of an image acquisition device acquires data and outputs the data to a field programmable gate array module, and the field programmable gate array module receives the data output by the image sensor for preprocessing including color correction, image enhancement and data compression; and the image processing host receives the preprocessed data output by the field programmable gate array module and processes the preprocessed data again. The system complexity can be simplified, and the image quality and the processing speed are improved.

Description

technical field [0001] The present invention relates to the technical field of camera devices, in particular to a camera system with a heterogeneous computing architecture and an image processing method implemented by using the camera system. Background technique [0002] The technology of using electronic equipment to capture images and process images is widely used in various fields. As people have higher and higher requirements for image quality, higher requirements are put forward for equipment used to capture images and image processing. At present, the field of image research mainly includes two relatively independent directions, namely research on camera systems and image display and processing. [0003] Generally, a camera system includes a host, a camera, an adapter, and cables. The camera system is used in conjunction with a lens and a monitor to convert the optical signal collected by the lens into an electrical signal, which is processed and transmitted to the mo...

AI Technical Summary

Problems solved by technology

[0005] First of all, the camera system and image display processing equipment are usually two devices that implement different functions. The camera system and image display and processing equipment are too complicated, and it takes a long time for users to learn, and even several people need to work together

[0006] Secondly, when a large amount of image data is transmitted from the camera system to the image display processing device for calculation, the calculation load increases significantly, even in the case of using optimized code, it is overwhelmed, often causing delays, freezes, and frame loss in image processing In such cases, the resolution or frame rate can only be reduced to process the collected image at a very low frame rate, resulting in a decrease in the quality of the processed image, and the advantages of high transmission bandwidth cannot be brought into play, and the whole process loses its practical significance

If high-quality image processing and other applications are performed on the image display processing device at the same time, it will further reduce the computing speed

[0007] Finally, most of the current camera systems usually use special processors such as ASSP, ISP or DSP to sequentially process the data collected by the image sensor, and then transmit the processed data to the camera control unit CCU of the host computer for subsequent processing. The circuit of the camera system is complicated. , larger size, longer delay time, and more image noise

Image display processing devices usually use acquisition cards to capture images. The data exchange between the camera system and image display processing devices makes the delay more prominent. The color gamut standard difference of the image further increases the color error, which often requires complex image processing. time-consuming color calibration

Images