Digital video processing system based on USB multi-view camera

Abstract

The invention discloses a digital video processing system based on a USB multi-view camera. The digital video processing system comprises a CSI camera data receiving module, a feature extraction module, a camera initialization module, a DDR memory, a color space processing module, a USB UVC data module, an upper computer processing module and a camera control module. The upper computer processing module is connected with the USB UVC data module, and the upper computer processing module receives displayed video data sent by the USB UVC data module; the USB UVC data module is connected with the camera control module, the camera control module is further independently connected with the camera initialization module, the camera initialization module is externally connected with a CSI camera, and the upper computer processing module issues control data to the camera control module through the USB UVC data module. And the camera control module sends the configuration parameters of the CSI camera to the camera initialization module to complete parameter configuration of the CSI camera.

Description

Technical Field

[0001] The present invention relates to the technical field of video processing, in particular to a digital video processing system based on a USB multi-camera. Background Art

[0002] In recent years, with the development of artificial intelligence technology, digital cameras have become more and more popular. People usually need to obtain the real-time status of a wider area and automatically extract feature parameters from digital camera data. In order to achieve a larger and wider real-time monitoring area, more digital cameras are needed to obtain enough digital video data. A large amount of video data poses a serious challenge to people. At this time, people urgently need an efficient, lightweight, and fast digital video processing technology to quickly obtain the feature time of interest to users from a large amount of video information. Under this demand, portable digital video processing technology came into being, aiming to process the collected digital video, allowing users to quickly browse and quickly extract feature images for abnormal monitoring, greatly reducing dependence on manual work;

[0003] At present, digital video processing technology requires the use of digital processing storage units. Digital processing storage units have complex connections, difficult equipment debugging, slow processing speed, high cost, large size and inconvenient carrying, etc., which cannot meet the current demand for low-cost and miniaturized machines. Based on the current situation, it is urgent to improve the existing technology. Summary of the invention

[0004] The object of the present invention is to provide a digital video processing system based on a USB multi-eye camera to solve the problems raised in the above background technology.

[0005] The present invention provides the following technical solution: a digital video processing system based on a USB multi-camera, comprising: a CSI (Camera Serial Interface) interface camera is a common camera interface used in embedded systems or mobile devices) camera data receiving module, a feature extraction module, a camera initialization module, an image scaling processing module, an image cropping module, an image overlay module, an image cache control module, a DDR memory, a color space processing module, a USBUVC (USB video class, a protocol standard defined for a USB video capture device) data module, a host computer processing module, and a camera control module;

[0006] The host computer processing module is connected to the USB UVC data module, and the host computer processing module receives the displayed video data sent by the USB UVC data module, and compresses and stores the returned display data in the local memory;

[0007] The USB UVC data module is connected to the camera control module, and the camera control module is also separately connected to the camera initialization module, and the camera initialization module is externally connected to the CSI camera, the upper computer processing module sends control data to the camera control module through the USB UVC data module, and the camera control module sends the configuration parameters of the CSI camera to the camera initialization module to complete the parameter configuration of the CSI camera;

[0008] The CSI camera data receiving module is connected to the image scaling processing module, and the output end of the image scaling processing module is connected to the image cropping module, and the output end of the image cropping module is connected to the image overlay module, and the output end of the image overlay module is loaded into the image cache module;

[0009] The camera control module is also separately connected to the image scaling processing module, and the image scaling parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image scaling processing module;

[0010] The camera control module is also separately connected to the image cropping module, and the image size parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cropping module;

[0011] The camera control module is also separately connected to the image overlay module, and the image overlay control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cache control module;

[0012] The camera control module is also separately connected to the feature extraction module, and the output end of the feature extraction module is connected to the image superposition module, and the output end of the image superposition module is connected to the image cache control module, and the image cache control module is provided with a DDR memory;

[0013] The camera control module is also separately connected to the image cache control module, and the image cache control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cache control module;

[0014] The camera control module is also separately connected to the color space processing module, and the color space control parameters are converted into corresponding control parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the color space processing module.

[0015] The present invention has the following beneficial effects: the design solution separates the processing unit module and the digital storage unit module, omitting the expensive and bulky digital processing storage unit, thereby significantly reducing the cost and the size of the device.

[0016] The present invention adopts a feature extraction module to independently extract feature parameters. When the feature parameters required by the user are more complex, the local digital camera data can be routed to other processing modules for auxiliary processing. This can shorten the time for finding special diagnosis parameters, and the single special diagnosis parameter extraction module does not need to perform complex feature parameter calculations, which greatly reduces the design complexity of the single feature parameter extraction module and reduces the design cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic diagram of the structure of the present invention. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in the field of the present invention without creative work are within the scope of protection of the present invention.

[0019] refer to Figure 1 The present invention provides the following technical solution: a digital video processing system based on a USB multi-camera, comprising: a CSI camera data receiving module, a feature extraction module, a camera initialization module, an image scaling processing module, an image cropping module, an image overlay module, an image cache control module, a DDR memory, a color space processing module, a USB UVC data module, a host computer processing module, and a camera control module;

[0020] The host computer processing module is connected to the USB UVC data module. The host computer processing module receives the video data sent by the USB UVC data module and displays it on the display. At the same time, the returned display data is compressed and stored in the local memory to achieve the purpose of long-term storage.

[0021] The USB UVC data module is connected to the camera control module, and the camera control module is also separately connected to the camera initialization module, the camera initialization module is externally connected to the CSI camera, the upper computer processing module sends control data to the camera control module through the USB UVC data module, and the camera control module sends the configuration parameters of the CSI camera to the camera initialization module, and the CSI camera can work after the parameters are configured;

[0022] The CSI camera data receiving module, the image scaling processing module and the image cropping module may be provided with multiple paths, and the connection mode of each path is the same, that is, the CSI camera data receiving module is connected to the image scaling processing module, and the output end of the image scaling processing module is connected to the image cropping module, and the output end of the image cropping module is connected to the image overlay module, and the output end of the image overlay module is loaded into the image cache module; in this embodiment, multiple CSI cameras can work simultaneously, and the physical image scanned by the multiple CSI cameras is received by the CSI camera data receiving module. The image is scaled, cropped and overlaid by the image scaling processing module, the image cropping module and the image overlay module, and the incorrect image with different configuration parameters is highlighted;

[0023] The camera control module is also separately connected to the image scaling processing module, and the image scaling parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image scaling processing module;

[0024] The camera control module is also separately connected to the image cropping module, and the image size parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cropping module;

[0025] The camera control module is also separately connected to the image overlay module, and the image overlay control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image scaling processing to be converted into corresponding control parameters and sent to the image overlay;

[0026] The camera control module is also separately connected to the feature extraction module, and the output end of the feature extraction module is connected to the image superposition module, and the output end of the image superposition module is connected to the image cache control module, and the image cache control module is provided with a DDR memory; the feature data is sent to the camera control module through the USB UVC data module by the host computer processing module, and the feature data is finally stored in the feature extraction module, and the CSI camera data receiving module compares the received digital image data with the feature data sent by the above-mentioned host computer, and sends the result to the image superposition module, and stores it in the DDDR memory through the image cache control module;

[0027] The camera control module is also separately connected to the image cache control module, and the image cache control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cache control module;

[0028] The output end of the image cache control module is connected to the color space processing module, and the output end of the color space processing module is loaded into the USB UVC data module; the USB UVC data module converts the data stored in the DDR memory in the early stage through the image cache control module through the color space processing module at a fixed period, and transmits it back to the host computer for display and storage;

[0029] The camera control module is also separately connected to the color space processing module, and the color space control parameters are converted into corresponding control parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the color space processing module;

[0030] As an implementation mode of the present invention, in this embodiment, it is assumed that there are 2 CSI cameras working at the same time. First, the upper computer processing module sends control data to the camera control module through the USB UVC data module, and the camera control module sends the configuration parameters of the CSI camera to the camera initialization module. The CSI camera can work after the parameters are configured; on the one hand, the feature extraction module performs feature extraction on the image scanned by the CSI camera, such as scanning a circuit board of a probe. Since the feature extraction module has the feature data parameters of the circuit board of the probe sent in advance by the upper computer processing module, during feature extraction, if it is found that a rectangular chip is missing or a triangle buffer is missing, it will be displayed in the image overlay module; on the other hand, the image scanned by the CSI camera is transmitted to the image scaling processing module, the image cropping module, and the image overlay module in sequence, and the image is scaled, cropped, and overlaid respectively. , since the camera control module is separately connected to the image scaling processing module, the image cropping module, and the image overlay module, and the corresponding configuration parameters are sent to the image scaling processing module, the image cropping module, and the image overlay module respectively through the host computer processing module, for example: the image scaling parameters are sent to the image scaling processing module; the image size parameters are sent to the image cropping module; the image overlay control parameters are sent to the image overlay module; the image scaling processing module, the image cropping module, and the image overlay module compare the image scanned by the CSI camera according to the corresponding configuration parameters sent, and store the relevant position images that are different from the relevant configuration parameters in the image cache control module, and convert them into the corresponding color system through the color space processing module and transmit them back to the host computer for display.

[0031] In this implementation, data from multiple digital cameras are collected simultaneously for image acquisition, scaling, cropping, feature extraction and superposition. Each processing module is connected separately through a camera control module, and the data from each digital camera is independently processed and stored in a DDR memory after superposition. Then, the USB UVC timing and fixed frame rate transmit the data stored in the DDR memory to the host computer via USB for local display and storage.

[0032] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A digital video processing system based on USB multi-camera, characterized in that: include: CSI camera data receiving module, feature extraction module, camera initialization module, image scaling processing module, image cropping module, image overlay module, image cache control module, DDR memory, color space processing module, USB UVC data module, host computer processing module, camera control module; The host computer processing module is connected to the USB UVC data module, and the host computer processing module receives the displayed video data sent by the USB UVC data module, and compresses and stores the returned display data in a local memory; The USB UVC data module is connected to the camera control module, and the camera control module is also separately connected to the camera initialization module, and the camera initialization module is externally connected to the CSI camera, the upper computer processing module sends control data to the camera control module through the USB UVC data module, and the camera control module sends the configuration parameters of the CSI camera to the camera initialization module to complete the parameter configuration of the CSI camera; The CSI camera data receiving module is connected to the image scaling processing module, and the output end of the image scaling processing module is connected to the image cropping module, and the output end of the image cropping module is connected to the image overlay module, and the output end of the image overlay module is loaded into the image cache module; The camera control module is also separately connected to the image scaling processing module, and the image scaling parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image scaling processing module; The camera control module is also separately connected to the image cropping module, and the image size parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cropping module; The camera control module is also separately connected to the image overlay module, and the image overlay control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cache control module; The camera control module is also separately connected to the feature extraction module, and the output end of the feature extraction module is connected to the image superposition module, and the output end of the image superposition module is connected to the image cache control module, and the image cache control module is provided with a DDR memory; The camera control module is also separately connected to the image cache control module, and the image cache control parameters are converted into corresponding parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the image cache control module; The camera control module is also separately connected to the color space processing module, and the color space control parameters are converted into corresponding control parameters by the host computer processing module through the USB UVC data module and the camera control module, and sent to the color space processing module.

2. A digital video processing system based on a USB multi-camera according to claim 1, characterized in that: The CSI camera data receiving module, the image scaling processing module and the image cropping module can be provided with multiple paths, and the connection mode of each path is the same.

3. A digital video processing system based on a USB multi-camera according to claim 1, characterized in that: The output end of each image cropping module is connected to the image superposition module, and the image superposition module performs superposition processing on the multi-channel data output by the image cropping module.

4. The digital video processing system based on USB multi-camera according to claim 1, characterized in that: The host computer processing module sends feature data to the camera control module through the USB UVC data module, stores the feature data in the feature extraction module, and the CSI camera data receiving module compares the received digital image data with the feature data sent by the host computer, stores the result and sends it to the image overlay module, and stores it in the DDDR memory through the image cache control module.

5. The digital video processing system based on USB multi-camera according to claim 1, characterized in that: The output end of the image cache control module is connected to the color space processing module, and the output end of the color space processing module is loaded into the USB UVC data module; and the USB UVC data module converts the data stored in the DDR memory through the image cache control module at a fixed period, and returns the data to the host computer through the color space processing module into a corresponding color system for display and storage.

Images