AI technical title is built by Patsnap AI team. It summarizes the technical point description of the patent document.
A processing method and pipeline technology, applied in the field of image processing, can solve the problems of difficulty in ensuring real-time performance, complex algorithms, and inability to meet the real-time requirements of HDR images, and achieve the effect of meeting real-time requirements and occupying less storage resources.
Active Publication Date: 2021-07-13
BEIJING RES INST OF SPATIAL MECHANICAL & ELECTRICAL TECH
View PDF4 Cites 0 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
However, the above method cannot meet the real-time requirements for HDR images in the current embedded field. The main problems are:
[0004] 1. High storage resource requirements. For color images with a resolution of 1920×1080, RGB (Red / Green / Blue, red / green / blue) format is used to store HDR image data, and Reinhard tone mapping needs to consume 1920×1080 *4=7.9MB on-chip storage resources to store a frame of images, which is unacceptable to PFGA (Field Programmable Gate Array, element programmable logic gate array) devices with limited on-chip storage resources
[0005] 2. Real-time performance is difficult to guarantee. HDR video stores the lumen value of each pixel, and a large number of calculation processes are based on floating-point values. Therefore, the algorithm not only requires more storage resources, but also needs to call the DSP (DigitalSignal Processing, digital signal processing) resources process addition and multiplication operations
Lapray et al. used FPGA Virtex V to implement the algorithm: it can complete video processing with a frame rate of 30fps and a resolution of 1 million, but this method uses constant parameters; Urena et al. applied an algorithm combining global operators and local operators, and implemented it on XilinxSpartan III , can complete video processing with 60fps frame rate and 640x480 resolution. This method adopts the method of manually adjusting parameters. These two methods are not conducive to real-time video processing. In addition, the algorithms are relatively complicated. A large amount of hardware resources is not conducive to integration on the image sensorchip
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0059] refer to figure 1 , shows a flow chart of the steps of a video pipeline processing method provided by an embodiment of the present invention, as figure 1 As shown, the processing method of the video pipeline may specifically include the following steps:
[0060] Step 101: Obtain the long-exposure image and short-exposure image corresponding to the spacecraft.
[0061] In the embodiments of the present invention, space vehicles refer to various types of vehicles that basically operate in space outside the earth's atmosphere according to the laws of celestial mechanics. The space vehicle may be any aircraft such as an artificial earth satellite, a space probe, and a manned spacecraft, which is not limited in this embodiment of the present invention.
[0062] In the present invention, first, the long-exposure image and the short-exposure image corresponding to the spacecraft may be acquired, and then step 102 is performed.
[0063] Step 102: Obtain a first exposure time...
Embodiment 2
[0139] refer to Figure 7 , which shows a schematic structural diagram of a video pipeline processing device provided by an embodiment of the present invention, as shown in Figure 7 As shown, the processing device of the video pipeline may specifically include the following modules:
[0140] An exposure image acquisition module 710, configured to acquire a long exposure image and a short exposure image corresponding to the spacecraft;
[0141] An exposure time acquiring module 720, configured to acquire a first exposure time corresponding to the long exposure image and a second exposure time corresponding to the short exposure image;
[0142] An exposure area calculation module 730, configured to calculate an over-exposed area, an under-exposed area, a well-exposed area, and an exposure blind area according to the first exposure time and the second exposure time;
[0143] A composite image generation module 740, configured to generate a composite image according to the over...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
Embodiments of the present invention provide a video pipeline processing method and device. The method includes: acquiring a long-exposure image and a short-exposure image corresponding to the spacecraft; acquiring a first exposure time corresponding to the long-exposure image and a second exposure time corresponding to the short-exposure image; time and the second exposure time, calculate the overexposed area, underexposed area, well exposed area and exposed blind area; according to the overexposed area, the underexposed area, the well exposed area and the described exposed blind area, A composite image is generated; and a high dynamic range image corresponding to the spacecraft is determined according to image parameters of the composite image. The embodiments of the present invention can adaptively adjust mapping parameters according to video image data, and can meet real-time requirements.
Description
technical field [0001] The invention relates to the technical field of image processing, in particular to a video pipeline processing method and device. Background technique [0002] On-board HDR (High-Dynamic Range, high-dynamic-range images) technology processes video streams and images in the form of data strings, and continuously outputs each imaging result in line format. Compared with the image algorithm, the HDR video streamalgorithm includes HDR video stream generation, video streamencoding algorithm, decoding algorithm, synthesis and tone mapping algorithm. Therefore, the pipeline processing HDR video algorithm requires higher real-time performance, and how to reduce the memory usage on a hardware platform with limited resources has also been a research issue. [0003] Luo Xuemei et al. used the color appearance model to reproduce high dynamic range images. Chen Huaizhang et al. used an experimental platform with DMD and FPGA devices to expand the dynamic range o...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More
Patent Type & AuthorityPatents(China)
IPC IPC(8): H04N5/235
CPCH04N23/741H04N23/73
Inventor董书莉郭进一董方刘冰洁张润鑫李阳杨翊东张斐然常淞泓武文波李春梅
OwnerBEIJING RES INST OF SPATIAL MECHANICAL & ELECTRICAL TECH
Login to View More 
Login to View More