43 results about "High-dynamic-range imaging" patented technology

This disclosure provides a video production method, apparatus, electronic device, and storage medium. The method includes: when producing a video file using high dynamic range imaging technology, determining first metadata information, wherein the first metadata information is ambient light-related metadata information; and writing the first metadata information into the header information of the video file. This disclosure expands the metadata information of video files, improves the display effect of video files produced under different ambient light conditions, and enhances the usability of HDR technology.

Disclosed is an imaging system with an image sensor and processor(s). The image sensor has a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor; a colour filter array with colour filters of at least three different colours; and a polarisation mask with polarisation filters arranged on an optical path of at most a first predefined percent of the colour filters. The processor(s) is / are configured to: read out image data from the image sensor; and process the image data to generate at least one of: a full-resolution colour image, a full-resolution polarisation image, a high-dynamic range (HDR) image.

An image processing apparatus for forming an enhanced image is disclosed. The apparatus comprises one or more processors configured to: receive one or more input images; form, from each of the one or more input images, a respective feature representation, each feature representation representing features of the respective input image; and subject the one or more feature representations to a symmetric pooling operation to form an enhanced image from at least some of the features of the one or more feature representations identified by the symmetric pooling operation. The apparatus may generate images with increased photoreceptive dynamic range, increased bit depth and signal-to-noise ratio, with less quantization error and richer colour representation.

This invention relates to the field of high dynamic range imaging technology and discloses a deep learning-based high dynamic range imaging method. The method includes acquiring original images with different exposure types; extracting features from the original images; using a cross-frame entanglement mechanism to perform quantum motion compensation on abnormal exposure feature maps based on normal exposure feature maps, resulting in compensated abnormal exposure feature maps; fusing features between the normal exposure feature maps and the compensated abnormal exposure feature maps using a multi-scale feature pyramid and adaptive spatial attention, resulting in fused features; and reconstructing the image using an attention-guided residual reconstruction model to obtain a high dynamic range image. This invention solves the motion offset problem between multi-exposure images through quantum motion compensation, eliminating dynamic blur; achieves detail enhancement and color correction through a multi-scale feature pyramid and spatial attention; and reduces computational complexity and improves reconstruction efficiency through a lightweight reconstruction model.

The embodiment of the invention discloses a multi-lens shooting system. The multi-lens shooting system comprises a control assembly, a double-rate synchronous dynamic random access memory DDR, a first processing assembly comprising n image front-end processing units IFPU, a second processing assembly comprising m high dynamic range imaging HDR sensors, and an HDR pipeline arranged on any IFPU, and n and m are integers greater than 0; and the control assembly is used for performing opening and closing control on a connection circuit between the IFPU and the corresponding HDR sensor, controlling the IFPU to output corresponding exposure data to at least one of the DDR pipeline and the HDR pipeline, and controlling the HDR pipeline to perform hardware HDR processing on at least one path of exposure data. According to the invention, the purpose of HDR multi-camera video recording is realized by designing and multiplexing a set of HDR hardware based on time division, and on the premise of ensuring a certain rate, the chip area is effectively reduced, and the construction cost is reduced.

Image data from an image sensor is read out, wherein when reading out, processor(s) is / are configured to employ subsampling. The image data is processed, using neural network(s), to generate an image.

An image processing apparatus (700) comprising one or more processors (704) is described herein for: receiving (601) a plurality of input images (301, 302, 303); for each input image, forming (602) a decomposition dataset by decomposing the input image (301, 302, 303) or a filtered version thereof (307, 308, 309) into a plurality of frequency-specific components (313), each frequency-specific component representing occurrences of features of a respective frequency interval in the input image or filtered version thereof; processing (603) each decomposition dataset using one or more convolutional neural networks to form a combined image dataset (327); performing (604) a build operation on the combined image dataset (327), the build operation being adapted for image building from a plurality of frequency-specific components, thereby forming an output image (333) representing a combination of the input images. The generated HDR output image can have fewer artifacts and provide better quality results. Furthermore, the apparatus is computationally efficient, maintaining a good balance between accuracy and efficiency.

The invention discloses a high-dynamic-range imaging CMOS camera based on a K7 gigabit network. The high-dynamic-range imaging CMOS camera comprises a camera shell 9, and a high-dynamic-range imaging CMOS camera body is installed in the camera shell 9. The CMOS camera body comprises a CMOS sensor chip 1, an FPGA (Field Programmable Gate Array) programmable logic device 2, a DDR3 (Double Data Rate 3) high-speed memory 3, a FLASH memory chip 4, a gigabit Ethernet interface 5, a GPIO (General Purpose Input / Output) isolation interface 6 and a power supply module 7. The FPGA chip receives high-gain and low-gain 2048 * 2048 resolution image data from the CMOS sensor chip at the same time, data caching is carried out through the DDR3 high-speed memory, high-dynamic-range image synthesis is completed in real time, images with 46 frames per second (the resolution is 2048 * 2048) and the dynamic range reaching 70.3 dB are output through the gigabit Ethernet interface, and working parameters of the camera can be configured through a computer.

The application discloses a panoramic depth high dynamic range imaging system and method based on compound eye structure, relates to the technical field of computational imaging and image processing, and synchronously collects and multi-scale motion estimation ensures the time sequence consistency between sub-images, effectively reduces the splicing dislocation and ghosting caused by the rapid movement or partial occlusion of an object, and improves the stability of a dynamic scene; an adaptive HDR fusion mechanism based on exposure difference and local features preferentially retains high-contrast unsaturated region details through intelligent weight distribution, overcomes the overexposure and underexposure problems under backlight or light mutation, and makes the output image naturally smooth in the bright-dark transition area; in addition, multi-scale depth synthesis and edge perception filtering work cooperatively, enhances the depth estimation accuracy of a low-texture area, avoids depth jumping and edge blurring, and guarantees the overall definition of the panoramic depth image; meanwhile, rolling shutter correction and space-time interpolation compensation further reduce dynamic ghosting and noise interference.

An imaging device includes a pixel-circuit and a readout circuit. The pixel-circuit includes a photodetector. The readout circuit is configured to perform a series of iterations, each iteration including (i) accumulating an electrical charge in the photodetector during an integration time, (ii) transferring a portion of the electrical charge accumulated in the photodetector to a floating diffusion, the portion being less than all the electrical charge accumulated in the photodetector, and (iii) coupling a voltage of the floating diffusion to a storage capacitance, to subsequently, in a final iteration, transfer a remaining electrical charge from the photodetector, and to derive an output digital value, indicative of a total energy of the light incident on the photodetector over the series of iterations and the final iteration, from the voltage on the storage capacitance and from the remaining electrical charge transferred in the final iteration.

The application discloses a multi-frame fusion fixed image noise dynamic compensation system and method, and particularly relates to the technical field of image processing, and is used for solving the problem of the existing independent noise compensation leading to the noise band artifact of the fusion boundary; a mapping relationship between the pixel-level imaging parameter difference degree and the fusion weight is established by acquiring a multi-frame image sequence with different imaging parameters and identifying a transition area with a dramatic change in luminance gradient; a noise visibility correction factor is generated by extracting the frequency energy skewness feature and the chroma phase change boundary feature of the transition area through nonlinear fusion; the multi-frame noise compensation is cooperated by dynamically constraining the compensation intensity range; finally, the cooperative compensation is executed within the constraint range and fused and output; the discontinuity of the fusion boundary noise is effectively eliminated, and the visual quality of the high dynamic range imaging is significantly improved.

The invention relates to the technical field of digital image processing, in particular to a light energy fusion-based high dynamic range image acquisition method, which comprises the following steps of: constructing an imaging system comprising a low-sensitivity sensor, a medium-sensitivity sensor and a high-sensitivity sensor; the method comprises the following steps: carrying out high dynamic range imaging on a shooting scene by using an imaging system, and respectively obtaining three corresponding images in three sensors: respectively carrying out corresponding calculation on the three images according to respective inverse response functions of the three sensors to obtain light energy corresponding to the three sensors; corresponding fusion weights are set for the three kinds of light energy; fusing the three kinds of light energy by using the fusion weight to obtain shooting scene light energy of the shooting scene; and according to the three inverse response functions and the corresponding light energy, carrying out step conversion on the scene light energy to obtain a high dynamic range image of the shooting scene.

The high dynamic range imaging network method based on pyramid structure spatial feature transformation is based on three sub-networks: a deformable convolutional alignment network, a PSFT conditional network, and a fusion network of deformable convolutional residual dense blocks. The process is as follows: 1) The exposure of the input image is aligned using gamma correction, and then all images with and without exposure alignment are input into two convolutional layers of the deformable convolutional alignment network with shared offsets to obtain preliminary image features; 2) The exposure-aligned image features are geometrically aligned in the deformable convolutional alignment network with shared offsets, and the offset obtained in the geometric alignment process is also applied to the LDR image features without exposure alignment for geometric alignment; only gamma correction is used to align the exposure; 3) The geometrically aligned LDR image features without exposure alignment are input into the PSFT-based conditional network to obtain optimized features and obtain a high dynamic range image.

The invention discloses a compressor valve plate welding positioning method and system based on machine vision, and relates to the field of image welding positioning, polarization structured light is actively projected, the interference of mirror reflection on imaging is inhibited from a physical source by using polarization characteristics, and meanwhile, the structured light technology is used for extracting fragile gray-scale edges from a positioning problem; and more stable light stripes which are deformed or interrupted on the surface of the object are analyzed. And by combining a high dynamic range imaging technology and fusing a multi-exposure frame sequence, it is ensured that feature details of highlight and dark areas are completely reserved. On the basis of the high-quality image, a group of stable and reliable feature point sets can be obtained by decoding the structured light and accurately extracting discontinuous points generated at the outline of the valve plate. And subsequently, contour fitting and pose calculation are carried out based on the point set, so that high-precision and high-robustness positioning of the valve plate is realized.

The application relates to an ultrahigh dynamic range imaging system and method based on a diffusion model image prior, the system comprising a pre-alignment module, a variational autoencoder, a decomposition fusion control module, a fidelity control module and a variational self-decoder, and the method comprising the following steps: adopting an optical flow estimation algorithm to transform and align a short-exposure image onto a long-exposure image, and masking a blocked area to obtain a pre-alignment result; decomposing information of the short-exposure image and the long-exposure image, and fusing and tone mapping the pre-alignment result by controlling a fusion process of a diffusion model to obtain a fusion result; controlling fidelity of the fusion result according to the long-exposure image and the pre-alignment result, and obtaining a reconstructed image through decoding. Compared with the prior art, the application can improve alignment and fusion robustness under the condition that exposure levels are greatly different, and can generate natural and realistic tone mapping effects in an ultrahigh dynamic range scene.

The invention relates to the technical field of image processing, and provides a high dynamic range imaging exposure interpolation method and device, equipment and a medium. The method comprises the following steps: acquiring a high-exposure image and a low-exposure image for the same scene, wherein the exposure time of the high-exposure image is longer than that of the low-exposure image; respectively mapping the high-exposure image and the low-exposure image to a target exposure time to obtain a first intermediate image and a second intermediate image; performing weighted fusion processing according to the first intermediate image and the second intermediate image to generate an initial intermediate exposure image; and inputting the initial intermediate exposure image into a pre-trained residual diffusion model, and performing residual detail recovery on the initial intermediate exposure image through the pre-trained residual diffusion model so as to generate a high dynamic range image based on the recovered residual details. According to the method, through a technical path of combining physical exposure interpolation and residual diffusion optimization, high-quality and high-dynamic range image reconstruction with natural vision and rich details is realized.

Described herein is an image processing apparatus (1200) for forming an enhanced image, the apparatus comprising one or more processors (1204) configured to: receive (1101) one or more input images (301, 302, 404, 405, 406, 501, 502, 503, 601, 602, 603); form (1102) a respective feature representation from each of the one or more input images, each feature representation representing features of the respective input image; perform (1103) a symmetric pooling operation (305) on the one or more feature representations to form an enhanced image (408, 505, 608) from at least some of the features of the one or more feature representations identified by the symmetric pooling operation. The apparatus can generate images with greater dynamic range of sensitivity, greater bit depth and signal-to-noise ratio, and with less quantization error and richer color representation.

The present disclosure provides a video production method and apparatus, an electronic device, and a storage medium. The method comprises: when a video file is produced using high dynamic range (HDR) imaging technology, determining first metadata information, the first metadata information being metadata information related to ambient light; and writing the first metadata information into header file information of the video file. The present disclosure expands metadata information of the video file, improves the display effect of video files produced under different ambient light conditions, and improves the availability of HDR technology.

The invention particularly relates to a semantic knowledge migration-based high dynamic range imaging method, which comprises the following steps of: acquiring a low dynamic range image, and generating an initial high dynamic range image by utilizing an initial high dynamic range reconstruction model; converting the initial high dynamic range image into a reconstructed image of a standard dynamic range domain through domain migration operation; processing the reconstructed image of the standard dynamic range domain by adopting a semantic segmentation network SAM to obtain semantic priori; processing the reconstructed image of the standard dynamic range domain by combining semantic prior with a semantic prior guidance reconstruction model to obtain a refined reconstructed image; based on a knowledge distillation method, cross-domain semantic priori migration is realized at three levels of content, color and features, and an initial high dynamic range reconstruction model is optimized through a combined loss function; in the reasoning stage, only the optimized initial high dynamic range reconstruction model is adopted to output a final high dynamic range image. According to the method, high-dynamic-range image reconstruction is carried out by effectively utilizing the advanced capability of semantic priori.

This invention provides a solid-state imaging device, a driving method for a solid-state imaging device, and electronic equipment that enable sufficient high dynamic range and image quality, and that offer an AD conversion unit with a small circuit area and low power consumption for high dynamic range imaging. [Solution] The pixel signal processing unit 400 includes an AD conversion unit 430 capable of performing AD conversion processing to convert the first conversion gain signal and the second conversion gain signal of the input pixel signal from an analog signal to a digital signal, and a multiple bit memory (SRAM) unit 440. The AD conversion unit 430 determines which of the first conversion gain signal and the second conversion gain signal is required for image generation, and selects information to be stored in the memory unit 440 based on the determination information.

Image sensors, imaging systems, and methods for high dynamic range imaging. The image sensor includes image sensor pixels, a light filter, and a controller. The light filter is configured to attenuate transmission of incident light to the image sensor pixels. The controller is configured to set the light filter to a high-transmission state and capture a first image generated by the image sensor pixels during a first exposure. The controller is also configured to set the light filter to a low-transmission state and capture a second image generated by the image sensor pixels during a second exposure. The controller is further configured to combine the first and second images to generate a high dynamic range image. The controller is also configured to adjust an attenuation of the light filter for a next iteration of the low-transmission state based on pixel signals generated during the second exposure.

The invention provides a distributed photovoltaic regulation and control device based on four fusible terminals, and the device comprises a fusion terminal unit, an edge coordination unit, and a cloud cluster optimization unit, which are connected with a deterministic message channel through a publishing and subscribing bus to form an end-side cloud cooperation system. The fusion terminal unit comprises a visual perception module, a measurable electric parameter module, a computable planning module and a controllable execution module which form the same software and hardware stack, and the visual perception module obtains a sky scene image and the brightness of a reflection target surface and implements multi-frame high dynamic range imaging and self-calibration; fusing environmental meteorology and assembly back temperature information, and outputting short-time irradiance estimation and cloud cluster evolution characteristics; according to the invention, the problems proposed in the background technology are solved.

The application discloses a part surface reflection light suppression method based on high dynamic range imaging and photometric stereo vision, and has the characteristics that: first, a visual detection system is established, the visual detection system comprising a visual system framework, an industrial camera and a lens, a diffuse reflection light source and a strip light source, a polarizer and a light source controller; second, the industrial camera and the lens are assembled, the polarizer is arranged on the lens, the camera is fixed on the upper middle of the visual system framework, and the part to be detected is placed below the camera; third, the light source is arranged; meanwhile, the strip light source is arranged at multiple directions of the part to be detected, and the light source is connected with the light source controller; fourth, the detection is completed. The application solves the interference of the part surface high reflection light to the visual detection in the image preprocessing process, effectively suppresses the part high reflection light interference, and introduces the visual detection method into the industrial field, thereby expanding the applicability of the visual detection.

The invention relates to the technical field of artificial vision and neuromorphic devices, and particularly discloses a retina-like adaptive vision device based on a perovskite and hydrogen bond organic framework material heterostructure and a preparation method of the retina-like adaptive vision device. According to the device, a hydrogen bond organic framework is adopted to regulate and control perovskite crystal lattices, carboxyl and lead ion coordination are utilized to induce crystal lattice strain, defect energy barriers are effectively improved, non-radiative recombination of carriers is inhibited, and dynamic regulation and control of photon-generated carriers are achieved. The device can realize the functions of light adaptation and dark adaptation driven by light intensity without voltage modulation, and shows the Weber's law response characteristic similar to the retina of human eyes. The device shows ultra-low monopulse power consumption, wide spectral response range, response speed close to human eyes and high dynamic range, is obviously superior to a traditional CMOS sensor, and provides a new way for high dynamic range imaging and on-chip neuromorphic calculation.

This invention discloses a packaging inspection method and system based on high dynamic range 3D imaging, relating to the field of semiconductor packaging inspection technology. The method includes: acquiring multi-exposure images of the packaged device surface; pre-classifying the point cloud into metal pads, molding compounds, and pin regions based on the curvature coefficient of the saturation region and the dynamic range width of the linear region of the brightness response curve; calculating the normal vector dispersion index to extract complete point cloud layers for each material; constructing a weighted spatial transformation error function using this index as dynamic weights, and fusing multiple point clouds into a high-density complete point cloud; calculating a weighted fusion value of the local surface curvature change rate and depth gradient modulus, matching it with defect feature intervals to identify cold solder joints, warpage, and cracks, and outputting their locations; calculating a dynamic threshold based on the fusion value and the normal vector dispersion index, outputting a pass / fail conclusion, and generating an inspection report. This invention significantly improves the defect detection accuracy and reliability of complex surface packaging by adaptively adjusting parameters.

This application discloses an image processing method, apparatus, and electronic device, belonging to the field of artificial intelligence technology. The method includes: acquiring at least two mask images and an image restoration guide map corresponding to at least two first images, wherein the mask images are used to indicate the area to be restored in the first images, and the image restoration guide map is used to indicate the restoration target of the area to be restored, and the first images are low dynamic range (LDR) images; and performing image restoration processing on at least two first images based on the at least two mask images and the image restoration guide map to obtain high dynamic range (HDR) images.

This application provides a projection display system, relating to the field of optical technology, aiming to achieve high dynamic range imaging overlay with "high peak power and low average power consumption". The projection display system includes a controller, a base image engine, and a high-brightness compensation engine. The controller is configured to obtain a base frame based on image data, determine the desired brightness of each compensation pixel based on the image data, and calculate the output brightness of each compensation pixel based on a power budget to obtain a sparse high-brightness instruction containing the output brightness of the compensation pixels. The base image engine is configured to display a base image based on the base frame under the control of the controller. The high-brightness compensation engine is configured to output laser light at the compensation pixels according to the sparse high-brightness instruction under the control of the controller.

The invention discloses an uncooled same-frequency heterogeneous infrared detector and a preparation method thereof, and relates to the technical field of semiconductor devices. The first micro-bridge structure and the second micro-bridge structure are integrated on the same wafer substrate to form the focal plane pixel array, the first micro-bridge structure with higher thermal capacity of the thermosensitive layer and higher thermal resistance of the bridge legs is used as a high-sensitivity pixel, and the second micro-bridge structure with smaller thermal capacity of the thermosensitive layer and lower thermal resistance of the bridge legs is used as a low-sensitivity pixel. The high-sensitivity pixels and the low-sensitivity pixels have the same photosensitive frequency band and are integrated on the same focal plane, high-dynamic-range imaging can be realized, an infrared image with rich details from a dark part to a bright part is obtained, the low-sensitivity pixels adapt to the frame frequency optimization requirement, the high-sensitivity pixels adapt to the high-image quality requirement, and the image quality is improved. Key performance indexes such as sensitivity, dynamic range, response speed and the like of the uncooled infrared detector are considered, and finally high-quality infrared imaging is realized.

The application discloses a photographing method and device, electronic equipment and a readable storage medium, and belongs to the technical field of electronic equipment. The photographing method comprises the following steps: displaying a photographing preview interface corresponding to high dynamic range imaging; in response to a first input to the photographing preview interface, determining a target type of exposure image; the target type of exposure image is one of a first exposure image, a second exposure image and a third exposure image, the first exposure image, the second exposure image and the third exposure image are used for generating a high dynamic range image, and the first exposure image, the second exposure image and the third exposure image correspond to different exposure time ranges respectively; in response to a second input to the photographing preview interface, a target exposure time is determined; and the target type of exposure image is collected according to the target exposure time.

Systems and methods are disclosed to enable fast readout from an image sensor to support pixel-wise conversion gain selection for high dynamic range imaging. In embodiments, an image sensor integrated circuit performs the pixel-wise gain selection with its readout circuitry, so that the image sensor outputs pixels with only the selected gain option. In this manner, the image sensor is able to achieve faster frame rates and lower power consumption. Depending on the embodiment, the conversion gain may be selected by the readout logic, an image signal processor, or an auto-exposure engine. The gain selection may be made based on a previous image captured by the camera or other pixels in the same image. The image signal processor may interpolate a high-gain and a low-gain portion of the image to obtain full resolution images in the two gain options, and merge the two to obtain the final image.