11 results about "Computational photography" patented technology

The invention relates to the technical field of multi-camera image processing and computational photography, and discloses an image processing method and system based on four-camera cross-focal-length continuous zooming fusion. The image processing method comprises the steps of system initialization, image acquisition, zoom routing, automatic ROI extraction and tracking, field-of-view cutting and geometric alignment, image fusion and binocular depth recognition. Through systematized multi-camera collaborative design, an innovative mechanism is introduced in key links such as zoom routing, geometric alignment, image fusion and depth recognition, smooth zoom, space consistency, detail fidelity, power consumption optimization and high-quality 3D perception are realized, the imaging quality is improved through the effects, the application scene is expanded, and the application prospect is wide. And a comprehensive solution is provided for mobile photography, AR and intelligent visual systems.

The invention relates to the field of image enhancement, provides a low-light image enhancement method and device, aims to realize low-light image enhancement with interpretability, low complexity and high enhancement performance, and realizes differential enhancement of different brightness intervals by constructing a bipartite function enhancement model and utilizing correction parameters in the bipartite function enhancement model to regulate and control concavity and convexity of a function curve. Meanwhile, parameters are optimized in combination with a genetic algorithm, the defects that a traditional method is poor in enhancement effect and parameters depend on manual adjustment and optimization are overcome, the problems that a deep learning method is high in complexity and weak in interpretability are solved, core indexes such as detail reservation, color naturalness, real-time performance and scene adaptability of the low-light image are obviously improved, and the method is suitable for popularization and application. The method can be widely applied to the fields of video monitoring, automatic driving, medical imaging, computational photography, industrial visual inspection and the like.

The application provides a single-pixel diffraction imaging method and device, and belongs to the field of coherent diffraction imaging and computational photography, wherein the method comprises the following steps: (1) in the single-pixel imaging light path, different modulation sequences are used to modulate the illumination light beam of the target scene, and a single-pixel detector is used to record the intensity value of a one-dimensional sequence; (2) the intensity value corresponding to the different modulation sequences is used to replace the amplitude value of the reconstructed diffraction light field on the detector plane, and then alternating iteration calculation is performed until the target scene is reconstructed. The application has the advantages of simple structure, strong operability, wide application range and strong expandability. Through the application, the cost of single-pixel diffraction imaging can be reduced, fast and accurate measurement of the target scene is realized, and convenience is brought to high-quality single-pixel imaging.

The invention provides a dark field image acquisition method and device, an image correction method and device, equipment and a medium, and relates to the field of image processing, in particular to the technical fields of digital image signal processing, sensor noise calibration, computational photography and the like. According to the implementation scheme, the method comprises the steps of S1, obtaining a target image generated by an image sensor based on imaging parameters and a shooting part in a first state; s2, on the basis of at least one of the parameter information of the shooting part or the target image, determining whether a dark field acquisition condition is satisfied; and S3, in response to a dark field acquisition condition, switching the shooting part into a second state, acquiring a dark field image under the current imaging parameter, and adding the dark field image into a dark field database.

This application discloses a low-light image compression method and system based on an intelligent diffusion model, relating to the fields of image compression and computational photography. The method includes: mapping a low-light image to a low-dimensional latent space using an encoder to obtain a latent feature representation; performing adaptive quantization on the latent feature representation to obtain a discretized compressed feature representation; using the compressed feature representation as a condition, performing an iterative denoising process through a conditional diffusion model to reconstruct a clear latent feature representation; and converting the reconstructed clear latent feature representation to pixel space using a decoder to generate a reconstructed image. The parameters of the conditional diffusion model and encoder are optimized based on an intelligent gain criterion, which is the ratio of information gain to system complexity. This application achieves efficient compression and high-quality reconstruction of low-light images at extremely low bit rates, effectively suppressing noise and restoring details.

An endoscopy system having a low-profile multi-imager endoscope. The system is capable of using computational photography to provide enhanced output images using techniques such as super-resolution, foveation, magnification, and two-dimensional to three-dimensional conversion. The enhanced output images can improve clinical decision making and patient treatment. Signals from multiple imagers may be used to affect / adjust handing characteristics of the endoscope or direct semi-robotic guidance thereof.

The method of snapshot compressive imaging three-dimensional Gaussian splatting reconstruction belongs to the field of computer vision and computational photography. A reconstruction network based on the hybrid architecture of stochastic gradient Langevin dynamics (SGLD) and explicit three-dimensional Gaussian representation is built. Then, multiple physical perception modules are combined to achieve the deep decoupling and reconstruction of the spatiotemporal information of dynamic scenes. Driven by the embedded decoupling deformation field, the deformation field contains a coarse-grained trajectory prediction branch and a fine-grained integral fitting branch: the coarse-grained branch combines low-frequency time coding with latent embedding features, enabling Gaussian primitives to capture global rigid motion trajectories and serving as a temporal regularizer; the fine-grained branch uses high-frequency time coding to predict non-rigid deformation and physically fits the motion blur stripes generated by temporal integration through anisotropic scale stretching. An adaptive density control strategy compatible with physics is introduced. Using the physical integral imaging simulation module, high-fidelity and multi-view consistent high-speed dynamic three-dimensional scene reconstruction results are obtained.

The present application relates to a kind of single-pixel imaging method and device of supervised and unsupervised learning combination, belong to the field of computational photography technology.The method designs a kind of single-pixel one-step imaging network based on Transformer, can directly from undersampled single-pixel measurement value reconstruct target image, without the step of solving approximate result, while using the way of supervised learning and unsupervised learning combination to train the network, guarantee the strong generalization of method.Through the combination of mean square loss function and total variation loss function, prevent network from appearing overfitting problem, guarantee the reconstruction performance of method.The device includes data acquisition submodule, supervised learning submodule, unsupervised learning submodule and reconstruction submodule.The present application can effectively capture the long-range dependence between single-pixel measurement value, can realize high-quality single-pixel imaging under low sampling.

The application discloses an inverse ISP method based on a spiral diffusion model and camera perception adaptation, and relates to the technical field of computer photography and image signal processing. The method comprises the following steps: S1, constructing an inverse ISP training sample, each training sample comprising an RGB image, a target RAW image corresponding to the RGB image and a camera label; S2, constructing an inverse ISP network based on a spiral diffusion model, introducing a time-varying weight map related to pixel intensity at different time steps in the diffusion process; S3, setting a camera perception low-rank adaptation module in the inverse ISP network, comprising a plurality of low-rank adaptation branches corresponding to different camera labels, and selecting a corresponding low-rank adaptation branch to participate in network calculation according to the input camera label; S4, in the training stage, training the inverse ISP network based on the forward probability distribution of the spiral diffusion model; in the sampling stage, inputting the RGB image and the camera label into the trained inverse ISP network, and obtaining the target RAW image based on the reverse iterative sampling process of the spiral diffusion model.

The invention relates to the technical field of computer vision and computational photography, in particular to a structured scanning platform for quickly capturing a design manuscript and a deviation rectifying method, which comprises the following modules: a multi-modal sensing module for projecting a phase shift stripe sequence and acquiring a modulation image, solving an absolute phase by using a multi-frequency heterodyne method, and obtaining physical point cloud data of the surface of the design draft based on triangulation; and the discrete geometric modeling module constructs the physical point cloud data into a pure complex grid by using Delauni triangulation, calculates the Euclidean distance of the side length of the grid as a discrete Riemannian metric value, and constructs a discrete Hough star operator. In the invention, through an active optical flow closed-loop feedback mechanism, the Lie derivative flow is driven by phase residual error to iteratively correct the discrete Riemannian metric, and then high-fidelity physical expansion is realized, so that the problems that open-loop geometric projection is mostly adopted in the traditional correction technology, and physical precision verification is lacked, so that the correction precision is poor are solved. And therefore, the problems of scale distortion and texture distortion after the precision drawing is digitalized can be solved.

This invention discloses an inverse ISP image reconstruction method based on a diffusion model, belonging to the fields of computer vision and computational photography. This method uses pure noise as the initial input and introduces the target RGB image as a conditional constraint during the diffusion-based inverse denoising process. By fine-tuning the pre-trained diffusion model using ControlNet, the model learns the mapping relationship between RGB and RAW, thereby gradually guiding the reconstruction of a RAW domain image consistent with the conditional RGB content. To improve the structural consistency, detail fidelity, and color / brightness response of the reconstruction results, this invention incorporates attention-guided strategies (such as spatial attention and cross-feature interactive attention) during the conditional injection process. This fully utilizes the edge, texture, and semantic information in the RGB image, suppressing artifacts and detail loss caused by inversion / reconstruction, and enhancing the ability to restore details in extreme exposure areas such as highlights and shadows.