53 results about "Sparse image" patented technology

The invention discloses a million-frame-level industrial vision system and method based on event driving and compressed sensing, and the system is characterized in that an event camera imaging module in the system captures the brightness change of each pixel in a field of view of the event camera imaging module in an asynchronous manner, and generates an event containing a pixel coordinate, a timestamp and change polarity for each change; a compressed sensing coding module constructs sparse image vectors for events in a time window, and the sparse image vectors are projected to low-dimensional observation vectors through an observation matrix phi; the sparse image reconstruction module is used for optimizing an objective function through sparse constraint and total variation regularization; a dynamic ROI compression module controls a compression mask function according to the event density and a gradient threshold. The method can break through the limitation of the traditional frame rate, has the advantages of high precision, high efficiency, low power consumption, strong robustness and the like, and has a wide industrial application prospect.

The invention discloses a three-dimensional Gaussian splashing method and system for sparse view curve reconstruction, and the method reconstructs a three-dimensional curve scene through a sparse image: firstly, obtaining a dense point cloud and a camera pose, extracting a two-dimensional line segment graph, employing a line segment guide Gaussian initialization strategy, and obtaining a three-dimensional curve scene; generating an initial Gaussian set on the basis of the dense point cloud and the two-dimensional line segment graph; structure perception Gaussian pruning is executed in the optimization process of the initial Gaussian set, and spatial outliers and visibility redundant gauss are removed; and finally, calculating the total loss containing sparse regular terms through the difference between the rendered image and the sparse image, and iteratively optimizing Gaussian parameters until the total loss converges, thereby obtaining a final three-dimensional curve reconstruction result. According to the method, the problem of geometric prior deficiency under a sparse view is solved through line segment guide initialization, overfitting and artifacts are effectively inhibited by using structure pruning and sparse constraint, and high-quality three-dimensional curve reconstruction is realized.

The invention discloses a sparse view angle three-dimensional Gaussian language field construction method and system for humanoid robot grabbing. Comprising the following steps: acquiring an RGB image set and a user natural language instruction under a sparse view angle; reconstructing a three-dimensional point cloud through stereo matching, and initializing a three-dimensional Gaussian primitive field after noise elimination and measurement alignment; two-dimensional semantic features are embedded into the field, joint optimization is carried out through a double-path semantic supervision module, and a three-dimensional Gaussian language field with consistent semantics is constructed; wherein the dual-path semantic supervision comprises an object perception path and a global context path, the local semantic consistency and the overall semantic relationship are constrained respectively, and the final semantic representation of each Gaussian primitive is obtained through weighted fusion; and finally, candidate grabbing postures are generated, semantic reordering is carried out in combination with a language instruction, and the optimal grabbing posture is screened through geometric-semantic joint scoring. Under the sparse image set input condition, the execution accuracy of a robot grabbing task under a complex instruction can be improved.

A computer-implemented method of generating training data to be used to train a machine learning model for generating a segmentation mask of an image containing overlapping particles. Training data is generated from sparse particle images which contain no overlaps. Generating masks for non-overlapping particles is generally not a problem if the particles can be identified clearly; in many cases simple methods such as thresholding already yield usable masks. The sparse images can then be combined to images which contain artificial overlaps. The same can be done for the masks as well which yields a large amount of training data, because of the many combinations which can be created from just a small set of images. The method is simple yet effective and can be adapted to many domains for example by adding style-transfer to the generated images or by including additional augmentation steps.

The application provides a SAR image target detection method based on SAR image sparse enhancement and Bayesian saliency detection; comprising: step one: inputting a matched filter SAR image, obtaining initial values of regularization parameters of a SAR sparse enhancement method by calculating gray statistical characteristics of the image; step two: solving a convolution sparse feature enhancement algorithm model based on L1 norm by using an alternating direction multiplier method, and obtaining a SAR sparse enhancement image; step three: calculating a Bayesian saliency map of the SAR sparse enhancement image, binarizing the saliency map by using a threshold detection method, and realizing final target detection. The method can reduce SAR speckle noise by using a sparse image enhancement method, reduce background gray values, highlight target regions by using a SAR image saliency detection method, further reduce background pixel values, and finally realize efficient detection of ground and sea surface targets of interest.

The application discloses an industrial CT image reconstruction method and device, electronic equipment and storage equipment, comprising obtaining projection image data and preprocessing to obtain target image data; based on the pre-trained U-Net variant lightweight network, the target image data is processed to obtain fine gradient direction prediction data and structure level similarity data, the U-Net variant lightweight network is trained based on the projection image data and the true value image data, and the loss function of the U-Net variant lightweight network comprises a structure similarity loss; based on the target image data, the fine gradient direction prediction data and the structure level similarity data, the target function is iteratively updated by using an alternating direction multiplier method to obtain reconstructed image data, and the target function is a high-order regularization function constructed based on the second-order total generalized variation and the structure level non-local mean of the iterative image data. The application can inhibit the streak artifact and photon noise of sparse images, so as to meet the requirements of fast scanning and sparse image reconstruction quality.

The embodiment of the invention discloses an image processing method and device, electronic equipment and a computer program product. The method comprises the following steps: acquiring a first grey-scale map and a blurring intensity map corresponding to a to-be-processed image; processing light source points contained in the first grey-scale map to obtain a light spot reference map; generating a second sparse image according to the light spot reference image and the first sparse image; and according to the second sparse image and the blurring intensity image, performing point diffusion processing on each target pixel point in the to-be-processed image to obtain a target blurring image corresponding to the to-be-processed image. According to the image processing method and device, the electronic equipment and the computer program product, the calculated amount of image blurring can be reduced, the edge of the light spot in the obtained target blurred image is sharper, the definition and layering sense of the light spot are improved, and therefore the visual effect of the target blurred image is improved.

The application discloses a sparse-view three-dimensional Gaussian language field construction method and system for humanoid robot grasping. The method comprises the following steps: acquiring an RGB image set under sparse-view and a natural language instruction of a user; reconstructing a three-dimensional point cloud through stereo matching, initializing a three-dimensional Gaussian primitive field after noise elimination and metric alignment; embedding two-dimensional semantic features in the field, jointly optimizing through a double-path semantic supervision module, and constructing a semantic-consistent three-dimensional Gaussian language field; wherein the double-path semantic supervision comprises an object perception path and a global context path, which respectively constrain local semantic consistency and overall semantic relationship, and the final semantic representation of each Gaussian primitive is obtained through weighted fusion; finally, candidate grasping postures are generated, semantic reordering is performed in combination with the language instruction, and the optimal grasping posture is selected through geometric-semantic joint scoring. The method can improve the execution accuracy of the robot grasping task under complex instructions under the condition of sparse image set input.

The present application belongs to the technical field of photoelectric countermeasure, and relates to a detection technology for a hidden camera device, and particularly provides a long-distance detection method for a hidden camera device based on sparse representation, which is used to overcome the problem of low recognition accuracy in the prior art; in the present application, after sparse representation of an image through wavelet transform, a measurement matrix group is obtained by compressing and projecting the sparse image using a random measurement matrix; a measurement matrix without static background and dynamic background information is obtained by performing a series of difference addition operations on the matrix group; then, the orthogonal matching pursuit algorithm is used to reconstruct and recover the measurement matrix to obtain a recovered image; finally, the cat-eye target area is screened out according to the image pixel value and the connected area area judgment method, so as to realize the cat-eye effect target recognition method based on sparse representation; in this way, the image data redundancy is greatly reduced, the recognition accuracy of the long-distance cat-eye target is effectively improved, and the anti-detection of the hidden camera device is realized, so as to eliminate the potential information leakage danger.

The application belongs to the technical field of camouflage target detection, and provides a camouflage target detection method and system based on confidence awareness evaluation pruning, which comprises the following steps: acquiring a target image to be detected; extracting confidence information in the acquired target image; dividing the acquired target image into a first target image and a second target image according to the extracted confidence information and a double-threshold strategy; processing the obtained first target image by using a double-path feature compensation mechanism to obtain a first target compensation image; performing recursive token backfilling on the obtained first target compensation image and the second target image to obtain backfilling sparse image features at each stage; fusing the obtained backfilling sparse image features at each stage to generate a camouflage target detection result of the target image, thereby completing the camouflage target detection based on confidence awareness evaluation pruning.

The application discloses a snapshot multispectral camera demosaicing method and device based on a binary tree coating array, according to a multispectral original image, a plurality of single spectral band mosaic images are extracted according to spectral bands, and a pseudo panchromatic estimation image is estimated according to the multispectral original image; a difference value between each spectral band sparse pseudo panchromatic estimation image and an original spectral band sparse image is calculated, and the difference value at all pixel positions is calculated; then, the difference value image after filtering and interpolation is added to the pseudo panchromatic estimation image, to obtain a demosaicing reconstruction result based on the pseudo panchromatic estimation image; and the color and spatial correlation between adjacent spectral bands is utilized to enhance the spatial high-frequency information of a binary tree low node spectral band image based on a binary tree high node spectral band image. The above method can solve the artifact problem caused by the weak spectral correlation of a wide spectral distribution filter, reduce the artifact of a reconstructed image, and improve the spatial resolution of the image after demosaicing.

The application provides a global sparse texture filtering method based on edge structure preservation, including introducing a texture inhibition function in a penalty term, and constraining the gradient of an output image, the texture inhibition function inhibits texture, noise and unnecessary detail information in the image by setting two threshold values, then using the inhibited gradient as the input of the denominator of the penalty term, so that the penalty term can sufficiently distinguish texture and structure; sparse regular L1 norm is used to constrain the penalty term, non-convex optimization is converted into a convex optimization problem by introducing a sub-gradient, and an alternating direction multiplier method is used for iterative solution, so that better edge preservation is achieved; sparse L p Norm is used to constrain the penalty term and a preconditioned conjugate gradient method is used to accelerate and improve the calculation efficiency, so that more robust and sparse image smoothing effect is achieved. The application can improve the robustness of the algorithm in distinguishing texture and structure, retain better semantic information, and achieve better edge structure preservation and smoothing performance.

The invention discloses an image restoration method and device based on AI and CG algorithms, and relates to the technical field of image restoration. The method comprises the steps that a real image, a damaged image, an AI reference image, a difference image and a damaged image of the difference image are acquired, an AI repair image serves as prior information and is combined with wavelet transform, TV operator and L1 norm prior information, a wavelet coefficient model of the repaired difference image is constructed, and a CG algorithm is utilized to calculate and obtain a repaired difference image wavelet coefficient; after inverse wavelet transform is carried out, a repaired difference image is obtained; and finally, utilizing the repaired difference image and the AI reference image to obtain a repaired image. The method solves the problems that the AI platform is not high enough in repairing precision due to the parameter generalization problem, and the traditional modeling method is fuzzy in repairing, and improves the image repairing precision of the AI platform and the traditional modeling method. Moreover, the method provided by the invention is suitable for sparse image restoration, such as SAR images, and is also suitable for smooth natural images and the like.

The invention provides a mirror image file programming method and device, electronic equipment and a computer program product. The method comprises the steps of obtaining first data contained in a to-be-programmed first mirror image file; the first data is fill data; the first mirror image file is a sparse image; filling the first data with second data to obtain third data; determining a first programming mode corresponding to the third data according to the second data and a first value; the first programming mode at least comprises writing in a first storage medium or erasing a first offset address and size in the first storage medium; the first value is 0; the first storage medium is an emmc storage medium; and programming the third data to a first storage medium according to the first programming mode. The programming efficiency of the mirror image file can be improved, so that the programming time consumption of the mirror image file is reduced.

The invention discloses a sparse image stripe defect complementing and repairing method and device, and relates to the technical field of image repairing. The method comprises the following steps: acquiring a sparse image with fringe defects; performing two-dimensional difference sparsification on the sparse image with the fringe defect to obtain a sparse difference domain; performing two-dimensional Fourier transform on the sparse difference domain to obtain a difference frequency domain; based on the difference frequency domain, constructing a difference frequency domain binary Hankel structure matrix; and constructing a sparse image completion model based on the differential frequency domain bifolding Hankel structure matrix, and solving the sparse image completion model in a distributed manner by using an alternating iteration ADMM algorithm to obtain a repaired sparse image. According to the method, stripe defects of the sparse image can be effectively processed, the repaired image does not have obvious stripe traces, a new theoretical method and an effective way are provided for sparse image repair, and the method has important significance on image processing in the fields of biomedical imaging, aerospace, astronomy and the like.

The invention relates to a multi-view three-dimensional reconstruction method based on a video diffusion model, and the method comprises the steps: extracting multi-scale point clouds from an original sparse image set, and fusing the multi-scale point clouds into a global three-dimensional point cloud image; the reconstruction track is segmented into a plurality of segments, each segment comprises one or more new view angles, and image generation is performed on each segment in sequence, including: projecting a corresponding point cloud in the global three-dimensional point cloud image to the current segment to obtain a rendering index map and a rendering color map, and screening a reference frame from a dynamic acquisition view library; inputting the reference frame, the rendered color map and the visibility mask of the rendered color map into a disordered context video diffusion model, and outputting an image sequence containing the new view angle complete image and the reference frame; and extracting the point cloud of the new view angle complete image to update the global three-dimensional point cloud image to guide the image generation of the next segment. The problems of poor geometric consistency and insufficient expansibility of a reconstruction result when an input view angle is sparse and disordered and long-distance displacement exists are solved.

The invention discloses a rapid reverberation suppression method, system and device based on variational Bayes. The method comprises the following steps: generating a two-dimensional data matrix according to a three-dimensional sonar image sequence; a variational Bayesian algorithm is used to separate low-rank components and sparse components in a data matrix, and a generalized approximate message passing algorithm is used to avoid a matrix inversion step in a variational Bayesian iteration process so as to reduce low-rank sparse decomposition time; and reversely quantizing the two-dimensional sparse matrix into a three-dimensional sparse image sequence. The system comprises a data conversion module, a separation module and a reverse quantity module. The device comprises a memory and a processor used for executing the rapid reverberation suppression method based on variational Bayes. By using the invention, reverberation suppression can be quickly and stably implemented, so that a moving target can be detected. The method can be widely applied to the field of active detection of underwater moving targets.

This invention relates to a method and system for calculating accurate pose information of images used in Nerf image reconstruction. The method includes: capturing current earthwork images using a camera on a drone, and collecting pose information of the camera during the capture of the earthwork images using a measuring device on the drone; constructing a dense set of optical flow vectors and a sparse set of optical flow vectors based on the earthwork images; constructing a dense image set based on the dense set of optical flow vectors; and constructing a sparse image set based on the sparse set of optical flow vectors. Based on the dense image set and the pose information of the earthwork images collected by the measuring device, the pose deviation of the camera during the capture of each earthwork image is calculated. The accurate pose information of the earthwork images in the sparse image set is calculated based on the pose deviation of the camera during the capture of each earthwork image. This invention effectively solves the problem of large image pose estimation errors in Nerf image reconstruction.

A method for providing enhanced subpixel resolution includes obtaining point spread function (PSF) data associated with an input image. The method also includes determining subpixel PSF data from the PSF data. The method further includes generating a filled subpixel sparse image from pixels of the input image. In addition, the method includes applying nearest neighbor pixel deconvolution (NNPD) to the subpixel PSF data and the filled subpixel sparse image to generate an enhanced subpixel image having an increased resolution.

The disclosed focal plane polarization demosaicking method based on local gradient and channel correlation belongs to the field of polarization imaging and image processing. The method comprises the following steps: obtaining a sparse image by downsampling a polarization mosaic image; calculating the local gradient of a current pixel by using the pixels of other adjacent polarization directions, and designing a smoothness weight to optimize the bilinear interpolation process, thereby generating an initial demosaicked image; calculating the relationship between the minimum cost function and the normalized cross-correlation coefficient by using the normalized cross-correlation coefficient and guided filtering, and designing a polarization channel correlation weight with symmetry characteristics; and applying the weight in the polarization channel difference model to further optimize the demosaicking result. The method can more accurately reflect the distribution characteristics of intensity, linear polarization degree and polarization angle in actual application scenarios, improve the polarization demosaicking effect, and reduce the instantaneous field of view error of the focal plane polarization mosaic image.

The invention discloses a signal lamp duration estimation method based on depth image prior guided by physical information, which comprises the following steps: constructing a space-time grid at a target entrance lane, and mapping vehicle position and speed information into a sparse queue contour image; constructing a depth image prior model, taking the sparse image as input, performing iterative optimization through fusion reconstruction, traffic wave physical constraint and signal control information composite loss, and repairing to obtain a complete queue contour; identifying a signal lamp state based on a stop line queue time sequence, combining continuous time periods, and calculating a red light, a green light and a period duration; according to the method, signal lamp time length estimation is reconstructed into sparse queue contour image restoration, a depth image prior model guided by physical information is combined, and periodic signal lamp time length estimation can be realized in fixed timing and dynamic timing scenes without depending on a large amount of historical annotation information.

This application relates to the technical field of intelligent measurement, and in particular to a method, system, device, and medium for component measurement path planning based on sparse images. The method includes: expanding the boundaries of the sparse image and filling the mask matrix; obtaining 3D visual mask points based on the fine mask; generating an initial sparse point cloud based on the 3D visual mask points; constructing a coarse 3D data model based on the initial sparse point cloud; performing clustering and redundant region removal on the coarse 3D data model; constructing a covariance matrix based on the working area of ​​the effective measurement unit; performing eigenvalue decomposition on the covariance matrix; calculating the camera spatial position based on the surface normal vector field and the preset vertical measurement height; modeling the camera measurement posture using the camera spatial position; performing field-of-view coverage analysis on the working area of ​​the effective measurement unit and the surface normal vector field using the camera measurement posture model; analyzing the scanning spatial position and calculating the optimal path objective function, thereby improving the efficiency of component measurement.

The invention relates to a sparse view angle three-dimensional reconstruction pose optimization mode. The method comprises the following steps: inputting a sparse image; constructing an annular virtual coordinate system; performing depth guide pose projection; generating a curvature-color joint mask; performing multi-mode micro rendering optimization; pose output is optimized, physical constraint is achieved, feature dependence is broken through, and a virtual coordinate system achieves zero-overlapping pose multiplexing (SIFT / ORB feature matching is not needed); dynamic interference suppression and curvature-color joint mask are adopted to solve boundary jitter caused by clothes wrinkles; lightweight real-time optimization is achieved, NeRF implicit coding is replaced by multi-mode regularization, and the reasoning speed is increased by 13 times.

The invention discloses an image processing method and device and computer equipment. The method comprises the steps that truncation processing is carried out on gray levels with the frequency number larger than a target truncation threshold value in a gray level histogram of a target gray level image, a sparse gray level histogram of the target gray level image is generated, the target gray level image comprises a saliency area of a to-be-detected object, and the target gray level image meets the preset gray level number; carrying out random sampling processing on the gray level of the target gray level image based on the sparse gray level histogram, and generating a sparse image corresponding to the sampling gray level; and filtering the sparse image to generate a saliency image of the to-be-detected object. According to the method, the dense region can be suppressed, interference of the dense region is avoided, low-contrast change of the local region can be detected more easily, the accuracy of image saliency detection is improved, and reliable data support is provided for subsequent analysis.

The invention discloses an image denoising method based on a low-rank subspace and an enhanced nuclear norm, and the method comprises the steps: extracting each frame of initial image from a dynamic background image or video, and carrying out the preprocessing of the initial image, and obtaining an image matrix; after a low-rank matrix and a sparse noise matrix are initialized, an image matrix is used as a training matrix to be input into an EKRPCA optimization model for image denoising; an augmented Lagrange multiplier method is adopted to convert the EKRPCA optimization model into an augmented Lagrange function; iteratively solving the augmented Lagrange function through an alternating direction multiplier method to obtain a low-rank matrix and a sparse noise matrix; repeating the iteration image denoising process until a termination condition is reached, and converting the final low-rank matrix and sparse noise matrix into an image format to obtain a background image with a low-rank structure and a sparse image with noise; according to the method, the low-rank structure can be recovered from the data damaged by the noise or the abnormal value, and the visualization effect of the image is remarkably improved.

The invention belongs to the technical field of spectral imaging, and particularly relates to a color imaging method for a high-speed camera. The method comprises the following steps: S1, acquiring an original image output by a detector; s2, setting binary masks arranged in a 2 * 2 array, and processing the original image by using the binary masks; s3, restoring the panchromatic channel sparse image; s4, carrying out adaptive boundary detection on the panchromatic channel restored image; s5, obtaining an R channel image, a G channel image and a B channel image; s6, converting the R channel image, the G channel image and the B channel image into HSV images; and S7, keeping the H component and the S component unchanged, and performing reverse conversion in combination with the corrected V component to obtain an RGB image. The method can be applied to complex scenes with different brightness and noise.

The invention relates to a light field display optimization method and system based on deep learning. The method comprises the following steps: collecting a multi-key view angle sparse image covering a plurality of key view angles in a full-target view angle space by adopting a sparse sampling strategy; constructing a viewpoint super-resolution synthesis network based on deep learning; performing viewpoint interpolation and complementation on the multi-key-view-angle sparse image by using a viewpoint super-resolution synthesis network to generate a full-target-view-angle complete image; performing optical field synthesis on the full-target view angle complete image through image rendering, and mapping the image to a display screen through a macro pixel structure; the non-uniform microlens array is used for carrying out angle and direction modulation on image light displayed by the display screen, so that audiences can receive images in different directions at different observation positions. The display quality and the visual angle continuity of the light field image are remarkably improved, and the system performance is improved under the condition that hardware resources are limited.

The invention discloses an image processing method, device and system, and relates to the field of artificial intelligence. The end side device obtains a sparse image sequence of multiple visual angles in the first scene and outputs the sparse image sequence of the multiple visual angles; the side device carries out image processing on the sparse image sequence of the multiple visual angles, three-dimensional reconstruction is carried out according to the processed image, a reconstruction model of the first scene is obtained, and image processing comprises signal image processing and intelligent processing. The image processing function of the end side is unloaded to the edge side, a sparse image sequence is collected at the end side, a dense image sequence does not need to be collected, and the end side extremely-simplified deployment form is achieved. Besides, since the data volume of the sparse image sequence acquired by the end side is small, image processing does not need to be performed on the sparse image sequence, so that the end side transmits the sparse image sequence to the edge side in time, image processing and three-dimensional reconstruction are performed on the edge side, and the problem of small computing power of the end side is solved through a computing power centralized pooling technology of an edge side device. And the three-dimensional reconstruction quality is improved.

Systems, methods, devices, and compositions of matter for 3D printing methods and systems that can be used for rapid nanoscale 3D printing of large and deterministic 3D structures with sub-micrometer features and porosities. The method includes storing or determining a plurality of interspersed features for a three-dimensional (3D) structure to project as a sequence of sparse images on the same plane to generate closely spaced fine features on a polymer resist; and generating, using the sequence of sparse images, a plurality of patterned light sheet on the polymer resist with a temporally-focused femtosecond pulse, the light sheet having patterns.

The invention discloses a cerebral blood flow diffusion assessment method based on attention guidance sparse image fusion, and belongs to the technical field of medical image processing, and the method comprises the steps: collecting an original data set of a CTA image sequence of an ischemic smoke disease, constructing a plurality of groups of sparse image pairs each comprising a diffusion image and a blood vessel image, and obtaining an image training set; constructing a sparse image fusion and visualization model; training a sparse image fusion and visualization model by using the image training set to obtain a trained sparse image fusion and visualization model; and processing a to-be-detected ischemic smoke disease CTA image by using the trained sparse image fusion and visualization model to obtain a corresponding reconstructed fusion image, and completing evaluation based on a pseudo-color image of the corresponding reconstructed fusion image and a visualization result. The problems that an existing method still has limitation in the aspect of sparse image fusion precision, cross-modal feature extraction and fusion efficiency is insufficient, and the accuracy of an evaluation result is limited are solved.