69 results about "Sparse image" patented technology

The invention discloses a million-frame-level industrial vision system and method based on event driving and compressed sensing, and the system is characterized in that an event camera imaging module in the system captures the brightness change of each pixel in a field of view of the event camera imaging module in an asynchronous manner, and generates an event containing a pixel coordinate, a timestamp and change polarity for each change; a compressed sensing coding module constructs sparse image vectors for events in a time window, and the sparse image vectors are projected to low-dimensional observation vectors through an observation matrix phi; the sparse image reconstruction module is used for optimizing an objective function through sparse constraint and total variation regularization; a dynamic ROI compression module controls a compression mask function according to the event density and a gradient threshold. The method can break through the limitation of the traditional frame rate, has the advantages of high precision, high efficiency, low power consumption, strong robustness and the like, and has a wide industrial application prospect.

The invention discloses a three-dimensional Gaussian splashing method and system for sparse view curve reconstruction, and the method reconstructs a three-dimensional curve scene through a sparse image: firstly, obtaining a dense point cloud and a camera pose, extracting a two-dimensional line segment graph, employing a line segment guide Gaussian initialization strategy, and obtaining a three-dimensional curve scene; generating an initial Gaussian set on the basis of the dense point cloud and the two-dimensional line segment graph; structure perception Gaussian pruning is executed in the optimization process of the initial Gaussian set, and spatial outliers and visibility redundant gauss are removed; and finally, calculating the total loss containing sparse regular terms through the difference between the rendered image and the sparse image, and iteratively optimizing Gaussian parameters until the total loss converges, thereby obtaining a final three-dimensional curve reconstruction result. According to the method, the problem of geometric prior deficiency under a sparse view is solved through line segment guide initialization, overfitting and artifacts are effectively inhibited by using structure pruning and sparse constraint, and high-quality three-dimensional curve reconstruction is realized.

The invention discloses a sparse view angle three-dimensional Gaussian language field construction method and system for humanoid robot grabbing. Comprising the following steps: acquiring an RGB image set and a user natural language instruction under a sparse view angle; reconstructing a three-dimensional point cloud through stereo matching, and initializing a three-dimensional Gaussian primitive field after noise elimination and measurement alignment; two-dimensional semantic features are embedded into the field, joint optimization is carried out through a double-path semantic supervision module, and a three-dimensional Gaussian language field with consistent semantics is constructed; wherein the dual-path semantic supervision comprises an object perception path and a global context path, the local semantic consistency and the overall semantic relationship are constrained respectively, and the final semantic representation of each Gaussian primitive is obtained through weighted fusion; and finally, candidate grabbing postures are generated, semantic reordering is carried out in combination with a language instruction, and the optimal grabbing posture is screened through geometric-semantic joint scoring. Under the sparse image set input condition, the execution accuracy of a robot grabbing task under a complex instruction can be improved.

The invention relates to a method for acquiring photos by using a closeness-density unmanned aerial vehicle to improve the precision of a nerf algorithm, and belongs to the technical field of three-dimensional reconstruction and neural rendering. The method comprises the following steps: collecting multi-view photos in a target scene in a sparse density path through an unmanned aerial vehicle; preprocessing the collected photos, extracting image features and generating sparse point clouds; inputting the extracted features and point cloud data to call a sparse image set to train a NeRF model, and generating high-quality three-dimensional scene reconstruction; by analyzing the deviation between a reconstruction result and a real scene, an unmanned aerial vehicle acquisition path and camera parameters are optimized; according to the optimized path, photos are collected again, the NeRF model is iteratively updated, unmanned aerial vehicle photo collection optimization based on the sparse image set is achieved, the reconstruction precision of the NeRF algorithm is improved, and the method is suitable for a high-precision three-dimensional modeling scene.

The present invention discloses a three-dimensional Gaussian visual positioning method for sparse perspective, which belongs to the field of positioning technology and is used for visual positioning. The method comprises extracting global image features and local image features of a sparse image and constructing a feature database; performing nearest neighbor search on the feature database and the RGB image to obtain a sparsity index, calculating the camera pose of a pseudo-perspective, rendering a color map and a depth map under the pseudo-perspective using a trained main model, extracting global features and local features and incorporating them into the feature database, constructing a 2D-3D correspondence relationship in combination with the target color map, performing dynamic inlier screening and pose solving, and obtaining a positioning result. The present invention intelligently supplements the perspective loss of key areas, effectively improves the balance and coverage of feature expression in three-dimensional scenes, realizes dynamic updating of 2D-3D matching relationships and elimination of false matches, thereby significantly improving positioning accuracy and system stability, and having stronger robustness and practical usability under sparse training conditions.

A computer-implemented method of generating training data to be used to train a machine learning model for generating a segmentation mask of an image containing overlapping particles. Training data is generated from sparse particle images which contain no overlaps. Generating masks for non-overlapping particles is generally not a problem if the particles can be identified clearly; in many cases simple methods such as thresholding already yield usable masks. The sparse images can then be combined to images which contain artificial overlaps. The same can be done for the masks as well which yields a large amount of training data, because of the many combinations which can be created from just a small set of images. The method is simple yet effective and can be adapted to many domains for example by adding style-transfer to the generated images or by including additional augmentation steps.

This application discloses a method, apparatus, device, medium, and product for constructing a spatiotemporal action detection dataset, relating to the field of dataset construction. The method includes cropping surveillance video into short video clips and extracting images to obtain dense image files, sparse image files, and detection image files; detecting all targets in the dense image files and sparse image files using a target detector; traversing the sparse image detection results, annotating target behaviors, and obtaining a target behavior detection dataset; tracking targets in the dense image detection results and sparse image detection results using a target tracker to obtain a target identity dataset; and matching the target behavior detection dataset with the target identity dataset to obtain a spatiotemporal action detection dataset. This application can improve the efficiency and quality of dataset production.

The present invention discloses a synthetic aperture radar (SAR) sparse imaging and autofocusing method, comprising the following steps: S1: assuming that a SAR transmits a continuous wave signal from an ideal array element position and receives an echo, and that the SAR's moving platform has no motion error, an ideal observation matrix and an ideal echo can be obtained; S2: in actual situations, the SAR's moving platform may experience random three-dimensional jitter, and an actual SAR echo containing motion error is obtained, and a mapping relationship between the actual echo and the ideal echo is established; S3: constructing a sparse imaging and autofocusing model; and S4: solving the sparse imaging and autofocusing model using an augmented Lagrangian function and an alternating direction multiplier method to achieve SAR sparse imaging and autofocusing. The present invention introduces an ADMM algorithm within the augmented Lagrangian multiplier, utilizing the structured sparsity of the target and significantly improving image reconstruction quality in weakly sparse scenarios.

The application provides a SAR image target detection method based on SAR image sparse enhancement and Bayesian saliency detection; comprising: step one: inputting a matched filter SAR image, obtaining initial values of regularization parameters of a SAR sparse enhancement method by calculating gray statistical characteristics of the image; step two: solving a convolution sparse feature enhancement algorithm model based on L1 norm by using an alternating direction multiplier method, and obtaining a SAR sparse enhancement image; step three: calculating a Bayesian saliency map of the SAR sparse enhancement image, binarizing the saliency map by using a threshold detection method, and realizing final target detection. The method can reduce SAR speckle noise by using a sparse image enhancement method, reduce background gray values, highlight target regions by using a SAR image saliency detection method, further reduce background pixel values, and finally realize efficient detection of ground and sea surface targets of interest.

The application discloses an industrial CT image reconstruction method and device, electronic equipment and storage equipment, comprising obtaining projection image data and preprocessing to obtain target image data; based on the pre-trained U-Net variant lightweight network, the target image data is processed to obtain fine gradient direction prediction data and structure level similarity data, the U-Net variant lightweight network is trained based on the projection image data and the true value image data, and the loss function of the U-Net variant lightweight network comprises a structure similarity loss; based on the target image data, the fine gradient direction prediction data and the structure level similarity data, the target function is iteratively updated by using an alternating direction multiplier method to obtain reconstructed image data, and the target function is a high-order regularization function constructed based on the second-order total generalized variation and the structure level non-local mean of the iterative image data. The application can inhibit the streak artifact and photon noise of sparse images, so as to meet the requirements of fast scanning and sparse image reconstruction quality.

The embodiment of the invention discloses an image processing method and device, electronic equipment and a computer program product. The method comprises the following steps: acquiring a first grey-scale map and a blurring intensity map corresponding to a to-be-processed image; processing light source points contained in the first grey-scale map to obtain a light spot reference map; generating a second sparse image according to the light spot reference image and the first sparse image; and according to the second sparse image and the blurring intensity image, performing point diffusion processing on each target pixel point in the to-be-processed image to obtain a target blurring image corresponding to the to-be-processed image. According to the image processing method and device, the electronic equipment and the computer program product, the calculated amount of image blurring can be reduced, the edge of the light spot in the obtained target blurred image is sharper, the definition and layering sense of the light spot are improved, and therefore the visual effect of the target blurred image is improved.

The invention belongs to the technical field of image processing, and provides a double-branch color point cloud 3D texture grid reconstruction method and device and electronic equipment, and the method comprises the steps: carrying out the multi-view projection and grid reconstruction of an input color point cloud, and obtaining a multi-view sparse image and a texture-free 3D grid; performing multi-view consistency repair on the multi-view sparse image to generate an initial UV texture map; based on a back projection and weighted hybrid algorithm, performing texture repair on the initial UV texture map to generate a complete UV texture map; performing texture resolution enhancement processing on the complete UV texture map to obtain a final UV texture map; and pasting the final UV texture map back to the surface of the texture-free 3D grid to generate a 3D texture grid. According to the scheme, through collaborative optimization of the double-branch frame in the image space and the texture space, the texture definition and the global consistency are improved by utilizing multi-view consistency repair, and the definition of the texture map is improved through texture repair and texture resolution enhancement.

The application discloses a sparse-view three-dimensional Gaussian language field construction method and system for humanoid robot grasping. The method comprises the following steps: acquiring an RGB image set under sparse-view and a natural language instruction of a user; reconstructing a three-dimensional point cloud through stereo matching, initializing a three-dimensional Gaussian primitive field after noise elimination and metric alignment; embedding two-dimensional semantic features in the field, jointly optimizing through a double-path semantic supervision module, and constructing a semantic-consistent three-dimensional Gaussian language field; wherein the double-path semantic supervision comprises an object perception path and a global context path, which respectively constrain local semantic consistency and overall semantic relationship, and the final semantic representation of each Gaussian primitive is obtained through weighted fusion; finally, candidate grasping postures are generated, semantic reordering is performed in combination with the language instruction, and the optimal grasping posture is selected through geometric-semantic joint scoring. The method can improve the execution accuracy of the robot grasping task under complex instructions under the condition of sparse image set input.

The present application belongs to the technical field of photoelectric countermeasure, and relates to a detection technology for a hidden camera device, and particularly provides a long-distance detection method for a hidden camera device based on sparse representation, which is used to overcome the problem of low recognition accuracy in the prior art; in the present application, after sparse representation of an image through wavelet transform, a measurement matrix group is obtained by compressing and projecting the sparse image using a random measurement matrix; a measurement matrix without static background and dynamic background information is obtained by performing a series of difference addition operations on the matrix group; then, the orthogonal matching pursuit algorithm is used to reconstruct and recover the measurement matrix to obtain a recovered image; finally, the cat-eye target area is screened out according to the image pixel value and the connected area area judgment method, so as to realize the cat-eye effect target recognition method based on sparse representation; in this way, the image data redundancy is greatly reduced, the recognition accuracy of the long-distance cat-eye target is effectively improved, and the anti-detection of the hidden camera device is realized, so as to eliminate the potential information leakage danger.

The application belongs to the technical field of camouflage target detection, and provides a camouflage target detection method and system based on confidence awareness evaluation pruning, which comprises the following steps: acquiring a target image to be detected; extracting confidence information in the acquired target image; dividing the acquired target image into a first target image and a second target image according to the extracted confidence information and a double-threshold strategy; processing the obtained first target image by using a double-path feature compensation mechanism to obtain a first target compensation image; performing recursive token backfilling on the obtained first target compensation image and the second target image to obtain backfilling sparse image features at each stage; fusing the obtained backfilling sparse image features at each stage to generate a camouflage target detection result of the target image, thereby completing the camouflage target detection based on confidence awareness evaluation pruning.

The application discloses a snapshot multispectral camera demosaicing method and device based on a binary tree coating array, according to a multispectral original image, a plurality of single spectral band mosaic images are extracted according to spectral bands, and a pseudo panchromatic estimation image is estimated according to the multispectral original image; a difference value between each spectral band sparse pseudo panchromatic estimation image and an original spectral band sparse image is calculated, and the difference value at all pixel positions is calculated; then, the difference value image after filtering and interpolation is added to the pseudo panchromatic estimation image, to obtain a demosaicing reconstruction result based on the pseudo panchromatic estimation image; and the color and spatial correlation between adjacent spectral bands is utilized to enhance the spatial high-frequency information of a binary tree low node spectral band image based on a binary tree high node spectral band image. The above method can solve the artifact problem caused by the weak spectral correlation of a wide spectral distribution filter, reduce the artifact of a reconstructed image, and improve the spatial resolution of the image after demosaicing.

The application provides a global sparse texture filtering method based on edge structure preservation, including introducing a texture inhibition function in a penalty term, and constraining the gradient of an output image, the texture inhibition function inhibits texture, noise and unnecessary detail information in the image by setting two threshold values, then using the inhibited gradient as the input of the denominator of the penalty term, so that the penalty term can sufficiently distinguish texture and structure; sparse regular L1 norm is used to constrain the penalty term, non-convex optimization is converted into a convex optimization problem by introducing a sub-gradient, and an alternating direction multiplier method is used for iterative solution, so that better edge preservation is achieved; sparse L p Norm is used to constrain the penalty term and a preconditioned conjugate gradient method is used to accelerate and improve the calculation efficiency, so that more robust and sparse image smoothing effect is achieved. The application can improve the robustness of the algorithm in distinguishing texture and structure, retain better semantic information, and achieve better edge structure preservation and smoothing performance.

The invention discloses an image restoration method and device based on AI and CG algorithms, and relates to the technical field of image restoration. The method comprises the steps that a real image, a damaged image, an AI reference image, a difference image and a damaged image of the difference image are acquired, an AI repair image serves as prior information and is combined with wavelet transform, TV operator and L1 norm prior information, a wavelet coefficient model of the repaired difference image is constructed, and a CG algorithm is utilized to calculate and obtain a repaired difference image wavelet coefficient; after inverse wavelet transform is carried out, a repaired difference image is obtained; and finally, utilizing the repaired difference image and the AI reference image to obtain a repaired image. The method solves the problems that the AI platform is not high enough in repairing precision due to the parameter generalization problem, and the traditional modeling method is fuzzy in repairing, and improves the image repairing precision of the AI platform and the traditional modeling method. Moreover, the method provided by the invention is suitable for sparse image restoration, such as SAR images, and is also suitable for smooth natural images and the like.

The invention provides a mirror image file programming method and device, electronic equipment and a computer program product. The method comprises the steps of obtaining first data contained in a to-be-programmed first mirror image file; the first data is fill data; the first mirror image file is a sparse image; filling the first data with second data to obtain third data; determining a first programming mode corresponding to the third data according to the second data and a first value; the first programming mode at least comprises writing in a first storage medium or erasing a first offset address and size in the first storage medium; the first value is 0; the first storage medium is an emmc storage medium; and programming the third data to a first storage medium according to the first programming mode. The programming efficiency of the mirror image file can be improved, so that the programming time consumption of the mirror image file is reduced.

The invention discloses a sparse image stripe defect complementing and repairing method and device, and relates to the technical field of image repairing. The method comprises the following steps: acquiring a sparse image with fringe defects; performing two-dimensional difference sparsification on the sparse image with the fringe defect to obtain a sparse difference domain; performing two-dimensional Fourier transform on the sparse difference domain to obtain a difference frequency domain; based on the difference frequency domain, constructing a difference frequency domain binary Hankel structure matrix; and constructing a sparse image completion model based on the differential frequency domain bifolding Hankel structure matrix, and solving the sparse image completion model in a distributed manner by using an alternating iteration ADMM algorithm to obtain a repaired sparse image. According to the method, stripe defects of the sparse image can be effectively processed, the repaired image does not have obvious stripe traces, a new theoretical method and an effective way are provided for sparse image repair, and the method has important significance on image processing in the fields of biomedical imaging, aerospace, astronomy and the like.

The invention relates to a multi-view three-dimensional reconstruction method based on a video diffusion model, and the method comprises the steps: extracting multi-scale point clouds from an original sparse image set, and fusing the multi-scale point clouds into a global three-dimensional point cloud image; the reconstruction track is segmented into a plurality of segments, each segment comprises one or more new view angles, and image generation is performed on each segment in sequence, including: projecting a corresponding point cloud in the global three-dimensional point cloud image to the current segment to obtain a rendering index map and a rendering color map, and screening a reference frame from a dynamic acquisition view library; inputting the reference frame, the rendered color map and the visibility mask of the rendered color map into a disordered context video diffusion model, and outputting an image sequence containing the new view angle complete image and the reference frame; and extracting the point cloud of the new view angle complete image to update the global three-dimensional point cloud image to guide the image generation of the next segment. The problems of poor geometric consistency and insufficient expansibility of a reconstruction result when an input view angle is sparse and disordered and long-distance displacement exists are solved.

The present invention proposes a sparse image view synthesis method based on time-domain filtered neural radiation fields. This method innovatively introduces a time-domain filtered neural radiation field model to solve the problem that the neural radiation field represented by the multi-layer perceptron has high rendering overhead and cannot reduce the aliasing noise of the synthesized image by oversampling. By applying filtering technology in the time domain, the computational burden required for oversampling is effectively shared over consecutive frames, thereby significantly improving the quality of the synthesized image and effectively reducing noise and aliasing without increasing the number of additional network inferences. In addition, in order to improve the geometric extraction capability of the neural radiation field, the method introduces a deep prior network and designs an inter-frame geometric consistency loss to enhance the expression capability of the neural radiation field in multiple views and improve the generalization performance of the network.

The invention discloses a rapid reverberation suppression method, system and device based on variational Bayes. The method comprises the following steps: generating a two-dimensional data matrix according to a three-dimensional sonar image sequence; a variational Bayesian algorithm is used to separate low-rank components and sparse components in a data matrix, and a generalized approximate message passing algorithm is used to avoid a matrix inversion step in a variational Bayesian iteration process so as to reduce low-rank sparse decomposition time; and reversely quantizing the two-dimensional sparse matrix into a three-dimensional sparse image sequence. The system comprises a data conversion module, a separation module and a reverse quantity module. The device comprises a memory and a processor used for executing the rapid reverberation suppression method based on variational Bayes. By using the invention, reverberation suppression can be quickly and stably implemented, so that a moving target can be detected. The method can be widely applied to the field of active detection of underwater moving targets.

This invention relates to a method and system for calculating accurate pose information of images used in Nerf image reconstruction. The method includes: capturing current earthwork images using a camera on a drone, and collecting pose information of the camera during the capture of the earthwork images using a measuring device on the drone; constructing a dense set of optical flow vectors and a sparse set of optical flow vectors based on the earthwork images; constructing a dense image set based on the dense set of optical flow vectors; and constructing a sparse image set based on the sparse set of optical flow vectors. Based on the dense image set and the pose information of the earthwork images collected by the measuring device, the pose deviation of the camera during the capture of each earthwork image is calculated. The accurate pose information of the earthwork images in the sparse image set is calculated based on the pose deviation of the camera during the capture of each earthwork image. This invention effectively solves the problem of large image pose estimation errors in Nerf image reconstruction.

A method for providing enhanced subpixel resolution includes obtaining point spread function (PSF) data associated with an input image. The method also includes determining subpixel PSF data from the PSF data. The method further includes generating a filled subpixel sparse image from pixels of the input image. In addition, the method includes applying nearest neighbor pixel deconvolution (NNPD) to the subpixel PSF data and the filled subpixel sparse image to generate an enhanced subpixel image having an increased resolution.

The disclosed focal plane polarization demosaicking method based on local gradient and channel correlation belongs to the field of polarization imaging and image processing. The method comprises the following steps: obtaining a sparse image by downsampling a polarization mosaic image; calculating the local gradient of a current pixel by using the pixels of other adjacent polarization directions, and designing a smoothness weight to optimize the bilinear interpolation process, thereby generating an initial demosaicked image; calculating the relationship between the minimum cost function and the normalized cross-correlation coefficient by using the normalized cross-correlation coefficient and guided filtering, and designing a polarization channel correlation weight with symmetry characteristics; and applying the weight in the polarization channel difference model to further optimize the demosaicking result. The method can more accurately reflect the distribution characteristics of intensity, linear polarization degree and polarization angle in actual application scenarios, improve the polarization demosaicking effect, and reduce the instantaneous field of view error of the focal plane polarization mosaic image.

The invention discloses a signal lamp duration estimation method based on depth image prior guided by physical information, which comprises the following steps: constructing a space-time grid at a target entrance lane, and mapping vehicle position and speed information into a sparse queue contour image; constructing a depth image prior model, taking the sparse image as input, performing iterative optimization through fusion reconstruction, traffic wave physical constraint and signal control information composite loss, and repairing to obtain a complete queue contour; identifying a signal lamp state based on a stop line queue time sequence, combining continuous time periods, and calculating a red light, a green light and a period duration; according to the method, signal lamp time length estimation is reconstructed into sparse queue contour image restoration, a depth image prior model guided by physical information is combined, and periodic signal lamp time length estimation can be realized in fixed timing and dynamic timing scenes without depending on a large amount of historical annotation information.

This application relates to the technical field of intelligent measurement, and in particular to a method, system, device, and medium for component measurement path planning based on sparse images. The method includes: expanding the boundaries of the sparse image and filling the mask matrix; obtaining 3D visual mask points based on the fine mask; generating an initial sparse point cloud based on the 3D visual mask points; constructing a coarse 3D data model based on the initial sparse point cloud; performing clustering and redundant region removal on the coarse 3D data model; constructing a covariance matrix based on the working area of ​​the effective measurement unit; performing eigenvalue decomposition on the covariance matrix; calculating the camera spatial position based on the surface normal vector field and the preset vertical measurement height; modeling the camera measurement posture using the camera spatial position; performing field-of-view coverage analysis on the working area of ​​the effective measurement unit and the surface normal vector field using the camera measurement posture model; analyzing the scanning spatial position and calculating the optimal path objective function, thereby improving the efficiency of component measurement.

The invention relates to a sparse view angle three-dimensional reconstruction pose optimization mode. The method comprises the following steps: inputting a sparse image; constructing an annular virtual coordinate system; performing depth guide pose projection; generating a curvature-color joint mask; performing multi-mode micro rendering optimization; pose output is optimized, physical constraint is achieved, feature dependence is broken through, and a virtual coordinate system achieves zero-overlapping pose multiplexing (SIFT / ORB feature matching is not needed); dynamic interference suppression and curvature-color joint mask are adopted to solve boundary jitter caused by clothes wrinkles; lightweight real-time optimization is achieved, NeRF implicit coding is replaced by multi-mode regularization, and the reasoning speed is increased by 13 times.

The invention discloses an image processing method and device and computer equipment. The method comprises the steps that truncation processing is carried out on gray levels with the frequency number larger than a target truncation threshold value in a gray level histogram of a target gray level image, a sparse gray level histogram of the target gray level image is generated, the target gray level image comprises a saliency area of a to-be-detected object, and the target gray level image meets the preset gray level number; carrying out random sampling processing on the gray level of the target gray level image based on the sparse gray level histogram, and generating a sparse image corresponding to the sampling gray level; and filtering the sparse image to generate a saliency image of the to-be-detected object. According to the method, the dense region can be suppressed, interference of the dense region is avoided, low-contrast change of the local region can be detected more easily, the accuracy of image saliency detection is improved, and reliable data support is provided for subsequent analysis.