161 results about "Pixel mapping" patented technology

The invention relates to the technical field of data processing, and discloses a visual data comprehensive processing method for automobile industrial data based on digital twinning. The method comprises the following steps: performing recursive quartering on a three-dimensional space of an automobile general assembly workshop through a workshop process pixel quadtree index algorithm, performing process type marking on multi-source heterogeneous data according to a process identification mapping rule, and allocating a workshop real-time data set to a quadtree index structure according to space coordinates to perform process state aggregation, and according to the viewport pixel mapping relation, performing weighted aggregation calculation on the process state aggregation matrix to obtain a pixel comprehensive display value, and based on the pixel comprehensive display value, performing layered rendering processing on the workshop multi-process parallel scene. According to the invention, the visual processing efficiency and the user interaction response speed of the digital twin system in the automobile industry are improved.

The invention discloses a deburring method combining a 2D image and a 3D point cloud, and relates to the technical field of image processing, and the method comprises the steps: carrying out the point cloud registration under the verification of the surface orientation consistency of a standard point cloud and an actual point cloud; constructing a pixel mapping matrix between the workpiece image and the RGB image; semantic-level edge coarse extraction is carried out on the workpiece image, and extraction of a sub-pixel-level actual edge contour is carried out on the basis of coarse extraction in combination with a traditional edge detection algorithm; aligning the actual edge contour to the actual point cloud through the pixel mapping matrix; and the target polishing surfaces are aligned to the actual point cloud, to-be-polished edge contours are screened based on the distances between the contours of all the target polishing surfaces in the actual point cloud and all the actual edge contours, and a polishing track is obtained in the workpiece image. According to the method, the sub-pixel edge positioning capability of the 2D image and the spatial topology information of the 3D point cloud are fused, and the inherent defect of a single mode is overcome.

The invention relates to the technical field of video recognition and analysis, and discloses a video recognition and analysis method based on physical characteristics. Video frame pixels are mapped to a two-dimensional coordinate system with the upper left corner as an original point, and mirror image expansion and median filtering are carried out on a gray level image; constructing a binary image based on a gray threshold value, and analyzing and extracting a target region by using a four-neighborhood connected domain; using neighborhood search and polar angle sorting to close the tracking contour, and generating equidistant re-sampling points based on Euclidean distance and an interpolation method; the curvature of the re-sampling points is estimated through a three-point difference algorithm, and zero denominator is avoided through numerical protection; performing discrete Fourier transform on the curvature sequence to extract a frequency spectrum, and normalizing an amplitude to form a standardized feature vector; and finally, inter-frame similarity is calculated based on the feature vector, and the most similar frame is automatically retrieved. By processing unified data standards in stages, edge noise is suppressed, sampling uniformity is ensured, and feature stability and cross-frame comparability are improved.

The invention discloses a reinforcing steel bar surface binding point identification and positioning method based on point cloud and pixel mapping. The method comprises the following steps: obtaining original three-dimensional point cloud data to carry out outlier noise point elimination; performing plane fitting on the denoised point clouds, identifying template surface point clouds and removing the template surface point clouds; mapping the spatial physical coordinate attribute of the steel bar surface point cloud into a three-channel coding image; separating the three-channel coded image into three single-channel images: a length image, a width image and a depth image; processing the depth image to extract an initial reinforcing steel bar straight line set; screening out a parallel steel bar straight line set from the initial steel bar straight line set according to a set reference direction and a parallel angle tolerance threshold value; and calculating straight line intersection points in the parallel steel bar straight line set to obtain candidate binding point pixel coordinates, determining representative binding point pixel positions through clustering, querying coordinate information of the three single-channel images, and outputting three-dimensional space coordinates of the steel bar binding points. According to the invention, robust and accurate steel bar binding point identification and positioning are realized.

The invention relates to the technical field of machine vision detection and intelligent image processing, and discloses an intelligent track defect identification method based on machine vision. The track center is automatically positioned through a pixel coordinate system with the upper left corner as the original point in combination with row gray scale accumulation and maximum projection, the region of interest is dynamically intercepted, and background noise and calculation amount are effectively reduced. For the area, multi-angle equal-interval projection is adopted, pixels are mapped into a one-dimensional sequence, and the response to various strips and slender defects is improved. Each projection sequence is subjected to secondary trend fitting, a comprehensive residual image is constructed through the maximum residual, and defect signals are enhanced. According to the scheme, a threshold value is determined in a self-adaptive mode through statistics, four-neighborhood connected domain extraction and a dynamic area threshold value are combined, and a noise small domain is removed. Boundary, main direction, length and severity features are extracted from the remaining connected domains and mapped back to an original image, and efficient, accurate and automatic track defect intelligent recognition is achieved.

The invention relates to the technical field of endoscopes, and provides a spectral image processing method for a three-dimensional endoscope. The method comprises the following steps: synchronously acquiring single-band spectral images returned by multiple sensors of the endoscope; after the single-band spectral image is corrected, a two-dimensional spectral image is generated by combining multi-level fusion of the spectral weight; constructing a three-dimensional point cloud coordinate set through parallax calculation; mapping the two-dimensional spectrum fusion image to a three-dimensional point cloud based on a back projection sub-pixel mapping algorithm to obtain a three-dimensional spectrum point cloud; and performing Poisson fusion driven inter-block splicing fusion on the three-dimensional spectrum point cloud, and outputting an interactive three-dimensional navigation model. The technical problem that image details are lost and three-dimensional reconstruction is inaccurate due to the fact that spectral image fusion precision is insufficient in an existing three-dimensional endoscope image processing method is solved, registration and reconstruction of high-precision three-dimensional spectral point clouds are achieved through multi-modal image collaborative correction and optimization fusion, and the image fusion precision is improved. And the accuracy and the real-time performance of navigation in the endoscope are improved.

The invention relates to the technical field of target tracking, in particular to a panoramic target tracking method and device based on fusion positioning, equipment and a storage medium. Comprising the steps of obtaining a panoramic video stream and a positioning coordinate sequence; performing pixel mapping on each positioning coordinate in the positioning coordinate sequence to obtain a current mapping coordinate and a historical mapping coordinate; performing delay compensation on the current mapping coordinates based on the historical mapping coordinates to obtain predicted mapping coordinates; performing target detection on the panoramic video stream to obtain a visual coordinate set of the current frame, and performing spatial matching on the predicted mapping coordinate and each visual coordinate in the visual coordinate set to form a matching candidate set; if the matching candidate set is null, outputting the predicted mapping coordinate as a target position coordinate; and if the matching candidate set comprises at least one candidate visual coordinate, outputting the candidate visual coordinate closest to the predicted mapping coordinate as a target position coordinate. According to the invention, the tracking performance under a complex environment condition can be improved.

The invention relates to a forest region satellite fire point monitoring method based on deep learning, and the method comprises the steps: collecting a multispectral image of a target forest region through a satellite remote sensing system, and carrying out the preprocessing of the multispectral image; feature information extraction is carried out on the preprocessed multispectral image, the extracted feature information is classified by using a convolutional neural network, and a classification feature vector is obtained; fire source areas are determined according to the classification feature vectors, and a first fire source area set is obtained; acquiring environment data, and acquiring a second fire source region set through a support vector machine model according to the environment data and the preprocessed multispectral image; according to the first fire source area set and the second fire source area set, real fire point pixels are obtained; and real fire point pixels are mapped to geographic coordinates of the target forest region, missing data are filled by adopting a spatial interpolation technology, and final fire point position distribution is obtained. According to the method, the accuracy and reliability of forest fire detection under the complex terrain condition are remarkably improved.

The invention relates to a light effect animation data generation method and apparatus, a device and a medium. The method comprises the steps of obtaining a target image for constructing light effect animation data; according to the color values of the pixels in the target image, constructing a palette containing a fixed number of reference colors, and determining attribution probability distribution corresponding to each reference color mapped to the palette by each pixel; corresponding to the parity of each pixel in the plane space position of the target image, selecting a reference color according to the attribution probability distribution so as to update the color value of the pixel; and packaging the target image with the updated color value into the light effect animation data. According to the method, the light effect animation data is generated by utilizing the attribution probability and odd-even spatial modulation, and the smooth pixelated light effect can be realized when the atmosphere lamp is played.

The invention relates to the technical field of image detection, in particular to a power battery flatness detection method based on image recognition. The method comprises the following steps: acquiring a power battery image and calibration board information, and determining a pixel mapping relation; generating a battery surface point cloud picture by using the pixel mapping relation; fitting a reference plane by using the battery surface point cloud atlas, and calculating point cloud deviation; marking a battery bump area according to the point cloud deviation; calculating the height deviation of the bulge area of the battery, and determining the bulge degree; marking surface sunken points based on the battery surface point cloud atlas, and calculating the sunken depth of the surface sunken points; when the recess depth is greater than the recess threshold value, marking as a recess abnormal region; the flatness of the power battery is evaluated according to the bulging degree and the sunken abnormal area; and converting the flatness of the power battery into a three-dimensional rendering graph, and outputting a flat area grading result. According to the invention, accurate quantification of the battery flatness is realized based on an image detection technology, and the flatness detection accuracy is improved.

A single-frame speckle deflection measurement method based on subarea wavefront correction belongs to the technical field of optical measurement, and comprises the following steps: based on a monocular deflection measurement system, projecting a standard speckle image to a to-be-measured mirror surface from a screen, and collecting a single-frame deformed speckle image reflected by the to-be-measured mirror surface; processing the reflected image by using a Zernike polynomial projection distortion correction method based on a mark point, and correcting the projection distortion of the reflected image caused by a non-orthogonal light path; obtaining sub-pixel mapping of the reflection image and the standard image based on a sub-region wavefront fitting correction and iterative registration algorithm; and based on system calibration and camera calibration, establishing a spatial incident light model and a spatial reflected light model, obtaining surface gradient distribution of the to-be-measured mirror surface, and reconstructing a three-dimensional shape of the to-be-measured mirror surface. According to the method, a reference plane is not needed, high-reflection surface shape measurement of only collecting a single-frame image can be achieved, the dynamic range and precision of speckle deflection measurement are improved through subarea wavefront correction, and the surface reconstruction precision can reach hundreds of nanometers.

The invention relates to the technical field of image generation, in particular to a medical beauty 3D model construction method and system based on an image large model, and the method comprises the following steps: obtaining rasterized image data based on a 3D full-head point cloud model through space coordinate projection and pixel mapping, judging connectivity and a missing region, screening region features, and generating texture guidance parameters; and screening textures according to partition features, determining a multi-region fitting index, and outputting a continuous boundary fusion region. According to the invention, through carrying out multi-angle spatial reconstruction and fine pixel mapping on the three-dimensional point cloud data, texture coverage is not limited to a single view angle, spatial feature partitioning and target attribute identification, so that accurate supplementation of the texture of the missing region is realized; the locally generated texture content and the original input region are highly fused in the aspects of color structure and detail representation, and region mutation is effectively eliminated through spatial adaptation and boundary adaptive processing, smooth connection of multi-part texture splicing presentation, color transition and gradient fusion.

The invention provides a virtual camera projection method and system, electronic equipment and a medium, and belongs to the technical field of target detection, and the method comprises the steps: constructing a training data set according to sampling points in a three-dimensional space; modeling projection and back projection between the real camera view and the virtual camera view to obtain a two-stage multi-layer perceptron model; training a two-stage multi-layer perceptron model according to the training data set to obtain a trained model; and obtaining a pixel mapping table between the virtual camera view and the real camera view based on the trained model. According to the method, the reversible pixel mapping relation between the real camera and the virtual camera is constructed by adopting the two-stage multi-layer perceptron model, and the pictures under any group of camera parameters are uniformly converted to be under the virtual camera parameters, so that high-quality label data are efficiently generated through the automatic labeling model; the data utilization rate and the generalization ability of the automatic labeling model are remarkably improved, so that the model can directly process multi-source heterogeneous data, and the model adaptation cost is reduced.

A multi-camera imaging system includes a plurality of imaging units arranged side-by-side to capture images of a scene. A calibration module is configured to determine intrinsic and extrinsic parameters of camera modules of the imaging units and to establish a per-pixel mapping from image coordinates to a three-dimensional space. An image processing module selects, for individual of the plurality of imaging units, a field-of-view region within a captured image and blends the fields-of-view from adjacent imaging units together to form a composite image.

A multi-camera imaging system includes a plurality of imaging units arranged side-by-side to capture images of a scene. A calibration module is configured to determine intrinsic and extrinsic parameters of camera modules of the imaging units and to establish a per-pixel mapping from image coordinates to a three-dimensional space. An image processing module selects, for individual of the plurality of imaging units, a field-of-view region within a captured image and blends the fields-of-view from adjacent imaging units together to form a composite image.

The present invention relates to a calibration measurement method and system based on pixel mapping. The method comprises: providing a camera for measurement, and performing pixel mapping-based calibration on the camera, wherein, during calibration, a pixel position-horizontal resolution mapping relationship of the camera is established, and a pixel horizontal offset fitting line of the image captured by the camera is determined; when measuring an object based on the calibrated camera, at the current pixel coordinates of the object image, the spatial height of the object and the corresponding width change in the horizontal direction of the image are determined based on the camera's pixel position-horizontal resolution mapping relationship and the pixel horizontal offset fitting line; based on the determined spatial height of the object and the corresponding width change in the horizontal direction of the image, single-frame contour information is spliced along the object scanning direction and step size to output a three-dimensional point cloud of the object. The present invention can achieve rapid calibration of the camera, and when measuring with the calibrated camera, a high-precision three-dimensional point cloud can be output.

The invention relates to the technical field of optical waveguide preparation, and discloses an optical waveguide mother set splicing-free preparation method based on a DMD dynamic mask, and the method comprises the steps: obtaining the layout data of an optical waveguide mother set as initial design information, and generating a mask pattern sequence which comprises a plurality of partition mask patterns; establishing a pixel mapping relationship between the on-off state of the micro-mirror unit and the partition mask pattern; driving the transparent substrate to execute partition positioning movement on the platform, and controlling the current exposure area of the photosensitive material layer to be aligned with the projection area of the partition mask pattern; on the basis of the pixel mapping relation and the partition positioning movement result, activating the mask pattern, and carrying out non-interval continuous exposure to form a full-page latent image pattern; the whole latent image pattern is subjected to developing treatment, the embossment structure of the optical waveguide master mask is treated and transferred into the transparent substrate, a waveguide core layer pattern is formed, the effects of non-interval continuous exposure and no segmented splicing are achieved, the preparation period of the surface embossment optical waveguide master mask is shortened, and the processing efficiency and the batch preparation yield are improved.

The application relates to the technical field of display, and particularly discloses an extended reality head-mounted display system based on Micro LED display, which comprises an eye movement tracking device, an image rendering processing unit, a bionic pixel mapping driving unit, a Micro LED display panel and an event-driven control unit; the line-of-sight center position is acquired through eye movement tracking, non-uniform rendering and bionic pixel mapping are realized, full-resolution pixels are driven in the line-of-sight center area, the data amount is reduced by using a pixel merging algorithm in the peripheral area, and the refresh is triggered only in the picture change area in combination with an event-driven mechanism. The application significantly reduces the computing power and bandwidth demand, relieves visual fatigue and dizziness, simultaneously realizes dynamic power consumption optimization, and improves the immersive experience and equipment endurance.

According to one embodiment, a processing apparatus for accelerating convolution operations comprises a memory array in which a plurality of elementary processing unit are arranged in an array structure, and an operation unit configured to temporarily store feature-map data, divide the feature-map data into predetermined units along a channel-axis direction according to a pixel-first mapping method, and deliver the divided data to the memory array in a manner of shifting the data according to a position of a kernel.

This application relates to a method, apparatus, electronic device, and storage medium for calculating road surface height. The method includes: acquiring lane lines; mapping lane line pixels to a first coordinate system to generate first coordinates; acquiring the next time-of-flight (RTK) point; calculating the distance between the next time-of-flight RTK point and the point containing the first coordinates to generate a deflection distance value; acquiring camera height data; processing the deflection distance value and the camera height data; and outputting the road surface height value. The solution provided in this application can replace the traditional method of calculating using the current time-of-flight RTK point and camera height data, thereby improving the accuracy of road surface height and thus improving the accuracy of the three-dimensional spatial coordinates of lane lines.

The present application relates to the technical field of image rendering, in particular to a rendering method and system for a model image interface, comprising the following steps: obtaining a view angle parameter and generating a screen pixel mapping result set of a surface patch, calculating a screen occupation ratio of the surface patch, generating a screen change feature of the surface patch in combination with a frame difference, generating a rendering scheduling sequence set based on the occupation ratio and the change feature, calling data in sequence to perform rasterization processing, and generating a rendering result of the model image interface. In the present application, the visual presentation weight under the current visual field is calculated by extracting vertex coordinate mapping, the difference in occupation ratio between the front and back frames is analyzed by using the finite difference method to capture the dynamic change trend, the dynamic rendering scheduling sequence is constructed based on the double dimensions of the occupation ratio and the change feature, the calculation resources are accurately tilted to the high screen occupation ratio and the high dynamic change area, the rendering quality of the core visual area is ensured, the invalid calculation overhead is greatly reduced, and the interface rendering real-time performance and frame rate stability in complex scenes are effectively improved.

The application provides a video blind area compensation transmission method and server based on dynamic field of view fusion, through acquiring multi-source video stream data, integrating all field of view regions under the same timestamp to a unified global reference space to obtain a global field of view splicing layout, constructing a dynamic field of view topology evolution graph containing a blind area hole outline and a pixel mapping transformation relationship between fields of view according to layout changes of continuous timestamps; performing pixel-by-pixel spatial migration on adjacent field of view video frames according to the pixel mapping transformation relationship of the blind area hole periphery to generate a blind area compensation video segment; performing panorama fusion on the compensation segment and the original video segment to obtain a panoramic video stream; analyzing the distribution pattern of the original collection source and the content remapping source in the panoramic video stream to generate a spatial mask, setting a differentiated encoding transmission strategy for different regions and encoding and distributing. The application realizes high-quality compensation of blind area content and regional differentiated efficient transmission of panoramic video streams.

This invention relates to the field of infrared imaging and low-level hardware processing technology, and discloses a parallel processing method and circuit for infrared image data based on FPGA. The method includes: establishing a pixel spatiotemporal mapping coordinate system and extracting pixel mapping point coordinate pairs; performing hardware topology sensing and spatial decoupling to output a spatial topology matrix; performing real-time pixel-level non-uniformity correction; implementing phase-locked noise reduction through a virtual offset field to obtain an equalized corrected bitstream; generating a quantization mapping curve based on saliency sensing; and performing real-time video reconstruction combined with adaptive power consumption control to output a video signal. This invention solves the problems of latency and instantaneous heat accumulation in large-area infrared data processing, achieving high-fidelity restoration of spatial topology and suppression of non-uniform noise; closed-loop energy management eliminates image blurring caused by thermal drift, comprehensively improving the system's imaging clarity and hardware operating efficiency.

A three-dimensional (3D) display monitor is disclosed, featuring an integrated processing chip designed to enhance real-time rendering and reduce system latency. The chip receives raw 3D image data and face tracking images, performs real-time face tracking and pixel mapping, and outputs the mapped image for display. The chip may receive direct eye center position data, bypassing face tracking images. The monitor includes functionalities including touch panel feedback, hand tracking, and automatic detection of 2D or 3D content, enabling seamless mode switching. Furthermore, the chip can convert 2D content to 3D content in real-time using a neural processing unit.

The invention discloses a multi-frequency thermal modulation infrared imaging calibration device, method and system and a storage medium, the device comprises a thermal pattern layer, a thermal modulation layer, a control unit layer, a thermal insulation layer, a support frame and a processing module, the thermal pattern layer provides a standardized thermal radiation pattern and is arranged facing an infrared camera, and the thermal modulation layer is arranged on the thermal insulation layer. The calibration module is used for geometric calibration and radiation calibration of the infrared camera; the thermal modulation layer is located below the thermal pattern layer and attached to the thermal pattern layer, comprises a plurality of thermal modulation modules and is used for independently heating or refrigerating different areas through pulse width modulation control; and the control unit layer is positioned below the thermal modulation layer and is electrically connected with the thermal modulation layer. The invention provides a calibration device which is adjustable in structure, changeable in pattern, controllable in frequency and adaptive to multi-band imaging, and in the calibration process, infrared imaging equipment is driven by a dynamic thermal modulation pattern to perform response surface fitting, so that a thermal map-pixel mapping relation can be accurately reconstructed.

The present application relates to the technical fields of machine vision detection and intelligent image processing, and discloses a track defect intelligent identification method based on machine vision. Through the pixel coordinate system with the upper left corner as the origin, combined with the line gray accumulation and the maximum projection automatic positioning track center, the interested region is dynamically intercepted, and the background noise and the calculation amount are effectively reduced. For the region, multi-angle equidistant projection is adopted, the pixels are mapped into one-dimensional sequence, and the response to various types of strips and slender defects is improved. Each projection sequence is fitted by quadratic trend, the maximum residual error is used to construct a comprehensive residual image, and the defect signal is strengthened. The scheme uses statistical quantity to adaptively determine the threshold, combines the four-neighbor connected domain extraction and the dynamic area threshold, and removes the small noise domain. The boundary, main direction, length and severity of the remaining connected domain are extracted and mapped back to the original image, so that efficient, accurate and automatic track defect intelligent identification is realized.

The application discloses a kind of self-adapting projection methods based on high light boundary three-dimensional remapping.First, based on phase shift brightness statistics diagram, extract single or multiple overexposure connected region, extract the pixel group coordinates of the un-overexposed boundary of the region and reconstruct the corresponding three-dimensional coordinates of boundary based on calibration parameter;Then, based on the projection light path model, the three-dimensional coordinates are inversely mapped to the DMD target surface to obtain a closed-loop connected domain;High light closed-loop connected domain is screened using a two-dimensional image to obtain the boundary of the outermost circle high brightness range, and the projection light intensity is gradually reduced by high light boundary extraction and three-dimensional inverse mapping, which reduces the high light range, and finally completely eliminates the overexposure range.The method first maps the high light edge pixels to the DMD target surface pixels, and reduces the projection light to eliminate all high light areas.The complex splicing process of different three-dimensional point clouds in the traditional multi-exposure method is avoided, which improves the reconstruction rate while reducing the complexity of calculation.

The invention relates to the technical field of medical image processing, in particular to a kidney ultrasonic image-based fibrosis quantitative evaluation method and system, and the method comprises the steps: obtaining an ultrasonic image, carrying out the standardization processing, and estimating a system response correction function and an optical flow field; selecting a key frame based on an optical flow field, performing registration and constructing pose map optimization, fusing a envelope to establish mapping between a cortical conformal coordinate system and a key frame pixel, and generating a cortical region probability field and a boundary uncertainty field; calculating a sound attenuation coefficient and a scattering statistical parameter in the sliding analysis window, correcting the sound attenuation coefficient and the scattering statistical parameter, projecting the sound attenuation coefficient and the scattering statistical parameter to a conformal coordinate system, carrying out Wasserstein gravity center fusion according to probability and uncertainty weighting, detecting the effective thickness of the cortex, and carrying out consensus optimization to obtain a fibrosis fraction field and a consensus residual field; and generating a non-consistency total score, outputting a confidence interval and a confidence level through conformal prediction calibration, and generating a fallback recalculation or re-collection instruction if necessary. The cross-view, cross-time and cross-equipment consistency is improved, and the closed-loop quality control capability is achieved.

A method for power-saving in a user equipment (UE). The method may include identifying user interface (UI) elements or regions of interest (ROIs) present on a display screen of the UE. The method may include obtaining a pixel map and generating a binary mask, based on mapping pixels in the pixel map with the identified at least one of UI elements or ROIs. Further, the method may include adjusting the brightness of pixels outside of the identified at least one of UI elements or the ROIs, thereby saving power in the UE using adaptive brightness.