Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

931 results about "Point pair" patented technology

A point pair refers to a point in the input image and its related point on the image created using the transformation matrix. You can select to use the RANdom SAmple Consensus (RANSAC) or the Least Median Squares algorithm to exclude outliers and to calculate the transformation matrix.

Method for repairing RPC of remote-sensing image

PCT designated stage expiredWO2025007775A1Image enhancementImage analysisFeature extractionLongitude
Disclosed in the present invention is a method for repairing an RPC of a remote-sensing image. The method comprises: S1, acquiring information such as an image to be repaired and a reference image; S2, performing feature extraction and matching on the image to be repaired and the reference image by using an SIFT algorithm, so as to obtain a matching point pair and corresponding first pixel coordinates; S3, acquiring longitude and latitude coordinates; S4, acquiring geodetic coordinates and a control point; S5, constructing an RFM model, performing RPC positive calculation on an original RPC parameter of the image to be repaired and the geodetic coordinates, so as to obtain corresponding second pixel coordinates of the geodetic coordinates on a remote-sensing image, and separately calculating a mean value of error distances between corresponding pixel coordinates; S6, introducing a constraint condition by using an L1 regularization optimization method, so as to obtain an optimized RFM model; and S7, performing determination according to the mean value of the error distances and a preset threshold value, and selecting different repair policies to recalculate or correct the RPC parameter. In the present invention, an RFM model is optimized by using an L1 regularization method, and different repair policies are selected to perform correction or estimation on an RPC parameter, thereby improving the geometric positioning precision of a satellite image.
Owner:BEIJING DATA INTELLIGENCE INFORMATION TECH CO LTD

Point cloud registration method based on neighborhood normal vector and curvature

The invention discloses a point cloud registration method based on a neighborhood normal vector and curvature. The method comprises the following steps: preprocessing data of a source point cloud and a target point cloud; according to the density degree of each point, constructing an adjacent point number constraint condition for the preprocessed source point cloud and target point cloud; extracting initial feature points from the preprocessed point cloud according to a normal vector inner product mean value between a sampling point and an adjacent point; performing secondary extraction on the initial feature points through the neighborhood average curvature to form feature points; forming a final feature point set according to the constructed curvature feature parameters; fPFH feature description is carried out on the final feature point set, initial feature matching is carried out according to the ratio of the bidirectional minimum Euclidean distance to the second minimum Euclidean distance between feature vectors, and Euclidean distance constraints between point pairs are adopted to eliminate mismatched point pairs; and calculating an initial value of an initial transformation parameter by taking the correct matching point pair as a unit quaternion, carrying out initial registration on the source point cloud and the target point cloud, and constructing a bidirectional k-dimensional tree improved ICP algorithm to finish accurate registration.
Owner:JIANGSU KUANGBO INTELLIGENT TECH CO LTD

Efficient panoramic image splicing method and system based on multi-view fusion

The invention relates to an image processing technology, and discloses an efficient panoramic image splicing method and system based on multi-view fusion, and the method comprises the steps: collecting a plurality of images from different views; performing multi-scale feature extraction on each image, generating a feature descriptor for each extracted feature point, and matching a corresponding feature point pair; performing multi-view geometric constraint screening on the feature point pairs; according to the screened feature point pairs, estimating a homography matrix between adjacent images, and carrying out global optimization on the homography matrix; aligning all the images into the same coordinate system; determining an overlapping region between adjacent images; and according to the pixel information in the overlapping areas, fusing the overlapping areas by adopting a self-adaptive weighted fusion algorithm so as to splice the plurality of images into a panoramic image. The invention further discloses a control device and a computer readable storage medium. The invention aims to improve the efficiency and accuracy of generating the multi-view fused panoramic image.
Owner:SHENZHEN QINUO TECH CO LTD

Camera extrinsic parameter calibration method, image stitching method and apparatus thereof

The invention provides a camera extrinsic parameter calibration method, an image stitching method and an apparatus thereof. The calibration method can include: acquiring a plurality of images captured by the camera based on a plurality of sets of extrinsic parameters to be calibrated, wherein each of the plurality of sets of extrinsic parameters to be calibrated include a horizontal rotation angle and a vertical rotation angle; obtaining at least one matched image pair based on feature point matching among the plurality of images, wherein each matched image pair includes matched feature point pairs with a quantity satisfying a threshold condition; and calibrating the plurality of sets of extrinsic parameters to be calibrated according to a first difference representation between coordinate representations of each matched feature point pair of each matched image pair in a reference coordinate system.
Owner:TP-LINK CORP PTE LTD

Three-dimensional point cloud registration method for image pre-registration and multi-criterion mismatching suppression

The invention discloses a three-dimensional point cloud registration method for image pre-registration and multi-criterion mismatching suppression, which relates to the technical field of point cloud registration, and comprises the following steps of: firstly, enhancing surface texture information of a to-be-measured object by using a projection speckle image to perform data acquisition, and then positioning an optimal registration area of the to-be-registered image by using an image partitioning and template matching algorithm, image pre-registration is realized by performing feature point detection and registration on the region, and adverse effects caused by the non-overlapping region of the to-be-registered image are inhibited; thirdly, according to the coordinate transformation relation, obtaining corresponding three-dimensional matching point pairs through the two-dimensional matching point pairs obtained through image pre-registration, and completing point cloud coarse registration; and finally, adopting a classic ICP algorithm to realize point cloud precise registration. In order to improve the precision and efficiency of registration, multiple error matching suppression strategies are integrated in the stages of image pre-registration and point cloud coarse registration. According to the method, high-efficiency and high-precision registration of the point clouds which are limited in overlapping rate and lack of features can be realized.
Owner:HUNAN UNIV OF SCI & TECH

Multi-view overlapped video fusion splicing method and system

The invention discloses a multi-view overlapped video fusion splicing method and system, and relates to the technical field of video fusion splicing, and the method comprises the following steps: carrying out the basic processing of images collected by all cameras, and guaranteeing the consistent brightness and color of the images before splicing; extracting key feature points from the image by using a feature point detection algorithm; and matching the key feature points of the two images by using the feature descriptors to find similar feature point pairs in adjacent images. According to the method, matching errors are intelligently sensed, real-time detection and optimization are carried out in combination with a machine learning model and a correction algorithm, it is ensured that feature points meet geometric consistency, and accurate alignment is achieved through a homography matrix. Through brightness and color unified processing and overlapping region fusion, the generated panoramic image is excellent in visual effect, the accuracy of target identification and behavior analysis can be improved, and the method is especially suitable for high-quality splicing demand scenes such as security monitoring and the like.
Owner:BEIJING NELDA TECH CO LTD +1

Real-time registration method from preoperative model to intraoperative point cloud based on deep learning

The invention provides a real-time registration method from a preoperative model to an intraoperative point cloud based on deep learning, and relates to the field of 3D point cloud registration. The method comprises the following steps: acquiring a pre-reconstructed preoperative model; the invention discloses an in-vivo flexible rapid three-dimensional reconstruction method based on a digital elevation model, and the method comprises the steps: obtaining a real-time intra-operative point cloud; pre-operation vertex features representing anisotropic characteristics of the pre-operation model are extracted, the pre-operation vertex features and the corresponding intra-operation point cloud features are spliced and serve as input of a graph convolutional neural network, and the deformed pre-operation model is reasoned and output; and taking the detection feature point pairs with the corresponding relationship as supervision signals, constructing a loss function training graph convolutional neural network until convergence, and finally outputting a real-time registered grid three-dimensional model. Based on a deep learning network framework including feature extraction, feature point detection and deformation prediction, real-time registration from a non-rigid preoperative model to an intra-operative point cloud is realized, and requirements under a real minimally invasive laparoscopic surgery scene are met.
Owner:HEFEI UNIV OF TECH

Cross-source data three-dimensional reconstruction method and system based on improved Gaussian sputtering

The invention discloses a cross-source data three-dimensional reconstruction method and system based on improved Gaussian sputtering, and the method comprises the steps: collecting an unmanned plane inclined image and a ground panoramic image of a target region, and constructing a time-space correlation data set; based on multi-view geometric constraints, space-time coding matching point pairs are established through an adaptive feature pyramid, intelligent incremental cross-source data sparse reconstruction is carried out, and point cloud and camera parameters are output; adopting improved Gaussian sputtering, compressing a three-dimensional Gaussian kernel into a two-dimensional Gaussian primitive through double tangent vector constraint, and fitting surface geometry to realize multi-scale reconstruction; and optimizing primitive parameters by using a differentiatable renderer, completing multi-scale fine reconstruction through gradient back propagation, and generating a high-precision three-dimensional model. According to the method, multi-scale accurate geometric prior input and accurate camera poses are provided for three-dimensional reconstruction, the dependence on professional manual operation in a traditional three-dimensional reconstruction method is greatly reduced, and meanwhile, the geometric accuracy and visual fidelity of a reconstruction result are remarkably improved.
Owner:HANGZHOU INST FOR ADVANCED STUDY UCAS

Slope deformation monitoring method, system, medium and equipment

The invention discloses a slope deformation monitoring method and system, a medium and equipment, and relates to the field of slope deformation monitoring, and the method comprises the steps: obtaining a slope image sequence with a fixed time interval; extracting features of the first image, tracking the features of the first image in the to-be-detected image by using a Lucas-Kanade optical flow method, estimating a view field translation amount and a rotation angle of the to-be-detected image relative to the first image, and performing view field motion correction on the to-be-detected image; performing semantic segmentation on the first image and the corrected to-be-detected image to obtain an image pair with a slope region mask; obtaining a feature point matching set of the image pair based on LoFTR; performing feature point mismatching elimination on the feature point matching set by using a two-stage mismatching elimination method to obtain a matching point pair set M [beta]; and calculating the displacement of each point pair in the M [beta], and obtaining a sub-pixel-level slope deformation field through Gaussian interpolation. The scheme is low in cost, small in calculation amount and high in precision.
Owner:WUHAN CENT CHINA GEOLOGICAL SURVEY CENT SOUTH CHINA INNOVATION CENT FOR GEOSCIENCES

Image feature matching optimization method based on intra-class space consistency

The invention discloses an image feature matching optimization method based on intra-class space consistency in the technical field of computer vision and image processing. The method comprises the following steps: feature point extraction and preliminary matching: extracting feature points from a query image and a reference image and performing preliminary matching; initialization and transformation model estimation: initializing a matching point set and a residual error, and calculating an initial transformation model; error calculation and matching point set updating: calculating the error of the matching point pair, and updating the matching point set by adopting a dynamic screening method; performing residual optimization: judging whether the optimal condition is reached or not based on the residual, and deciding whether to continue iteration or not; performing intra-class space consistency clustering and isolated cluster elimination: performing clustering analysis after the optimal residual error is obtained, and eliminating isolated clusters based on an intra-class space consistency separation ion structure; and outputting a result: outputting a matching point set after the isolated clusters are removed. The method solves the problem that a traditional feature matching method is difficult to completely remove mismatching in a complex scene and is sensitive to noise.
Owner:CHANGCHUN UNIV OF SCI & TECH

Multimodal image matching method and system, terminal device, and storage medium

Provided are a multimodal image matching method and system, terminal device, and storage medium. The method includes: performing self-supervised feature extraction on an optical image and a synthetic aperture radar (SAR) image to obtain a repetitive feature point between the optical image and the SAR image; segmenting the optical image and the SAR image into a first image block sequence based on the repetitive feature point, and performing feature extraction on the first image block sequence through a dual-branch network to obtain feature description vectors of the optical image and the SAR image respectively, where the dual-branch network includes a first branch network for extracting a global feature and a second branch network for extracting a local feature; and performing feature matching on the optical image and the SAR image based on the feature description vectors to obtain a matching point pair between the optical image and the SAR image.
Owner:SUN YAT SEN UNIV

Three-dimensional rapid modeling method based on profile contour multi-feature constraint

InactiveCN119131287AOptimization optimal solution rationality decline defectweaken spatial sparsityGeometric image transformationComplex mathematical operationsTriangulationSurface reconstruction
The invention relates to a three-dimensional rapid modeling method based on section contour multi-feature constraint, and the method comprises the steps: extracting preset key points based on the drilling space information data of a geologic body section, and constructing a discrete point set of the geologic body section; searching a starting point pair for the discrete point set, and unifying the bypassing direction of adjacent point sets; constructing an initial adjacent contour point set based on the starting point pair and the bypassing direction, performing multi-feature constrained auxiliary point interpolation on the initial adjacent contour point set, and constructing a one-to-one corresponding point set; carrying out interlayer interpolation on the contour point set after the auxiliary point interpolation; and based on the shortest diagonal constraint, carrying out triangulation network splicing on the contour point set after interlayer interpolation. According to the method, the property and the inlaying process of the basic triangular patch can be considered, reconstruction of sparse contour line discrete points with low shape similarity and different points is realized, and the problem of complex surface reconstruction under a sparse profile is effectively solved.
Owner:CHENGDU UNIVERSITY OF TECHNOLOGY +1

OCT image splicing method

The invention relates to the technical field of image processing, and provides an OCT (Optical Coherence Tomography) image splicing method, which comprises the following steps: acquiring image pairs and matching point pairs corresponding to the image pairs, the image pairs being adjacent OCT images; calculating a homography matrix based on the matching point pairs so as to align the image pairs, and outputting preliminary aligned image pairs; constructing a fusion weight map, wherein the fusion weight map comprises a weight value of a pixel position and a region type; and according to the weight value and the region type, carrying out fusion splicing on the pixel positions so as to output a panoramic OCT image. According to the method, partition fusion is achieved by fusing the weight map, the problems of tissue dislocation and artifacts in OCT splicing are solved, and then the problem that the splicing effect of OCT image splicing is poor is solved.
Owner:江苏富翰医疗产业发展有限公司

Weight dynamic combination coal mine underground point cloud accurate registration method

The invention provides a coal mine underground point cloud accurate registration method based on dynamic weight combination, and relates to the technical field of point cloud registration, and the method comprises the steps: constructing an initial point pair set; calculating a point pair distance weight by adopting a Gaussian kernel function; calculating the shape feature weight of the point pair based on the BSC descriptor; based on the point pair distance weight and the point pair shape feature weight, constructing a point pair reliability weight dynamic combination model, and screening high-reliability point pairs from the initial point pair set; and on the basis of the screened high-reliability point pairs, optimal rigid body transformation is calculated, and point cloud accurate registration is realized. According to the invention, based on the double-weight dynamic combination model of the Gaussian kernel function and the BSC descriptor, the reliability of the point pair is accurately evaluated, and the influence of noise and local feature degradation is effectively inhibited. The adaptive weight adjustment strategy dynamically adjusts the distance weight and the shape feature weight in different registration stages, and optimizes the registration process. And an efficient point pair screening and optimization mechanism is combined with KD-tree accelerated search and Gaussian Newton method optimization, so that the registration speed and precision are improved.
Owner:XIAN UNIV OF SCI & TECH

Pose estimation method and device based on point pair feature matching, medium and product

The invention discloses a pose estimation method and device based on point pair feature matching, a medium and a product. The method comprises the following steps: performing coarse registration on a fusion scene point cloud and each template point cloud, and calculating point pair features; according to the corresponding hash key values, retrieving from each hash table to establish registration point pairs; calculating a translation vector and a rotation quaternion matched with each registration point pair according to the reference point coordinate system and the template coordinate system, and performing clustering processing on each registration point pair to obtain each initial corresponding set; screening out a target pose candidate transformation matrix and a matched target template point cloud from the pose candidate transformation matrixes matched with the initial corresponding sets respectively; a target optimization function between the fusion scene point cloud and the target template point cloud is constructed, iterative optimization is performed on parameters in the target pose candidate transformation matrix, and the target pose of the fusion scene point cloud is obtained at the end of iteration, so that the precision, real-time performance and reliability of six-dimensional pose estimation are improved.
Owner:HUBEI CHINA TOBACCO INDUSTRY CO LTD

Target positioning method and device, computer equipment and storage medium

The invention relates to the technical field of camera measurement, and discloses a target positioning method and device, computer equipment and a storage medium, and the method comprises the steps: determining a model point and candidate feature points corresponding to a target point on a current frame image; determining a reference feature point according to the distance between the model point and the candidate feature point; determining matching point pairs according to the reference feature points; constructing a similar transformation matrix according to the matching point pairs, and determining a registration error corresponding to the similar transformation matrix; when the registration error is smaller than a preset threshold value, determining the similar transformation matrix as a target transformation matrix; determining a search area on the next frame of image through the covariance matrix; fitting a plurality of prediction points in the search area by using a least square method to obtain a fitting function, and solving an extreme point of the fitting function; and correcting the extreme point according to the target transformation matrix to obtain the position and speed of the target point on the next frame of image. Based on the technical scheme of the invention, the precision and efficiency of target point positioning can be improved.
Owner:CHINA CONSTR SCI & IND CORP LTD +2

IMU (Inertial Measurement Unit)-assisted moving target detection method under dynamic condition

The invention discloses an IMU (Inertial Measurement Unit)-assisted moving target detection method under a dynamic condition, which comprises the following steps of: firstly, extracting feature points of a target image for matching to obtain feature point pairs; then, relative coordinate conversion is carried out on IMU sensor data, a corresponding basic matrix or homography matrix is solved, and then corresponding polar lines or mapping projection feature points are obtained; classifying the extracted feature points into two parts, namely static background feature points and dynamic target feature points; an affine transformation matrix is solved according to the corresponding relation of the static background feature points of the two adjacent frames of images and the motion parameter model, an inter-frame difference method is used for carrying out difference on the two frames of images and carrying out image binarization and morphological processing, and a corresponding motion target frame is obtained; and finally, traversing the moving target frame to carry out overlap ratio matching, and screening out a detection object of which the overlap ratio is greater than a set threshold value, namely an actual moving target in the current image. The method provided by the invention can effectively improve the precision and accuracy of moving target identification in a dynamic background.
Owner:NANCHANG UNIV

Image registration method based on improved ORB feature extraction and grid feature matching

The invention discloses an image registration method based on improved ORB feature extraction and grid feature matching. The method comprises the following steps: inputting an image to be extracted; using an improved FAST algorithm to extract feature points of the to-be-spliced image; establishing a BRIEF descriptor, and obtaining a BRIEF descriptor with a direction; according to the feature point set of the to-be-spliced image, establishing a Delaunay triangular grid taking the feature points as vertexes; judging the similarity of triangles, and obtaining similar triangles formed by the feature points; matching the similar triangle vertexes by using a Hamming distance to obtain an optimal matching feature point pair; obtaining affine matrix parameters by using an SVD method; according to the image registration method provided by the invention, the image quality is ensured, the feature extraction efficiency and the extraction precision can be improved, wrong matching is reduced, the stability is improved, the real-time performance of video stitching is improved, the waste of memory resources is reduced, the equipment cost is reduced, the working efficiency is greatly improved, and the method is suitable for popularization and application. And a better method is provided for image splicing.
Owner:63963 TROOP OF THE PLA

Point cloud registration method for constructing random model based on synthetic variance covariance matrix

The invention relates to a point cloud registration method for constructing a random model based on a synthetic variance and covariance matrix. The method comprises the following steps: S1, obtaining a coarse registration transformation matrix and a corresponding coarse registration transformation point cloud; s2, calculating distances between a query point and all points in the KD-Tree index structure, and determining the number of nearest neighbor points corresponding to the query point based on the distances; s3, screening a new corresponding point pair set; s4, solving a cofactor matrix; s5, calculating an estimated value of a fine distribution conversion parameter and an estimated value of a random error; s6, calculating source point cloud coordinates in a new state, and if the source point cloud coordinates are smaller than a set threshold value, integrating the fine registration transformation parameters after iteration and the coarse registration transformation matrix to obtain a final transformation parameter matrix; and otherwise, taking the source point cloud coordinates in the new state as the current point cloud data, taking the conversion parameter estimation value as the current fine registration parameter, and returning to S1. Compared with the prior art, the method has the advantages of realizing higher-precision parameter estimation and the like.
Owner:SHANGHAI MAPPING INST

Incremental three-dimensional reconstruction method and device based on panorama

The invention discloses a panorama-based incremental three-dimensional reconstruction method and device, and the method comprises the steps: obtaining each panorama of at least one panorama in a video of a to-be-reconstructed scene, carrying out the perspective segmentation, obtaining a perspective image set, and calculating the priori pose of each perspective image and a first matching point pair set between any two perspective images; selecting at least two initialized images in the perspective image set to generate a three-dimensional model, and adding the at least two initialized images into a registered image set; selecting candidate images from the residual images of the perspective view set to obtain a three-dimensional model after incremental updating, and adding the candidate images into the registered image set; and performing bundle adjustment optimization on the three-dimensional model based on the error of the registered image set, and repeatedly executing the steps of selecting the candidate image and optimizing until the perspective image set is added into the registered image set. According to the method, the calculation complexity and the memory requirement are reduced, mismatching of repeated texture scenes is remarkably reduced, and the accuracy and robustness of three-dimensional reconstruction are improved.
Owner:HANGZHOU QIUGUOJIHUA TECHNOLOGY CO LTD

Three-dimensional point cloud registration method and system based on multi-feature dynamic weighting

The invention discloses a three-dimensional point cloud registration method and system based on multi-feature dynamic weighting. The method comprises the following steps: firstly, acquiring a source point cloud and a target point cloud to be registered and performing down-sampling; secondly, extracting geometric features of the source point cloud and the target point cloud, including curvatures and normal angles of all points; extracting a target point from the target point cloud, performing point pair matching by using a multi-constraint weighted scoring mechanism and a dynamic weight optimization strategy, and taking a point pair with a minimum dynamic weighted difference function value as a matching point pair; screening the matching point pairs according to the normal angle difference threshold value and the curvature difference threshold value, if the normal angle difference score is smaller than or equal to the normal angle difference threshold value and the curvature difference score is smaller than or equal to the curvature difference threshold value, reserving the matching point pairs, and otherwise, rejecting the matching point pairs; and finally, solving a rotation matrix and a translation vector according to the reserved matching point pairs to realize point cloud registration. The problems that a traditional ICP algorithm is sensitive to the initial attitude of the point cloud, the anti-noise capability is weak, and feature utilization is insufficient are solved.
Owner:HEBEI UNIV OF TECH

Method and system for registering optical image and SAR image of moon

The invention discloses a registration method and system for an optical image and an SAR image of the moon, and relates to the technical field of image registration, and the method comprises the steps: firstly determining the same typical moon appearance object in an image to be registered, and enabling the corresponding optical and SAR region images to form a region image pair; performing feature extraction and matching on each regional image pair by using a feature-based registration algorithm to obtain a preliminary matching point pair, and screening out a high-confidence matching point pair; and calculating a region affine transformation matrix of each region image pair based on the high-confidence matching point pairs, constructing a global optimization objective function according to all region affine transformation matrixes, solving an optimal affine transformation matrix, and finally realizing accurate registration of the to-be-registered image.
Owner:TECH & ENG CENT FOR SPACE UTILIZATION CHINESE ACAD OF SCI

ORB feature extraction and matching method based on adaptive threshold and geometric constraint

The invention belongs to the field of image processing, and relates to an ORB feature extraction and matching method based on a self-adaptive threshold value and geometric constraints, which comprises the following steps of: dynamically adjusting a feature extraction threshold value in an ORB algorithm according to an average gray value and a gray variance of an image through a self-adaptive threshold value algorithm; image feature extraction under different illumination conditions can be adapted; a quadtree structure is adopted to manage feature points, and uniform distribution of the feature points is achieved; a feature matching process is optimized by utilizing geometric constraints based on the slope, the distance and the descriptor distance between feature point pairs, and mismatching points are removed; and finally, performing a visual odometer task by using the processed feature point pairs, thereby improving the accuracy and robustness of positioning and navigation. Compared with the prior art, the method can provide more stable and uniform feature extraction in different illumination environments, and greatly improves the efficiency and accuracy of feature matching at the same time.
Owner:CHANGCHUN UNIV OF SCI & TECH

Image registration method and real-time tracking method

The invention relates to an image registration method and a real-time tracking method, and the method comprises the steps: dividing a reference frame and a subsequent frame into a plurality of regions according to the same rule, carrying out the registration of the reference frame and the subsequent frame, and obtaining a region combination (a reference frame region and a subsequent frame region) where each pair of registration points are located; screening out matching point pairs according to the distribution condition of the registration point pairs in all region combinations; and calculating a transformation matrix according to the matching point pairs. As the change of the images between the continuous frames is not large, the method calculates the transformation matrix for registration by using the most representative local area, can avoid interference information brought by the influence of the environment and noise on the partial area in the image, can ensure that the screened matching point pair for registration has high reliability, and can improve the registration accuracy. In addition, calculation is simple and convenient, the rapid processing requirement of real-time registration can be met, and the method has wide application scenes and value.
Owner:BRIGHTVIEW MEDICAL TECHNOLOGIES (NANJING) CO LTD

Multi-modal image matching method and system based on learning features and epipolar geometric constraints

The invention relates to a multi-modal image matching method and system based on learning features and epipolar geometric constraints. The method comprises the following steps: carrying out edge enhancement processing on an input image through wavelet transform; extracting a multi-scale dense feature map based on the transformed convolutional neural network, and generating a feature descriptor with rotation and scale invariance in combination with principal direction normalization; adopting an FLANN algorithm and dynamic distance constraint to realize preliminary feature matching; and introducing a basic matrix construction and epipolar geometric consistency verification mechanism, and eliminating mismatching point pairs in combination with an RANSAC affine constraint model. According to the method, image enhancement, deep learning and geometric verification strategies are fused, the problems of radiation nonlinearity and geometric distortion caused by imaging mechanism differences among multi-modal images are effectively solved, the matching precision and robustness are improved, and the method is suitable for remote sensing application scenes such as optical-SAR registration, multi-source image fusion and earth surface change detection.
Owner:NANJING TECH UNIV

Camera offset detection and dynamic labeling method based on feature point matching

The invention discloses a camera offset detection and dynamic labeling method based on feature point matching. The method comprises the following steps: constructing a target object feature point data model; acquiring a camera monitoring picture image in real time, performing feature point extraction on the picture and the video frame of the target object, and performing matching with the target object feature point data model by using a feature point matching algorithm to obtain a matched feature point pair; calculating the offset of the camera according to the matched feature point pairs, including the translation amount and the rotation amount; correcting the video frame according to the offset of the camera, and identifying and positioning a target object in the corrected video frame; and generating a corresponding label according to the identification and positioning result of the target object, and dynamically displaying the label in the video frame. The method can effectively solve the problems of poor real-time performance, low accuracy, poor robustness and the like in the prior art, and has a wide application prospect.
Owner:SHENZHEN RUIYU TECHNOLOGY CO LTD

Camera calibration method for low-precision plane target

The invention discloses a camera calibration method for a low-precision plane target, and relates to the field of camera parameter calibration, and the method comprises the following steps: carrying out the multi-view shooting through a camera, and collecting data; checkerboard angular points are detected, and pixel coordinates of each angular point are determined; establishing a corresponding relation between the coordinates of the angular points and the coordinates of the actual world, adding a three-dimensional offset factor on the angular points of the target, and solving the parameters of the camera when the sum of the offset between the feature point pairs on the ideal target and the actual target is zero; global constraint is applied to the offset factor, a cost function is rewritten, and optimization is carried out through a nonlinear optimization algorithm to minimize a re-projection error. Under the condition that a low-precision target is used, high-precision camera calibration is realized by correcting feature points on the target. Simulation and real experiment results show that under the condition that a low-precision target is used, the method can still obtain a high-precision calibration result and measurement precision which are comparable with those of a traditional calibration method adopting a high-precision target.
Owner:XIANGTAN UNIV

Satellite angular rate identification method and related equipment

The invention discloses a satellite angular rate identification method and related equipment, and relates to the technical field of rocket launching, and the method comprises the steps: obtaining a rocket telemetry video frame sequence after satellite-rocket separation; for each frame of image of the rocket telemetry video frame sequence, determining a dynamic image area of the target satellite based on the static area mask; based on a feature detection algorithm, binary descriptors are extracted from dynamic image areas of two adjacent frames of images; based on the binary descriptor, matching corresponding feature point pairs between two adjacent frames of images; estimating a rotation matrix between two adjacent frames of images through an iterative optimization algorithm based on the corresponding feature point pairs; and determining the angular rate of the target satellite according to the rotation matrix and the time interval between the two adjacent frames of images. According to the method, rapid and high-precision identification of the satellite angular rate is realized, the problem that the traditional technology depends on indirect data and is high in delay is solved, task success or failure can be judged in real time, and the launching task evaluation efficiency is improved.
Owner:AEROSPACE SCI & IND KET TECH CO LTD

Multi-modal image matching method and system, and terminal device and storage medium

Disclosed in the present invention are a multi-modal image matching method and system, and a terminal device and a storage medium. The method comprises: performing self-supervised feature extraction on an optical image and an SAR image, so as to obtain repeatable feature points between the optical image and the SAR image; on the basis of the repeatable feature points, segmenting the optical image and the SAR image into a first image block sequence, and performing feature extraction on the first image block sequence by means of a double-branch network, so as to respectively obtain a feature description vector of the optical image and a feature description vector of the SAR image, wherein the double-branch network comprises a first branch network used for extracting global features and a second branch network used for extracting local features; and on the basis of the feature description vectors, performing feature matching on the optical image and the SAR image, so as to obtain matching point pairs between the optical image and the SAR image. In the present invention, a two-stage training method is used, in which method training is performed first so as to obtain robust SAR-optical image feature description vectors, and learning is then performed in view of the feature description vectors so as to obtain feature points having high matching performance.
Owner:SUN YAT SEN UNIV

Lever image matching and positioning method based on perspective transformation

The invention discloses a lever image matching and positioning method based on perspective transformation, and relates to the technical field of computer vision and image recognition. The method specifically comprises the following steps: selecting a reference picture from a frame image, calculating a perspective transformation matrix, combining feature matching and instance segmentation screening, carrying out random sampling calculation and optimizing perspective transformation matrix model parameters, and estimating and evaluating matching and point mapping effects. According to the method, a perspective transformation matrix between two-dimensional images represented by multiple modes of the same object is utilized, feature point matching of a target lever image and a lever scaleplate surface area are obtained based on a feature extraction and detection method of a deep neural network, matching point pairs are screened in combination with the property of a vector, and the perspective transformation matrix is determined; and evaluating the effect of positioning the random point set on the known plane to the target image. The method does not depend on a single-standard multi-mode representation lever, the perspective transformation matrix dictionary is generated, and large errors possibly generated by single-standard operation are reduced.
Owner:TAIYUAN ZHILIN INFORMATION TECH CO LTD