344 results about "Vision Disparity" patented technology

The invention belongs to the technical field of ocean observation, and discloses an ocean wave field reconstruction method and device based on binocular vision. An ocean wave field reconstruction method based on binocular vision comprises the steps that internal parameters of a camera are calibrated through a Bouguet calibration algorithm, a binocular camera provided with an IMU sensor is used for collecting images and pose information, feature points are extracted through an SURF algorithm, feature matching is completed under a game theory framework, and abnormal points are removed through an RANSAC algorithm. Then, camera parameters are calculated based on an eight-point method, and the camera parameters and three-dimensional point coordinates are optimized through an SBA algorithm; thirdly, generating a disparity map by adopting epipolar correction and an SGM algorithm, and performing morphological processing on the disparity map; and the processed image is subjected to triangulation to generate a three-dimensional point cloud, and filtering is carried out. And finally, estimating a sea level position through an RANSAC algorithm, and optimizing a result through a least square method to complete three-dimensional reconstruction of ocean waves.

The invention discloses a seismic isolation structure support three-dimensional deformation monitoring method and system based on binocular vision. The method comprises the steps that a binocular camera is adopted to collect monitoring scenes under the view angle of a left camera and the view angle of a right camera; performing image distortion removal and three-dimensional correction on the monitored image pair by adopting camera internal and external parameters obtained by camera calibration; carrying out target detection on the corrected image by adopting a target detection algorithm; according to the coordinates of the target detection frame, calculating a cutting frame and cutting target areas in the left image and the right image; carrying out stereo matching on the cut image pair; according to the disparity value of each pixel in the disparity map, depth information of the target is calculated through a triangulation method, and finally a three-dimensional dense point cloud of the target is generated; performing optimization processing on the target three-dimensional dense point cloud obtained in the previous step to obtain an optimized point cloud; solving a rigid body transformation matrix of the two-point clouds by using an iterative nearest point algorithm; according to the invention, the cost of monitoring the three-dimensional pose deformation of the rubber support can be reduced, and the robustness and precision are effectively improved.

A perception system including at least one memory, and at least one processor configured to: (i) compute, in a stereo branch, disparity from a pair of stereo images including a left image and a right image; (ii) based on the computed disparity from the pair of stereo images, output, by the stereo branch, a depth for the left image and a depth for the right image; (iii) compute an absolute depth for the left image in a first monocular branch and an absolute depth for the right image in a second monocular branch; (iv) compute, in a first fusion branch, a depth map for the left image; (v) compute, in a second fusion branch, a depth map for the right image; and (vi) generate a single fused depth map based on the depth map for the left image and the depth map for the right image, is disclosed.

The invention particularly relates to a binocular vision-based three-dimensional reconstruction method, which comprises the following steps of: calibrating a binocular camera based on an improved Zhang Zhengyou calibration method to obtain internal and external parameters and a distortion coefficient of the camera; performing stereo correction on the image by using the internal and external parameters of the camera and the distortion coefficient obtained by calibration, so that the binocular image meets an epipolar constraint condition; a multi-strategy optimized semi-global stereo matching algorithm is adopted to process the image after stereo correction, and a disparity map is generated; based on the generated disparity map, generating a three-dimensional point cloud through a triangulation principle; carrying out anti-interference processing and registration optimization on the three-dimensional point cloud; and performing global splicing on the three-dimensional point clouds subjected to anti-interference processing and registration optimization based on a sequential registration error sharing strategy to complete three-dimensional reconstruction. According to the method, the key problems of large calibration error, weak texture matching failure, point cloud noise sensitivity and registration accumulative error in a traditional method are solved, and the reconstruction precision and stability are remarkably improved.

The invention relates to the technical field of image data processing and intelligent control, and discloses a patch board spot welding track intelligent control method and system based on visual perception. According to the method, synchronous image streams are collected through a binocular vision sensor, and epipolar correction image pairs are generated through timestamp synchronization, ROI extraction and epipolar correction processing; calculating a disparity map by adopting a stereo matching algorithm, and constructing a compensated three-dimensional point cloud model based on deformation vector field fusion multi-frame point cloud data of a radial basis kernel function; welding spot position error vectors are generated by extracting welding spot feature points and performing spatial filtering optimization; and carrying out inverse kinematics calculation on the mechanical arm by adopting a damping least square method, carrying out safety constraint optimization in combination with prospective collision risk assessment and real-time pose data, and generating a trajectory compensation instruction. According to the method, the problems of dynamic deformation compensation and motion safety in patch plate welding are solved, the submillimeter welding spot positioning precision is achieved, and the welding quality stability and the system robustness are improved.

The invention provides a robust stereo matching method fusing monocular semantic prior and multi-dimensional expert aggregation, relates to the technical field of computer vision and stereo matching, establishes a robust stereo matching framework fusing monocular semantic prior and multi-dimensional expert aggregation, and comprises a monocular branch and a binocular branch, inputting a stereo image into a robust stereo matching framework based on fusion of monocular semantic prior and multi-dimensional expert aggregation for matching calculation, wherein the matching calculation comprises the following steps: extracting semantic prior features of the input image by using a monocular branch; the method comprises the following steps: extracting a geometric enhancement feature map of a stereo image by using binocular branches, generating a matching cost body based on the geometric enhancement feature map, and carrying out refined iterative updating on the matching cost body to obtain a matched disparity map. According to the method, monocular and binocular depth estimation is cooperatively supported in a unified network architecture, and a parallel monocular depth prior path is utilized to actively guide and strengthen a core binocular matching process.

The invention relates to the technical field of intelligent maintenance of tunnel electromechanical facilities, in particular to a tunnel lamp recognition and spatial positioning method based on binocular vision, which comprises the following steps: synchronously acquiring tunnel environment images through left and right cameras subjected to polar horizontal correction, inputting the images into a lightweight tunnel lamp detection model, and detecting an area image containing a lamp bounding box; extracting feature points in the bounding box by adopting a multi-scale adaptive FAST feature extraction algorithm, describing the feature points by rotating an invariant binary descriptor, and generating a disparity map in combination with an adaptive Hamming distance matching algorithm; calculating three-dimensional space coordinates of the lamp according to the disparity map by using a binocular camera triangulation principle and combining camera parameters; when the ambient illumination is lower than a threshold value, a multispectral image fusion module is started to enhance the feature matching robustness; and when continuous matching fails, visible light communication assisted positioning is started. According to the invention, the problem of low positioning precision of the lamp in a complex tunnel environment is solved, and the reliability and efficiency of identification and positioning are improved.

The invention discloses an underwater swimming fish body mass estimation method and system, and relates to the technical field of computer vision, and the method comprises the steps: collecting fish body side view image data through a binocular camera, carrying out the calibration and correction operation, and carrying out the image preprocessing; the method comprises the following steps: extracting two-dimensional features of a fish body target, obtaining a final fish body image disparity map based on an APT-DMR method, extracting corresponding key matching points of a left image and a right image of a fish body based on the final disparity map, obtaining feature point space coordinates according to a triangular geometry principle, and calculating three-dimensional features by using a spatial distance formula; and constructing a fish body quality prediction model based on the MLR, and predicting the fish body quality. According to the method, the fish disparity map is obtained based on the SGBM algorithm, the corresponding key matching points of the left and right images of the fish body are extracted, the coordinates of the three-dimensional space feature points of the fish body are calculated, the three-dimensional features of the fish body target are extracted, the fish body quality prediction model based on the MLR is constructed, the fish body quality is predicted, and the prediction precision and reliability are improved.

The invention discloses a photoelectric fusion beam control method and device based on a reconfigurable intelligent reflecting surface. The method comprises the following steps: acquiring internal and external parameter matrixes of a binocular camera and a binocular-RIS coordinate transformation matrix; capturing a binocular image stream of a detection target by using a binocular camera and executing stereo matching to obtain a disparity map and depth data of a binocular image; detecting a target image in the binocular image and outputting bounding box information of a center point of the target image; calculating target image coordinates through the depth data and the bounding box information, and converting the target image coordinates into three-dimensional space coordinates under an RIS coordinate system so as to determine the spatial position of the target; generating an RIS phase codebook according to the target spatial position, wherein the RIS phase codebook comprises a near-field phase compensation item; and loading the phase codebook to the RIS unit to form a target beam so as to perform directional tracking on a target. According to the technical scheme of the invention, high-precision beam control and stable positioning and tracking of the target can be realized in a complex multi-target environment.

The invention provides a short-baseline binocular three-dimensional human body posture reconstruction method and system, and the method comprises the steps: collecting original left and right image pairs, and carrying out the detection of a human body region; carrying out human body image pair matching and scale transformation on the detected human body region; parallax features are obtained based on the processed left and right human body area image pairs, feature fusion is carried out on the parallax features and human body features extracted by the three-dimensional human body posture estimation sub-network, a parallax image initial result is obtained based on feature fusion information, a loss function is established with the human body features to carry out parallax optimization, and an optimized parallax image and a scene depth image are obtained; human body features are obtained based on left and right human body area image pairs, feature fusion is carried out on the human body features and parallax features, two-dimensional human body joint points are obtained through two-dimensional posture estimation according to feature fusion results, and a three-dimensional human body posture initial result is obtained based on binocular camera parameters and a triangulation calculation method; and establishing a loss function with the scene depth map and human body prior supervision, and performing three-dimensional human body posture optimization to obtain an optimized three-dimensional human body posture.

The invention belongs to the technical field of data measurement, and discloses a high-speed railway ballastless track construction measurement method, which comprises the following steps of: carrying out internal reference and external reference calibration on a binocular camera of a track detection trolley; obtaining related data containing a binocular image, and carrying out space-time alignment processing on the related data so as to construct a prediction state vector; carrying out stereo matching on the binocular image to generate a prediction disparity map, and carrying out three-dimensional reconstruction on the prediction disparity map to obtain a track point cloud map; and extracting a track inner side point coordinate sequence and a track height program sequence from the track point cloud picture, and generating a corresponding track gauge table and a corresponding smoothness table. According to the invention, vision, three-dimensional reconstruction and inertial navigation technologies are integrated, and integrated detection of gauge, elevation and smoothness parameters is realized.

The invention discloses a pavement disease size accurate quantification method based on binocular vision, and the method specifically comprises the steps: collecting pavement image data through a vehicle-mounted binocular camera, achieving the real-time detection of a disease target through an improved RT-DETR model, and outputting the disease type and detection frame information; after a pavement disease target is detected, pixel-level segmentation is carried out on a disease area in the detection frame based on a semantic segmentation model, and a disease contour mask is extracted; an improved IGEV-Stereo stereo matching algorithm is used for calculating a disparity map, depth information is output based on camera calibration parameters and a disparity estimation result, and conversion from pixel coordinates to three-dimensional coordinates is achieved; and the binocular depth information and a disease detection segmentation result are combined to realize accurate size quantification of typical road surface diseases with different characters. Through the binocular stereoscopic vision technology, automatic detection and precise quantification of pavement diseases can be realized, the cost can be effectively reduced while the disease quantitative evaluation precision is improved, and decision support is provided for road management and maintenance.

The invention discloses a target recognition method based on multi-view vision and a target recognition model training method, belongs to the technical field of target recognition, and solves the problem that global information is easy to lose due to the fact that a binocular vision method adopted in an existing method mainly depends on target detection after disparity maps and image splicing in the aspect of feature extraction. The method comprises the steps of performing pre-recognition processing on a target scene image based on an improved deep belief network model, responding to an auxiliary adjustment instruction by a multi-view vision acquisition system, fusing a pre-recognition result and a scene compensation image based on a spatial stamp alignment algorithm, and performing scene compensation. The target recognition model extracts global information of a scene fusion set in a parallel mode of combining a bidirectional feature pyramid network architecture with a YOLO algorithm; according to the invention, accurate identification of the target object type and the target object position in the three-dimensional space of the target scene is realized by adopting a cooperative cooperation mode of the improved deep belief network model and the target identification model, and the problems of global information loss and information insufficiency of the scene fusion set during target identification are avoided.

The invention discloses a water level measurement method based on binocular stereoscopic vision. The method comprises the following steps that model selection is conducted on a binocular camera according to an actual measurement scene; horizontally erecting a binocular camera on a river bank, adjusting a pitch angle to enable left and right views to cover a water surface area under a water level full range, and synchronously acquiring water surface images of the left and right views by using the binocular camera; acquiring a corresponding disparity map pixel by pixel by adopting an iterative optimization semi-global stereo matching method; based on a calibration result of the binocular camera, obtaining a three-dimensional point cloud coordinate value of the water surface image by using a relationship between parallax and depth; performing plane fitting on the point cloud by using an RANSAC algorithm to generate a horizontal plane equation; calculating the distance from the optical center of the left camera to the horizontal plane, and converting the elevation of the camera to obtain the water level. According to the invention, the shore-based arrangement of the instrument can be realized, the water level can be measured remotely in an inclined manner, the measurement does not depend on any reference object in contact with a water body such as a water gauge, the frame-while-frame measurement can be realized in severe environments such as a high flood period, and the device is particularly suitable for water level emergency monitoring.

The invention discloses a position monitoring method and system based on different-source image registration and binocular positioning, and relates to the field of position monitoring. The method comprises the following steps: performing target detection and instance segmentation on image data of a dangerous area acquired by left and right binocular cameras to construct a mask image set; matching and processing the mask image of the target to obtain a target matching and correction image; introducing angle fusion score screening to obtain an optimal feature point, carrying out image registration on the optimal feature point according to the bit difference degree, and carrying out fusion display; calculating an optimal binocular parallax to obtain a target three-dimensional coordinate, and generating a point cloud; and carrying out background integration on the personnel target point cloud image according to the obtained crane space position to form a complete real-time personnel monitoring point cloud image. Through a binocular vision technology combining infrared and visible light cameras, a YOLOv8 algorithm and three-dimensional point cloud modeling, real-time monitoring of a hoisting operation dangerous area is realized, and operation safety and monitoring efficiency are remarkably improved.

The invention discloses a disparity map generation method and device, equipment, a medium and a product, and relates to the technical field of stereoscopic vision, and the method comprises the steps: carrying out the cost calculation of a two-stage feature map through a cost aggregation network, and obtaining a first image cost volume; and performing parallax regression according to the first image cost volume to obtain a parallax image. Therefore, the two-stage feature map of the input image is extracted through the feature extractor, then the cost aggregation network is adopted to carry out cost calculation on the two-stage feature map to obtain the first image cost volume, and finally parallax regression is carried out according to the obtained first image cost volume to obtain a parallax map. The problem that the disparity map cannot be quickly and accurately obtained in a traditional stereo matching algorithm is solved, and the efficiency of generating the disparity map is improved.

The invention relates to the technical field of computer vision, and particularly provides a tunnel video stream three-dimensional modeling system based on binocular stereo matching and SLAM (Simultaneous Localization and Mapping), which comprises a multi-modal image acquisition unit, a binocular infrared camera and an RGB (Red, Green and Blue) camera are configured to synchronously acquire an infrared image pair, an RGB image pair and inertial measurement unit data of a tunnel environment, the multi-source data is uploaded to the cloud processing platform in real time through the wireless transmission module; based on a dynamic switching mechanism of environmental perception, performing adaptive fusion pose estimation of a feature point method and a direct method on input multi-modal image data; the stereo matching and dense reconstruction unit is used for calculating a disparity map by adopting an improved self-adaptive window stereo matching algorithm, generating a three-dimensional point cloud in combination with the pose information output by the pose estimation unit, and constructing a global consistency point cloud model of the tunnel scene through a time sequence point cloud registration and splicing algorithm; and a multi-algorithm target detection and semantic fusion unit. The method can meet the requirements of precision and robustness of tunnel reconstruction.

The invention provides a civil engineering construction period structure safety monitoring method and system based on image recognition, and belongs to the technical field of combination of computer vision and civil engineering safety monitoring. The method comprises the following steps: S1, collecting binocular image data of a construction site, and constructing a data set of a building material; s2, performing target detection and instance segmentation on the building material in the data set based on an improved Mask RCNN algorithm to obtain a mask and space coordinates; s3, carrying out stereo matching on the binocular image, generating a disparity map by adopting an SGM algorithm, and converting the disparity map into three-dimensional point cloud data; s4, calculating the volume of the building material based on the point cloud data, and optimizing a volume measurement result in combination with a correction coefficient k of the shooting angle theta; and S5, estimating the weight of the building material according to the material density and the corrected volume, and outputting a load distribution diagram. The method can replace traditional manual measurement, remarkably improves the construction load statistical efficiency and safety, and is suitable for real-time monitoring and early warning in a complex construction site environment.

The invention discloses a mechanical arm vision distance measurement method and a distance measurement system thereof, and relates to the technical field of intelligent vision perception, a camera is installed on a mechanical arm to collect images, and through an optimization matching algorithm, the images shot by the left eye and the right eye are rapidly compared to generate a clear and accurate disparity map; the motion state of the mechanical arm is detected in real time through a vibration compensation mechanism, a shot image is corrected, and it is ensured that the distance measuring process is stable and reliable; and in combination with the corrected disparity map, the accurate distance from the target object to the camera is obtained by utilizing a depth calculation formula, and the result is transmitted to a control system of the mechanical arm. The depth value is fed back to the mechanical arm controller in real time through depth calculation and linkage with a control system, the precision of dynamic path planning and action execution of the mechanical arm is improved, and the mechanical arm shows higher anti-interference capacity in a dynamic vibration environment.

The invention relates to the technical field of computer vision, in particular to a method and a device for constructing a binocular stereo matching recursive network based on deep learning, in a feature extraction stage, a self-adaptive spatial pyramid pooling layer based on a kernel normalization convolution layer is provided, multi-scale feature extraction is performed on an image, and in a matching cost calculation stage, a self-adaptive spatial pyramid pooling layer based on a kernel normalization convolution layer is provided. A new attention approach is utilized in combination with a regularized cost volume to produce a more accurate similarity measure. And in the main network framework, a GRU (Gated Recirculation Unit) based on kernel convolution is adopted as an iterative update operator, features are retrieved from the stereo matching cost body, and parallax is updated through regression iteration. The GRU can consider the wider context around each pixel, the fusion of local and global information is promoted, the more comprehensive understanding of the feature space is provided, and the reasoning ability of the network for the scene structure of a larger area is enhanced.

The invention relates to the technical field of computer vision, in particular to a three-dimensional reconstruction method and device based on optical polarization and stereoscopic vision principles. The three-dimensional reconstruction method sequentially comprises the steps of image preprocessing, polarization parameter extraction, binocular stereo matching, disparity map generation and optimization, normal vector correction, depth information fusion and three-dimensional point cloud reconstruction and modeling generation. A polarization normal vector field is constrained and corrected as a'skeleton ', and the azimuth angle pi ambiguity problem which puzzles polarization three-dimensional reconstruction for a long time is solved; high-frequency surface normal details contained in corrected polarization information are used as textures to enhance and fill up depth information loss of binocular vision in weak texture and repeated texture areas, the inherent limitation of a single sensing technology in a three-dimensional reconstruction task is overcome, and the three-dimensional reconstruction of the surface of an object, especially a diffuse reflection object, is realized. And high-precision and high-integrity three-dimensional shape recovery is realized.

The invention provides a three-dimensional calibration method using a speckle image as a calibration object and combining weight parameters. The method comprises the following steps: acquiring a standard grid image and the speckle image through a camera; determining angular point positions in the standard grid image through an angular point detection algorithm; calibrating the stereoscopic vision system by using the obtained angular points to obtain an initial calibration result; calculating 3D coordinates of the camera calibration board in the world by using the disparity map; determining a subset of the reference image corresponding to the checkerboard angular points in the target image through a digital image cross-correlation algorithm; calculating a weight parameter of each calibration point based on the re-projection error; solving internal and external parameters of the camera by using the weight parameters, radial alignment constraint and a least square method; optimizing the main point of the camera by using the weight parameters; and if the re-projection error or the number of iterations does not meet the requirement, repeatedly calculating the weight parameter of the calibration point and the subsequent steps, otherwise, obtaining a camera calibration result, and obtaining the distortion curved surface of the camera lens.

The invention provides a super-resolution binocular image generation method and system based on geometric structure consistency, and the method comprises the steps: extracting the deep features of a low-resolution binocular image through employing a convolutional neural network or a Transform model, achieving the information interaction of a left image and a right image in combination with a cross attention module, and constructing a pixel incidence matrix of the left image and the right image; acquiring a pixel corresponding relation of the left image and the right image by using the pixel incidence matrix, and constructing a continuous parallax field; performing spatial warping on the deep features based on a continuous parallax field to obtain warping features, and aligning the deep features of the left and right images; and merging the deep features and the warping features after spatial alignment, inputting the merged features into a feature up-sampling module based on implicit two-dimensional expression, and outputting a high-resolution binocular image of the same scene. The invention provides a binocular image super-resolution technology comprising binocular image feature extraction, continuous parallax field construction based on implicit two-dimensional expression, left and right image feature space alignment and feature upsampling based on implicit two-dimensional expression.

The invention belongs to the technical field of agricultural machinery, and discloses a method for measuring the stacking height of materials in a grain tank of a grain transport vehicle based on binocular vision, which comprises the following steps of: constructing a binocular vision system which comprises two cameras with the same parameters, installing the binocular vision system on the grain transport vehicle, shooting the grain tank at a fixed angle, and calculating the stacking height of the materials in the grain tank according to parallax caused by the positions of the cameras; the space coordinates of the feature points are calculated through triangulation by using the difference between the pixel coordinate values of the left image and the right image, the depth information of the measured target is obtained, and the object is positioned and measured; through accurate binocular camera calibration and an efficient stereo matching algorithm, rapid and non-contact measurement of the material stacking height is achieved, the error rate is as low as 4% or below, the high-precision operation requirement is met, measurement data are further optimized through introduction of a linear regression model, errors are effectively reduced, and the measurement accuracy is improved. And the stability and the reliability of a measurement result are improved.

The invention discloses an underwater fish body length measurement method, system and device based on binocular vision and a medium, and relates to the technical field of underwater measurement. The method comprises the following steps: performing fish body tracking on a collected fish school video, and determining an ID of each fish and corresponding position information; judging the straightening state based on the tracking frame corresponding to the ID of each fish, and when the judgment result is that the fish body is straightened, selecting a frame with the longest center line as a fish body straightening reference frame; carrying out ROI cutting and masking on the basis of the fish body straightening reference frame to obtain an ROI area map; inputting the left view and the right view in the ROI into a GMFlow model for parallax matching to obtain a parallax image which only contains the characteristics of the whole body of the target fish and the periphery of which forms a black frame; and calculating the length of the fish body according to the coordinates of the central points of the four corners of the fish body in the disparity map and calibration parameters of the binocular camera. According to the invention, efficient and accurate fish body measurement can be realized through step-by-step processing of the fish school image sequence.

The invention provides a road three-dimensional lane line detection method and system based on binocular vision, and relates to the technical field of automatic driving, and the method comprises the steps: carrying out the online calibration of internal and external parameters of a camera and the time sequence alignment of the binocular image and IMU attitude data through collecting the forward binocular image and IMU attitude data of a vehicle; processing the binocular image after time sequence alignment, and determining a dense disparity map; generating a road point cloud based on the dense disparity map and camera parameters, and constructing an adaptive terrain model; constructing a depth enhanced BEV feature map according to the depth feature of the road point cloud and the texture feature of the binocular image, predicting candidate parameters of a three-dimensional lane line, and screening through various constraints; and then executing extended Kalman filtering and trajectory optimization to obtain three-dimensional lane line parameters. According to the invention, rapid and accurate detection of the three-dimensional lane line can be realized, the accuracy of three-dimensional lane line detection under a complex terrain is improved, and the deployment cost is reduced.

The invention discloses a control method and device of a multi-mode intelligent manipulator, and relates to the technical field of manipulators and artificial intelligence. Capturing left and right images of the target object by using a binocular vision technology; outputting the category and boundary coordinates of the target object through a YOLO model; extracting center coordinates of a target object in the left and right images; matching objects consistent with the target object in category and similar to the target object in coordinate in the left and right images; calculating parallax and depth information between the left image and the right image to combine three-dimensional space coordinates of the target object; smoothing the historical coordinates of each target object to output a target detection result of the YOLO model; inputting the target detection result into a task decision model and converting the target detection result into a structured instruction; the grabbing force is executed, calculated and adjusted according to the structured instruction; according to the control method and device for the multi-mode intelligent manipulator, through deep learning and an intelligent control algorithm, the manipulator can autonomously recognize a target and optimize an execution path.

The application provides a three-dimensional reconstruction method based on binocular stereo matching, and relates to the technical field of binocular stereo vision. The method combines binocular stereo matching algorithm, triangulation algorithm and surface texture mapping, and can realize surface reconstruction of scene objects in different environments. After stereo calibration is performed on a binocular camera, the internal and external parameters of the binocular camera are obtained, stereo correction is performed, then an image disparity map of the corresponding scene object is generated according to an optimized semi-global stereo matching algorithm, after the disparity information is obtained, the point cloud information converted by the object disparity is triangulated on the surface according to the triangulation algorithm, and finally three-dimensional surface reconstruction of the object is realized through the texture mapping technology. The application can reduce the influence of noise in the disparity map generation process, i.e. the semi-global stereo matching algorithm, improve the accuracy of the disparity information, and complete the three-dimensional surface reconstruction task of the object with little sacrifice of time performance.

The invention relates to the field of medical instruments, and provides a cannula pose recognition method and system based on binocular vision, and the method comprises the steps: firstly, building a binocular camera system with a shooting range covering eyeballs, collecting a group of binocular images, and respectively recognizing cannulas and cannula holes in the two images; then, a disparity map is generated based on the casing pipe and the casing pipe hole in the two images, the disparity map is converted into a depth map in combination with the internal reference of the binocular camera system, and the boundary point cloud of the casing pipe hole is obtained; and finally, determining a fitting plane of the casing position and the casing hole according to the boundary point cloud, and taking a normal vector as a casing posture. According to the method, the operation complexity of aligning the instrument to the cannula in the robot-assisted surgery can be reduced, additional arrangement of a marker is not needed, the precision and speed of cannula pose recognition are effectively improved, eyeball movement is directly recognized through cannula pose changes, the compensation effect of eyeball movement is enhanced, and the safety of the robot-assisted surgery is improved.

The invention discloses a plant growth monitoring method based on binocular vision stereo matching, and the method comprises the steps: collecting a target plant image, improving the brightness distribution of the plant image through employing an image enhancement algorithm of histogram equalization and dual gamma function weighted fusion, improving the contrast of the image, and obtaining an improved image; formulating a binocular vision stereo matching constraint criterion; constructing a binocular vision stereo matching model, including matching cost calculation, cost aggregation, parallax calculation and parallax optimization; inputting the improved image into a binocular vision stereo matching model to obtain a final target plant growth image; and performing experimental analysis on the final target plant growth image to obtain a target plant generation stage. According to the method, the pixel matching accuracy of a stereo matching algorithm is improved, so that accurate extraction of distance and phenotype parameters of plant leaves in an actual scene is realized, and certain real-time performance of a system is ensured.