4962 results about "Multiple view" patented technology

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.

The invention discloses a large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering, and relates to computer graphics. The method comprises the following steps: collecting a multi-view image set of a large scene; obtaining a scene sparse point cloud according to the multi-view image set; performing monocular depth estimation on the multi-view image by using a pre-trained depth prediction network to obtain monocular depth estimation priori; the method comprises the following steps of: performing global training on a scene by utilizing scene sparse point cloud and monocular depth estimation prior to obtain an initial three-dimensional Gaussian model, and performing space grid division on the initial three-dimensional Gaussian model to obtain a plurality of scene blocks with axis alignment bounding boxes; setting image view angle data of each scene block; performing deep supervised training on the Gaussian ellipsoids in the plurality of scene blocks by using a parallel GPU (Graphics Processing Unit); combining the trained scene blocks to obtain a final three-dimensional Gaussian model; in view of low geometric structure reconstruction precision caused by only depending on color information of a multi-view image in large-scene three-dimensional rendering, the method improves the reconstruction precision of large-scene rendering.

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.

The invention discloses a three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian, and aims to solve the problems of Gaussian drift, edge blur, structure artifacts and the like of a reconstruction model due to the fact that sparse point cloud contains outliers, Gaussian morphology and normal are mismatched and a multi-dimensional optimization target is lacked in an existing three-dimensional Gaussian sputtering reconstruction method. A key frame is extracted by collecting target scene video data, sparse three-dimensional point clouds are reconstructed by using an SfM algorithm, a depth map and a normal map are generated through a Lotus model, three-dimensional Gaussian distribution is initialized after the sparse point clouds are filtered, a Gaussian covariance matrix is adjusted by using a normal consistency regular term, and the sparse point clouds are extracted. And after structure attribute analysis is carried out, a comprehensive scoring function is constructed to screen Gaussian points, and finally, a combined training framework including luminosity, normal consistency and structure continuity loss is adopted to optimize and generate a three-dimensional Gaussian scene model. The method is mainly applied to the field of three-dimensional reconstruction and multi-view rendering, and scene reconstruction precision and geometric consistency can be improved.

The invention discloses a mechanical arm positioning and grabbing method based on machine vision, and relates to the technical field of machine vision and mechanical arm control, the method comprises the following steps: synchronously acquiring RGB-D images of a target scene through a multi-view camera array, and generating three-dimensional point cloud data through data fusion; an improved LSD algorithm and a PnP algorithm are adopted to calculate the initial pose of the target object, illumination distortion is eliminated in combination with the generative adversarial network, and three-dimensional coordinates are output; a mechanical arm motion error transfer model is constructed based on Monte Carlo simulation, and a candidate grabbing scheme set is generated through reinforcement learning; and an optimal grabbing scheme is screened through a preset priority evaluation rule, and a mechanical arm joint movement track and a control instruction set are generated. Through multi-modal data fusion and a nonlinear optimization algorithm, the technical problems of large target positioning deviation and sensitive illumination interference in a complex environment are solved, and the grabbing precision and robustness of the mechanical arm are improved.

The invention relates to an optimization method and device for sparse view angle three-dimensional Gaussian splash, and belongs to the technical field of three-dimensional reconstruction in computer vision, and the method comprises the steps: collecting a sparse view angle image; a multi-view stereoscopic vision model based on deep learning generates a geometrically consistent depth map for the sparse view image, converts the depth map into point clouds and fuses the point clouds to obtain dense point clouds; sampling dense point clouds by adopting voxel-guided farthest point sampling to obtain initialized point clouds, and constructing a three-dimensional Gaussian field; rendering the three-dimensional Gaussian field through an enhanced geometric renderer to obtain a rendering depth and a rendering normal; constructing a multi-level geometric regularization loss function, and optimizing the three-dimensional Gaussian field; and performing optimization adjustment on the three-dimensional Gaussian field based on a shape-scale constraint criterion and a two-stage adaptive opacity constraint strategy to obtain an optimized three-dimensional Gaussian field. According to the method, the problems of initialization failure, insufficient geometric supervision and element out-of-control of 3D Gaussian splashing under the sparse view angle are solved.

The invention relates to the technical field of three-dimensional model adjustment, in particular to a three-dimensional model adjustment method and system and a medium. The method comprises the following steps: obtaining a multi-angle image of an original model, carrying out multi-view normalization on the multi-angle image, generating a normalized view image set, extracting feature points of the original model, carrying out parallax correction on the feature points, reconstructing a simulation three-dimensional model, collecting basic purpose data of the model, carrying out ideal demand mapping through the data, and carrying out ideal demand mapping. The method comprises the following steps: determining an ideal three-dimensional model structure, carrying out core region segmentation on a reconstruction model according to basic purpose data to obtain key region model slices, carrying out highlight region comparison with the ideal model structure, analyzing model differences, determining a structure adjustment amplitude interval according to a comparison result, and carrying out cyclic fine adjustment correction on the key region model slices to obtain a three-dimensional model. And the three-dimensional model is consistent with the ideal three-dimensional model in structure, so that the optimized three-dimensional model is generated. According to the invention, efficient and accurate three-dimensional model adjustment and optimization are realized.

The invention relates to an injection molding product defect detection method based on machine vision, which comprises the following steps: collecting material information of a to-be-detected injection molding product in real time, and dynamically matching and adjusting light source parameters according to spectral reflection characteristics of materials to ensure image collection quality; secondly, the collected images are preprocessed, edge features and texture features are extracted, a three-dimensional model is constructed through multi-view image splicing, and three-dimensional defect features are extracted; thirdly, the multi-dimensional features are input into a deep learning model, the defect probability is calculated through feature fusion and forward propagation, and whether the product has defects or not is judged; if the defect exists, further identifying the defect category, and calculating the number and size of the defect; and generating a standardized detection report based on the defect information. According to the method, the image adaptability of products made of different materials is improved through dynamic light source adjustment, the two-dimensional and three-dimensional features are fused, the defect recognition accuracy is improved, and full-process automation from qualitative judgment to quantitative analysis of the defects is achieved.

The invention relates to an image processing technology, and discloses an efficient panoramic image splicing method and system based on multi-view fusion, and the method comprises the steps: collecting a plurality of images from different views; performing multi-scale feature extraction on each image, generating a feature descriptor for each extracted feature point, and matching a corresponding feature point pair; performing multi-view geometric constraint screening on the feature point pairs; according to the screened feature point pairs, estimating a homography matrix between adjacent images, and carrying out global optimization on the homography matrix; aligning all the images into the same coordinate system; determining an overlapping region between adjacent images; and according to the pixel information in the overlapping areas, fusing the overlapping areas by adopting a self-adaptive weighted fusion algorithm so as to splice the plurality of images into a panoramic image. The invention further discloses a control device and a computer readable storage medium. The invention aims to improve the efficiency and accuracy of generating the multi-view fused panoramic image.

The invention provides a road bridge crack detection method and system, and the method comprises the steps: collecting a bridge surface multi-view image, and constructing a training data set containing crack feature labeling through quality screening and standardized labeling; preprocessing the image by using a multi-scale feature fused deep convolutional neural network and carrying out semantic segmentation, initially identifying a suspected crack region and generating a segmentation mask; and constructing a BeNNS proxy model based on the mask, and establishing a mapping relationship between the detection result and the bridge structure topology, the stress flow field and the service function chain so as to evaluate the result reliability. And inputting an evaluation result into a hybrid evaluation mechanism, performing online real-time detection and offline batch verification to optimize precision, and outputting a verified crack region. Finally, morphological analysis is conducted on the area, geometric parameters and danger levels of cracks are extracted and integrated to a bridge health monitoring system, a crack evolution tracking algorithm and an early warning mechanism are established, and dynamic tracking early warning is achieved. The problem of low detection precision in a complex environment can be solved.

The invention provides a square power battery shell visual defect rapid detection method and system, and relates to the technical field of image processing, and the method comprises the steps: obtaining a high-resolution multi-view image sequence, outputting standardized image data, carrying out front visual scratch detection, outputting scratch defect positions and features, and outputting defect candidate regions containing confidence scores; and recognizing bubble defects, summarizing recognition results of the defect candidate areas, and generating a labeling image. The method solves the problems that in the prior art, due to the fact that multi-view image information is not fully fused, traditional scratch detection depends on a single edge feature, and a main defect recognition model is insufficient in recognition capacity for tiny defects such as bubbles, defect detection accuracy is low, missing detection and false detection phenomena are serious, and detection efficiency is high. According to the method, the problems that the defect is difficult to comprehensively and accurately locate and classify in the prior art are solved, the multi-view information fusion capability and the identification accuracy and detection efficiency of multi-class defects are improved, and high-precision, comprehensive and real-time quality monitoring of defect detection results is realized.

The invention discloses a personnel positioning method and system based on a 3D Gaussian splash model and video fusion. The method comprises the following steps: firstly, acquiring input data of at least two visual angles through a multi-visual angle video stream acquisition module, and constructing an initial three-dimensional Gaussian model by utilizing a sparse point cloud initialization module; a time sequence dynamic tracking module is combined with an optical flow algorithm to realize cross-frame parameter updating of a Gaussian ellipsoid, and a time sequence consistency optimization module is adopted to suppress parameter drift; identifying a constructor bounding box by using a target detection module, and establishing a corresponding relation between pixels and three-dimensional coordinates through a three-dimensional-two-dimensional space matching module; three-dimensional coordinates are calculated through a multi-view fusion positioning module, and the positioning precision is improved through a multi-sensor fusion optimization module in combination with IMU data. A 3D Gaussian splash model is combined with multi-view geometry and time sequence optimization, high-precision personnel dynamic positioning without marking in a construction scene is realized, and the problems of tracking drift and shielding in a complex environment in a traditional method are effectively solved.

The invention discloses a cut workpiece defect detection method and system based on image feature feedback, and relates to the technical field of image processing.The method comprises the steps that cut workpiece technological characteristics are obtained, a preset defect type library is constructed, a hardware system is built, and parameters are initialized; synchronously acquiring a multi-view original image, and storing and associating annotation information; de-noising the original image, enhancing the contrast, and extracting a region of interest ROI; extracting texture, shape, edge and gray features from the ROI, and screening through a Relief-F algorithm to obtain an optimal feature subset; inputting into an SVM (Support Vector Machine) model for reasoning, and screening to obtain an effective defect detection result; and calculating an evaluation index and generating a feedback signal, and performing iterative optimization after adjusting parameters. The system comprises an acquisition module, a master control module, a data processing module and a display module. Through the precise design and closed-loop feedback of the whole process, the precision, efficiency and long-term adaptability of defect detection of the complex cutting workpiece are improved, and the industrial quality management and control requirements are met.

The invention relates to the technical field of intelligent warehousing and logistics automation, in particular to a forklift dynamic path planning method based on deep reinforcement learning, and the method comprises the steps: deploying multi-view vision, geomagnetism and other multi-source sensors, achieving data calibration and fusion through employing an insect compound eye-imitating vision model, and constructing a high-dimensional state space vector; heuristic models such as migrant bird navigation and biological stress response are adopted, deep reinforcement learning is combined, decision instructions are generated from the three aspects of path planning, dynamic obstacle avoidance and energy efficiency management, actions are executed through a control system, and deviation is fed back; a reward function is used for evaluating the decision effect, rewards are formed by weighting path efficiency, obstacle avoidance success and energy consumption penalty, the weight can be updated in a self-adaptive mode, and therefore the deep reinforcement learning model is optimized. According to the method, the accuracy, safety and efficiency of forklift path planning are effectively improved, the method can adapt to complex dynamic environments, and the requirements of intelligent logistics and industrial automation for forklift intelligent operation are met.

The invention relates to the technical field of traditional Chinese medicinal material defect detection, in particular to a traditional Chinese medicinal material defect detection method based on vision, which comprises the following steps: regularly acquiring a time sequence image of a traditional Chinese medicinal material sample, acquiring a multi-view image, carrying out pixel alignment on the time sequence image, and carrying out structured organization on the multi-view image according to a shooting direction to associate camera parameters; and generating a registration time sequence image sequence and a multi-view image set. According to the method, the time sequence images of the traditional Chinese medicine samples are collected regularly, pixel alignment is carried out, image offset caused by environment illumination fluctuation and equipment jitter is eliminated, and time-space consistency of dynamic variable quantity calculation is ensured. Structured organization is carried out on multi-view-angle images according to shooting directions, camera parameters are associated, a geometric constraint relation between view angles is established, and the problem that three-dimensional reconstruction precision is insufficient due to view angle isolation in a traditional method is solved.

The invention relates to the technical field of image processing, and discloses an industrial part alignment method and system based on visual analysis and a storage medium. The method comprises the steps that a three-view camera collects an industrial part image, and preprocessing is carried out through gradient magnitude local contrast enhancement to obtain an enhanced image; performing hierarchical feature extraction to identify edge contours and key control points to form a multi-dimensional feature set; and establishing a dynamic reference coordinate system based on the feature set to obtain a part space attitude matrix. And the attitude deviation is compensated through Z-axis offset and rotation coupling error analysis. Posture adjustment is decomposed into a plurality of sub-stages, an alignment track is optimized by adopting a variable speed planning strategy, and accurate alignment of the parts is achieved. The problems that multi-view visual information fusion is insufficient, a special recognition algorithm for geometrical characteristics of the industrial parts is lacked, and Z-axis offset and rotation coupling error compensation is inaccurate in the posture adjustment process are solved, and the precision and stability of alignment of the industrial parts are improved.

The present disclosure relates to the field of computer vision and discloses a three-dimensional dynamic scene reconstruction method and apparatus, and a storage medium. The three-dimensional dynamic scene reconstruction method comprises: acquiring synchronized videos of a plurality of viewpoints of a dynamic scene; computing matching points between video images of different viewpoints, and estimating intrinsic and extrinsic parameters of each camera; obtaining a Gaussian splatting point set {p0} on the basis of a sparse point cloud constructed according to the depth of each matching point; for the first image frame of each video, using {p0} to perform static training thereon, to obtain a Gaussian splatting point set {p}; for the remaining image frames, dividing {p} into a static point set {S} and a dynamic point set {D}, performing dynamic training on {D}, and constructing a dynamic Gaussian splatting point set {P} from {p}, {S}, and the final {D}; and, in view of the intrinsic and extrinsic parameters of each camera, rendering {P} using a Gaussian splatting rendering pipeline, to obtain rendered images at different moments from new viewpoints.

The embodiment of the invention provides an end-to-end automatic driving control method and device based on multi-camera fusion, and multi-view target detection and tracking are realized through spatial transformation and coordinate mapping by combining front wide-angle camera information and left and right wide-angle camera information. A multi-view feature fusion network architecture is designed, the multi-view feature fusion network architecture comprises three sub-networks of feature extraction, dynamic weight distribution and feature fusion, and the fusion weight is dynamically adjusted based on image definition, detection confidence and view overlapping degree. A geometric consistency constraint between visual angles and a reconstruction loss function are introduced, a deep neural network model is constructed, abnormal conditions such as camera shielding are effectively handled, and an accurate control instruction is output. According to the method, the defects of the traditional technology in the aspects of multi-view information fusion, shielding processing and the like are overcome, and the sensing ability and the control reliability of the automatic driving system are remarkably improved.

The invention provides a posture recognition algorithm for any object under a monocular camera and an application system, and the algorithm comprises the steps: S1, constructing a target three-dimensional model, carrying out the multi-view annular shooting image collection of a target, and generating a dense grid model through feature extraction, matching, posture calculation and a multi-view geometric method; s2, generating an image depth map, and predicting depth information of a target in a motion process based on a monocular image sequence; s3, extracting a target image mask, and generating a target area mask graph through an image encoder, a prompt encoder and a mask decoder; and S4, executing attitude estimation, performing attitude initialization, correction and screening by combining the three-dimensional model, the depth map and the mask map, and outputting a six-degree-of-freedom attitude result of the target. According to the method, the target is subjected to annular shooting modeling through the method based on multi-view geometry, the three-dimensional model of the target is generated, attitude estimation is achieved in combination with the image mask and the depth map, the generalization ability of an attitude estimation algorithm in an actual scene is improved, and the application range of the attitude estimation algorithm in the actual scene is widened.

The invention relates to the field of earth wall defect recognition, and discloses an assembled retaining wall defect recognition method and system based on image recognition, and the method comprises the steps: obtaining multi-view image data of an assembled retaining wall, and constructing a defect recognition image data set in combination with a boundary detail enhancement mechanism and a region illumination compensation strategy; performing edge guide feature extraction on the defect identification image data set, and constructing an image deep feature model based on a boundary context fusion network; judging whether the response intensity change of the image deep feature model in the crack region reaches a preset threshold value or not through an edge response enhancement mechanism, and if yes, marking that the crack region has potential defects; utilizing a multi-scale morphological structure analysis method to carry out contrast perception optimization on the corrected crack area; and based on a defect identification result, combining a component positioning mechanism and component historical operation and maintenance data to perform severity grading evaluation on the defect. The method has the advantage of improving the sensitivity to the marginal area.

The invention relates to the technical field of automatic workpiece grabbing and visual servo control, and discloses a workpiece grabbing method and system based on visual feedback, and the method comprises the steps: obtaining a real-time image through a front-view camera, a side-view camera and a top-view camera, and extracting surface features through a feature fusion network; inputting the features into a pose estimation model based on a particle filtering framework, and iteratively updating the pose in combination with a multi-dimensional observation likelihood function to generate prediction parameters; constructing a multi-target path planning model based on the parameters, and optimizing the path by adopting a dynamic planning algorithm with the shortest path and the minimum joint movement as targets; a hierarchical control model is established, a strategy layer performs global planning, an adjustment layer corrects a local path, and an execution layer realizes trajectory tracking through visual servo control and outputs a control instruction to complete grabbing. Through multi-view perception, robust pose estimation, global optimization path planning and hierarchical control, the precision, efficiency and stability of workpiece grabbing in a complex environment are improved.

The invention relates to the technical field of quality monitoring, and discloses a diamond high-strength micro-powder quality detection method and system based on artificial intelligence. The method comprises the steps of obtaining a two-dimensional projection image sequence of diamond micro-powder particles, calculating a projection matrix based on camera calibration parameters and geometric constraints, obtaining a multi-view image data set of the particles, establishing a pixel-level corresponding relation, extracting three-dimensional space coordinates of the surfaces of the particles, and reconstructing dense point cloud data of the particles. Establishing a local coordinate system based on the dense point cloud data, determining attitude parameters of particles in a three-dimensional space, if the attitude parameters deviate from a normal range, performing attitude compensation processing to obtain standardized point cloud data, and performing three-dimensional grid model construction on the standardized point cloud data; and calculating geometrical characteristic parameters of the particles based on the three-dimensional grid model, performing defect detection on the surfaces of the particles, and generating a crystal integrity evaluation report of the particles. The quality detection accuracy of the diamond high-strength micro-powder particles is improved.

The invention relates to the technical field of tunnel engineering construction, and discloses an intelligent material transportation and safety monitoring system and method for shield construction, and the system comprises a visual perception unit, a sensor network module, an AI analysis center module, a safety decision module and a human-computer interaction interface. According to the invention, data acquisition is carried out through the visual perception unit and the sensor network module, multi-target detection operation is carried out on image frames through the AI analysis center module after target identification and track prediction, target types, space coordinates, contour boundaries and confidence coefficients are identified and extracted, and safety judgment and early warning output are carried out. According to the invention, by integrating the multi-view camera equipment and the UWB, GNSS and other sensors and adopting a deep learning target detection algorithm, high-precision identification and continuous tracking can be carried out on construction site personnel, equipment, segments and other key objects, and accurate input is provided for subsequent risk analysis.

A method and apparatus for reconstructing a three-dimensional (3D) scene from a two-dimensional (2D) input image of the scene using a fully-differentiable transformer-based encoder-decode. A 2D input image encoded into a set of image features using a pre-trained vision transformer model, wherein the vision transformer model is pre-trained with multi-view RGB image supervision and point cloud supervision. The set of image features is projected onto a 3D triplane representation using a transformer decoder to obtain output triplane tokens. A triplane representation is created from the tokens and queried. 3D point features of color and density for volumetric rendering re predicted using a multi-layer perceptron. The geometry of the generated 3D asset is represented with a surface mesh including vertices and triangular faces. A texture map by is created with a multichannel image in UV space. Multiple views of the 3D scene are simultaneously generated based on the surface mesh.

The invention relates to the technical field of traditional Chinese medicine acupuncture and moxibustion teaching, in particular to a multi-view fused traditional Chinese medicine acupuncture and moxibustion visual teaching system which comprises a basic data construction module, an immersive environment building module, a multi-view interactive teaching module, a collaborative annotation conflict processing module, an annotation result auditing module and a model and data optimization module. Compared with the prior art, the traditional Chinese medicine acupuncture and moxibustion visual teaching method has the advantages that a new traditional Chinese medicine acupuncture and moxibustion visual teaching paradigm of data-driven cognition, interactive verification logic and intelligent optimization iteration is constructed through a closed loop of'problem definition-technical breakthrough-effect guidance ', space and modal limitations of traditional teaching are broken through, and the traditional Chinese medicine acupuncture and moxibustion visual teaching method is suitable for popularization and application. In addition, deep fusion of traditional Chinese medicine inheritance and modern medical education is achieved, and a reproducible digital solution is provided for standardized and precise acupuncture and moxibustion teaching.

The invention relates to the technical field of unmanned aerial vehicle autonomous control, and discloses an unmanned aerial vehicle obstacle avoidance control method and system based on computer vision, and the method comprises the steps: collecting the multi-view image data of a flight environment in real time through a multi-view camera, and carrying out the preprocessing; using an improved YOLOv7 network to identify obstacles in the preprocessed image, and extracting position, size and motion information of the obstacles; generating a three-dimensional environment map and a plurality of candidate obstacle avoidance paths in combination with the flight parameters of the unmanned aerial vehicle and the extracted obstacle information; an optimal path is screened based on a dynamic safety evaluation model, and the attitude and power output of the unmanned aerial vehicle are adjusted in real time to complete obstacle avoidance; an obstacle avoidance effect is verified by using an optical flow method and depth information, and path planning is dynamically corrected. According to the method, the dynamic safety evaluation model is introduced, multi-dimensional factors are comprehensively considered, the safety of each path is dynamically determined, and it is ensured that the flight path of the unmanned aerial vehicle can be timely and accurately modified and optimized in a dynamic complex environment.

The embodiment of the invention discloses an intelligent surveying and mapping method and system based on AI and BIM fusion. The method comprises the steps that an unmanned aerial vehicle platform carrying a laser radar, an RGB camera and a positioning system is used for scanning ancient building cultural relics and surroundings in a multi-angle flight mode, point cloud data, multi-view image data and position and attitude data are synchronously collected, and the three are associated through timestamps; after the point cloud data and the multi-view image data are preprocessed, cross-modal registration is completed through feature matching and pose estimation in combination with the position and pose data, and a registration data set is obtained; semantic segmentation is carried out on the point cloud data and the image data in the registration data set, and semantic segmentation results are fused based on the incidence relation; classifying and aggregating the original point cloud components according to category labels, constructing a topological relation reasoning assembly relation, calling corresponding BIM template instantiation model components based on the assembly relation, and hooking a segmentation result to generate a semantic enhanced BIM model; and integrating the BIM model and the GIS base map to form a fusion model so as to plot the historic building cultural relics.

The invention relates to the technical field of image recognition, in particular to an image processing method and system for rehabilitation training action analysis. According to the method, a multi-view image sequence is collected based on a binocular camera device, skeleton key point data of a user in a training process is extracted by utilizing a three-dimensional attitude reconstruction technology, and an action three-dimensional time sequence data set is constructed. The method comprises the following steps: firstly, constructing an individual standard power generation characteristic model of a user, modeling a skeleton driving path of a main muscle group, and forming a personalized power generation reference structure; and then a standard rehabilitation action path is matched through a dynamic time warping algorithm, and the attitude deviation under the key frame is identified. And the system dynamically compares the identified non-standard motion mode with the individual model, judges whether abnormal force generation exists or not and outputs the type and the part of the muscle compensation behavior. And finally, multi-modal feedback information with highlighted graphs, voice prompts and character suggestions is generated in combination with an identification result, so that the identification precision and personalized guidance capability of rehabilitation training are remarkably improved.

The invention relates to the technical field of visual automatic calibration, and discloses a joint manipulator automatic calibration method and device based on a visual system. The method comprises the following steps: carrying out multi-view image acquisition on a joint manipulator of the five-axis robot to obtain original image data; performing occlusion region extraction on the original image data to obtain a joint occlusion region set; on the basis of the joint occlusion region set, disordered image splicing and mark point feature extraction are carried out on the original image data, and joint feature image data are obtained; constructing an adaptive calibration equation based on the joint feature image data, and solving a target transformation relation between a global visual coordinate system and a local visual coordinate system; multi-joint collaborative calibration and joint chain constraint optimization of the five-axis robot are executed according to the target transformation relation, and joint error correction parameters are generated, high-precision joint error correction parameter calculation is achieved, and the positioning precision and the movement precision of a joint manipulator of the five-axis robot are greatly improved.

The invention relates to the technical field of natural language processing and information retrieval, and discloses a deep dense document recall method based on multi-view vector fusion, comprising the following steps: S1, preprocessing user query and candidate documents to generate a standardized text; s2, respectively constructing multi-view semantic vector representation of the query and the document, wherein multiple views at least comprise a keyword view, a semantic extension view and an intention view; s3, calculating a similarity score between the query and the document for each semantic view, and fusing the scores of all the views through a dynamic weight; and S4, sorting the documents according to the fusion score, and returning a front Top-K result. By constructing multi-dimensional semantic representation of keywords, semantic extension and an intention perspective, multiple semantic information such as term accurate matching, context association and task target consistency is effectively fused. The dynamic weight distribution mechanism adaptively adjusts the contribution degree of each view angle according to the query content, and overcomes the defect of insufficient semantic coverage of a single view angle.