17172 results about "View angle" patented technology

The invention discloses a manipulator grabbing planning system and method based on visual identification, and relates to the technical field of robots, the manipulator grabbing planning system comprises a visual perception module, a coordinate conversion module, a motion planning module, a control execution module, a tail end perception module and a system integration and communication module; the visual perception module realizes multi-view target detection, semantic segmentation and three-dimensional pose estimation through a binocular depth camera; the coordinate conversion module is used for converting a target pose under a camera coordinate system into a world coordinate under a mechanical arm base coordinate system; the motion planning module is responsible for generating a mechanical arm grabbing path, optimizing a strategy and supporting generalization migration of a multi-form mechanical arm; the control execution module drives the six-axis cooperative mechanical arm to complete the grabbing action, and vision-force mixed feedback closed-loop control is achieved. The tail end sensing module monitors the grabbing state in real time through a touch sensor and dynamically adjusts a grabbing strategy; and the system integration and communication module is used for realizing real-time data interaction and cooperative work among the modules of the system.

Disclosed in the present invention is a dynamic human modeling method based on three-dimensional Gaussians. In the present method, a multi-view human video is given firstly, and in order to correct and transform the dynamic human appearance, a latent code and a set of blend weights are added to each Gaussian; and the latent code and a target pose are inputted to an MLP to correct the Gaussian in a canonical space, so as to capture an appearance change under the target pose. The corrected Gaussian is transformed into the target pose by means of the blend weights thereof in a linear blend skinning (LBS) manner. Finally, a realistic human image at a new viewing angle or a new pose can be rendered in real time by means of Gaussian splatting. Compared with an existing method based on an implicit neural radiance field (NeRF), the three-dimensional Gaussian representation of the present invention can better capture high-frequency details while achieving optimal rendering performance.

The invention discloses a large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering, and relates to computer graphics. The method comprises the following steps: collecting a multi-view image set of a large scene; obtaining a scene sparse point cloud according to the multi-view image set; performing monocular depth estimation on the multi-view image by using a pre-trained depth prediction network to obtain monocular depth estimation priori; the method comprises the following steps of: performing global training on a scene by utilizing scene sparse point cloud and monocular depth estimation prior to obtain an initial three-dimensional Gaussian model, and performing space grid division on the initial three-dimensional Gaussian model to obtain a plurality of scene blocks with axis alignment bounding boxes; setting image view angle data of each scene block; performing deep supervised training on the Gaussian ellipsoids in the plurality of scene blocks by using a parallel GPU (Graphics Processing Unit); combining the trained scene blocks to obtain a final three-dimensional Gaussian model; in view of low geometric structure reconstruction precision caused by only depending on color information of a multi-view image in large-scene three-dimensional rendering, the method improves the reconstruction precision of large-scene rendering.

The embodiment of the invention provides a three-dimensional model adaptive generation method based on video and point cloud data, scene data is collected through a multi-view camera array and a depth scanning array, and key features are extracted and screened by using a hierarchical feature extraction network and an attention mechanism. And organizing local data blocks by adopting a hierarchical index tree based on a union-check set, and realizing self-adaptive parameter optimization by combining integrity and accuracy scores. Meanwhile, efficient reconstruction and material mapping of a local three-dimensional grid are realized through a parallel operation channel and a dynamic calculation resource scheduling mechanism. According to the method, the precision and efficiency problems of a traditional three-dimensional reconstruction scheme in processing a large-scale scene are effectively solved, and the model generation quality is improved.

The invention relates to the technical field of optical detection, in particular to a workpiece surface defect detection method and system based on the optical technology, and the method comprises the following steps: S1, generating a curvature model of a workpiece; s2, dynamically adjusting the irradiation angle and the light spot shape of a light source according to the curvature model in the S1; s3, adjusting the focal length of the detection equipment in real time; s4, imaging acquisition is carried out on the workpiece at the same time through multiple angles; s5, correcting image distortion caused by surface curvature change, and fusing the multi-angle images into a high-precision workpiece surface image; s6, defect features of the surface of the workpiece are extracted, defects are classified, positions are marked, and a defect detection report is generated; according to the invention, by dynamically adjusting the light source and the focal length and combining multi-view imaging and advanced image processing technologies, efficient and accurate defect detection is realized, and the product quality and the production efficiency are remarkably improved.

Disclosed in the present invention are a digital image calculation method and system for deformable template-based RGB-D camera multi-view matching. The method comprises the six steps of data acquisition, point cloud data preprocessing, feature point matching, re-registration of deformable templates, calculation of a point cloud data transformation relationship between large-view images, and point cloud fusion. The size of a non-adjacent image matching template is adjusted on the basis of a registration result of adjacent views to achieve correct registration of feature points of non-adjacent view images, thereby improving the matching precision, eliminating the accumulative error of an image set, providing a relatively accurate initial value for subsequent iteration of point cloud fusion, reducing the number of iterations, and implementing three-dimensional reconstruction of images.

The invention provides a laser enhanced vision three-dimensional reconstruction method and system based on Gaussian splashing, and belongs to the field of computer vision. The method is divided into two parts of pose calculation and scene reconstruction: during pose calculation, relative rotation is solved by using image feature matching, and the relative pose with a real scale is further solved according to the pose of the relative rotation initialization point cloud ICP; the pose is further optimized by combining the re-projection error of the image matching feature and the matching error of the point cloud through a least square method, so that the high-precision pose is obtained; during scene reconstruction, a large number of three-dimensional Gaussian balls are used for representing a scene, an image with a high-precision pose and a depth map generated by point cloud projection are used for supervising a composite image capable of being micro-rendered, and a gradient descent method is used for optimizing parameters of the three-dimensional Gaussian balls to reconstruct and optimize the three-dimensional scene. Therefore, dense reconstruction of the scene and high-quality new view angle image synthesis are realized.

The invention provides a scene reconstruction method based on delayed rendering and three-dimensional Gaussian. The method comprises the following steps: S1, generating initial three-dimensional point cloud data based on a multi-view image; s2, constructing a trainable structural body for three-dimensional Gaussian modeling; s3, normal initialization and residual optimization are carried out on the Gaussian ellipsoid primitives, depth consistency constraint is combined, and a differentiable and learnable normal reconstruction mechanism is realized, so that the geometric expression ability of illumination modeling is enhanced; s4, introducing a reflection training mechanism based on ambient light and a reflection direction, and generating a Gaussian attribute based on a visual angle; and S5, a final image is generated through a differentiable Gaussian sputtering rendering algorithm, and optimization is carried out through pixel loss of the final image and a real image. According to the method, the reality sense and geometric consistency of the Gaussian sputtering model under the complex illumination condition are remarkably improved, and the technical problems of unreal rendering effect, inaccurate surface normal estimation, weak propagation capability and the like of the existing three-dimensional Gaussian sputtering model under the complex illumination condition are solved.

The invention provides a rehabilitation training action evaluation method and device based on multi-view vision. According to the method, a multi-view camera is adopted to synchronously collect a rehabilitation training image sequence, two-dimensional coordinates of key points of a human body are extracted by improving an HRNet deep learning model, three-dimensional reconstruction is performed in combination with a Gaussian process, motion feature data are extracted, and rehabilitation training quality is evaluated. Accurate motion capture without wearing mark points by the patient is realized, the training constraint feeling of the patient is effectively reduced, the rehabilitation evaluation accuracy is improved, and a personalized rehabilitation scheme can be generated.

The invention discloses a mechanical arm positioning and grabbing method based on machine vision, and relates to the technical field of machine vision and mechanical arm control, the method comprises the following steps: synchronously acquiring RGB-D images of a target scene through a multi-view camera array, and generating three-dimensional point cloud data through data fusion; an improved LSD algorithm and a PnP algorithm are adopted to calculate the initial pose of the target object, illumination distortion is eliminated in combination with the generative adversarial network, and three-dimensional coordinates are output; a mechanical arm motion error transfer model is constructed based on Monte Carlo simulation, and a candidate grabbing scheme set is generated through reinforcement learning; and an optimal grabbing scheme is screened through a preset priority evaluation rule, and a mechanical arm joint movement track and a control instruction set are generated. Through multi-modal data fusion and a nonlinear optimization algorithm, the technical problems of large target positioning deviation and sensitive illumination interference in a complex environment are solved, and the grabbing precision and robustness of the mechanical arm are improved.

The invention relates to the technical field of three-dimensional model adjustment, in particular to a three-dimensional model adjustment method and system and a medium. The method comprises the following steps: obtaining a multi-angle image of an original model, carrying out multi-view normalization on the multi-angle image, generating a normalized view image set, extracting feature points of the original model, carrying out parallax correction on the feature points, reconstructing a simulation three-dimensional model, collecting basic purpose data of the model, carrying out ideal demand mapping through the data, and carrying out ideal demand mapping. The method comprises the following steps: determining an ideal three-dimensional model structure, carrying out core region segmentation on a reconstruction model according to basic purpose data to obtain key region model slices, carrying out highlight region comparison with the ideal model structure, analyzing model differences, determining a structure adjustment amplitude interval according to a comparison result, and carrying out cyclic fine adjustment correction on the key region model slices to obtain a three-dimensional model. And the three-dimensional model is consistent with the ideal three-dimensional model in structure, so that the optimized three-dimensional model is generated. According to the invention, efficient and accurate three-dimensional model adjustment and optimization are realized.

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.

The invention provides a cloud collaborative three-dimensional building modeling rendering method and system based on WebGL (Web Graphics Library). The method comprises the following steps: acquiring design parameters of a target building, analyzing the design parameters into geometric topological data of a plurality of independent components on the basis of a functional attribute division rule, and generating a multi-stage detail geometric model; adding material physical attributes to the surface vertex data, calculating a diffuse reflection coefficient and specular reflection intensity through a ray tracing algorithm, and generating lightweight component data carrying physical rendering parameters; in response to a view angle switching instruction of a terminal user, according to a space block corresponding to a current view angle, a main GPU node is distributed from a distributed GPU cluster, the main GPU node is divided according to the space block, adjacent blocks of the space block are distributed to edge GPU nodes, parallel ray tracing calculation is executed based on a WebGL protocol, and the parallel ray tracing calculation is executed based on the WebGL protocol. And returning to the main GPU node synthesis terminal display image and displaying. According to the technical scheme provided by the invention, the response speed is remarkably improved while the physical-level rendering effect is kept.

The invention provides a tunnel construction monitoring analysis method and system based on AI video monitoring, and relates to the technical field of artificial intelligence. A tunnel construction original video stream data set is acquired through a multi-view video acquisition device, and a spatio-temporal feature sequence is generated through spatio-temporal feature fusion processing; the spatiotemporal feature unit comprises a pixel region movement track, a personnel wearing identifier and a construction equipment contour feature, then extracting dynamic features of the spatiotemporal feature sequence to obtain a dynamic spatiotemporal feature set, and executing construction personnel statistical processing based on the dynamic spatiotemporal feature set; generating a hole entering personnel quantity statistical result, a personnel distribution statistical result of each construction part and a personnel identity matching result, performing work efficiency comparative analysis according to the personnel statistical result and a preset construction progress plan, and generating a construction progress deviation index and resource allocation optimization strategy; and when the progress deviation index exceeds the first threshold value, early warning is triggered, and a strategy is output to the management terminal, so that effective monitoring and management of tunnel construction are realized.

The invention relates to an injection molding product defect detection method based on machine vision, which comprises the following steps: collecting material information of a to-be-detected injection molding product in real time, and dynamically matching and adjusting light source parameters according to spectral reflection characteristics of materials to ensure image collection quality; secondly, the collected images are preprocessed, edge features and texture features are extracted, a three-dimensional model is constructed through multi-view image splicing, and three-dimensional defect features are extracted; thirdly, the multi-dimensional features are input into a deep learning model, the defect probability is calculated through feature fusion and forward propagation, and whether the product has defects or not is judged; if the defect exists, further identifying the defect category, and calculating the number and size of the defect; and generating a standardized detection report based on the defect information. According to the method, the image adaptability of products made of different materials is improved through dynamic light source adjustment, the two-dimensional and three-dimensional features are fused, the defect recognition accuracy is improved, and full-process automation from qualitative judgment to quantitative analysis of the defects is achieved.

The invention provides a tumor area double-view detection method and system based on image modalities and views, and relates to the field of medical image analys.The method comprises the steps that multi-modal image data are collected from the body of a patient, and image data of different view angles at the same position are obtained according to time frames; extracting multi-modal features from the image data of different modalities and different view angles, and performing weighted fusion on the extracted multi-modal features to form a fused feature map; inputting the fused feature map to train and predict the 3D-CNN network so as to identify and position a tumor region, and marking the tumor region by using a mask output by the segmentation model; calculating the pixel number of the tumor area in each layer of image according to the marked mask, and multiplying the pixel number by the volume of each pixel to obtain the volume of the tumor area; and the segmentation results of each layer of image are superposed, and a three-dimensional model of a tumor region is generated by using 3D reconstruction, so that the limitation of single-mode and single-view image data in tumor detection is overcome.

The invention relates to the technical field of target detection and tracking, in particular to a highway abnormal event detection and tracking method under the view angle of an unmanned aerial vehicle, which comprises the following steps: establishing an aerial photography historical data set of the view angle of the unmanned aerial vehicle; constructing a target detection model and a target tracking model, and training the target detection model and the target tracking model based on the historical data set; acquiring a real-time aerial image of a highway, inputting the real-time aerial image into the trained target detection model, and acquiring position information and environment information of a target vehicle; inputting the detected target vehicle information into the trained target tracking model, and obtaining the motion track information of the target vehicle; according to the position information, the environment information and the movement track information of the target vehicle, analyzing and judging whether the target vehicle has an abnormal event or not; and outputting a detection result of the abnormal event. The technical scheme of the invention can effectively capture the dynamic state of the vehicle and provide effective support for timely discovery and processing of abnormal events, thereby improving the safety and efficiency of road operation.

An example operation may include at least one of receiving, via a user interface of a device, an activation input from a user to initiate a session, capturing, by a camera of the device, a scan of a body of the user, wherein the capturing comprises recording at least one image and / or at least one video of the user, processing the at least one image and / or video to generate a three- dimensional model of the user comprising measurements and contours of the body, retrieving, from a database, at least one clothing item associated with the user, the at least one clothing item comprising dimensional attributes and texture attributes, rendering, by a graphics processing unit, the at least one clothing item onto the three-dimensional model to generate a visual representation, wherein the rendering simulates draping behavior, movement, and light interaction of the at least one clothing item relative to the three-dimensional model, and displaying, on the user interface, an interactive visualization comprising the visual representation of the three-dimensional model with the at least one clothing item from multiple viewing angles.

The invention provides a square power battery shell visual defect rapid detection method and system, and relates to the technical field of image processing, and the method comprises the steps: obtaining a high-resolution multi-view image sequence, outputting standardized image data, carrying out front visual scratch detection, outputting scratch defect positions and features, and outputting defect candidate regions containing confidence scores; and recognizing bubble defects, summarizing recognition results of the defect candidate areas, and generating a labeling image. The method solves the problems that in the prior art, due to the fact that multi-view image information is not fully fused, traditional scratch detection depends on a single edge feature, and a main defect recognition model is insufficient in recognition capacity for tiny defects such as bubbles, defect detection accuracy is low, missing detection and false detection phenomena are serious, and detection efficiency is high. According to the method, the problems that the defect is difficult to comprehensively and accurately locate and classify in the prior art are solved, the multi-view information fusion capability and the identification accuracy and detection efficiency of multi-class defects are improved, and high-precision, comprehensive and real-time quality monitoring of defect detection results is realized.

A display device includes: a display panel including a first area and a second area; and a panel driver configured to drive the display panel, to provide a first mode control signal to pixels in the first area, and to provide a second mode control signal to pixels in the second area, wherein the first area is configured to be driven in a first mode to display an image having a first viewing angle or a second mode to display an image having a second viewing angle narrower than the first viewing angle based on the first mode control signal, and wherein the second area is configured to be driven in the first mode or the second mode based on the second mode control signal.

Disclosed in the present invention are a multi-modal shared teleoperation system and method for a three-arm space robot. The system at least comprises a master-side teleoperation system, a communication module and a slave-side robot system, wherein the master-side teleoperation system at least comprises two force feedback hand controllers, a microphone array and upper computer software, and the slave-side robot system comprises two operating arms each equipped with a gripper at the end, an observation arm having a binocular camera mounted at the end, a vision unit, a force sensor and lower computer software. The method comprises: an operator controlling two operating arms of an extravehicular robot to execute a task, and controlling an observation arm to acquire a better local field of view. In the method, a multi-modal teleoperation method comprising pose control, voice control and force control is fused with autonomous control of a robot by means of a shared control algorithm, and thus, human-robot collaborative control over the position, orientation and contact force of a robotic arm can be realized on the basis of the requirements of the operator, and the robot autonomously executes other relatively simple tasks, thereby reducing the operation burden of operators, and improving the control efficiency.

The invention discloses an automobile leather defect detection method and system based on visual inspection, and relates to the technical field of industrial visual inspection, and the method comprises the steps: reconstructing the three-dimensional shape of a leather surface and generating a three-dimensional point cloud picture by analyzing the parallax relation and illumination direction reflection characteristics among multi-view automobile leather images; automobile leather surface curvature change characteristics of the three-dimensional point cloud picture are extracted, multi-scale texture analysis is carried out, and potential defect areas are identified and marked; through a three-dimensional shape measurement method, defect three-dimensional shape characteristics of the potential defect area are extracted, and defect three-dimensional geometric parameters are calculated; by analyzing defect geometrical characteristics and spatial distribution rules of the defect three-dimensional geometrical parameters and utilizing a preset grading judgment rule to divide defect grades, an automobile leather quality evaluation report containing defect three-dimensional coordinates is generated; according to the method, through combination of curvature-texture multi-scale fusion detection, the recognition capability of complex surface defects is remarkably enhanced.

The invention discloses a personnel positioning method and system based on a 3D Gaussian splash model and video fusion. The method comprises the following steps: firstly, acquiring input data of at least two visual angles through a multi-visual angle video stream acquisition module, and constructing an initial three-dimensional Gaussian model by utilizing a sparse point cloud initialization module; a time sequence dynamic tracking module is combined with an optical flow algorithm to realize cross-frame parameter updating of a Gaussian ellipsoid, and a time sequence consistency optimization module is adopted to suppress parameter drift; identifying a constructor bounding box by using a target detection module, and establishing a corresponding relation between pixels and three-dimensional coordinates through a three-dimensional-two-dimensional space matching module; three-dimensional coordinates are calculated through a multi-view fusion positioning module, and the positioning precision is improved through a multi-sensor fusion optimization module in combination with IMU data. A 3D Gaussian splash model is combined with multi-view geometry and time sequence optimization, high-precision personnel dynamic positioning without marking in a construction scene is realized, and the problems of tracking drift and shielding in a complex environment in a traditional method are effectively solved.

The invention relates to the field of image recognition, in particular to an automatic solid waste sorting method and device applying machine vision. The method comprises the following steps that monitoring images of to-be-sorted areas in multiple directions are obtained; performing spatial geometric view angle deviation correction on the monitoring images of the to-be-sorted areas in the multiple directions, performing spatial panoramic image optimization, and constructing a panoramic image of the sorting area; performing frame-by-frame solid waste visual positioning scanning on the panoramic image of the sorting area, and performing three-dimensional morphological structure analysis so as to generate a three-dimensional morphological structure representation of each solid waste; performing solid type classification decision according to the three-dimensional morphological structure representation of each solid waste, and performing bounding box coding mapping to obtain a coding mapping bounding box of each solid waste; and performing equipment action sequence simulation on the coding mapping bounding box of each solid waste, and constructing a fine tuning action sequence. Efficient solid waste recognition is achieved, and the sorting efficiency is improved.

The invention relates to the technical field of flexible screens, and discloses a flexible screen brightness control method and device based on region segmentation, and the method comprises the steps: carrying out the multi-view image collection of a plurality of bending regions of a flexible display screen, obtaining target image data, and calculating the deformation compensation partition data of the flexible display screen; gridding brightness sampling is carried out on the deformation compensation partition data to generate brightness uniformity characteristic data, LED driving parameter calculation is carried out based on the brightness uniformity characteristic data, and a driving compensation matrix is output; inputting the driving compensation matrix into a second-order state observer for real-time current estimation and temperature feedback, and generating a partition driving control signal; and performing multi-region collaborative optimization on the partition driving control signal to realize brightness uniformity control of the flexible display screen in different bending states. According to the method, the influence of temperature drift on the display uniformity is eliminated, the stability of the driving current is improved, and the display deviation caused by temperature change is remarkably reduced.

The invention relates to the technical field of intelligent warehousing and logistics automation, in particular to a forklift dynamic path planning method based on deep reinforcement learning, and the method comprises the steps: deploying multi-view vision, geomagnetism and other multi-source sensors, achieving data calibration and fusion through employing an insect compound eye-imitating vision model, and constructing a high-dimensional state space vector; heuristic models such as migrant bird navigation and biological stress response are adopted, deep reinforcement learning is combined, decision instructions are generated from the three aspects of path planning, dynamic obstacle avoidance and energy efficiency management, actions are executed through a control system, and deviation is fed back; a reward function is used for evaluating the decision effect, rewards are formed by weighting path efficiency, obstacle avoidance success and energy consumption penalty, the weight can be updated in a self-adaptive mode, and therefore the deep reinforcement learning model is optimized. According to the method, the accuracy, safety and efficiency of forklift path planning are effectively improved, the method can adapt to complex dynamic environments, and the requirements of intelligent logistics and industrial automation for forklift intelligent operation are met.

The invention relates to the technical field of traditional Chinese medicinal material defect detection, in particular to a traditional Chinese medicinal material defect detection method based on vision, which comprises the following steps: regularly acquiring a time sequence image of a traditional Chinese medicinal material sample, acquiring a multi-view image, carrying out pixel alignment on the time sequence image, and carrying out structured organization on the multi-view image according to a shooting direction to associate camera parameters; and generating a registration time sequence image sequence and a multi-view image set. According to the method, the time sequence images of the traditional Chinese medicine samples are collected regularly, pixel alignment is carried out, image offset caused by environment illumination fluctuation and equipment jitter is eliminated, and time-space consistency of dynamic variable quantity calculation is ensured. Structured organization is carried out on multi-view-angle images according to shooting directions, camera parameters are associated, a geometric constraint relation between view angles is established, and the problem that three-dimensional reconstruction precision is insufficient due to view angle isolation in a traditional method is solved.

The invention relates to the technical field of image processing, and discloses an industrial part alignment method and system based on visual analysis and a storage medium. The method comprises the steps that a three-view camera collects an industrial part image, and preprocessing is carried out through gradient magnitude local contrast enhancement to obtain an enhanced image; performing hierarchical feature extraction to identify edge contours and key control points to form a multi-dimensional feature set; and establishing a dynamic reference coordinate system based on the feature set to obtain a part space attitude matrix. And the attitude deviation is compensated through Z-axis offset and rotation coupling error analysis. Posture adjustment is decomposed into a plurality of sub-stages, an alignment track is optimized by adopting a variable speed planning strategy, and accurate alignment of the parts is achieved. The problems that multi-view visual information fusion is insufficient, a special recognition algorithm for geometrical characteristics of the industrial parts is lacked, and Z-axis offset and rotation coupling error compensation is inaccurate in the posture adjustment process are solved, and the precision and stability of alignment of the industrial parts are improved.

The embodiment of the invention provides an end-to-end automatic driving control method and device based on multi-camera fusion, and multi-view target detection and tracking are realized through spatial transformation and coordinate mapping by combining front wide-angle camera information and left and right wide-angle camera information. A multi-view feature fusion network architecture is designed, the multi-view feature fusion network architecture comprises three sub-networks of feature extraction, dynamic weight distribution and feature fusion, and the fusion weight is dynamically adjusted based on image definition, detection confidence and view overlapping degree. A geometric consistency constraint between visual angles and a reconstruction loss function are introduced, a deep neural network model is constructed, abnormal conditions such as camera shielding are effectively handled, and an accurate control instruction is output. According to the method, the defects of the traditional technology in the aspects of multi-view information fusion, shielding processing and the like are overcome, and the sensing ability and the control reliability of the automatic driving system are remarkably improved.

The invention provides a posture recognition algorithm for any object under a monocular camera and an application system, and the algorithm comprises the steps: S1, constructing a target three-dimensional model, carrying out the multi-view annular shooting image collection of a target, and generating a dense grid model through feature extraction, matching, posture calculation and a multi-view geometric method; s2, generating an image depth map, and predicting depth information of a target in a motion process based on a monocular image sequence; s3, extracting a target image mask, and generating a target area mask graph through an image encoder, a prompt encoder and a mask decoder; and S4, executing attitude estimation, performing attitude initialization, correction and screening by combining the three-dimensional model, the depth map and the mask map, and outputting a six-degree-of-freedom attitude result of the target. According to the method, the target is subjected to annular shooting modeling through the method based on multi-view geometry, the three-dimensional model of the target is generated, attitude estimation is achieved in combination with the image mask and the depth map, the generalization ability of an attitude estimation algorithm in an actual scene is improved, and the application range of the attitude estimation algorithm in the actual scene is widened.