12651 results about "View angle" patented technology

The invention discloses a manipulator grabbing planning system and method based on visual identification, and relates to the technical field of robots, the manipulator grabbing planning system comprises a visual perception module, a coordinate conversion module, a motion planning module, a control execution module, a tail end perception module and a system integration and communication module; the visual perception module realizes multi-view target detection, semantic segmentation and three-dimensional pose estimation through a binocular depth camera; the coordinate conversion module is used for converting a target pose under a camera coordinate system into a world coordinate under a mechanical arm base coordinate system; the motion planning module is responsible for generating a mechanical arm grabbing path, optimizing a strategy and supporting generalization migration of a multi-form mechanical arm; the control execution module drives the six-axis cooperative mechanical arm to complete the grabbing action, and vision-force mixed feedback closed-loop control is achieved. The tail end sensing module monitors the grabbing state in real time through a touch sensor and dynamically adjusts a grabbing strategy; and the system integration and communication module is used for realizing real-time data interaction and cooperative work among the modules of the system.

Disclosed in the present invention is a dynamic human modeling method based on three-dimensional Gaussians. In the present method, a multi-view human video is given firstly, and in order to correct and transform the dynamic human appearance, a latent code and a set of blend weights are added to each Gaussian; and the latent code and a target pose are inputted to an MLP to correct the Gaussian in a canonical space, so as to capture an appearance change under the target pose. The corrected Gaussian is transformed into the target pose by means of the blend weights thereof in a linear blend skinning (LBS) manner. Finally, a realistic human image at a new viewing angle or a new pose can be rendered in real time by means of Gaussian splatting. Compared with an existing method based on an implicit neural radiance field (NeRF), the three-dimensional Gaussian representation of the present invention can better capture high-frequency details while achieving optimal rendering performance.

The invention discloses a large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering, and relates to computer graphics. The method comprises the following steps: collecting a multi-view image set of a large scene; obtaining a scene sparse point cloud according to the multi-view image set; performing monocular depth estimation on the multi-view image by using a pre-trained depth prediction network to obtain monocular depth estimation priori; the method comprises the following steps of: performing global training on a scene by utilizing scene sparse point cloud and monocular depth estimation prior to obtain an initial three-dimensional Gaussian model, and performing space grid division on the initial three-dimensional Gaussian model to obtain a plurality of scene blocks with axis alignment bounding boxes; setting image view angle data of each scene block; performing deep supervised training on the Gaussian ellipsoids in the plurality of scene blocks by using a parallel GPU (Graphics Processing Unit); combining the trained scene blocks to obtain a final three-dimensional Gaussian model; in view of low geometric structure reconstruction precision caused by only depending on color information of a multi-view image in large-scene three-dimensional rendering, the method improves the reconstruction precision of large-scene rendering.

The invention provides a scene reconstruction method based on delayed rendering and three-dimensional Gaussian. The method comprises the following steps: S1, generating initial three-dimensional point cloud data based on a multi-view image; s2, constructing a trainable structural body for three-dimensional Gaussian modeling; s3, normal initialization and residual optimization are carried out on the Gaussian ellipsoid primitives, depth consistency constraint is combined, and a differentiable and learnable normal reconstruction mechanism is realized, so that the geometric expression ability of illumination modeling is enhanced; s4, introducing a reflection training mechanism based on ambient light and a reflection direction, and generating a Gaussian attribute based on a visual angle; and S5, a final image is generated through a differentiable Gaussian sputtering rendering algorithm, and optimization is carried out through pixel loss of the final image and a real image. According to the method, the reality sense and geometric consistency of the Gaussian sputtering model under the complex illumination condition are remarkably improved, and the technical problems of unreal rendering effect, inaccurate surface normal estimation, weak propagation capability and the like of the existing three-dimensional Gaussian sputtering model under the complex illumination condition are solved.

The invention provides a rehabilitation training action evaluation method and device based on multi-view vision. According to the method, a multi-view camera is adopted to synchronously collect a rehabilitation training image sequence, two-dimensional coordinates of key points of a human body are extracted by improving an HRNet deep learning model, three-dimensional reconstruction is performed in combination with a Gaussian process, motion feature data are extracted, and rehabilitation training quality is evaluated. Accurate motion capture without wearing mark points by the patient is realized, the training constraint feeling of the patient is effectively reduced, the rehabilitation evaluation accuracy is improved, and a personalized rehabilitation scheme can be generated.

The invention discloses a mechanical arm positioning and grabbing method based on machine vision, and relates to the technical field of machine vision and mechanical arm control, the method comprises the following steps: synchronously acquiring RGB-D images of a target scene through a multi-view camera array, and generating three-dimensional point cloud data through data fusion; an improved LSD algorithm and a PnP algorithm are adopted to calculate the initial pose of the target object, illumination distortion is eliminated in combination with the generative adversarial network, and three-dimensional coordinates are output; a mechanical arm motion error transfer model is constructed based on Monte Carlo simulation, and a candidate grabbing scheme set is generated through reinforcement learning; and an optimal grabbing scheme is screened through a preset priority evaluation rule, and a mechanical arm joint movement track and a control instruction set are generated. Through multi-modal data fusion and a nonlinear optimization algorithm, the technical problems of large target positioning deviation and sensitive illumination interference in a complex environment are solved, and the grabbing precision and robustness of the mechanical arm are improved.

The invention relates to the technical field of three-dimensional model adjustment, in particular to a three-dimensional model adjustment method and system and a medium. The method comprises the following steps: obtaining a multi-angle image of an original model, carrying out multi-view normalization on the multi-angle image, generating a normalized view image set, extracting feature points of the original model, carrying out parallax correction on the feature points, reconstructing a simulation three-dimensional model, collecting basic purpose data of the model, carrying out ideal demand mapping through the data, and carrying out ideal demand mapping. The method comprises the following steps: determining an ideal three-dimensional model structure, carrying out core region segmentation on a reconstruction model according to basic purpose data to obtain key region model slices, carrying out highlight region comparison with the ideal model structure, analyzing model differences, determining a structure adjustment amplitude interval according to a comparison result, and carrying out cyclic fine adjustment correction on the key region model slices to obtain a three-dimensional model. And the three-dimensional model is consistent with the ideal three-dimensional model in structure, so that the optimized three-dimensional model is generated. According to the invention, efficient and accurate three-dimensional model adjustment and optimization are realized.

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.

The invention provides a cloud collaborative three-dimensional building modeling rendering method and system based on WebGL (Web Graphics Library). The method comprises the following steps: acquiring design parameters of a target building, analyzing the design parameters into geometric topological data of a plurality of independent components on the basis of a functional attribute division rule, and generating a multi-stage detail geometric model; adding material physical attributes to the surface vertex data, calculating a diffuse reflection coefficient and specular reflection intensity through a ray tracing algorithm, and generating lightweight component data carrying physical rendering parameters; in response to a view angle switching instruction of a terminal user, according to a space block corresponding to a current view angle, a main GPU node is distributed from a distributed GPU cluster, the main GPU node is divided according to the space block, adjacent blocks of the space block are distributed to edge GPU nodes, parallel ray tracing calculation is executed based on a WebGL protocol, and the parallel ray tracing calculation is executed based on the WebGL protocol. And returning to the main GPU node synthesis terminal display image and displaying. According to the technical scheme provided by the invention, the response speed is remarkably improved while the physical-level rendering effect is kept.

The invention provides a tunnel construction monitoring analysis method and system based on AI video monitoring, and relates to the technical field of artificial intelligence. A tunnel construction original video stream data set is acquired through a multi-view video acquisition device, and a spatio-temporal feature sequence is generated through spatio-temporal feature fusion processing; the spatiotemporal feature unit comprises a pixel region movement track, a personnel wearing identifier and a construction equipment contour feature, then extracting dynamic features of the spatiotemporal feature sequence to obtain a dynamic spatiotemporal feature set, and executing construction personnel statistical processing based on the dynamic spatiotemporal feature set; generating a hole entering personnel quantity statistical result, a personnel distribution statistical result of each construction part and a personnel identity matching result, performing work efficiency comparative analysis according to the personnel statistical result and a preset construction progress plan, and generating a construction progress deviation index and resource allocation optimization strategy; and when the progress deviation index exceeds the first threshold value, early warning is triggered, and a strategy is output to the management terminal, so that effective monitoring and management of tunnel construction are realized.

The invention relates to an injection molding product defect detection method based on machine vision, which comprises the following steps: collecting material information of a to-be-detected injection molding product in real time, and dynamically matching and adjusting light source parameters according to spectral reflection characteristics of materials to ensure image collection quality; secondly, the collected images are preprocessed, edge features and texture features are extracted, a three-dimensional model is constructed through multi-view image splicing, and three-dimensional defect features are extracted; thirdly, the multi-dimensional features are input into a deep learning model, the defect probability is calculated through feature fusion and forward propagation, and whether the product has defects or not is judged; if the defect exists, further identifying the defect category, and calculating the number and size of the defect; and generating a standardized detection report based on the defect information. According to the method, the image adaptability of products made of different materials is improved through dynamic light source adjustment, the two-dimensional and three-dimensional features are fused, the defect recognition accuracy is improved, and full-process automation from qualitative judgment to quantitative analysis of the defects is achieved.

The invention relates to the technical field of target detection and tracking, in particular to a highway abnormal event detection and tracking method under the view angle of an unmanned aerial vehicle, which comprises the following steps: establishing an aerial photography historical data set of the view angle of the unmanned aerial vehicle; constructing a target detection model and a target tracking model, and training the target detection model and the target tracking model based on the historical data set; acquiring a real-time aerial image of a highway, inputting the real-time aerial image into the trained target detection model, and acquiring position information and environment information of a target vehicle; inputting the detected target vehicle information into the trained target tracking model, and obtaining the motion track information of the target vehicle; according to the position information, the environment information and the movement track information of the target vehicle, analyzing and judging whether the target vehicle has an abnormal event or not; and outputting a detection result of the abnormal event. The technical scheme of the invention can effectively capture the dynamic state of the vehicle and provide effective support for timely discovery and processing of abnormal events, thereby improving the safety and efficiency of road operation.

An example operation may include at least one of receiving, via a user interface of a device, an activation input from a user to initiate a session, capturing, by a camera of the device, a scan of a body of the user, wherein the capturing comprises recording at least one image and / or at least one video of the user, processing the at least one image and / or video to generate a three- dimensional model of the user comprising measurements and contours of the body, retrieving, from a database, at least one clothing item associated with the user, the at least one clothing item comprising dimensional attributes and texture attributes, rendering, by a graphics processing unit, the at least one clothing item onto the three-dimensional model to generate a visual representation, wherein the rendering simulates draping behavior, movement, and light interaction of the at least one clothing item relative to the three-dimensional model, and displaying, on the user interface, an interactive visualization comprising the visual representation of the three-dimensional model with the at least one clothing item from multiple viewing angles.

The invention provides a square power battery shell visual defect rapid detection method and system, and relates to the technical field of image processing, and the method comprises the steps: obtaining a high-resolution multi-view image sequence, outputting standardized image data, carrying out front visual scratch detection, outputting scratch defect positions and features, and outputting defect candidate regions containing confidence scores; and recognizing bubble defects, summarizing recognition results of the defect candidate areas, and generating a labeling image. The method solves the problems that in the prior art, due to the fact that multi-view image information is not fully fused, traditional scratch detection depends on a single edge feature, and a main defect recognition model is insufficient in recognition capacity for tiny defects such as bubbles, defect detection accuracy is low, missing detection and false detection phenomena are serious, and detection efficiency is high. According to the method, the problems that the defect is difficult to comprehensively and accurately locate and classify in the prior art are solved, the multi-view information fusion capability and the identification accuracy and detection efficiency of multi-class defects are improved, and high-precision, comprehensive and real-time quality monitoring of defect detection results is realized.

Disclosed in the present invention are a multi-modal shared teleoperation system and method for a three-arm space robot. The system at least comprises a master-side teleoperation system, a communication module and a slave-side robot system, wherein the master-side teleoperation system at least comprises two force feedback hand controllers, a microphone array and upper computer software, and the slave-side robot system comprises two operating arms each equipped with a gripper at the end, an observation arm having a binocular camera mounted at the end, a vision unit, a force sensor and lower computer software. The method comprises: an operator controlling two operating arms of an extravehicular robot to execute a task, and controlling an observation arm to acquire a better local field of view. In the method, a multi-modal teleoperation method comprising pose control, voice control and force control is fused with autonomous control of a robot by means of a shared control algorithm, and thus, human-robot collaborative control over the position, orientation and contact force of a robotic arm can be realized on the basis of the requirements of the operator, and the robot autonomously executes other relatively simple tasks, thereby reducing the operation burden of operators, and improving the control efficiency.

The invention discloses an automobile leather defect detection method and system based on visual inspection, and relates to the technical field of industrial visual inspection, and the method comprises the steps: reconstructing the three-dimensional shape of a leather surface and generating a three-dimensional point cloud picture by analyzing the parallax relation and illumination direction reflection characteristics among multi-view automobile leather images; automobile leather surface curvature change characteristics of the three-dimensional point cloud picture are extracted, multi-scale texture analysis is carried out, and potential defect areas are identified and marked; through a three-dimensional shape measurement method, defect three-dimensional shape characteristics of the potential defect area are extracted, and defect three-dimensional geometric parameters are calculated; by analyzing defect geometrical characteristics and spatial distribution rules of the defect three-dimensional geometrical parameters and utilizing a preset grading judgment rule to divide defect grades, an automobile leather quality evaluation report containing defect three-dimensional coordinates is generated; according to the method, through combination of curvature-texture multi-scale fusion detection, the recognition capability of complex surface defects is remarkably enhanced.

The invention discloses a personnel positioning method and system based on a 3D Gaussian splash model and video fusion. The method comprises the following steps: firstly, acquiring input data of at least two visual angles through a multi-visual angle video stream acquisition module, and constructing an initial three-dimensional Gaussian model by utilizing a sparse point cloud initialization module; a time sequence dynamic tracking module is combined with an optical flow algorithm to realize cross-frame parameter updating of a Gaussian ellipsoid, and a time sequence consistency optimization module is adopted to suppress parameter drift; identifying a constructor bounding box by using a target detection module, and establishing a corresponding relation between pixels and three-dimensional coordinates through a three-dimensional-two-dimensional space matching module; three-dimensional coordinates are calculated through a multi-view fusion positioning module, and the positioning precision is improved through a multi-sensor fusion optimization module in combination with IMU data. A 3D Gaussian splash model is combined with multi-view geometry and time sequence optimization, high-precision personnel dynamic positioning without marking in a construction scene is realized, and the problems of tracking drift and shielding in a complex environment in a traditional method are effectively solved.

The invention relates to the technical field of flexible screens, and discloses a flexible screen brightness control method and device based on region segmentation, and the method comprises the steps: carrying out the multi-view image collection of a plurality of bending regions of a flexible display screen, obtaining target image data, and calculating the deformation compensation partition data of the flexible display screen; gridding brightness sampling is carried out on the deformation compensation partition data to generate brightness uniformity characteristic data, LED driving parameter calculation is carried out based on the brightness uniformity characteristic data, and a driving compensation matrix is output; inputting the driving compensation matrix into a second-order state observer for real-time current estimation and temperature feedback, and generating a partition driving control signal; and performing multi-region collaborative optimization on the partition driving control signal to realize brightness uniformity control of the flexible display screen in different bending states. According to the method, the influence of temperature drift on the display uniformity is eliminated, the stability of the driving current is improved, and the display deviation caused by temperature change is remarkably reduced.

The invention relates to the technical field of intelligent warehousing and logistics automation, in particular to a forklift dynamic path planning method based on deep reinforcement learning, and the method comprises the steps: deploying multi-view vision, geomagnetism and other multi-source sensors, achieving data calibration and fusion through employing an insect compound eye-imitating vision model, and constructing a high-dimensional state space vector; heuristic models such as migrant bird navigation and biological stress response are adopted, deep reinforcement learning is combined, decision instructions are generated from the three aspects of path planning, dynamic obstacle avoidance and energy efficiency management, actions are executed through a control system, and deviation is fed back; a reward function is used for evaluating the decision effect, rewards are formed by weighting path efficiency, obstacle avoidance success and energy consumption penalty, the weight can be updated in a self-adaptive mode, and therefore the deep reinforcement learning model is optimized. According to the method, the accuracy, safety and efficiency of forklift path planning are effectively improved, the method can adapt to complex dynamic environments, and the requirements of intelligent logistics and industrial automation for forklift intelligent operation are met.

The invention relates to the technical field of traditional Chinese medicinal material defect detection, in particular to a traditional Chinese medicinal material defect detection method based on vision, which comprises the following steps: regularly acquiring a time sequence image of a traditional Chinese medicinal material sample, acquiring a multi-view image, carrying out pixel alignment on the time sequence image, and carrying out structured organization on the multi-view image according to a shooting direction to associate camera parameters; and generating a registration time sequence image sequence and a multi-view image set. According to the method, the time sequence images of the traditional Chinese medicine samples are collected regularly, pixel alignment is carried out, image offset caused by environment illumination fluctuation and equipment jitter is eliminated, and time-space consistency of dynamic variable quantity calculation is ensured. Structured organization is carried out on multi-view-angle images according to shooting directions, camera parameters are associated, a geometric constraint relation between view angles is established, and the problem that three-dimensional reconstruction precision is insufficient due to view angle isolation in a traditional method is solved.

The invention relates to the technical field of image processing, and discloses an industrial part alignment method and system based on visual analysis and a storage medium. The method comprises the steps that a three-view camera collects an industrial part image, and preprocessing is carried out through gradient magnitude local contrast enhancement to obtain an enhanced image; performing hierarchical feature extraction to identify edge contours and key control points to form a multi-dimensional feature set; and establishing a dynamic reference coordinate system based on the feature set to obtain a part space attitude matrix. And the attitude deviation is compensated through Z-axis offset and rotation coupling error analysis. Posture adjustment is decomposed into a plurality of sub-stages, an alignment track is optimized by adopting a variable speed planning strategy, and accurate alignment of the parts is achieved. The problems that multi-view visual information fusion is insufficient, a special recognition algorithm for geometrical characteristics of the industrial parts is lacked, and Z-axis offset and rotation coupling error compensation is inaccurate in the posture adjustment process are solved, and the precision and stability of alignment of the industrial parts are improved.

The embodiment of the invention provides an end-to-end automatic driving control method and device based on multi-camera fusion, and multi-view target detection and tracking are realized through spatial transformation and coordinate mapping by combining front wide-angle camera information and left and right wide-angle camera information. A multi-view feature fusion network architecture is designed, the multi-view feature fusion network architecture comprises three sub-networks of feature extraction, dynamic weight distribution and feature fusion, and the fusion weight is dynamically adjusted based on image definition, detection confidence and view overlapping degree. A geometric consistency constraint between visual angles and a reconstruction loss function are introduced, a deep neural network model is constructed, abnormal conditions such as camera shielding are effectively handled, and an accurate control instruction is output. According to the method, the defects of the traditional technology in the aspects of multi-view information fusion, shielding processing and the like are overcome, and the sensing ability and the control reliability of the automatic driving system are remarkably improved.

The invention provides a posture recognition algorithm for any object under a monocular camera and an application system, and the algorithm comprises the steps: S1, constructing a target three-dimensional model, carrying out the multi-view annular shooting image collection of a target, and generating a dense grid model through feature extraction, matching, posture calculation and a multi-view geometric method; s2, generating an image depth map, and predicting depth information of a target in a motion process based on a monocular image sequence; s3, extracting a target image mask, and generating a target area mask graph through an image encoder, a prompt encoder and a mask decoder; and S4, executing attitude estimation, performing attitude initialization, correction and screening by combining the three-dimensional model, the depth map and the mask map, and outputting a six-degree-of-freedom attitude result of the target. According to the method, the target is subjected to annular shooting modeling through the method based on multi-view geometry, the three-dimensional model of the target is generated, attitude estimation is achieved in combination with the image mask and the depth map, the generalization ability of an attitude estimation algorithm in an actual scene is improved, and the application range of the attitude estimation algorithm in the actual scene is widened.

The invention discloses an unmanned aerial vehicle multi-modal feature fusion target tracking method and system based on natural language description, belongs to the technical field of computer vision and image processing, and solves the problem that in the prior art, when the quality of an image collected by an unmanned aerial vehicle is poor or image features are not obvious, the target tracking capability and the long-time tracking capability are poor. Natural language description is carried out on a traffic accident scene in an image of an unmanned aerial vehicle visual angle, and a language prompt is obtained; constructing a scene-context feature pyramid network to perform context information enhancement processing on the image of the view angle of the unmanned aerial vehicle to obtain a feature-enhanced image; respectively carrying out visual coding and language coding on the enhanced image and language prompt to obtain visual features and language feature vectors, and carrying out visual-language bimodal feature local alignment; and fully fusing the obtained aligned new language features with the visual features to obtain multi-modal features for target tracking. The method is used for multi-modal feature fusion target tracking of the unmanned aerial vehicle.

The invention provides a geographic information visualization intelligent analysis system based on unmanned aerial vehicle surveying and mapping, and belongs to the field of surveying and mapping, and the system comprises an unmanned aerial vehicle aerial survey module which carries out regional aerial survey based on a multi-source sensor carried by an unmanned aerial vehicle, obtains multi-modal geographic data, and carries out the preprocessing of the multi-modal geographic data; the data processing module is used for forming an initial geographic data set under a standard coordinate system; the three-dimensional modeling module is used for obtaining the fused geographic feature data, constructing a three-dimensional geographic information model, optimizing the three-dimensional geographic information model and embedding time dimension information to form a four-dimensional spatio-temporal data set; the analysis and decision module is used for generating an analysis report comprising a terrain evolution trend and disaster risk assessment; and the visual platform module is used for visualizing the analysis report through a preset visual interaction interface and adjusting the rendering precision of the optimized three-dimensional geographic information model in real time according to the change of the visual angle of the user. The system provides an efficient and intelligent solution for geographic surveying and mapping and disaster early warning.

The invention discloses a three-dimensional Gaussian sputtering method for sparse visual angle semantic priori. The method comprises the following steps of: 1, acquiring a target scene image, constructing a real image set as a data set, and manually selecting an interested object in a target scene to perform semantic three-dimensional reconstruction to obtain an initial semantic image of a sparse view angle; a multi-view image is collected, camera external parameters and scene sparse point clouds are obtained, a plurality of views are selected and input into the SAM2 segmentation model, and a view set Is with semantic images is obtained; 2, using a pre-trained SAM2 segmentation model as an interactive image sequence segmentation model, and initializing a three-dimensional Gaussian primitive according to the scene sparse point cloud; and step 3, training parameters of semantic three-dimensional Gaussian sputtering based on the trained three-dimensional Gaussian sputtering model and the interactive image sequence segmentation model, and reconstructing a target scene. According to the method, the high-quality semantic model is efficiently reconstructed. And the reconstruction result can be easily corrected through the interactive graphical interface in the training process.

The invention relates to the technical field of automatic workpiece grabbing and visual servo control, and discloses a workpiece grabbing method and system based on visual feedback, and the method comprises the steps: obtaining a real-time image through a front-view camera, a side-view camera and a top-view camera, and extracting surface features through a feature fusion network; inputting the features into a pose estimation model based on a particle filtering framework, and iteratively updating the pose in combination with a multi-dimensional observation likelihood function to generate prediction parameters; constructing a multi-target path planning model based on the parameters, and optimizing the path by adopting a dynamic planning algorithm with the shortest path and the minimum joint movement as targets; a hierarchical control model is established, a strategy layer performs global planning, an adjustment layer corrects a local path, and an execution layer realizes trajectory tracking through visual servo control and outputs a control instruction to complete grabbing. Through multi-view perception, robust pose estimation, global optimization path planning and hierarchical control, the precision, efficiency and stability of workpiece grabbing in a complex environment are improved.

The invention relates to the technical field of spatial-temporal trajectory data anomaly detection, in particular to a trajectory anomaly route detection method and system based on self-supervised trajectory representation learning. The method comprises the following steps: preprocessing acquired trajectory data; track double-view comparison representation learning is carried out based on a double-view-angle synchronous mask strategy; coding time dynamic based on a space-time fusion mechanism and fusing the time dynamic with spatial features; learning essential representation from the fused spatio-temporal features to perform trajectory reconstruction; and error checking is carried out based on the reconstructed trajectory, and an abnormal trajectory is judged through the reconstructed error. The invention provides a brand new trajectory anomaly detection model. According to the model, a GPS track and a grid-based track feature are fused, so that track representation is enriched; and meanwhile, a double-view synchronous mask mechanism is designed, so that the model can sense local disturbance of space and time dimensions at the same time in a training stage, and thus the sensitivity to local anomaly is improved.

The invention discloses a power equipment detection method and device based on data acquisition of an inspection unmanned aerial vehicle, electronic equipment and a storage medium, and the method comprises the steps: obtaining a multi-view image of to-be-detected power equipment, and inputting the multi-view image into an abnormal region detection model, and generating an anomaly existence probability and a suspected anomaly region coordinate of the equipment under the current view angle. When it is detected that the abnormal probability at a certain visual angle exceeds a preset threshold value, a reinspection instruction is sent to the inspection unmanned aerial vehicle in an adjacent area, and image data of the equipment at a new visual angle are fed back. A second anomaly existence probability is calculated by re-inputting the new view angle image to the anomaly detection model. If the probability exceeds a preset threshold value, judging that the power equipment is abnormal, and sending an alarm signal; otherwise, judging that the equipment is normal. According to the invention, the abnormal accurate positioning and intelligent alarm of the power equipment can be realized, and the efficiency and accuracy of equipment inspection can be effectively improved.

The invention discloses a three-dimensional scene reconstruction method and device based on structure perception. The method comprises the following steps: constructing a sparse point cloud generation model according to a diffusion model based on a Unet architecture; inputting the information into a sparse point cloud generation model, and generating camera internal and external parameters and sparse point cloud data of the RGB image frame under the corresponding view angle; constructing a rough three-dimensional structure grid according to the sparse point cloud data; carrying out random sampling on the rough three-dimensional structure grid, and carrying out Gaussian field initialization on the Gaussian primitives according to a random sampling result to obtain an initialized Gaussian field; the loss between the current image frame and the RGB color image is calculated, parameters of Gaussian primitives of all the RGB image frames in the information are iteratively optimized in sequence according to the loss, all the optimized Gaussian primitives are combined, and a reconstructed three-dimensional scene is obtained. According to the invention, the spatial consistency and accuracy of reconstruction results are improved.