1191 results about "Visual feedback" patented technology

The invention discloses a three-degree-of-freedom parallel robot trajectory tracking method and system, and relates to the technical field of industry-university-research, and the method comprises the steps: obtaining motion data related to the execution trajectory of a three-degree-of-freedom parallel robot, and carrying out the data preprocessing; based on historical operation data, an intelligent prediction model is constructed to predict trajectory errors and is used for optimizing feedforward compensation of trajectory tracking control parameters; acquiring actual execution track information of the robot based on a visual sensor, and performing error calculation on the actual execution track information and an expected track to perform real-time track correction; dynamically adjusting control parameters in combination with error prediction data and visual feedback data; in the operation process of the robot, the control strategy is continuously optimized, and the intelligent prediction model is updated by using real-time data. Through the intelligent prediction model, visual feedback and adaptive control optimization, high-precision trajectory tracking, rapid error correction, energy consumption reduction and environmental adaptability enhancement are realized.

The invention relates to the technical field of automatic workpiece grabbing and visual servo control, and discloses a workpiece grabbing method and system based on visual feedback, and the method comprises the steps: obtaining a real-time image through a front-view camera, a side-view camera and a top-view camera, and extracting surface features through a feature fusion network; inputting the features into a pose estimation model based on a particle filtering framework, and iteratively updating the pose in combination with a multi-dimensional observation likelihood function to generate prediction parameters; constructing a multi-target path planning model based on the parameters, and optimizing the path by adopting a dynamic planning algorithm with the shortest path and the minimum joint movement as targets; a hierarchical control model is established, a strategy layer performs global planning, an adjustment layer corrects a local path, and an execution layer realizes trajectory tracking through visual servo control and outputs a control instruction to complete grabbing. Through multi-view perception, robust pose estimation, global optimization path planning and hierarchical control, the precision, efficiency and stability of workpiece grabbing in a complex environment are improved.

The invention relates to the field of building information management and construction progress visualization, in particular to a curtain wall construction progress visualization method and system based on a BIM model, and the method comprises the steps: obtaining the three-dimensional position information and installation state data of a curtain wall unit plate in real time through a sensor and an image collection device, and comparing the three-dimensional position information and installation state data with BIM integrated data, generating and updating a digital twinborn model; analyzing the construction data by using an artificial intelligence model, detecting a construction deviation and generating a construction adjustment suggestion; an optimal path is calculated through a construction path optimization algorithm, construction data are integrated to generate visual feedback, and the construction progress, the installation state and deviation information are displayed in real time through a visual engine, so that the construction monitoring and management efficiency is remarkably improved.

The invention relates to the technical field of AI intelligent customer service, in particular to an AI intelligent customer service multi-channel interaction and data analysis system which comprises a multi-channel access module, an interaction data preprocessing module, a multi-modal intention analysis module, a dynamic strategy generation module, a data capitalization management module and a visual feedback module. The multi-channel access module is used for receiving multi-source heterogeneous interaction data; the interaction data preprocessing module generates standardized interaction data; the multi-modal intention analysis module generates a multi-dimensional user portrait and a real-time session path; the dynamic strategy generation module outputs adjustment parameters of a dynamic service strategy; the data asset management module generates a data asset packet with a timestamp; and the visual feedback module is used for generating an interactive decision graph. According to the invention, the data security, the customer service intelligence level and the decision optimization capability are improved, and finally an efficient, accurate and safe intelligent customer service system is realized.

A robotic surgical system includes a robotic manipulator configured to perform surgical procedures under direct surgeon control. A surgical camera system captures real-time intraoperative video. An external imaging interface receives multimodal imaging data, including preoperative and intraoperative data from at least one of magnetic resonance imaging (MRI), computed tomography (CT), ultrasound, and fluoroscopy. An artificial intelligence (AI module has a trained neural network and a deep learning model trained on multi-institutional annotated surgical datasets, The AI module is configured to execute one or more of: fuse acquired video and imaging data into temporally and spatially coherent anatomical visualizations; generate continuously updating overlays aligned with the surgical field, with segmented anatomical features; projected tissue boundaries, proximity indicators for instruments, and predictive deformation trends; provide dynamic predictive trend visualization indicating zones of future anatomical complexity or risk; register and align preoperative imaging data with intraoperative imaging data in real time; adapt overlay presentation in response to tissue deformation without actuating the robotic manipulate or; and passively augment visual feedback without initiating any autonomous actuation of surgical instruments.

The invention relates to the technical field of brain-computer interfaces, and discloses a self-adaptive dynamic feedback brain-computer interface training method and system based on virtual reality. The training method comprises the steps that a user performs motor imagery according to a training scene presented by the VR display device; the electroencephalogram acquisition equipment acquires electroencephalogram signals; configuring a data processing module, and operating a motor imagery continuous control model to calculate characteristic parameters by taking the electroencephalogram signals as input; under the condition that the task exists, the characteristic parameters are used as input, and a dynamic self-adaptive characteristic-feedback mapping model is operated to calculate control parameters; sending the control parameters to a functional electrical stimulation device to load electrical stimulation of corresponding intensity to the muscle to obtain tactile feedback; meanwhile, the dynamic adaptive feature-feedback mapping model is dynamically updated according to latest input feature parameters; the control parameters are sent to the VR display device to present visual feedback, and the user adjusts the motor imagery based on the visual feedback and the haptic feedback. The participation sense of the user and the training efficiency can be improved.

The invention relates to the technical field of interaction systems, in particular to an intelligent control-based nursing board interaction system, which comprises a nursing board, and is characterized in that the nursing board internally comprises a voice recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent equipment control module and a feedback and interaction module; the voice recognition and control module integration, the billboard data interaction and display module, the billboard function page control module, the intelligent equipment control module and the feedback and interaction module are electrically connected. According to the method, a visual nursing billboard large screen is provided, interaction with the visual nursing billboard large screen is carried out through an API interface, instruction analysis and execution are supported, meanwhile, real-time voice and visual feedback and a multi-mode interaction mode are provided, and the user experience is remarkably improved.

The invention relates to the technical field of welding automation and robot visual perception, and discloses a robot intelligent welding method and system.The method comprises the steps that a three-dimensional point cloud image is constructed through a laser triangulation method; filtering and enhancing the point cloud image, and extracting a weld point cloud set by adopting a U-Net semantic segmentation model; carrying out space path identification and attitude regression based on the set to obtain a track element of a position-attitude pair; fitting a path by adopting a cubic B-spline curve and interpolating to generate a continuous welding track; and in the welding process, visual feedback is combined, and proportional differential control logic is introduced for closed-loop track error compensation. Compared with the technical problem that in the prior art, weld joint path recognition and accurate tracking cannot be stably achieved under complex structures such as curved surfaces and variable cross sections, a perception control closed loop based on visual servo is constructed, high-precision automatic welding of the complex weld joint structures is achieved, and the track fitting precision is improved.

The invention discloses a code spraying identification optimal path planning method based on an intelligent optimization algorithm, and relates to the technical field of code spraying control, and the method comprises the steps: dispersing a code spraying region into a three-dimensional space, and constructing a dynamic environment model of marking parameter constraint; based on the code spraying task priority queue, a hybrid optimization algorithm is adopted to carry out collaborative optimization of marking parameters and path nodes, and an optimal path candidate set is generated; an obstacle avoidance model is constructed based on the optimal path candidate set, a collision-free path is generated, the pose of a nozzle is adjusted in combination with visual feedback, and an anti-interference code spraying action sequence is output; monitoring the operation feedback of the code spraying equipment, and carrying out the iterative updating of the marking parameter library and the algorithm rule. According to the method, the core advantages of multiple intelligent optimization algorithms are fused, a mixed collaborative optimization architecture is constructed, the limitation of a single algorithm in a complex scene is effectively broken through, and a traditional path planning algorithm is easily troubled by a local optimal solution and is difficult to meet multi-dimensional constraint conditions at the same time.

The invention provides a fan blade tip visual positioning method based on multi-parameter correction, and relates to the technical field of visual localization, and the method comprises the steps: firstly controlling an unmanned aerial vehicle to reach a top view point through the position information of a fan, carrying out the target detection and feature extraction of the fan through an algorithm, and according to the position relation between a hub and a cabin, carrying out the target detection and feature extraction; a redundancy calculation mechanism for acquiring yaw information of the fan is designed; secondly, the unmanned aerial vehicle conducts pose correction based on the top view by means of visual feedback, and therefore calculation is conducted and the unmanned aerial vehicle goes to a fan front view point; then, primary positioning of blade tips is completed through a front view, and three correction parameters of a blade phase angle, a wind wheel elevation angle and a blade taper angle are measured and calculated; and finally, constructing a fan simplified model and combining the corrected parameters to realize accurate positioning. According to the invention, precision guarantee can be provided for fan inspection route planning.

A system configured to generate dynamic visual feedback by synchronizing smart lights with a rhythm and energy levels of music being output. A device may translate audio samples to luma (brightness), chroma (color), and location data using a low-latency algorithm. For example, the device may divide the full band audio data into separate frequency bands based on the number of output devices and control a brightness for an output device by tracking energy within a corresponding frequency band. The color and location may be controlled based on a number of beats per minute, direction, and / or the like. In addition to controlling external lighting via a smart home hub, the device can control LED light(s) on the device via an LED controller. To further reduce latency, the device can directly communicate between an audio processor, the smart home hub, and / or the LED controller using low level hardware abstraction layers (HALs).

The invention provides a picking mechanical arm operation method and system based on visual feedback. The picking mechanical arm operation method comprises the steps that firstly, a multi-dimensional visual perception set including the shape contour, surface physical characteristic visual representation, connection part space distribution, growth environment dynamic interference and the like of a picked object is obtained; a mechanical arm collaborative decision-making model is constructed based on the multi-dimensional visual perception set, stress distribution characteristics of connection parts are analyzed, and optimal contact area parameters and mechanical arm posture collaborative parameters are determined; according to the parameters, generating a sub-time sequence action instruction set containing action information in the contact stage, the clamping stage and the separation stage; when the mechanical arm is controlled to execute the instruction set, a dynamic visual feedback set of the picking scene is obtained in real time; and finally, input parameters of the collaborative decision model are updated based on feedback, and instruction set parameters are adjusted, so that the mechanical arm completes picking operation on the premise of keeping the integrity of the picked object, and the intelligent level and the picking operation quality of the picking mechanical arm are improved.

The invention relates to the technical field of ward air purification systems, and discloses a ward air purification system which comprises an environment sensing module, a purification path planning module, a filter unit configuration module, a purification execution module, a dynamic adjustment module, a state monitoring module and a feedback control module. The environment sensing module obtains ward space information to construct an air flow topology; the purification path planning module calls air quality data to label the topology; the filter unit configuration module sets purification nodes and adjustment intervals; the purification execution module implements basic purification; the state monitoring module analyzes data to determine operation state characteristics, and the feedback control module generates monitoring records and performs visual feedback. The system can accurately perceive the air quality of the ward, scientifically plan the purification path, dynamically adjust the purification strategy, effectively improve the air quality of the ward and guarantee the health of patients and medical staff, and has high practical value.

The invention discloses an edge spraying compensation control method based on intelligent visual feedback. The method comprises the following steps: performing space scanning on a to-be-sprayed workpiece to obtain spraying image data, and establishing a space corresponding relation between a spray gun motion coordinate and a workpiece surface coordinate; registering the real-time spraying image by using the corresponding relation, identifying a geometric boundary line, brightness gradient change and a coating adhesion area of the edge of the workpiece, and generating edge feature data; according to the difference between the edge feature data and the target spraying image, the spraying coverage deviation and the boundary overlapping error are calculated, the coating thickness change trend, the optical density change rate and the boundary direction offset are extracted, and the spraying gun posture adjustment amount, the spraying distance correction amount, the spraying pressure correction amount and the path speed correction amount are generated; the angle, the spraying distance, the pressure and the movement speed of the spray gun are dynamically adjusted according to the parameters; according to the method, real-time visual feedback and self-adaptive compensation control in the spraying process are achieved, and the uniformity and consistency of the coating on the edge of the workpiece are effectively improved.

The invention relates to the technical field of electronic packaging, and discloses an intelligent dispensing control method and system based on machine vision and a storage medium. The method comprises the following steps: acquiring a dispensing part image, and performing feature extraction on the dispensing part image to obtain feature information; according to the feature information, carrying out dispensing position area calculation to obtain the area of a dispensing area; calculating the surface roughness of the dispensing part according to the feature information of the image to obtain roughness information; according to the feature information, the dispensing position and the roughness information, the dispensing amount is calculated, and dispensing parameters are obtained; according to the dispensing parameters and the roughness information, the dispensing amount is adjusted, and the effective dispensing amount is obtained; according to the dispensing parameters, the effective dispensing amount and the dispensing area, dispensing operation is carried out, and a dispensing result is obtained; and according to the dispensing result, the dispensing quality is monitored and adjusted based on visual feedback control. According to the method, the dispensing precision of the dispensing machine can be improved, parameters are optimized, and efficient dispensing control is achieved.

The invention discloses a seeding unit integrating visual feedback and calibration functions and a control method, and relates to the technical field of agricultural machinery, the seeding unit comprises a control system, a row spacing adjusting mechanism and a seeding depth control mechanism, the seeding depth control mechanism is connected with the row spacing adjusting mechanism, and the row spacing adjusting mechanism is connected with the control system; the control system is composed of an industrial camera and an image recognition module, the image recognition module comprises a broken ridge prediction control mechanism and a ridge center line fitting and sowing offset correction mechanism, and the ridge center line fitting mechanism recognizes ridge line boundaries and fits center line tracks. The broken ridge prediction control mechanism detects a ridge line interruption area and delays ridges according to the advancing speed and response of the seeding monomers. According to the seeding monomer integrated with the visual feedback and calibration functions and the control method, the visual identification technology is integrated to monitor the earth surface condition in real time, the response is quick, the control is accurate, and the seeding monomer is suitable for high-speed seeding operation under different terrain and soil conditions.

The invention discloses an AI data scheduling distribution system and method based on cloud computing, and relates to the technical field of intelligent cloud computing, and the system comprises an AI data collection module, a feature extraction module, a decision parameter generation module, a scheduling distribution module and a visual feedback module. The AI data acquisition module acquires equipment video data and temperature data, the feature extraction module extracts video temperature features, the decision parameter generation module outputs equipment vibration intensity and temperature rise rate, and the scheduling distribution module calculates equipment shutdown probability and node load score and triggers a shutdown instruction and a task migration decision. And the visual feedback module maps the equipment health state and node load distribution, and optimizes the feature weight. Through multi-modal data fusion and a closed-loop feedback mechanism, accurate early warning of equipment abnormity and dynamic optimal allocation of resources are realized, visual decision assistance and adaptive weight adjustment are combined, equipment safety and cluster load balancing efficiency in a cloud computing environment are improved, and manual intervention requirements and operation and maintenance cost are reduced.

The invention belongs to the technical field of interventional robots, and discloses a method, device and equipment for automatically adjusting the collection frame rate and a medium, and the method comprises the steps: obtaining the current movement speed of an interventional robot; adjusting a corresponding collection frame rate according to the movement speed; and controlling a camera to perform data acquisition based on the acquisition frame rate. The appropriate frame rate is selected according to the real-time movement speed of the interventional robot, the high frame rate is provided during high-speed movement by dynamically adjusting the collection frame rate of the camera so as to reduce movement blur, and the frame rate is reduced in a low-speed or static state so as to save bandwidth resources. According to the method, unnecessary data transmission quantity is reduced, network congestion and processing burden are relieved, the overall performance and stability of the system are improved, real-time and accurate transmission of image information is ensured, smooth and clear visual feedback is provided, the accurate control capability in the intervention process is improved, and the safety of the intervention process is improved.

The invention discloses a robot-oriented article recognition and grabbing system and method, and belongs to the technical field of artificial intelligence, and the robot-oriented article recognition and grabbing system comprises a multi-source data input module, an image recognition module, a semantic generation module, a task guiding evaluation module and a visual feedback module, the multi-source data input module comprises an RGB-D camera for obtaining target 3D point cloud data and a natural language instruction interface for receiving a natural language instruction FI; the image recognition module comprises a double-flow convolutional neural network and an improved Transform network; the semantic generation module comprises a large language model LLM; the task-oriented evaluation module comprises a task-oriented capture evaluator TGE and a point cloud encoder; and the visual feedback module is used for judging whether grabbing succeeds or not after the grabbing task is finished. The target object can be accurately recognized, and the grabbing performance of the mechanical arm on the target object is optimized.

The invention relates to the technical field of dispensing machines, and discloses an intelligent dispensing machine based on visual feedback and a dispensing path optimization system.The intelligent dispensing machine comprises an equipment rack, a main control computer is installed in the equipment rack, and the dispensing path optimization system is erected on the equipment rack and electrically connected with the main control computer; the inner bottom wall of the equipment rack is fixedly connected with a base, the top of the base is provided with a three-axis movement mechanism, the three-axis movement mechanism comprises an X-axis linear guide rail, a Y-axis linear guide rail and a Z-axis linear guide rail which are all driven by a stepping motor, and the outer side of the three-axis movement mechanism is provided with a servo driver. Through cooperative work of a laser positioning unit and an image recognition positioning unit in the high-precision positioning module, the positioning precision is controlled within + / -0.01 mm, the dispensing position is accurately determined, the problems of dispensing deviation, point leakage and the like caused by positioning deviation are avoided, the dispensing reliability is greatly improved, and the product quality is remarkably improved.

The invention relates to the field of navigation signal processing, and discloses a radiation therapy bolus dose feedback and tracking system based on image registration, the system comprises an image acquisition module, an image registration module, a bolus identification module, a dose recalculation module, a dose deviation analysis module and a feedback and adjustment module, space registration is carried out through an FBCT image acquired every day and an original plan CT, and the radiation therapy bolus dose feedback and tracking system based on image registration is obtained. The fitting state between the bolus and the skin is automatically identified, the position of an air gap is detected, and dose recalculation is carried out based on an actual structure. Through comparison with an original planned dose, the system can output a deviation index of a key dose parameter and provide visual feedback, if the deviation exceeds a set threshold value, a prompt is automatically sent out, and a radiotherapy technician and a physician are supported to carry out bolus adjustment or call an adaptive planning engine to reconstruct a treatment plan. Quantitative analysis of bolus fitting quality and closed-loop control of dose delivery consistency are realized, radiotherapy precision and safety are effectively improved, and the method is suitable for superficial radiotherapy scenes containing bolus design.

The invention relates to the technical field of navigation and positioning, and discloses an arthroscopic surgery navigation and positioning system based on artificial intelligence, which comprises a preoperative image processing and lesion analysis module for analyzing preoperative images, a multi-modal data fusion module for integrating image data from different sources in the surgery, and a navigation and positioning module for performing navigation and positioning on the integrated image data. The intra-operative real-time joint tracking and posture estimation module is used for tracking the joint position and soft tissue deformation in real time, the AI dynamic operation path planning module is used for intelligently optimizing the operation path, the robot auxiliary operation and automatic adjustment module is used for automatically adjusting the position and angle of an operation instrument, and the intra-operative AI voice and visual feedback module is used for providing real-time feedback. The operation data storage and intelligent learning module is used for storing and analyzing operation data. By means of the multi-modal data fusion technology, arthroscopic images, ultrasonic images and infrared images are combined, accurate visualization of an operation area is achieved, and the effect of improving operation accuracy and safety is achieved.

The invention relates to the technical field of robot control, in particular to a robot object grabbing adaptive learning system based on visual and tactile feedback. The robot object grabbing adaptive learning system based on visual and tactile feedback comprises a data acquisition module used for acquiring adaptive control data of a robot; the joint adjusting module is used for obtaining the joint compensation amount of the robot according to the adaptive control data of the robot and adjusting the grabbing motion of the robot to obtain the final joint adjustment degree; the visual feedback module is used for obtaining a rough grabbing force estimation value of the visual information by using a visual feedback formula according to the visual data of the robot; and the tactile feedback module is used for obtaining correction force of tactile feedback by using a tactile feedback formula according to the tactile data of the robot. Through multi-modal information fusion and modular design, high-precision and self-adaptive grabbing of the thermochromic object by the robot is realized.

The invention provides a humanoid robot hand-eye coordination intelligent calibration control system and a humanoid robot hand-eye coordination intelligent calibration control method, and the humanoid robot hand-eye coordination intelligent calibration control system integrates high-precision contour extraction, visual feedback closed-loop control, multi-sensor fusion and dynamic path planning. The robot hand-eye calibration method has the beneficial effects that the calibration efficiency and precision can be remarkably improved, the problem of calibration parameter drift caused by system time-varying characteristics and environmental interference is effectively solved through continuous tracking of a target contour and real-time online compensation of pose deviation, and the calibration accuracy is improved. Therefore, the reliability and the absolute positioning precision of the robot in long-term complex operation tasks are guaranteed, and the self-adaptive capability of a robot system is enhanced.

The invention discloses a CAD drawing instant positioning method and device based on spatial index analysis, and relates to the related technical field of CAD drawing positioning, and the method comprises the steps: carrying out the multi-stage splitting identification of a multi-version target CAD drawing; performing associated indexing on the drawing version information, the drawing layer information and the drawing component set; semantic analysis and spatial association are carried out on the drawing text annotations; embedding and associating the drawing component space semantic tag set into a component-layer-drawing three-level association graph; performing matching indexing on the drawing semantic query request based on the drawing spatial index mapping table; and inquiring a topology path based on the component to carry out instant positioning and visual feedback. The technical problems that in the prior art, complex spatial relations and semantic information in the drawings are difficult to effectively process, and multi-version CAD drawings are low in retrieval efficiency, insufficient in instantaneity and inaccurate in positioning are solved, and the technical effect of improving the retrieval efficiency, query instantaneity and positioning accuracy of the multi-version drawings is achieved.

The invention discloses a visual question and answer method based on environmental perception and a knowledge base, and aims to realize an accurate visual question and answer function through a reasoning technology of integrating field specific environmental information and knowledge base information. The method comprises the following steps: firstly, extracting image features by utilizing a ResNet model in visual feature extraction, extracting text features by utilizing a BERT model in text feature extraction, and comprehensively processing the features and context information acquired by an environment perception module through multi-modal fusion; and then, on the basis of the fused multi-modal features, through combination of a Wikdata knowledge base and Seq2Seq, an answer is output in a text form, and visual feedback can be provided. Through environment perception, the system can adjust answers in real time to ensure that the system highly adapts to the current scene, and is applied to the fields of intelligent assistants, aided driving, household robots and the like.

The invention, which relates to the technical field of agricultural intelligent equipment, discloses an agricultural plant protection unmanned aerial vehicle sowing control system comprising a sowing flow field dynamic modeling and prediction module, an attitude regulation and control module, a speed matching module, a path compensation module, a visual monitoring module and a control strategy module. A flow field dynamic mapping model based on the flight height, the downward pressing airflow speed and the particle size and density of the scattered particles is constructed, particle drop point deviation is predicted in combination with flight real-time data, and a pneumatic coupling risk area is identified. Through flow field modeling prediction and attitude adjustment, trajectory compensation, speed control and visual feedback, adaptive regulation and control in the sowing process are realized, air scattering and nonlinear collapse are effectively prevented, seedling burning, germination failure and pesticide residue risks caused by over-dense sowing are avoided, the operation uniformity and the agricultural effect are improved, and the method has practical value and popularization prospects.

The invention provides a unified coding method and system for park equipment assets collected by using the Internet of Things. The method comprises the following steps: carrying out unified coding on the equipment assets; constructing a three-dimensional model of a corresponding building based on a digital twinning technology; optimizing spatial data processing in the video monitoring system by using a spatial optimization search algorithm; ensuring that the video monitoring image and the three-dimensional building model are accurately aligned in space; real-time video data and the state information of the building model are fused, and accurate mapping of a target or an event in a video in a three-dimensional model is achieved; detecting the data through an intelligent analysis technology; and carrying out visual feedback on a processing result. The method has the advantages that space-level coding information is added in equipment asset coding, equipment management and positioning are facilitated, unique identification and standardized management of equipment assets are achieved through a unified coding system, and equipment management efficiency and accuracy are improved.

The invention discloses a bridge construction monitoring method, device and equipment based on digital twinning and a medium, and relates to the technical field of digital twinning, and the method comprises the steps: carrying out the construction environment data collection of a preset construction environment, and constructing a virtual construction site according to the collected construction environment data; acquiring equipment information of the construction equipment, and acquiring positioning data of the construction equipment in real time through a preset positioning sensor; determining real-time attitude information of the construction equipment based on positioning information generated by the positioning data and the equipment information; determining a real-time bridge erection point location based on the collected real-time construction image so as to generate bridge tracking information; and constructing a bridge construction model based on digital twinning based on the virtual construction site, the positioning information, the real-time attitude information and the bridge tracking information, and performing remote real-time monitoring according to the bridge construction model. Therefore, real-time visual feedback can be provided for intelligent control through the constructed bridge construction site model based on digital twinning.

The invention provides a multi-view video reward mechanism learning framework and method, and the framework comprises a multi-view video evaluation subsystem which employs a multi-view video learning framework MVR to evaluate robot behaviors according to multi-view video learning; the visual feedback reward feedback strategy subsystem is used for generating visual feedback according to task text description through a visual language large model; accurate reward feedback is obtained according to the latest state correlation evaluation, so that the strategy is adjusted more effectively; the visual feedback task reward balancing subsystem analyzes the importance degree of task reward feedback according to the degree that robot behaviors approach to an expected target through a task reward model, dynamically adjusts the relative size between a task reward and a visual language model reward according to state correlation, and carries out visual feedback and task reward balancing; and the multi-view video reward combination subsystem is used for providing more accurate visual feedback and learning effect in a complex robot motion task in combination with multi-view videos and task rewards.