37880results about "Programme-controlled manipulator" patented technology

The invention discloses a system and a method for task planning of an intelligent robot with a body based on multi-dimensional situation awareness, and particularly relates to the technical field of task planning of the intelligent robot with the body, space-time alignment is carried out on asynchronous heterogeneous data generated by a multi-modal sensor channel, and cross-modal space-time features are extracted through a cross-modal feature fusion network; a fusion situation matrix is generated, dynamic causal modeling is used to update association strength among the multi-modal data, an anti-factual reasoning engine is used to identify and trace abnormities, and an abnormities traceability result is output; dynamically adjusting the reliability weight of each sensing channel through a multi-modal credibility evaluation model by using the fusion situation matrix and an abnormal traceability result; and on the basis of the reliability weight, inputting the fusion situation matrix into a real robot dynamic model and a digital twin virtual model, executing collaborative predictive control, and starting an adaptive rule evolution mechanism when a safety score is lower than a threshold value, thereby solving the problem of fusion matrix distortion in dynamic obstacle avoidance and precise grabbing tasks.

The invention discloses a manipulator grabbing planning system and method based on visual identification, and relates to the technical field of robots, the manipulator grabbing planning system comprises a visual perception module, a coordinate conversion module, a motion planning module, a control execution module, a tail end perception module and a system integration and communication module; the visual perception module realizes multi-view target detection, semantic segmentation and three-dimensional pose estimation through a binocular depth camera; the coordinate conversion module is used for converting a target pose under a camera coordinate system into a world coordinate under a mechanical arm base coordinate system; the motion planning module is responsible for generating a mechanical arm grabbing path, optimizing a strategy and supporting generalization migration of a multi-form mechanical arm; the control execution module drives the six-axis cooperative mechanical arm to complete the grabbing action, and vision-force mixed feedback closed-loop control is achieved. The tail end sensing module monitors the grabbing state in real time through a touch sensor and dynamically adjusts a grabbing strategy; and the system integration and communication module is used for realizing real-time data interaction and cooperative work among the modules of the system.

The invention discloses an industrial robot real-time adaptive control method and system based on digital twinning, and relates to the technical field of industrial robots. The digital twin engine module runs a high-fidelity dynamics simulation model and an environment interaction model, performs real-time state estimation, abnormal working condition recognition and twin parameter dynamic updating, is seamlessly integrated with the control execution module, and provides decision support with high robustness and high adaptability for an industrial scene; the adaptive control module performs online rolling optimization on a control strategy based on a deep reinforcement learning algorithm, generates joint space trajectory correction, tail end precision compensation and dynamic load adaptability optimal instructions, and realizes parameter adaptive setting through fuzzy logic or a neural network; and the fault diagnosis module performs multi-scale time sequence analysis by using an LSTM and convolutional neural network fusion model, detects position offset, moment sudden change or temperature overrun and other abnormalities, and triggers emergency shutdown, sound-light alarm and an adaptive recovery strategy.

The invention discloses a target recognition and grabbing posture planning system for a collaborative robot, and belongs to the technical field of mechanical arms. According to material posture information provided by a sensing module, the optimal grabbing posture is intelligently matched from a preset grabbing strategy library by fusing mechanical arm movement track parameters and target material physical characteristics; the initial accuracy of the grabbing scheme is ensured, in the grabbing process, the camera continuously collects the material poses in real time, and the offset is accurately calculated by comparing the real-time poses with the expected poses. Once material deviation is detected, a visual and force closed-loop adjusting mechanism is triggered immediately, a force-position hybrid control model is utilized, position deviation is synchronously corrected, and grabbing force parameters are dynamically adjusted, so that the grabbing stability and precision are remarkably improved, the grabbing failure rate is effectively reduced, manual intervention and reset time are greatly shortened, and the grabbing efficiency is improved. Therefore, the production efficiency is comprehensively improved.

A humanoid robot includes an upper region includes a head and neck assembly having a neck portion and a head portion coupled to the neck portion. Said head portion includes: a frontal shell having a rear edge, a rear shell having a frontal edge, and an illumination assembly. The illumination assembly is configured to illuminate a region that: (i) extends between a rear edge of the frontal shell and an extent of the frontal edge of the rear shell, (ii) is positioned adjacent to the extent of the rear edge of the frontal shell, and (iii) is positioned adjacent to the extent of the frontal edge of the rear shell.

The invention relates to the technical field of intelligent assessment and decision making, in particular to a robot dynamic risk assessment and decision making system and method based on multi-modal perception, and the system comprises a multi-modal sensor module which is used for collecting environment vision, acoustics, mechanics and position data in real time; the edge calculation unit is used for carrying out space-time alignment and feature fusion on the sensor data; the dynamic risk assessment model is used for integrating the environment uncertainty quantification module and the robot state prediction module based on a reinforcement learning framework; the decision execution interface is used for outputting a risk level and obstacle avoidance, speed reduction and shutdown instructions; by integrating visual, acoustic, mechanical and position multi-source sensor data and the like, the system can comprehensively capture various risk factors in a complex dynamic environment, so that the defect that a traditional single sensor system is insufficient in sensing dimension is overcome, and the system is particularly suitable for terrains and weather conditions with variable regions.

The invention discloses a manipulator grabbing method based on deep learning target detection and image segmentation, and relates to the technical field of artificial intelligence and robotics.The manipulator grabbing method comprises the following steps that a scene image to be processed is collected, the image quality is improved through the multi-light-source fusion image enhancement technology, and recognition errors caused by uneven illumination are reduced; and inputting the enhanced image to a pre-trained deep learning model, executing a target detection task, and outputting an initial bounding box and a category label of the target object. According to the method, through multi-light-source image enhancement and high-precision image segmentation, the accuracy of target recognition and contour extraction is remarkably improved, and the capture failure rate caused by image misjudgment is reduced. And meanwhile, geometric consistency verification and a multi-factor grabbing scoring mechanism are introduced, dynamic screening and collision pre-detection are conducted on the paths, the grabbing stability and safety of the mechanical arm in the complex environment are effectively guaranteed, and the intelligence and robustness of the whole system are remarkably improved.

The invention discloses a mechanical arm positioning and grabbing method based on machine vision, and relates to the technical field of machine vision and mechanical arm control, the method comprises the following steps: synchronously acquiring RGB-D images of a target scene through a multi-view camera array, and generating three-dimensional point cloud data through data fusion; an improved LSD algorithm and a PnP algorithm are adopted to calculate the initial pose of the target object, illumination distortion is eliminated in combination with the generative adversarial network, and three-dimensional coordinates are output; a mechanical arm motion error transfer model is constructed based on Monte Carlo simulation, and a candidate grabbing scheme set is generated through reinforcement learning; and an optimal grabbing scheme is screened through a preset priority evaluation rule, and a mechanical arm joint movement track and a control instruction set are generated. Through multi-modal data fusion and a nonlinear optimization algorithm, the technical problems of large target positioning deviation and sensitive illumination interference in a complex environment are solved, and the grabbing precision and robustness of the mechanical arm are improved.

The invention provides a teaching-free welding robot path planning system based on visual autonomous learning, and relates to the technical field of industrial welding, and the teaching-free welding robot path planning system comprises a pose compensation module which is used for arranging three infrared reflective mark points on the surface of a clamp base in an L shape, collecting original point clouds of the mark points and a workpiece by using a stereo camera, and preprocessing the point clouds; generating a pose compensation matrix based on the offset of the actual coordinate and the theoretical coordinate of the mark point, and outputting a de-noising point cloud data set and a compensation matrix; and the pose correction module is used for fitting a workpiece plane equation by adopting a random sampling consistency algorithm on the basis of the de-noised point cloud data set, acting a pose compensation matrix on the workpiece plane equation, correcting a pose error caused by clamp drifting, calculating a welding seam track end point coordinate and outputting a corrected welding seam pose parameter and a scanning pose instruction. According to the method, clamp drift can be compensated, weld joint poses can be corrected, three-dimensional features are extracted, a collision-free path is planned, and the welding precision, efficiency and automation degree are improved.

The invention relates to the technical field of industrial robots, in particular to an industrial robot disordered grabbing system and method based on multi-modal sensing, and the system comprises a multi-modal sensing module, a pose estimation and correction module, a grabbing task planning module and a mechanical arm execution module. The multi-modal sensing module is used for acquiring RGB image data, depth image data, point cloud data and force / torque data in a working environment, and the pose estimation and correction module performs feature extraction and fusion on multi-modal data based on topology invariant mapping and performs adaptive pose estimation on a target object. The grabbing task planning module generates an optimal grabbing strategy based on deep reinforcement learning and outputs a grabbing control instruction, and the mechanical arm execution module receives the grabbing control instruction, controls a mechanical arm to execute a grabbing action and monitors a grabbing state through force / torque feedback. And the environmental adaptability and the perception robustness are improved.

The invention relates to a multi-product-line-oriented robot welding integration method, device and equipment and a medium, and the method comprises the steps that three-dimensional geometrical characteristics and material attribute data of multiple types of workpieces are collected, and geometric parameters and material mechanical properties of weld joints are extracted; an order demand template is intelligently matched, and initial welding parameters and a clamp configuration scheme are generated; the health state of production equipment is evaluated in real time, and the collision-free movement track of the mechanical arm is planned; dynamically analyzing the joint angle sequence to generate a high-precision servo control signal; the welding process is monitored in real time, and current and molten pool temperature parameters are corrected; and iteratively optimizing the algorithm weight of the process knowledge base to improve the adaptive capacity. Through cooperation of multi-source data fusion and an intelligent algorithm, rapid switching of multiple kinds of workpieces, self-adaptive compensation of the equipment operation state and closed-loop optimization of welding process parameters are achieved, and the equipment utilization rate and the welding quality stability in a flexible production scene are remarkably improved.

Disclosed are systems and methods for generating a 3D model from a single 2D image, the method comprising: receiving a single 2D input image of an object; generating a set of consistent multi-view images based on the single 2D input image using a fine-tuned 2D diffusion model that processes multiple views together in a tiled configuration; constructing a 3D feature volume by projecting 2D patch features from the generated multi-view images using corresponding camera pose information; generating a 3D mesh using a pair of 3D diffusion networks conditioned on the multi-view images, wherein the pair of 3D diffusion networks comprises a first network for generating a coarse occupancy volume and a second network for generating a high-resolution sparse volume; and refining a texture of the generated 3D mesh to produce a textured 3D mesh.

A mechanical end effector for a humanoid robot includes a plurality of identical finger assemblies. Each of the finger assemblies is removably connected to a frame. Each of the finger assemblies is fully self-contained and operable independently of every other one of the finger assemblies and independently of every other component connected to the frame. Each of the finger assemblies includes a single electric motor and is configured to be fully operable using only the single electric motor.

The invention relates to the technical field of welding, in particular to a corrosion steel welding cooperative control method and system. Comprising the following steps that welding seam geometric parameters, molten pool dynamic characteristic parameters and welding heat input parameters in the corrosion steel welding process are collected in real time through a multi-dimensional sensor array; constructing a corroded steel welding seam feature space model based on the welding seam geometric parameters, and determining material corrosion grade distribution and mechanical property parameters of a welding seam area in combination with a preset corroded steel material database; a molten pool form evolution prediction model is established through an adaptive Kalman filtering algorithm by utilizing the dynamic characteristic parameters of the molten pool and the welding heat input parameters, and the solidification behavior and the welding seam forming trend of the molten pool are predicted in real time; according to the material corrosion grade distribution, the mechanical property parameters and the molten pool forming trend, a dynamic adjustment strategy of the welding process parameters is generated through a multi-objective optimization algorithm; the reliability and safety of the corrosion steel welding joint can be improved.

The invention provides a motion control method and system for an intelligent robot, and the method comprises the steps: collecting environment and state data through an intelligent sensor group of a humanoid robot, inputting the environment and state data into a pre-training first neural network model, and obtaining motion prediction data and an environment analysis result; constructing a motion planning model, and performing energy consumption-stability multi-objective optimization on the joint motion track by adopting a preset first algorithm; the central controller generates a joint position, speed and torque reference trajectory based on an optimization result; and the local second controller of each joint locally adjusts the reference trajectory within the prediction time domain according to the real-time feedback. According to the invention, multiple sensors are combined with the mixed attention neural network to realize environment and self state intelligent perception, and the problem of multi-sensor data fusion time sequence dependence is solved; through energy consumption-stability multi-objective optimization, the complex environment movement efficiency is remarkably improved; the central controller and the local controller work cooperatively, and in combination with an edge computing architecture, the communication delay is reduced, and the system response speed is improved.

Disclosed in the present invention are a multi-modal shared teleoperation system and method for a three-arm space robot. The system at least comprises a master-side teleoperation system, a communication module and a slave-side robot system, wherein the master-side teleoperation system at least comprises two force feedback hand controllers, a microphone array and upper computer software, and the slave-side robot system comprises two operating arms each equipped with a gripper at the end, an observation arm having a binocular camera mounted at the end, a vision unit, a force sensor and lower computer software. The method comprises: an operator controlling two operating arms of an extravehicular robot to execute a task, and controlling an observation arm to acquire a better local field of view. In the method, a multi-modal teleoperation method comprising pose control, voice control and force control is fused with autonomous control of a robot by means of a shared control algorithm, and thus, human-robot collaborative control over the position, orientation and contact force of a robotic arm can be realized on the basis of the requirements of the operator, and the robot autonomously executes other relatively simple tasks, thereby reducing the operation burden of operators, and improving the control efficiency.

A multimodal shared telerobotic system and method for a three-arm space robot, the system at least includes a local-site system, a communication module, and a remote-site system, where the local-site system includes two force-feedback haptic devices for left and right hands, a microphone array, and upper computer software; the remote-site system includes two robotic arms provided with end-effectors, an observation arm with a stereo camera installed at an end thereof, two force sensors, a vision unit and lower computer software; an operator can control the two robotic arms of the robot outside a cabin for performing operations, and control the observation arm to obtain a better local view; and a multimodal telerobotic control method of pose control, voice control, and force control is integrated with the robot's autonomous control through a shared control algorithm.

The invention relates to a multi-modal intelligent robot system and an interaction method, and belongs to the technical field of robot digital data processing, and the method comprises the following steps: S1, multi-modal input collection; s2, carrying out multi-modal input preprocessing; s3, performing multi-modal information fusion, inputting the information into a pre-trained multi-modal feature fusion model, and performing feature fusion on each modal feature through a quantitative feature data fusion mechanism to obtain a user interaction intention vector and a user emotional state vector; s4, interaction response generation: matching a preset interaction response strategy library based on the user interaction intention vector to obtain basic response content, and performing emotion adaptation adjustment on the basic response content in combination with the user emotion state vector to generate multi-modal response content including text information, voice information and action information; s5, interactive feedback is executed; the method has the beneficial effects that the robot is fused with multi-modal information through the basic response content and the user emotional state vector, and interaction is dynamically optimized.

The invention discloses a mechanical arm dynamic deviation correction method and system based on visual driving and a medium, and relates to the technical field of mechanical arm control. The method comprises the steps that when the tail end of a mechanical arm enters a preset machining space, an integrated 3D visual sensor is triggered to collect 3D point cloud of a workpiece to be machined; after pose recognition is carried out on the point cloud, the offset is recognized according to the teaching pose and the actual pose, and the initial offset is output; calling the multi-dimensional perception data, performing fusion correction, and outputting a correction offset; performing interference correction through an offset compensation model, and outputting a target offset; parameter adjustment and optimization are carried out according to the target offset, and a joint angle adjustment instruction is output; and performing correction closed-loop feedback according to the updated pose data. The technical problems of precision errors and low efficiency caused by deviation in the operation process of the mechanical arm are solved, and the technical effects that through dynamic deviation correction and multi-sensor data fusion, the operation precision and efficiency of the mechanical arm are improved, and stable operation in a complex environment is ensured are achieved.

The invention relates to the technical field of artificial intelligence, can be applied to the field of medical health and the field of financial transaction, discloses an action generation method and device based on multi-modal pre-training, a robot and a medium, and is applied to a high-frequency action generation scene of an intelligent surgical robot or an intelligent customer service and wealth management scene. The method comprises the following steps: acquiring a language instruction, a visual image and robot body sensing data; performing multi-modal feature alignment and cross-modal feature fusion on the language instruction, the visual image and the robot body sensing data through a pre-trained visual language model to generate a fused joint feature vector; generating a target continuous control instruction based on the fused joint features through a pre-trained target action model by adopting a flow matching technology; and generating continuous actions of the robot based on the target continuous control instruction. According to the method, the robot action generation efficiency and the cross-platform adaptability are improved.

A humanoid robot includes a torso, a left arm assembly coupled to the torso and having a first reference line, a left wrist coupled to the left arm assembly and including at least a rotational axis, and a left end effector coupled to the left wrist. The left end effector is configured to move about the rotational axis and includes a finger assembly with a second reference line and at least two degrees of freedom, and a thumb assembly with at least three degrees of freedom. A first angle is formed between the first and second reference lines when the left wrist is in a first configuration, and a second angle is formed when the left wrist is in a second configuration. Both the first and second angles are greater than 70 degrees, and the difference between the first and second angles is greater than 150 degrees.

The embodiment of the invention provides an unhooking robot control method based on multi-source visual fusion, which is applied to the technical field of robot control and comprises the following steps: acquiring an RGB image, a depth image, an infrared image and IMU data through a multi-source sensing system mounted at the tail end of a robot; carrying out feature fusion identification by adopting a double-branch neural network, and outputting the boundary contour of the lifting hook and the three-dimensional coordinates of the optimal grabbing point; the visual coordinates are unified to a robot base coordinate system through a registration correction mechanism; a Transform prediction model is constructed based on the visual and inertial signals, and future pose changes of the lifting hook are estimated; a feedforward control track is generated to counteract swing of the lifting hook, and track correction is carried out in combination with visual servo feedback; and a joint instruction is generated through path planning and inverse kinematics solution, and the mechanical arm is driven to complete precise unhooking operation. According to the method, the recognition precision, the anti-interference capability and the operation success rate of unhooking operation in complex illumination and dynamic environments are effectively improved.

The invention discloses a multi-mechanical-arm space-time synchronization control method for coiled pipe welding, and belongs to the technical field of automation control, and the method comprises the steps: in a primary laser and TIG hybrid welding execution stage, carrying out real-time data acquisition on a welding area of a workpiece, carrying out real-time deviation detection, and once real-time welding deviation is detected, carrying out time-space synchronization on the welding area of the workpiece; a local correction mechanism is triggered immediately, and deviation is prevented from being accumulated in the single welding process; after one-time welding is completed, the workpiece enters a transition area, global contour reconstruction is conducted on a welded section of the workpiece through three-dimensional scanning equipment, global deviation recognition is conducted, and unprocessed hysteresis deformation and accumulative errors are covered and corrected in real time; on the basis of the analysis result of the global deviation recognition, double correction is conducted on secondary welding, and cooperative control over space track correction and technological parameter adaptation is achieved; and after secondary welding is completed, the correction effect is evaluated through a double-layer evaluation mechanism, and the stability of the correction process is ensured.

The invention relates to the technical field of robot autonomous navigation and control, and discloses a robot system based on a sensing system, which comprises a multi-mode sensing module for outputting data to a dynamic environment modeling module; the dynamic environment modeling module is used for transmitting the model to the path planning module; the path planning module outputs the path sequence to the neural motion control module; the neural motion control module outputs the control signal to the dynamic execution module; the dynamic execution module is used for receiving the pulse control signal and driving each joint of the robot to execute the path in combination with inverse kinematics solution and a feedback control mechanism; and the collaborative optimization module is in two-way communication with the modeling module, the path planning module and the neural motion control module. According to the method, the contradiction between real-time performance and integrity of environment modeling in a complex scene is solved by fusing cross-modal information complementary characteristics of binocular vision, millimeter-wave radar and inertial data and combining mathematical representation of a hypergraph topology model on a dynamic obstacle interaction relationship.

The disclosure provides a method and system for trajectory tracking control of a vehicle-manipulator coupling system with finite time prescribed performance. Specifically, a coupling weaken trajectory planning method is designed to reduce the system's coupling effects. A finite time performance function is designed to constrain the trajectory tracking error. In a case the constraint conditions corresponding to the finite time performance function are satisfied, the trajectory tracking error is converted to obtain a transformed error. The sliding mode surface is designed based on the transformed error to control the transformed error to converge in a finite time, and the external disturbance of the vehicle-manipulator coupling system is observed based on non-linear disturbance observer. The control input of the vehicle-manipulator coupling system is designed based on the sliding mode surface and the non-linear disturbance observer output. This ensures that the vehicle-manipulator coupling system can operate precisely along the desired trajectory.

The invention provides an intelligent storage robot group cooperative scheduling method based on deep reinforcement learning, and relates to the technical field of intelligent storage, and the method comprises the steps: constructing a group perception module through a hierarchical attention mechanism, and generating a dynamic cooperative perception matrix; establishing a deep reinforcement learning model for strategy learning; and designing a multi-level reward function and optimizing a training process through an adaptive weight adjustment mechanism. According to the invention, the cooperative efficiency of warehouse robot group scheduling is improved, the task conflict rate is reduced, and the adaptability of the system to a complex dynamic environment is enhanced.

The invention belongs to the technical field of robot control, particularly provides a force feedback teleoperation control system and method for the tail end of a mechanical arm of a quadruped robot, and aims at the key challenges that control errors are caused by communication time delay and soft obstacles are difficult to recognize in a dynamic environment. Modeling and judgment are conducted on the contact state of the tail end of the mechanical arm in advance, and feedforward control and buffer adjustment oriented to communication time delay are achieved. And meanwhile, a dynamic semantic map is constructed in combination with multi-source sensing information, and soft obstacle reasoning and path optimization are performed by fusing a tail end force sense change trend, so that the recognition and avoidance capabilities of the system in a complex and invisible obstacle environment are remarkably improved. The system has good perspectiveness, self-adaptability and high redundancy safety characteristics, is suitable for multi-task inspection operation of industrial sites such as a thermal power plant, and is especially suitable for a remote man-machine cooperative operation scene in a narrow space.

The present disclosure provides a humanoid robot with an arrangement of components that allows the robot to mimic the movements, functionality and capabilities of a human being. The robot includes a torso coupled to a waist, an arm assembly, and a head assembly. A pelvis is coupled to the waist and has left and right actuator mounts. Left and right hip assemblies are coupled to the respective actuator mounts. Each hip assembly includes a hip pitch actuator assembly, a hip roll actuator assembly, and a leg twist actuator assembly. The hip pitch actuator assembly has a portion positioned within the pelvis and is coupled to the actuator mount. The hip roll actuator assembly is coupled to the hip pitch actuator assembly, with a non-90 degree angle formed between their axes. The leg twist actuator assembly is coupled to the hip roll actuator assembly and positioned below extents of both the hip pitch and hip roll actuator assemblies.

The present disclosure provides a humanoid robot comprising a torso portion, an arm assembly extending from the torso portion, a leg assembly extending from the torso portion, and an exterior covering system. The exterior covering system is configured to cover at least a portion of the torso portion, the arm assembly, and the leg assembly. The exterior covering system includes an energy attenuation assembly positioned adjacent to at least one of the torso portion, arm assembly, or leg assembly. The exterior covering system further includes a cover assembly positioned over the energy attenuation assembly, and a coupling means for securing the cover assembly to the humanoid robot.

The embodiment of the invention discloses a multi-area mechanical arm collaborative operation method and electronic device.The multi-area mechanical arm collaborative operation method comprises the steps that real-time operation state data are obtained from a multi-area mechanical arm through multi-modal sensor data collection and synchronization; dynamic operation boundary division based on region segmentation is adopted, the operation range of each mechanical arm is determined, and an operation boundary set is generated; according to the running state data and the multi-sensor information, task paths of the multiple mechanical arms are analyzed, whether path conflicts exist or not is determined, and conflict area identifiers are generated; according to the conflict area identification, the speed and posture parameters of all the mechanical arms are determined, the task execution sequence is optimized, and adjusted operation parameters are obtained; through an instruction distribution and synchronous execution mechanism, the adjusted operation parameters are transmitted to all mechanical arm controllers, and synchronous mechanical arm operation states are obtained; and feedback data are collected according to the operation state of the mechanical arm, and a final task execution report is generated.