29734 results about "Roboty" patented technology

The invention relates to the technical field of robot path planning, and discloses a robot path planning method based on reinforcement learning. The method comprises the following steps: acquiring environment depth information and an obstacle movement track through a multi-sensor array, constructing a dynamic environment sensing network, and generating an environment state tensor under space-time constraint; building a hierarchical reinforcement learning framework, and optimizing the motion track of the robot in stages by adopting a strategy gradient algorithm to obtain an initial path strategy; designing a reward function calculation model based on an attention mechanism, and accounting an action value in real time according to an environment state tensor; deploying a distributed experience playback buffer pool, and performing priority sampling and track fragment recombination on historical decision data; and establishing a strategy iterative optimization mechanism, and searching and dynamically correcting an initial path strategy by utilizing a Monte Carlo tree. The method can accurately adapt to the dynamic environment, optimize the path decision efficiency, enhance the adaptability and reliability of robot path planning, and is suitable for various robot autonomous operation scenes.

The embodiment of the invention provides an unhooking robot control method based on multi-source visual fusion, which is applied to the technical field of robot control and comprises the following steps: acquiring an RGB image, a depth image, an infrared image and IMU data through a multi-source sensing system mounted at the tail end of a robot; carrying out feature fusion identification by adopting a double-branch neural network, and outputting the boundary contour of the lifting hook and the three-dimensional coordinates of the optimal grabbing point; the visual coordinates are unified to a robot base coordinate system through a registration correction mechanism; a Transform prediction model is constructed based on the visual and inertial signals, and future pose changes of the lifting hook are estimated; a feedforward control track is generated to counteract swing of the lifting hook, and track correction is carried out in combination with visual servo feedback; and a joint instruction is generated through path planning and inverse kinematics solution, and the mechanical arm is driven to complete precise unhooking operation. According to the method, the recognition precision, the anti-interference capability and the operation success rate of unhooking operation in complex illumination and dynamic environments are effectively improved.

A human-guided vision-force fused impedance iterative learning control method for a robotic arm, comprising: analyzing a robot-environment interaction dynamics equation, solving a visual servo acceleration model, and making use of the equation to establish a human-robotic arm-environment interaction dynamics model in an image feature space; acquiring an image feature position and speed curve of a human-guided robot completing an assembly task, and using dynamic movement primitives for coding and generalization; and designing an impedance iterative learning controller which uses image feature tracking errors as control input, learning impedance characteristics when the human-guided robot performs a contact operation, identifying unknown contact dynamics under the interaction between the robot and the environment, and counteracting identified contact interference in the feature space, so as to implement a flexible assembly operation. The control method solves the problems in existing assembly operations that human-robotic arm-environment coupling nonlinear dynamics, unknown contact dynamics of intensive contact assembly tasks and poor generalization of assembly scenarios require relearning for different scenarios, etc.

A humanoid robot includes an upper region includes a head and neck assembly having a neck portion and a head portion coupled to the neck portion. Said head portion includes: a frontal shell having a rear edge, a rear shell having a frontal edge, and an electronics assembly. The electronics assembly includes various components and devices used in the operation of the humanoid robot.

The invention relates to the technical field of robot control, and discloses a robot control method, system, equipment and medium based on a multi-modal large model, and the method comprises the steps: collecting the multi-source modal data of a scene where an operation task is located, and carrying out the processing through a machine learning model, obtaining a multi-modal feature, and carrying out the position coding and Transform fusion processing, multi-modal fusion features are obtained, the multi-modal fusion features and the constructed job task knowledge base are input into a large language model to decompose a target job task, a human-in-the-loop mechanism is introduced to optimize a decomposition result, and a sub-task sequence is obtained; according to a subtask type in the subtask sequence, processing the subtask sequence through a visual language action model or a reinforcement learning model, and generating a motion instruction to enable the robot to start an execution process of the target operation task; live-line work tasks are processed through the multi-modal large models LLM, VLA and the like, and the work efficiency of the autonomous distribution network live-line work robot is improved.

The invention discloses a dynamic path planning and self-adaptive control method and system for a coating robot, and relates to the technical field of coating automation. The method comprises the following steps: acquiring point cloud data through three-dimensional scanning equipment, constructing a dynamically updated workpiece curved surface model, and extracting curvature, edge and high-curvature mutation region features; a spraying path is generated based on a reinforcement learning algorithm, and path density, speed and coating supply are dynamically adjusted for a high-curvature area; distance, force feedback and environment parameters are fused, and mechanical arm and spray gun parameters are dynamically adjusted; dividing operation sub-areas and distributing tasks based on robot capability characteristics to realize multi-machine cooperation; and fault redundancy control and multispectral imaging are added to optimize the coating quality. The system comprises a sensing module, a decision-making module, an execution module, a redundancy control module and a communication module. According to the invention, the uniformity of the complex curved surface coating, the multi-machine cooperation efficiency and the system anti-interference capability are improved, and the method is suitable for spraying large workpieces such as aircraft fuselages and high-speed rail vehicle bodies.

The invention relates to the technical field of body-equipped intelligent robots, in particular to a multi-mode body-equipped intelligent robot control method and device, and the method comprises the steps: synchronously collecting visual, auditory, tactile, force sense and body perception information, and unifying the information to the same time-space reference through a cross-mode time-space stamp alignment mechanism; hierarchical feature extraction and fusion are carried out on the multi-modal information, and unified multi-modal scene state representation is generated; reasoning a decision based on the representation by using a body agent framework, and outputting a control instruction; motion planning and control, visual servo tracking in a non-contact stage and dynamic parameter correction in a contact stage are executed according to instructions; optimizing the multi-modal strategy network through an incremental strategy distillation mechanism based on the interactive data flow; the problem of space-time asynchronization of multi-modal sensing information is solved through a cross-modal space-time stamp alignment mechanism.

The invention relates to the technical field of robot decision making, and provides a robot multi-modal fusion autonomous decision making method and system based on a large language model.The method comprises the steps that a robot obtains multi-modal environment information through a visual sensor, a touch sensor, an auditory sensor and a laser radar which are carried by the robot; performing preliminary filtering and noise reduction processing on the original sensor data, and synchronously recording all the sensor data by timestamps; performing space-time semantic alignment on the preprocessed multi-modal data, mapping pixel coordinates of a target in a visual target coordinate quantization original image to a robot coordinate system, performing uncertainty evaluation on a multi-modal signal through a dynamic Bayesian network, and taking entropy or variance as an uncertainty quantitative evaluation index. According to the method, the information quality is improved from a data fusion source, accurate and reliable basic support is provided for subsequent decision making, and decision making errors caused by data deviation are greatly reduced.

The invention relates to the technical field of robot control, and discloses a heavy-load robot motion trail method and system based on machine learning. The method comprises the steps that historical movement track data of the heavy-load robot in a working scene are collected, and the data comprise a joint position sequence, an end effector pose sequence and environment obstacle distribution information; the data is preprocessed, track features are extracted, a space-time correlation matrix is constructed, and the matrix is used for representing the dynamic coupling relation between joint movement and the tail end pose; training a trajectory prediction model containing a long and short-term memory network and an attention mechanism based on the matrix, and generating a collaborative mapping relation between a joint position and a tail end pose; obtaining a current task target pose sequence and an environment constraint condition in real time, and outputting a candidate track set meeting dynamic constraint through a model; and adopting a multi-objective optimization algorithm to screen candidate tracks, generating an optimal track instruction and issuing the optimal track instruction to an execution mechanism. The method adapts to the complex characteristics and variable working conditions of the heavy-load robot, and the track adaptability is improved.

A head and neck assembly for a humanoid robot, including a head portion having an exterior surface defining an overall shape resembling a human head; a neck portion extending from the head portion; a head housing assembly enclosing the head portion and neck portion; an electronics assembly contained within the head housing assembly; and a head actuator assembly configured to move the head portion relative to a torso of the humanoid robot.

Systems and methods that allow robots to perform tasks for users are provided. A robot may comprise one or more robotic arms and / or a mobile base. The arms may be controlled by electric actuators and may have six or more degrees of freedom. The robot may have sensors which can be accessed remotely. Robots may have varying levels of autonomy, including, for example, full teleoperation (in which a human can have detailed control over the robot) or full autonomy (in which the robot can complete a task without any human intervention). Various entities can interact with individual robots or groups of robots over a network, locally, directly or in person, or any combination thereof. A management system can allow entities to control and / or monitor the robots.

The invention discloses a storage checking method based on a multi-modal sensing technology, a robot and a storage system, and belongs to the technical field of storage management and intelligent sensing fusion. Multi-modal data such as a visual image, space depth, radio frequency sensing and infrared temperature are collected, and an image feature vector, a three-dimensional point cloud model, a radio frequency response matrix and a temperature map are constructed; generating a fusion recognition vector through a multi-channel fusion network based on an attention mechanism, and dynamically adjusting a modal weight; constructing an article space distribution map, and marking a perception missing region; automatically complementing low-confidence region data based on a priority scheduling algorithm; performing joint verification on the original fusion result and the completion result to form a final inventory list; if the confidence coefficient of a certain article is lower than an early warning threshold continuously for multiple times, triggering an abnormal alarm and generating a traceable sensing sequence; the method is suitable for a high-precision inventory task in a complex storage scene, and has the advantages of high recognition robustness, intelligent completion mechanism, traceable abnormity and the like.

The invention discloses a welding robot track self-adaptive correction method based on multi-modal data fusion, and particularly relates to the technical field of industrial robots, which comprises the following steps: synchronously acquiring visual three-dimensional point cloud and arc current and voltage transient waveform data in a welding process in real time; an enhanced working trajectory feature vector fusing the visual trajectory features and the arc deviation compensation amount is constructed; respectively calculating real-time confidence coefficients of the visual sense and the arc sensing mode; inputting the confidence coefficient into a weight distribution strategy model, dynamically resolving vision and arc weight coefficients, and when the confidence coefficient of one sensor is low, lifting the weight of the other sensor to dominate correction; performing weighted fusion on the two pose adjustment amounts by using a weight coefficient to generate a six-degree-of-freedom comprehensive trajectory correction amount; and finally, the robot is driven to execute online adaptive trajectory correction. Through a confidence-driven dynamic fusion strategy, the limitation of a single sensor is overcome, and the welding robot trajectory tracking precision and the adaptive capacity are improved.

The invention discloses an intelligent voice recognition and natural language interaction method based on a quadruped robot, and the method comprises the following steps: S1, collecting a user voice instruction, generating a standardized voice text, and extracting a semantic keyword set; s2, collecting multi-source sensing data of the quadruped robot and generating a structured state data tensor; s3, constructing a multi-modal collaborative modeling mechanism, and generating a multi-modal joint semantic embedding vector; s4, constructing a semantic map based on semantic embedding and generating an action chain plan structure; s5, executing each sub-action in the action chain, and performing path analysis and execution monitoring; s6, storing the interaction task as a multi-modal semantic behavior memory unit; and S7, performing similarity retrieval based on current semantic input and historical memory to realize behavior migration and action chain multiplexing. The method has the advantages of accurate semantic understanding, intelligent interaction response, high behavior migration capability and the like.

The invention discloses a multi-robot task conflict resolution and dynamic scheduling system and method, and belongs to the technical field of robot control. The system comprises a perception detection layer which is used for acquiring operation information of a plurality of robots and a space-time semantic map of a to-be-executed task executed by the robots, and generating conflict information under the condition that at least two target robots are detected to conflict; the decision scheduling layer is used for determining task execution priorities of the to-be-executed tasks according to the conflict information and priority factors and value functions of the to-be-executed tasks corresponding to the target robots so as to rearrange the to-be-executed tasks corresponding to the target robots and generate a task sequence; and the execution control layer is used for generating a dynamic scheduling instruction according to the task sequence, the space-time semantic map and the operation information of the target robot and issuing the dynamic scheduling instruction to the corresponding target robot. The system can flexibly cope with a dynamic scheduling scene of multiple robots in real time.

The invention relates to a humanoid robot double-arm body operation method based on reinforcement learning, belongs to the field of robot cooperative control, and is characterized in that a strategy of trajectory block prediction and time integration fusion is used for double-arm cooperative control, and continuity and stability of double-arm operation are improved; in reinforcement learning control, a three-dimensional pose track generation and correction module is introduced, condition generation and denoising correction of a three-dimensional space are carried out on a track block layer, and geometric consistency and naturalness of a generated track are guaranteed; the invention further provides a reinforcement learning optimization framework and a simulation-reality migration process, and through system integration of reward, value guidance and migration processes, strategy deployability and safety are guaranteed; compared with the prior art, the method has the advantages that the naturalness, the collaboration and the success rate of double-arm operation can be remarkably improved, the generalization ability is high, and the good simulation-to-reality migration ability is achieved.

The invention discloses an inspection robot collaborative planning method and system based on digital twinning, and the method comprises the steps: constructing a virtual simulation environment of a large-scale component through a point cloud modeling technology, and integrating a motion capture system to achieve the real-time mapping of a physical environment and a virtual model; defining a cooperative mechanism of the scanning robot and the positioning robot, providing global coordinates and path guidance by the positioning robot, and correcting position errors in real time by the motion capture system; simulating a dual-machine motion track in the digital twin model, and identifying a potential collision risk through a conflict prediction model; designing a collaborative planning algorithm under coupling constraint, and performing optimization by taking path optimization and scanning visual angle coverage as a joint target; based on a twin intelligent framework with a body, the path and the visual angle of the robot are dynamically adjusted by combining reinforcement learning with real-time feedback, and self-adaptive collaborative planning is achieved. Through double-machine division cooperation and real-time correction, the scanning efficiency and precision of the large-size component can be remarkably improved, and the collision risk is reduced.

A humanoid robot includes an upper region includes a head and neck assembly having a neck portion and a head portion coupled to the neck portion. Said head portion includes: a frontal shell having a rear edge, a rear shell having a frontal edge, and an electronics assembly. The electronics assembly includes various components and devices used in the operation of the humanoid robot.

The invention discloses a double-station robot sorting optimization method and system based on digital twinning and a terminal, double improvement of sorting efficiency and safety is achieved by constructing a digital twinning driven collaborative operation system, and the method comprises the steps that firstly, a laser radar and a polarization camera are used for forming a composite sensing unit; geometric morphology, material reflection characteristics and spatial pose data of a target object are synchronously obtained, and are input into a digital twin engine after time synchronization processing; an engine constructs a virtual sorting scene containing a material attribute database based on a physical rendering technology, sub-millimeter-level space registration is achieved through feature fusion of a binocular stereoscopic vision depth map and geometric parameters, high-precision digital twin stations are generated, a system plans a space-time constraint trajectory of a double-station robot in a virtual environment, and a target object is obtained. And an integrated discrete event simulation engine performs operation time sequence conflict prediction, and when a space overlapping risk is detected, an alternative path containing a dynamic obstacle avoidance strategy is generated through a trajectory re-planning algorithm.

The invention discloses a building robot multi-machine collaborative operation optimizing and monitoring method and system based on digital twinning, and belongs to the technical field of building construction intellectualization. The method comprises the following steps: constructing a digital twinborn body comprising an environment perception model and a kinematics / dynamics model based on a building information model and robot physical parameters; performing multi-machine task allocation and path planning containing static / dynamic obstacle avoidance in the virtual environment; synchronizing physical environment data in real time through a multi-mode sensor; dynamically optimizing operation parameters by adopting a genetic algorithm or a particle swarm algorithm and realizing closed-loop control; and generating a safety early warning and emergency scheme based on machine learning. According to the method, Markov decision path planning of reinforcement learning and multi-agent game task allocation are creatively fused, laser radar-vision-inertial navigation multi-source data fusion is adopted, the technical problems that in a traditional method, digital twinning precision is insufficient, and dynamic cooperation efficiency is low are solved, and the method is suitable for large-scale popularization and application. And the construction efficiency, the safety and the man-machine interaction experience are remarkably improved.

The invention relates to the technical field of autonomous mobile robots, in particular to a freight robot autonomous navigation obstacle avoidance method based on multi-sensor fusion, which comprises the following steps of: identifying dynamic targets such as pedestrians and vehicles through data fusion of a depth camera and a laser radar, and predicting a future short-term movement track of the dynamic targets by utilizing a filtering algorithm; a risk corridor over time is generated, so that emergency braking or deadlock is avoided, and the operation efficiency and the traffic smoothness are greatly improved; a space-time consistency cross validation mechanism is established by utilizing the characteristics that the laser radar is insensitive to transparent objects and ultrasonic waves are sensitive to the transparent objects, so that false alarm and missing alarm are effectively eliminated, the robot can safely pass through a complex indoor environment, and the application boundary is greatly expanded; a depth camera is used for fitting a ground plane and analyzing point cloud height change in real time, so that obstacles which cannot be expressed by a two-dimensional navigation map can be identified; and an optimal track is generated by minimizing a multi-target cost function, so that the path is ensured to be safe and smooth.

The invention discloses an inspection robot navigation method, system and device based on Beidou and binocular vision fusion and a storage medium, and relates to the field of robot navigation and obstacle avoidance, and the method comprises the following steps: carrying out multi-modal data fusion processing based on an initial coordinate of an inspection robot and an image captured by a binocular vision system to obtain an environment sensing result; carrying out global planning and local optimization based on an environment perception result, and carrying out cooperation to generate a trajectory planning scheme; based on the environment sensing result and the trajectory planning scheme, intelligent navigation cooperative regulation and control are carried out, and an inspection robot motion control strategy is obtained; by improving the environmental perception accuracy, optimizing the path planning and performing intelligent navigation regulation and control, the navigation problem of the inspection robot in complex environments such as a transformer substation can be effectively solved, the inspection safety and efficiency are improved, and the method has remarkable practical application value.

The invention relates to a long-range task-oriented VLA model method for a humanoid robot, which comprises the following steps of: S01, analyzing a natural language instruction through a space-time semantic analyzer to generate an atomic operation sequence with a space-time dependency relationship; s02, maintaining a task state machine by using a dynamic memory network, and tracking the task execution progress in real time; s03, integrating vision, language and sensor data through a multi-modal perception fusion engine; s04, calling a predefined action primitive based on an adaptive execution system and optimizing a motion track; and S05, performing online updating and optimization on the model through a continuous learning mechanism. According to the method, a natural language instruction is analyzed into a structured task sequence with space-time dependence through a space-time semantic analyzer, an execution sequence and preconditions are defined, the semantic understanding ability and the structuring degree of task planning are improved, and task decomposition and replanning in a dynamic environment are supported; according to the method, the LSTM and the knowledge graph are combined, and the task state is maintained in real time.

The invention relates to the technical field of robot cooperative control, in particular to a humanoid robot body intelligent cooperative control system based on multi-modal sensing fusion, and the system comprises a multi-modal sensing fusion module which recognizes a target boundary position, analyzes a pressure change, and combines with a posture to extract audio features to generate an environment sensing graph; the dynamic time sequence adjustment module optimizes an action rhythm adjustment detail generation execution plan, the cross-modal behavior correction module corrects an offset optimization track generation coordination sequence, the task priority distribution module analyzes task distribution to generate an execution list, and the time sequence conflict correction module optimizes a path adjustment conflict generation coordination path. According to the method, an environment perception graph is constructed through matching and fusion of multi-source perception data, the action sequence and interval are dynamically adjusted to optimize an execution chain, trajectory offset is corrected to improve action precision, nearest response and load balancing are achieved through real-time task allocation, conflict blocking is reduced through path rearrangement and time sequence coordination, and a perception decision execution closed loop is formed; and the identification precision and the cooperation efficiency are improved.

The invention discloses a quadruped robot robust motion control method based on deep reinforcement learning, and belongs to the technical field of robot motion control, and the method comprises the steps: constructing a deep reinforcement learning model which comprises a state estimation network, a strategy network and a value network; interaction between the quadruped robot and the simulation environment is carried out, and standard observation information, historical observation information and privileged observation information of the quadruped robot at all moments are obtained; inputting the standard observation information, the historical observation information and the privilege observation information of the moment into a deep reinforcement learning model, and training based on a total loss function until convergence is carried out to obtain a trained deep reinforcement learning model; inputting standard observation information and historical observation information at corresponding moments in an actual scene into the trained deep reinforcement learning model to obtain output features of a corresponding strategy network; and the target position of each joint motor is calculated to complete the motion control of the quadruped robot. And efficient training and robust motion on various complex and unstructured terrains can be realized.

The invention relates to the technical field of robot training. The robot self-adaptive training method based on reinforcement learning comprises the steps that task sub-target information is generated through a high-level strategy network, the task sub-target information is input into a low-level execution network, an action control instruction is generated according to the task sub-target information, interaction feedback information is collected in the execution process, and the action control instruction is sent to a robot through a robot. Calculating a reward value according to the interaction feedback information, carrying out association processing on the reward value and the scene complexity parameter, executing a dynamic reward shaping operation, generating an adjusted reward signal, generating a strategy model optimized by meta-learning based on the adjusted reward signal, loading the strategy model in a simulation environment, and carrying out dynamic reward shaping. A target strategy model optimized through simulation training is generated, the target strategy model is loaded to the robot, and the robot is controlled to execute task operation in the actual interaction scene. The method has the effect of realizing adaptive task learning of the robot in a multi-interaction scene.

An intelligent task-type dialogue method based on a large language model, comprising: acquiring a dialogue with a user; identifying and parsing input information of the user to obtain an identification and parsing result; on the basis of the identification and parsing result, synchronously updating the state of a dialogue state tracker; on the basis of the intelligent guidance of the tracker, entering a proper dialogue scene node; executing a preset Action to complete a specific task; and on the basis of the current dialogue node context and dialogue historical data, generating a feedback message of a robot. In the method, by combining the large language model, rapid adaptation and efficient configuration of a scene can be achieved, and by dynamically loading the configuration information of a specific scene, a round of dialogue process can be efficiently pushed on the basis of preset process logic. Also disclosed are an intelligent task-type dialogue system based on a large language model, an electronic device, and a computer program product.

The present disclosure provides a system for generating motor control commands for a humanoid robot, comprising an alpha model with over 1 billion parameters that processes visual observations and language instructions at a first frequency to generate contextual embeddings, and a beta model operating at a higher second frequency. The beta model includes an embodiment-specific state encoder projecting robot state information into a shared embedding space, a diffusion transformer module generating denoised action sequences through iterative flow-matching that cross-attends to the alpha model's contextual embeddings, and an embodiment-specific action decoder converting denoised sequences into motor control commands. The beta model generates action chunks comprising future action sequences over a predetermined time horizon in a single inference step, with the complete system having less than 5 billion parameters.

The invention belongs to the technical field of robot navigation, and discloses a robot path planning method based on a graph neural network, through causal perception dynamic graph construction and AST-GNN training, a causal relationship, such as pedestrian steering-path change, of obstacle movement is excavated, extreme scene features are learned in combination with adversarial training, and the path planning precision is improved. Therefore, when the robot is in an emergency scene (such as object falling and pedestrian sharp turning), the obstacle movement pre-judgment accuracy is improved, the path re-planning response speed is increased, the collision risk is greatly reduced, and the operation safety in a complex dynamic environment is ensured; a block chain alliance chain and an intelligent contract mechanism are adopted, path data credibility is guaranteed through ECC encryption, a PBFT algorithm rapidly reaches a consensus, an intelligent contract automatically allocates priorities, such as emergency task priority, and a path optimized through differential geometry is combined, so that the path conflict rate of multiple robots in dense scenes such as storage and venues is remarkably reduced.

The invention belongs to the technical field of data processing, and particularly discloses a dynamic path planning method and system for an inspection robot, and the method comprises the steps: collecting field data through a sensor, processing a laser scanning point cloud and a camera image through a positioning mapping algorithm, and fusing multi-source information to generate a real-time map. Obtaining a three-dimensional environment model containing a dynamic obstacle position; according to the three-dimensional environment model, obstacle features are extracted, a deep learning model is adopted to identify moving personnel and randomly placed goods, obstacle types and movement tracks are judged, and a classified obstacle data set is obtained; through the classified obstacle data set, the distance and the relative speed between the obstacle and the current position of the robot are calculated, and if the distance is smaller than a preset threshold value and the speed is larger than zero, high-priority interference is marked; according to the invention, the problem of inaccurate dynamic obstacle identification and obstacle avoidance in a complex scene in the prior art is solved.