Collaborative robot two-channel collision prediction method and device and computer equipment

By obtaining the protocol information of the collaborative robot and the object to be evased, and using the constraint protocol for code parsing and envelope update, the collision prediction failure caused by code errors in traditional methods is solved, and the security collision prediction under the PLd security level is realized, reducing the Risk.

CN118927248AActive Publication Date: 2024-11-12SHENZHEN HANS ROBOT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411050583.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-12
Estimated Expiration
2044-08-01

AI Technical Summary

Technical Problem

In traditional collaborative robots’ dual-channel collision prediction methods, code writing errors can easily lead to failure of collision prediction, which poses great risks.

Method used

By obtaining the initial envelope radius of the collaborative robot and the protocol information of the object to be evaded, using the constraint protocol for code analysis, determining the object envelope information, and updating the envelope based on the estimated sliding distance, performing collision prediction, ensuring that under the control of the controller Whether the collaborative robot will collide with the object to be avoided.

Benefits of technology

On the basis of ensuring the PLd safety level, the development capabilities of the security module are expanded, and the risk of the collision prediction process is reduced. Even if there are abnormalities in the camera components, it will not affect the collision prediction process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118927248A_ABST
    Figure CN118927248A_ABST
Patent Text Reader

Abstract

The invention relates to a collaborative robot dual-channel collision prediction method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring an initial envelope radius of the collaborative robot and protocol information determined by a camera assembly for a to-be-evaded object of the collaborative robot; the protocol information is used for representing an object envelope of the to-be-evaded object; performing code analysis on the protocol information by using a constraint protocol matched with the protocol information, and determining object envelope information of the object envelope; determining an estimated sliding distance of the collaborative robot under the control of the controller, and superposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot; and determining a collision prediction result of the collaborative robot under the control of the controller based on a position relationship between the update envelope and the object envelope. By adopting the method, the collision prediction risk can be reduced under the condition of ensuring that the PLd security level is reached.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of robotics technology, and in particular to a collaborative robot dual-channel collision prediction method, device, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the development of robot research and development technology, collaborative robot dual-channel collision prediction technology has emerged, which can predict collisions between the robot and objects that may collide in the environment, and then take emergency stop operations to avoid collisions.

[0003] In the traditional dual-channel collision prediction method of collaborative robots, the collision process is generally predicted by the host computer software, and then instructions are issued. However, the process of the host computer software issuing prediction instructions is executed by manually writing a whole set of codes. Once a programming error occurs in the code designed by the technician, the collision prediction process cannot be carried out, which poses a great risk. Summary of the invention

[0004] Based on this, it is necessary to provide a collaborative robot dual-channel collision prediction method, device, computer equipment, computer-readable storage medium and computer program product that can reduce risks in response to the above-mentioned technical problems.

[0005] In a first aspect, the present application provides a collaborative robot dual-channel collision prediction method, comprising:

[0006] Acquire an initial envelope radius of the collaborative robot and protocol information determined by the camera component for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided;

[0007] Using a constraint protocol matching the protocol information, performing code parsing on the protocol information to determine object envelope information of the object envelope;

[0008] Determining an estimated sliding distance of the collaborative robot under the control of a controller, and superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot;

[0009] Based on the positional relationship between the update envelope and the object envelope, a collision prediction result of the collaborative robot under the control of the controller is determined.

[0010] In one embodiment, using a constraint protocol matching the protocol information to perform code parsing on the protocol information to determine object envelope information of the object envelope includes:

[0011] Obtaining camera identification information of the camera component;

[0012] Searching a protocol database for a protocol corresponding to the camera identification information as a constraint protocol matching the protocol information;

[0013] The protocol information is parsed using the constraint protocol to determine object envelope information of the object envelope.

[0014] In one embodiment, using the constraint protocol to perform code parsing on the protocol information to determine the object envelope information of the object envelope includes:

[0015] Obtaining the data format corresponding to the constraint protocol;

[0016] The protocol information is parsed based on the data format to determine object envelope information of the object envelope.

[0017] In one embodiment, determining an estimated sliding distance of the collaborative robot under the control of a controller, and superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot includes:

[0018] Obtaining the maximum deceleration speed and current movement speed of the collaborative robot;

[0019] determining an estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed;

[0020] The estimated sliding distance is superimposed on the initial envelope radius to obtain an updated envelope of the collaborative robot.

[0021] In one of the embodiments, determining a collision prediction result of the collaborative robot under the control of the controller based on a positional relationship between the update envelope and the object envelope includes:

[0022] The coordinates of each point in the update envelope are calculated to be different from the coordinates of each point in the object envelope, so as to obtain a coordinate difference set between the update envelope and the object envelope;

[0023] When the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, it is determined that the collaborative robot will collide with the object to be avoided under the control of the controller.

[0024] In a second aspect, the present application further provides a collaborative robot dual-channel collision prediction system, characterized in that the system comprises: a camera assembly, and a safety module connected to the camera assembly;

[0025] The camera component is used to determine protocol information for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided;

[0026] The security module is used to implement the method described in the above embodiment.

[0027] In a third aspect, the present application also provides a collaborative robot dual-channel collision prediction device, comprising:

[0028] A protocol information acquisition module, used to acquire an initial envelope radius of the collaborative robot and protocol information determined by the camera component for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided;

[0029] A code parsing module, used to perform code parsing on the protocol information using a constraint protocol matching the protocol information, and determine object envelope information of the object envelope;

[0030] An updated envelope determination module is used to determine an estimated sliding distance of the collaborative robot under the control of the controller, and to superimpose the estimated sliding distance onto the initial envelope radius to obtain an updated envelope of the collaborative robot;

[0031] A collision prediction result determination module is used to determine the collision prediction result of the collaborative robot under the control of the controller based on the positional relationship between the update envelope and the object envelope.

[0032] In a fourth aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the above method are implemented.

[0033] In a fifth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and the computer program implements the steps of the above method when executed by a processor.

[0034] In a sixth aspect, the present application further provides a computer program product, wherein the computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0035] The above-mentioned collaborative robot dual-channel collision prediction method, device, computer equipment, computer-readable storage medium and computer program product obtain the initial envelope radius of the collaborative robot and the protocol information determined by the camera component for the object to be avoided of the collaborative robot, so as to determine the specific conditions of the collaborative robot and the object to be avoided, wherein the protocol information is used to characterize the object envelope of the object to be avoided, and the protocol information is coded and parsed using a constraint protocol matching the protocol information to determine the object envelope information of the object envelope, and the estimated sliding distance of the collaborative robot under the control of the controller is determined, and the estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot. The initial envelope of the collaborative robot can be updated according to the deceleration process of the collaborative robot under the control of the controller, and the collision prediction result of the collaborative robot under the control of the controller is determined based on the positional relationship between the updated envelope and the object envelope, so as to determine whether the collaborative robot will collide with the object to be avoided when decelerating to a standstill under the control of the controller. By using the above method to predict the collision situation of the collaborative robot, a dual-channel collision prediction can be realized in which the controller controls the movement and the safety module predicts the collision of the movement process. On the basis of ensuring the PLd safety level, the integrator's development capabilities for the safety board where the safety module is located are expanded. In addition, as long as the protocol information determined by the camera component is obtained, collision prediction can be performed. Even if there is an abnormality in the camera component, it will not affect the collision prediction process, thereby reducing the risk of the collision prediction process. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0037] Figure 1 A diagram showing an application environment of a dual-channel collision prediction method for a collaborative robot in one embodiment;

[0038] Figure 2 A schematic diagram of a flow chart of a dual-channel collision prediction method for a collaborative robot in one embodiment;

[0039] Figure 3 A system framework diagram of a collaborative robot device including a collaborative robot dual-channel collision prediction system in one embodiment;

[0040] Figure 4 is an analysis diagram of a human arm in one embodiment;

[0041] Figure 5A schematic diagram of a robot arm using a connecting rod collision model for combined protection in one embodiment;

[0042] Figure 6 A schematic diagram of a flow chart of a dual-channel collision prediction method for a collaborative robot in another embodiment;

[0043] Figure 7 It is a structural block diagram of a dual-channel collision prediction device for a collaborative robot in one embodiment;

[0044] Figure 8 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0046] The collaborative robot dual-channel collision prediction method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. Among them, the safety module 102 can interact with the camera component 104 to obtain the protocol information determined by the camera component 104 for the object to be avoided by the collaborative robot, and the controller 106 can control the collaborative robot 108 to move. Among them, the connection between the safety module 102 and the camera component 104 can be a wired connection or a wireless connection. The wireless connection can be, for example, Bluetooth, WIFI, etc., which are not limited here. Among them, the safety module 102 is a control board specifically designed to ensure the safety of the collaborative robot's movement. It mainly monitors the movement position, movement speed, joint torque, whole machine power, following error, etc. of the collaborative robot. The controller 106 is a set of hardware real-time layer below the control system and above the driver. The main task of this layer is to receive script instructions from the user, and then convert them into executable, constrained target position instructions for the robot hardware, and send them to the drive layer in a real-time control manner to drive the collaborative robot to move. The specific implementation method is to implement it through the planner. In this application, the constraint protocol enables the safety module 102 to support more functions, such as collision prediction of the collaborative robot involved in this application. The safety module 102 can also interact with the collaborative robot 108 to obtain the initial envelope radius of the collaborative robot 108, and can also update the initial envelope in the collaborative robot 108, and determine the collision prediction result of the collaborative robot 108. Specifically, in the process of performing dual-channel collision prediction of the collaborative robot, the safety module 102 obtains the initial envelope radius of the collaborative robot 108 and the protocol information determined by the camera component 104 for the object to be avoided by the collaborative robot 108; the protocol information is used to characterize the object envelope of the object to be avoided; the protocol information is parsed using the constraint protocol matching the protocol information to determine the object envelope information of the object envelope; the estimated sliding distance of the collaborative robot 108 under the control of the controller 106 is determined, and the estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot 108; based on the positional relationship between the updated envelope and the object envelope, the collision prediction result of the collaborative robot 108 under the control of the controller 106 is determined.

[0047] In an exemplary embodiment, Figure 2 As shown in the figure, a collaborative robot dual-channel collision prediction method is provided, and the method is applied to Figure 1 The security module in the example is used to illustrate, including:

[0048] Step S202, obtaining the initial envelope radius of the collaborative robot and the protocol information determined by the camera component for the object to be avoided by the collaborative robot.

[0049] Among them, a collaborative robot is a robot designed to directly interact and collaborate with human workers in the same working environment. Unlike traditional industrial robots, collaborative robots are specially designed to have higher safety, allowing them to work in close proximity with humans without physical isolation. The initial envelope radius refers to the envelope radius of the initial envelope of the collaborative robot. Among them, if a set of curves has a common boundary or surrounding area, this boundary or surrounding area can be called an envelope, and the envelope radius refers to the radius of this boundary curve to a reference point (such as the center of the curve). The camera component refers to an external camera device that can be used to collect data on the collaborative robot's object to be avoided and encode the data. The object to be avoided refers to a description of a person, object or obstacle that needs to be identified and avoided in a specific situation. The protocol information is used to characterize the object envelope of the object to be avoided.

[0050] Specifically, the same constraint protocol can be configured for the security module and the camera component, and the camera collects data on the object to be avoided by the collaborative robot, and then encodes the data according to the constraint protocol to obtain the protocol information of the object to be avoided. The security module can then obtain the protocol information determined by the camera component for the object to be avoided by the collaborative robot. Similarly, the security module also needs to obtain the initial envelope radius of the collaborative robot to determine the size of the initial envelope of the collaborative robot. Among them, the initial envelope of the collaborative robot can be pre-set, for example, it can include a capsule body, a rounded corner box, and a sphere. Furthermore, the process of obtaining the initial envelope radius and protocol information can be actively acquired or passively received.

[0051] For example, the protocol information may be expressed in the following format, where radius represents the radius of the object.

[0052] {

[0053] "ballCollision1":{

[0054] "offset":[0,-0.025,0.05],

[0055] "radius":0.11

[0056] }

[0057] "capsuleCollision1":{

[0058] "start": [0, 0, -0.09],

[0059] "end":[0, 0.23, -0.09],

[0060] "radius":0.045

[0061] }, ...

[0063] }

[0064] It should be noted that after the camera component detects the object to be avoided in the environment, it needs to convert the object to be avoided into a combination of multiple envelopes. For example, when the object to be avoided is a human body, the human body can be roughly divided into arms, torso, and head, and the arms can be divided into upper arms and lower arms. For obstacle avoidance of the human body, the approximate position of the skeletal control points of the human body in space can be determined by real-time skeletal recognition. Then the corresponding envelope is generated by the identified skeletal control points: for example, the upper and lower arms of the human body can be represented as capsules, the human torso can be represented as a rounded box, and the human head can be represented as a sphere, etc. Taking the desktop as an example, the table and the wall are obstacles that the robot arm needs to avoid. After the camera component recognizes them, the table and the wall can be marked as spatial planes preset by the constraint protocol, and the parameter information of the spatial plane can be transmitted to the security module externally through a secure channel.

[0065] Step S204: using the constraint protocol matching the protocol information, performing code parsing on the protocol information to determine object envelope information of the object envelope.

[0066] In network communication, a constraint protocol may refer to a set of rules for ensuring that the format, size, transmission rate, etc. of a data packet meet the requirements of network devices and protocols. Object envelope information refers to specific information of the object envelope. For example, when the object envelope is a capsule, the object envelope information may be the center, radius, highest point, and lowest point of the capsule.

[0067] Specifically, after obtaining the protocol information determined by the camera component for the object to be avoided by the collaborative robot, since the protocol information is edited in a specific form through a constraint protocol, it is necessary to use a constraint protocol that matches the protocol information to parse the protocol information and obtain the object envelope information of the object envelope. It can be understood that the number and type of object envelopes may be more than one. In a specific embodiment, the security module can obtain the camera identification information of the camera component, search the protocol database for the protocol corresponding to the camera identification information as the constraint protocol that matches the protocol information, and use the constraint protocol to parse the protocol information and determine the object envelope information of the object envelope. In another specific embodiment, a constraint protocol matching model can also be established, and the constraint protocol matching model can be used to obtain the constraint protocol that matches the protocol information, parse the protocol information and determine the object envelope information of the object envelope.

[0068] Step S206, determining the estimated sliding distance of the collaborative robot under the control of the controller, and superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot.

[0069] Among them, the controller is a hardware real-time layer below the control system and above the driver. The main task of this layer is to receive script instructions from the user, and then convert them into constrained target position instructions that can be executed by the robot hardware, and send them to the driver layer through real-time control to drive the collaborative robot to move. The specific implementation method is to implement it through the planner. The estimated sliding distance refers to the distance the collaborative robot slides when the speed becomes zero after the collaborative robot decelerates at the maximum deceleration speed. It is used to estimate whether the collaborative robot will collide with the object to be avoided when the speed becomes zero. The updated envelope refers to the envelope after the initial envelope is updated.

[0070] Specifically, in order to predict the collision between the collaborative robot and the object to be avoided, it is necessary to determine the estimated sliding distance of the collaborative robot under the control of the controller, that is, it is necessary to determine the distance the collaborative robot slides when the speed becomes zero after the collaborative robot decelerates at the maximum deceleration speed. The estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope radius, and the updated envelope radius corresponds to the updated envelope. In a specific embodiment, the safety module can obtain the maximum deceleration speed and the current movement speed of the collaborative robot, determine the estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed, superimpose the estimated sliding distance on the initial envelope radius, and obtain the updated envelope of the collaborative robot. In another specific embodiment, an estimated sliding distance model can also be established, with the parameters of the collaborative robot as input, and the output is the estimated sliding distance, and then the estimated sliding distance of the collaborative robot is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot.

[0071] Step S208, determining a collision prediction result of the collaborative robot under the control of the controller based on the positional relationship between the update envelope and the object envelope.

[0072] The position relationship refers to the positional intersection relationship between the update envelope and the object envelope. The collision prediction results include "collision" and "no collision".

[0073] Specifically, after determining the update envelope of the collaborative robot, it is possible to determine whether the collaborative robot and the object to be avoided will collide based on the positional relationship between the update envelope and the object envelope, and obtain the collision prediction result of the collaborative robot. It can be understood that the number of update envelopes and object envelopes can be one or more. In a specific embodiment, when there is one update envelope and multiple object envelopes, the positional relationship between the update envelope and each object envelope is determined. As long as there is a positional intersection between the update envelope and at least one object envelope, the collision prediction result of the collaborative robot is considered to be "collision". In another specific embodiment, when there are multiple update envelopes and one object envelope, the positional relationship between each update envelope and the object envelope is determined. As long as there is a positional intersection between at least one update envelope and the object envelope, the collision prediction result of the collaborative robot under the control of the controller is considered to be "collision". In another specific embodiment, when there are multiple update envelopes and multiple object envelopes, the positional relationship between each update envelope and each object envelope is determined. As long as there is an intersection between the positions of at least one update envelope and at least one object envelope, the collision prediction result of the collaborative robot under the control of the controller is considered to be "collision".

[0074] In the above-mentioned collaborative robot dual-channel collision prediction method, the initial envelope radius of the collaborative robot and the protocol information determined by the camera component for the object to be avoided of the collaborative robot are obtained, so as to determine the specific conditions of the collaborative robot and the object to be avoided, wherein the protocol information is used to characterize the object envelope of the object to be avoided, and the constraint protocol matching the protocol information is used to parse the protocol information, and the object envelope information of the object envelope is determined, and the estimated sliding distance of the collaborative robot under the control of the controller is determined, and the estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot. The initial envelope of the collaborative robot can be updated according to the deceleration process of the collaborative robot under the control of the controller, and the collision prediction result of the collaborative robot under the control of the controller is determined based on the positional relationship between the updated envelope and the object envelope, so as to determine whether the collaborative robot will collide with the object to be avoided when decelerating to a standstill under the control of the controller. By using the above method to predict the collision situation of the collaborative robot, a dual-channel collision prediction can be realized in which the controller controls the movement and the safety module predicts the collision of the movement process. On the basis of ensuring the PLd safety level, the integrator's development capabilities for the safety board where the safety module is located are expanded. In addition, as long as the protocol information determined by the camera component is obtained, collision prediction can be performed. Even if there is an abnormality in the camera component, it will not affect the collision prediction process, thereby reducing the risk of the collision prediction process.

[0075] In an exemplary embodiment, a constraint protocol that matches the protocol information is used to parse the protocol information to determine the object envelope information of the object envelope, including: obtaining camera identification information of the camera component; searching a protocol database for a protocol corresponding to the camera identification information as a constraint protocol that matches the protocol information; and using the constraint protocol to parse the protocol information to determine the object envelope information of the object envelope.

[0076] The camera identification information refers to the identification information of the camera component, and it can be understood that different camera components correspond to different camera identification information. The protocol database refers to a pre-established database containing multiple protocols.

[0077] Specifically, in order to ensure that the same constraint protocol is used as the camera component so that the code parsing is successful, the camera identification information of the camera component can be obtained first, and the protocol corresponding to the camera identification information can be searched in the protocol database according to the camera identification information, as the constraint protocol that matches the protocol information, and then the constraint protocol is used to perform code parsing on the protocol information to determine the object envelope information of the object envelope.

[0078] In this embodiment, the corresponding constraint protocol is determined according to the camera identification information of the camera assembly, which can ensure that the safety module and the camera assembly use the same constraint protocol, thereby ensuring the accuracy of the collision prediction.

[0079] In an exemplary embodiment, the constraint protocol is used to perform code parsing on protocol information to determine object envelope information of the object envelope, including: obtaining a data format corresponding to the constraint protocol; and performing code parsing on the protocol information based on the data format to determine object envelope information of the object envelope.

[0080] The data format of the constraint protocol usually refers to the format standard used to ensure that data meets specific constraints in network communication, data exchange or software interface. These constraints may include data type, size, range, precision, etc. The specific data format of the constraint protocol will depend on the specific protocol or field to which it is applied.

[0081] Specifically, each constraint protocol corresponds to a different data format. When parsing the protocol information, it is necessary to first determine the data format corresponding to the constraint protocol, and then parse the protocol information based on the data format to determine the object envelope information of the object envelope. For example, the corresponding data in the protocol information can be extracted according to the data format to determine the object envelope information of the object envelope.

[0082] In this embodiment, the protocol information is parsed according to the data format corresponding to the constraint protocol, which can ensure the normal progress of the code parsing process and further ensure the normal progress of the collision prediction process.

[0083] In an exemplary embodiment, an estimated sliding distance of the collaborative robot under the control of a controller is determined, and the estimated sliding distance is superimposed on an initial envelope radius to obtain an updated envelope of the collaborative robot, including: obtaining a maximum deceleration speed and a current movement speed of the collaborative robot; determining an estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed; and superimposing the estimated sliding distance on the initial envelope radius to obtain an updated envelope of the collaborative robot.

[0084] The maximum deceleration speed refers to the maximum deceleration speed of the collaborative robot during the deceleration process, which can represent the deceleration speed of the collaborative robot. The current movement speed refers to the movement speed of the collaborative robot at the current moment.

[0085] Specifically, the safety module can first obtain the maximum deceleration speed and current movement speed of the collaborative robot, and then calculate the estimated sliding distance of the collaborative robot from the final speed with a value of zero, the maximum deceleration speed and the current movement speed. After that, the estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot. In other words, the initial envelope of the collaborative robot needs to be expanded according to the estimated sliding distance to obtain the updated envelope.

[0086] In this embodiment, the estimated sliding distance of the collaborative robot is determined by the maximum deceleration speed and current movement speed of the collaborative robot, and the estimated sliding distance is superimposed on the initial envelope radius to obtain the updated envelope of the collaborative robot, which can ensure the accuracy of collision prediction.

[0087] In an exemplary embodiment, based on the positional relationship between the update envelope and the object envelope, the collision prediction result of the collaborative robot under the control of the controller is determined, including: subtracting the coordinates of each point in the update envelope from the coordinates of each point in the object envelope to obtain a coordinate difference set of the update envelope and the object envelope; when the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, it is determined that the collaborative robot will collide with the object to be avoided under the control of the controller.

[0088] The coordinate difference set refers to the set of coordinate differences between the coordinates of each point in the update envelope and the coordinates of each point in the object envelope, which can be combined into a geometric convex hull. The geometric convex hull is a concept in convex geometry, which refers to the smallest convex polygon or polyhedron of a point set, which contains all the points in the point set. In other words, if there are any line segments from the point set to the outside, they are completely contained by this smallest convex polygon or polyhedron, then this polygon or polyhedron is the convex hull of the point set.

[0089] Specifically, after determining the update envelope and the object envelope, the coordinates of each point in the update envelope and the coordinates of each point in the object envelope can be subtracted respectively to obtain the coordinate difference set of the update envelope and the object envelope. When the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, it is determined that the collaborative robot will collide with the object to be avoided. If the coordinate origin is not located in the geometric convex hull represented by the coordinate difference set, the collaborative robot will not collide with the object to be avoided.

[0090] In this embodiment, by determining whether the geometric convex hull represented by the coordinate difference set of the update envelope and the object envelope contains the origin, it is determined whether the collaborative robot will collide with the object to be avoided under the control of the controller, thereby improving the accuracy of collision prediction.

[0091] In an exemplary embodiment, a collaborative robot dual-channel collision prediction system is also provided, characterized in that the system includes: a camera component, and a safety module connected to the camera component; the camera component is used to determine protocol information for an object to be avoided by the collaborative robot; the protocol information is used to characterize the object envelope of the object to be avoided; and the safety module is used to implement the method in any one of the above embodiments.

[0092] The above-mentioned collaborative robot dual-channel collision prediction system obtains the initial envelope radius of the collaborative robot and the protocol information determined by the camera component for the object to be avoided by the collaborative robot, so as to determine the specific conditions of the collaborative robot and the object to be avoided, wherein the protocol information is used to characterize the object envelope of the object to be avoided, and the constraint protocol matching the protocol information is used to parse the protocol information, determine the object envelope information of the object envelope, determine the estimated sliding distance of the collaborative robot under the control of the controller, and superimpose the estimated sliding distance on the initial envelope radius to obtain the updated envelope of the collaborative robot. The initial envelope of the collaborative robot can be updated according to the deceleration process of the collaborative robot under the control of the controller, and the collision prediction result of the collaborative robot under the control of the controller is determined based on the positional relationship between the updated envelope and the object envelope, so as to determine whether the collaborative robot will collide with the object to be avoided when decelerating to a standstill under the control of the controller. By using the above method to predict the collision situation of the collaborative robot, a dual-channel collision prediction can be realized in which the controller controls the movement and the safety module predicts the collision of the movement process. On the basis of ensuring the PLd safety level, the integrator's development capabilities for the safety board where the safety module is located are expanded. In addition, as long as the protocol information determined by the camera component is obtained, collision prediction can be performed. Even if there is an abnormality in the camera component, it will not affect the collision prediction process, thereby reducing the risk of the collision prediction process.

[0093] In a specific embodiment, a collaborative robot device including a collaborative robot dual-channel collision prediction system is also provided. Figure 3, which is the overall system framework diagram. The collaborative robot device consists of three main components, among which the controller mainly processes the user program, and the robot includes a driver and a body. The safety controller is used to predict the collision of the collaborative robot. The safety controller is equivalent to the above-mentioned safety module and is set on the safety board of the collaborative robot.

[0094] Specifically, the input module includes safety channel 1 and safety channel 2, that is, an independent safety channel can be used to receive the position and speed information of the driver, and an independent industrial bus protocol can be used to receive the constraint protocol provided by the camera component. The constraint protocol has the following types: spatial plane, sphere, capsule, and rounded box.

[0095] The protocol information may be expressed in the following format, where radius represents the radius of the object.

[0096] {

[0097] "ballCollision1":{

[0098] "offset":[0,-0.025,0.05],

[0099] "radius":0.11

[0100] }

[0101] "capsuleCollision1":{

[0102] "start": [0, 0, -0.09],

[0103] "end":[0, 0.23, -0.09],

[0104] "radius":0.045

[0105] }, ...

[0107] }

[0108] After the camera component detects the object to be avoided in the environment, it needs to convert the object to be avoided into a combination of multiple envelopes. For example, when the object to be avoided is a human body, the human body can be roughly divided into arms, torso, and head. Figure 4As shown, the arm can be divided into the upper arm, arm and palm. For human obstacle avoidance, the approximate position of the human skeleton control points in space can be determined by real-time skeleton recognition. Then the corresponding envelope is generated through the identified skeleton control points: for example, the upper and lower arms of the human body can be represented as capsules, the human torso can be represented as a rounded box, the human head can be represented as a sphere, etc. Taking the desktop as an example, the table and the wall are obstacles that the robot needs to avoid. After the camera component recognizes them, the table and the wall can be marked as spatial planes preset by the constraint protocol, and the parameter information of the spatial plane can be transmitted to the security module externally through a secure channel.

[0109] Collision prediction module: The collision prediction process will take into account the specific deceleration braking distance and deceleration time of the collaborative robot's robotic arm. The estimated maximum sliding distance can be obtained by combining the current movement speed of the collaborative robot obtained in safety channel 1 with the maximum deceleration speed of the collaborative robot. The safety module parses the protocol information and converts the content in the protocol information into the object envelope information for internal judgment and negotiation in the safety module. The actual radius of the robot's updated envelope will be superimposed on the estimated sliding distance based on the user's given value to ensure the user's safety. Finally, the updated envelope is represented in the base coordinate system of the robotic arm body. Perform collision prediction. The body of the robotic arm is also identified as a combination of a sphere, a capsule, and a rounded box. At the same time, the joint position of the robotic arm is obtained from safety channel 1, and a spatial scanning model of the connecting rod is generated. The update envelope and object envelope judgment negotiation are called collision prediction. The specific detection algorithm we use is GJK (Gilbert-Johnson-Keerthi algorithm) for fast collision detection. Among them, such as Figure 5 As shown, the robot arm uses a link collision model for combined protection, x-axis refers to the x-axis, y-axis refers to the y-axis, and z-axis refers to the z-axis.

[0110] Output module: The output module contains safety I / O and virtual I / O. When an abnormality occurs, the safety I / O will change the level of the external IO of the collaborative robot's electrical box and trigger a Cat1 emergency stop. If the collaborative robot is detected to have not stopped moving within the maximum deceleration time, the robot arm will trigger a Cat0 emergency stop. Virtual IO will be displayed on the user software and is not an immediate module.

[0111] In this embodiment, the integrator's development capabilities for safety boards can be expanded on the basis of ensuring the PLd (one of the performance levels (PL) defined in the ISO 13849-1 standard) safety level. And the architecture meets the PLd safety level requirements, and the functional abnormality of the main controller will not affect the normal use of the safety protection function. Even if the host computer's processing of environmental data or control program is abnormal, the protection function of the direct connection between the camera component and the collaborative robot can play a normal protective role (as long as the constraints output by the camera component can be stably issued, but the correctness and stability of the constraints need to be guaranteed by the visual algorithm).

[0112] Improvement of safety monitoring frequency: This method increases the monitoring frequency. Compared with the traditional host computer software that handles safety functions externally and may cause communication frame loss and other problems, the safety module monitors the safety of robot constraints at a fixed period, which is undoubtedly more reasonable in architecture for high-speed moving robots.

[0113] Better scalability: The communication protocol is expected to adapt to more sensors, such as ultrasonic sensors, infrared imaging, etc.

[0114] In a specific embodiment, Figure 6 As shown, a collaborative robot dual-channel collision prediction method is also provided, including:

[0115] Step S601, obtaining an initial envelope radius of the collaborative robot and protocol information determined by the camera component for an object to be avoided by the collaborative robot;

[0116] Among them, the protocol information is used to characterize the object envelope of the object to be avoided;

[0117] Step S602, obtaining the camera identification information of the camera component, and searching the protocol database for the protocol corresponding to the camera identification information as the constraint protocol matching the protocol information;

[0118] Step S603, obtaining a data format corresponding to the constraint protocol, performing code parsing on the protocol information based on the data format, and determining object envelope information of the object envelope;

[0119] Step S604, obtaining the maximum deceleration speed and the current movement speed of the collaborative robot, and determining the estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed;

[0120] Step S605, superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot;

[0121] Step S606, calculating the difference between the coordinates of each point in the update envelope and the coordinates of each point in the object envelope, to obtain a coordinate difference set between the update envelope and the object envelope;

[0122] Step S607: When the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, it is determined that the collaborative robot will collide with the object to be avoided under the control of the controller.

[0123] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0124] Based on the same inventive concept, the embodiment of the present application also provides a collaborative robot dual-channel collision prediction device for implementing the collaborative robot dual-channel collision prediction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more collaborative robot dual-channel collision prediction device embodiments provided below can refer to the limitations of the collaborative robot dual-channel collision prediction method above, and will not be repeated here.

[0125] In an exemplary embodiment, Figure 7 As shown, a collaborative robot dual-channel collision prediction device 700 is provided, including: a protocol information acquisition module 702, a code parsing module 704, an update envelope determination module 706 and a collision prediction result determination module 708, wherein:

[0126] The protocol information acquisition module 702 is used to acquire the initial envelope radius of the collaborative robot and the protocol information determined by the camera component for the object to be avoided by the collaborative robot; the protocol information is used to characterize the object envelope of the object to be avoided;

[0127] A code parsing module 704, configured to perform code parsing on the protocol information using a constraint protocol matching the protocol information, and determine object envelope information of the object envelope;

[0128] An updated envelope determination module 706 is used to determine an estimated sliding distance of the collaborative robot under the control of the controller, and to superimpose the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot;

[0129] The collision prediction result determination module 708 is used to determine the collision prediction result of the collaborative robot under the control of the controller based on the positional relationship between the update envelope and the object envelope.

[0130] In an exemplary embodiment, the code parsing module 704 includes: a camera identification information acquisition component, used to obtain the camera identification information of the camera component; a database search component, used to search the protocol database for the protocol corresponding to the camera identification information as a constraint protocol matching the protocol information; a code parsing component, used to perform code parsing on the protocol information using the constraint protocol to determine the object envelope information of the object envelope.

[0131] In an exemplary embodiment, the code parsing component is specifically used to: obtain a data format corresponding to the constraint protocol; perform code parsing on the protocol information based on the data format to determine the object envelope information of the object envelope.

[0132] In an exemplary embodiment, the updated envelope determination module 706 is specifically used to: obtain the maximum deceleration speed and current movement speed of the collaborative robot; determine the estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed; and superimpose the estimated sliding distance on the initial envelope radius to obtain the updated envelope of the collaborative robot.

[0133] In an exemplary embodiment, the collision prediction result determination module 708 is specifically used to: calculate the difference between the coordinates of each point in the update envelope and the coordinates of each point in the object envelope, and obtain the coordinate difference set of the update envelope and the object envelope; when the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, determine that the collaborative robot will collide with the object to be avoided under the control of the controller.

[0134] Each module in the above collaborative robot dual-channel collision prediction device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0135] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 8As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, a mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, a collaborative robot dual-channel collision prediction method is realized. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0136] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0137] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps of the above method when executing the computer program.

[0138] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0139] In one embodiment, a computer program product is provided, comprising a computer program, which implements the steps of the above method when executed by a processor.

[0140] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0141] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0142] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0143] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A collaborative robot dual-channel collision prediction method, characterized in that: The method comprises: Acquire an initial envelope radius of the collaborative robot and protocol information determined by the camera component for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided; Using a constraint protocol matching the protocol information, performing code parsing on the protocol information to determine object envelope information of the object envelope; Determining an estimated sliding distance of the collaborative robot under the control of a controller, and superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot; Based on the positional relationship between the update envelope and the object envelope, a collision prediction result of the collaborative robot under the control of the controller is determined.

2. The method according to claim 1, characterized in that: The using a constraint protocol matching the protocol information to perform code parsing on the protocol information to determine the object envelope information of the object envelope includes: Obtaining camera identification information of the camera component; Searching a protocol database for a protocol corresponding to the camera identification information as a constraint protocol matching the protocol information; The protocol information is parsed using the constraint protocol to determine object envelope information of the object envelope.

3. The method according to claim 2, characterized in that The using the constraint protocol to perform code parsing on the protocol information to determine the object envelope information of the object envelope includes: Obtaining the data format corresponding to the constraint protocol; The protocol information is parsed based on the data format to determine object envelope information of the object envelope.

4. The method according to claim 1, characterized in that: The step of determining an estimated sliding distance of the collaborative robot under the control of the controller, and superimposing the estimated sliding distance to the initial envelope radius to obtain an updated envelope of the collaborative robot includes: Obtaining the maximum deceleration speed and current movement speed of the collaborative robot; determining an estimated sliding distance of the collaborative robot based on the maximum deceleration speed and the current movement speed; The estimated sliding distance is superimposed on the initial envelope radius to obtain an updated envelope of the collaborative robot.

5. The method according to claim 1, characterized in that The step of determining a collision prediction result of the collaborative robot under the control of the controller based on a positional relationship between the update envelope and the object envelope comprises: The coordinates of each point in the update envelope are calculated to be different from the coordinates of each point in the object envelope, so as to obtain a coordinate difference set between the update envelope and the object envelope; When the coordinate origin is located in the geometric convex hull represented by the coordinate difference set, it is determined that the collaborative robot will collide with the object to be avoided under the control of the controller.

6. A collaborative robot dual-channel collision prediction system, characterized in that: The system includes: a camera assembly, and a security module connected to the camera assembly; The camera component is used to determine protocol information for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided; The security module is used to implement the method according to any one of claims 1 to 5.

7. A collaborative robot dual-channel collision prediction device, characterized in that: The device comprises: A protocol information acquisition module, used to acquire an initial envelope radius of the collaborative robot and protocol information determined by the camera component for an object to be avoided by the collaborative robot; the protocol information is used to characterize an object envelope of the object to be avoided; A code parsing module, used to perform code parsing on the protocol information using a constraint protocol matching the protocol information, and determine object envelope information of the object envelope; An updated envelope determination module is used to determine an estimated sliding distance of the collaborative robot under the control of the controller, and to superimpose the estimated sliding distance onto the initial envelope radius to obtain an updated envelope of the collaborative robot; A collision prediction result determination module is used to determine the collision prediction result of the collaborative robot under the control of the controller based on the positional relationship between the update envelope and the object envelope.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Multi-target collision prediction system for industrial robot

    CN215729339U

  • Method, for preventing collisions between industrial robots and other objects, involves checking predicted path configuration by distance / obstruction algorithms, stopping robot / other objects if collision impending

    DE10226140A1

  • Method and control device for avoiding collisions between cooperating robots

    US20030225479A1

  • Humanoid robot push recovery on level and non-level ground

    US20120245734A1

  • A method and a device for avoiding collisions between an industrial robot and an object

    WO2008031664A1