Workspace determination method, device, equipment and storage medium

By determining the target points of the initial position of the robot arm and the target tool movement, the problem of low execution efficiency of the robot arm task is solved, efficient work space determination is achieved, and work efficiency and fluency are improved.

CN118219265BActive Publication Date: 2024-11-19BEIJING NATONG MEDICAL ROBOT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410420564.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-09
Publication Date
2024-11-19
Estimated Expiration
2044-04-09

AI Technical Summary

Technical Problem

In the application scenario of robotic arms, the prior art requires repeated adjustments and verification of target points to ensure that robotic arms can perform tasks, resulting in reduced operating efficiency.

Method used

By obtaining the initial position of the robot arm, the target point reached by the movement of the target tool is determined, which meets the working posture of the target task, and then determines the work space to avoid repeated adjustments and verification of position points.

Benefits of technology

It improves the working efficiency of the robotic arm, directly executes target tasks in the determined workspace, simplifies the workspace calculation method, and enhances the fluency of execution of tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118219265B_ABST
    Figure CN118219265B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a method, device, equipment and storage medium for determining a workspace. The method includes: obtaining the initial posture of the robotic arm when the target tool carried by the robotic arm is to perform a target task; determining the target point reached by the target tool when the robotic arm carries the target tool based on the initial posture; wherein the target point is the position point where the posture of the target tool satisfies the working posture corresponding to the target task; and determining the workspace corresponding to the target task according to the target point. Thus, the target point where the robotic arm drives the target tool to move in the working posture by the initial posture is determined, and the workspace capable of performing the target task is determined according to the target point, so that the points within the workspace are points capable of completing the target task, and the position points for performing the target task are subsequently directly determined in the workspace, avoiding repeated adjustment and verification of the position points, and improving the operation efficiency of the robotic arm.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of robotic arm technology, and in particular to a workspace determination method, device, equipment and storage medium. Background Art

[0002] With the development of the robotic arm industry, the application of robotic arms is becoming more and more extensive in all walks of life.

[0003] In the related art, after setting the position point that the target tool of the robot arm is to reach, it is verified whether the target tool can perform the task after reaching the position point. If not, it is necessary to repeatedly adjust and verify the position point. However, repeated adjustment and verification of the target point will significantly reduce the operating efficiency of the robot arm. Summary of the invention

[0004] In order to solve the above technical problems, the present disclosure provides a workspace determination method, apparatus, device and storage medium.

[0005] In a first aspect, the present disclosure provides a method for determining a workspace, the method comprising:

[0006] Acquire the initial position of the robotic arm when a target tool carried by the robotic arm is to perform a target task;

[0007] Determine a target point reached by the target tool when the robot arm carries the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task;

[0008] According to the target point, a workspace corresponding to the target task is determined.

[0009] In a second aspect, the present disclosure provides a workspace determination device, the device comprising:

[0010] An acquisition module, used to acquire the initial position and posture of the robotic arm when a target tool carried by the robotic arm is to perform a target task;

[0011] A first determination module is used to determine a target point reached by the target tool when the robot arm carries the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task;

[0012] The second determination module is used to determine the workspace corresponding to the target task according to the target point.

[0013] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the device comprising:

[0014] one or more processors;

[0015] a storage device for storing one or more programs,

[0016] When one or more programs are executed by one or more processors, the one or more processors implement the method provided in the first aspect.

[0017] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method provided in the first aspect is implemented.

[0018] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0019] A method, device, equipment and storage medium for determining a workspace according to an embodiment of the present disclosure obtains the initial posture of a robotic arm when a target tool carried by the robotic arm is to perform a target task; determines the target point reached by the target tool when the robotic arm carries the target tool based on the initial posture; wherein the target point is the position point where the posture of the target tool satisfies the working posture corresponding to the target task; and determines the workspace corresponding to the target task according to the target point. Thus, the target point where the robotic arm drives the target tool to move in the working posture is determined, and the workspace capable of performing the target task is determined according to the target point, so that the points within the workspace are points capable of completing the target task, and subsequently the position points for performing the target task are directly determined within the workspace, thereby avoiding repeated adjustment and verification of the position points and improving the operating efficiency of the robotic arm. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A flowchart of a method for determining a workspace provided in an embodiment of the present disclosure;

[0023] Figure 2 A flowchart of another workspace determination method provided by an embodiment of the present disclosure;

[0024] Figure 3 A schematic diagram of a process for determining a target point provided by an embodiment of the present disclosure;

[0025] Figure 4 A flowchart of another method for determining a working range provided in an embodiment of the present disclosure;

[0026] Figure 5 A schematic diagram of extracting envelope points provided by an embodiment of the present disclosure;

[0027] Figure 6 A schematic diagram of a coordinate system and space provided for an embodiment of the present disclosure;

[0028] Figure 7 A schematic diagram of a method for determining a workspace provided in an embodiment of the present disclosure;

[0029] Figure 8 A schematic diagram of the structure of a workspace determination device provided in an embodiment of the present disclosure;

[0030] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0031] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0032] With the development of the robotic arm industry, the application of robotic arms is becoming more and more extensive in all walks of life.

[0033] In some application scenarios of the robotic arm, it is necessary to limit the working posture of the target tool carried by the robotic arm. In the related art, the reachable space refers to the space that the robotic arm carrying the target tool can reach from at least one direction. The reachable space can be determined by algebraic solutions, geometric solutions, numerical solutions, etc. Among them, the algebraic solution is applicable to the robotic arm structure that is relatively simple and less intuitive, the geometric solution is more cumbersome for the robotic arm with complex structure, and the input of the numerical solution makes it difficult for the joint angle of the robotic arm to correspond to the space.

[0034] After determining the reachable space, the user can set the position point that the target tool of the robot arm needs to reach in the reachable space, and verify whether the target tool can perform the task after reaching the position point. If the target tool cannot perform the task at the position point, the user needs to readjust the position point and re-verify the new position point obtained by the adjustment. However, repeated adjustment and verification of the position point will significantly reduce the operating efficiency of the robot arm.

[0035] In order to solve at least one of the above technical problems, the workspace determination method provided by the embodiment of the present disclosure is described below. In the embodiment of the present disclosure, the workspace determination method can be performed by an electronic device. The electronic device can be a controller of a robot such as a surgical robot. The electronic device can include a tablet computer, a desktop computer, a laptop computer, and other devices with communication functions.

[0036] Figure 1 FIG. 1 is a flow chart of a method for determining a workspace provided by an embodiment of the present disclosure. Figure 1 As shown, the workspace determination method may include the following steps.

[0037] Step 101, obtaining the initial posture of the robotic arm when a target tool carried by the robotic arm is to perform a target task.

[0038] Among them, the robot arm can be used as a robot to perform tasks, and this embodiment does not limit the type of the robot arm. For example, the robot arm may include one of a surgical robot arm, an industrial assembly robot arm, and a safety explosion-proof robot arm. The target tool may be a tool connected to the robot arm, and the target tool may be an end tool connected to the end of the robot arm. This embodiment does not limit the type of the target tool. For example, the target tool may include one or more of a grinding head, a washboard, a scalpel, and a syringe. The target task may be a task to be performed by the target tool. This embodiment does not limit the type of the target task. For example, the target task may be an injection task for a target object. The target object may be the execution correspondence of the target task. The initial posture may be the posture of the robot arm when the target tool is located at a transition point. The transition point may be a position point where the target tool is located when the target tool is waiting to perform the target task. The transition point may be a position point where the target tool is located before visual guidance of the robot arm and is ready to perform the target task.

[0039] In an embodiment of the present disclosure, the workspace determination device can adjust the target tool carried by the robot arm to the transition point of the target task, and determine the posture of the robot arm when the target tool is at the transition point as the initial posture.

[0040] Step 102, determining the target point to be reached by the target tool when the robot arm moves with the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task.

[0041] The working posture may be the angle range that the target tool needs to reach when performing the target task. This embodiment does not limit the working posture. For example, the working posture may include: the target tool is vertically downward, or the target tool rotates around the Z axis.

[0042] In an embodiment of the present disclosure, the workspace determination device can obtain the working posture required for the target tool to perform the target task, and after determining the initial posture of the robotic arm, determine the position point in the initial space that the target tool can reach with the working posture as the target point, with the initial posture of the robotic arm as the starting posture.

[0043] Figure 2 A flowchart of another workspace determination method provided by an embodiment of the present disclosure is shown as follows: Figure 2 As shown, in some embodiments of the present disclosure, determining that the robot arm moves with the target tool based on the initial posture and the target point reached by the target tool includes:

[0044] Step 201, discretize the initial space according to a preset distance step to obtain a plurality of initial points.

[0045] The preset distance step may be a preset step for discretizing the initial space, and the preset distance step may be set according to user requirements, etc., and is not limited in this embodiment. For example, the preset distance step may be 1 mm. The initial space may be a sufficiently large three-dimensional space, and the initial space may be a three-dimensional space including the reachable space of the robot arm.

[0046] In this embodiment, the working space determining device can discretize the initial space in the horizontal, longitudinal and vertical directions according to a preset distance step, and determine the obtained multiple discrete points as multiple initial points.

[0047] Step 202: Determine multiple working postures corresponding to each initial point according to multiple initial points and working postures.

[0048] The working posture may be the posture that the target tool needs to reach if the target tool performs the target task at the initial point. The working posture may be the posture of the target tool obtained by determining the position based on the initial point and the angle based on the working posture.

[0049] In this embodiment, the workspace determination device can combine each initial point with the working posture to obtain multiple working postures corresponding to each initial point. Optionally, the workspace determination device can convert the working posture from being described in the base coordinate system of the robot arm to being described in the flange coordinate system of the robot arm, so as to perform inverse kinematics solution later.

[0050] In some embodiments of the present disclosure, based on multiple initial points and working postures, multiple working postures corresponding to each initial point are determined, including:

[0051] The working postures are divided according to the preset angle step to obtain multiple working angles; for each initial point, the initial point and the multiple working angles are respectively combined to obtain multiple working postures corresponding to the initial point.

[0052] The preset angle step may be a preset step for discretizing the working posture, and the preset angle step may be set according to user requirements, etc., and is not limited in this embodiment. For example, the preset angle step may be 5 degrees.

[0053] In this embodiment, the workspace determination device can divide the working posture into angle intervals with a preset angle step length, and obtain multiple working angles within the working posture. For example, if the working posture is a rotation around the Z axis and the preset angle step length is 5 degrees, the working angle can be an angle obtained by traversing from 0 degrees to 360 degrees with an angle interval of 5 degrees. Further, for each initial point, the initial point is combined with multiple working angles to obtain multiple working postures corresponding to the initial point.

[0054] Step 203: If the robot arm moves with the target tool based on the initial posture, and the target tool reaches a plurality of working postures corresponding to the initial point at the initial point, the initial point is determined as the target point.

[0055] In this embodiment, the initial posture of the robot arm is taken as the starting posture. If the target tool can reach the working posture corresponding to the position point at this position point, that is, reach the working posture corresponding to the position point, then the workspace determination device can determine the position point as the target point.

[0056] In some embodiments of the present disclosure, if the robot arm moves with the target tool based on the initial posture, and the target tool reaches multiple working postures corresponding to the initial point at the initial point, the initial point is determined as the target point, including:

[0057] Multiple working postures are respectively determined as postures to be processed; inverse kinematics is solved for the initial posture and the posture to be processed. If a solution exists, the solution is within the joint motion range of the robot arm, and the posture to be processed is not a singular position of the robot arm, then it is determined that the posture to be processed passes the detection; if multiple working postures corresponding to the initial point all pass the detection, the initial point is determined as the target point.

[0058] Among them, the posture to be processed can be one of multiple working postures, and the posture to be processed can be understood as the posture currently being processed. The solution result can be the inverse kinematics solution result determined according to the initial posture and the posture to be processed, and the solution result can include the joint angles of each axis of the robot. The joint motion range can be the motion angle range of each axis of the robot. The singular position is also called a singular position or a singular point, and the singular position can be a position that has a negative impact on the motion performance and control stability of the robot.

[0059] In this embodiment, the workspace determination device can determine the working postures as the postures to be processed respectively, and for each posture to be processed, perform inverse kinematics solution according to the initial posture and the posture to be processed through a preset inverse kinematics algorithm. This embodiment does not limit the preset inverse kinematics algorithm, and the preset inverse kinematics algorithm may include the inverse solution algorithm of the robot arm, or other robot arm inverse solution algorithms. If there is no solution result, the next initial point is calculated. If there is a solution result, it is determined whether the joint angles of each axis in the solution result are within the joint motion range corresponding to each axis. If there is at least one axis whose joint angle is outside the joint motion range corresponding to the axis, the next initial point is calculated; if the joint angles corresponding to each axis are all within the joint motion range corresponding to each axis, it is determined whether the posture to be processed is a singular position. If so, the next initial point is calculated, otherwise, it is determined that the posture to be processed passes the test.

[0060] Furthermore, if multiple to-be-processed postures corresponding to the initial point all pass the detection, the initial point is determined as the target point.

[0061] Figure 3 A schematic diagram of a process for determining a target point provided by an embodiment of the present disclosure, such as Figure 3 As shown in FIG. 1 , the process of determining the target point includes:

[0062] Step 301, set a preset distance step and a preset angle step. Specifically, for the traversal of the initial space, the initial space needs to be discretized and a preset distance step is set. For example, the preset distance step can be 1 mm. For the traversal of the working posture, the working posture needs to be discretized and a preset angle step is set. For example, the preset angle step can be 5 degrees.

[0063] Step 302: Discretize the initial space to obtain a plurality of initial points. Specifically, the initial space is discretely traversed in the X-axis direction, the Y-axis direction, and the Z-axis direction with a preset distance step length to obtain the initial points in the initial space.

[0064] Step 303, traverse the initial points. Traverse the initial points in the initial space in sequence.

[0065] Step 304: For each initial point, traverse within the working posture. For each initial point, traverse within the limited working posture angle range according to the preset angle step. For example, if the working posture is to rotate only around the Z direction, and the preset angle step is 5 degrees, then discrete traversal is performed every 5 degrees from 0 to 360 degrees.

[0066] Step 305, combine the working angle with the initial point to obtain the working posture. For each working angle obtained by traversal, combine the working angle with the corresponding initial point to obtain the working posture, which is the posture that the target tool of the robot arm is expected to achieve. In the case where the target tool is the working posture, that is, the coordinate system of the target tool coincides with the coordinate system of the target object to be executed, the working posture can be described as in, It is the description of the target tool coordinate system relative to the base coordinate system of the robot.

[0067] Step 306: convert the working posture into a description in the robot flange coordinate system. Specifically, if the tool parameters of the target tool are If the target tool is the end tool, the coordinate system of the target tool is the flange coordinate system of the end of the robot arm. The description of the working posture in the robot arm flange coordinate system is Can be:

[0068] Step 307, determine whether there is a solution for inverse kinematics. Specifically, the working posture in the flange coordinate system Combined with the initial position of the robot arm, the inverse solution algorithm interface provided by the robot arm itself or other inverse solution algorithms of the robot arm are used to perform inverse kinematics solution. If there is a solution result, step 308 is executed; otherwise, step 313 is executed.

[0069] Step 308 , judging whether the solution result exceeds the limit. Specifically, judging whether the solution result exceeds the set joint motion range, if it exceeds the joint motion range, executing step 313 ; otherwise, executing step 309 .

[0070] Step 309, determine whether the working posture is a singular position. If yes, execute step 313; otherwise, execute step 310.

[0071] Step 310, determine whether the working posture of the initial point is traversed. If yes, execute step 311; otherwise, execute step 304.

[0072] Step 311, determine whether the working postures of the initial point have all passed the test. If so, it means that the working postures of the initial point have all completed the traversal and passed the test, then execute step 312; otherwise, execute step 313.

[0073] Step 312: determine the initial point as the target point.

[0074] Step 313, determine whether the traversal of the initial point is completed. If so, the traversal of the initial point is completed; otherwise, execute step 303 to continue traversing the initial point;

[0075] Thus, by checking whether the target tool driven by the robot arm can reach the corresponding working posture at the initial point, the set of target points corresponding to the robot arm is determined.

[0076] In the above scheme, the working posture is tested in multiple dimensions to determine whether there is an inverse kinematics solution, whether the solution is within the range of joint motion, and whether it is a singular position. This determines whether the robot arm can drive the target tool to reach the working posture, and the corresponding working posture is determined as the target point through verification of the initial point, which lays the foundation for the subsequent determination of the continuous space.

[0077] Step 103: determine the workspace corresponding to the target task according to the target point.

[0078] The workspace is also called a limited workspace, which can be a three-dimensional space range defined for the target tool to implement the target task. It can be understood that if the target tool is located at a point in the workspace, the posture that the target tool can achieve includes the working posture.

[0079] In the embodiment of the present disclosure, after determining the target point, the workspace determination device may divide the workspace in which the target tool can perform the target task in the initial space according to the target point.

[0080] Figure 4 A flowchart of another method for determining a working range provided in an embodiment of the present disclosure is shown as follows: Figure 4 As shown, in some embodiments of the present disclosure, there are multiple target points, and according to the target points, determining the workspace corresponding to the target task includes:

[0081] Step 401, determining a continuous area according to a target point.

[0082] The continuous region may be a spatially continuous three-dimensional space, and the continuous space may be understood as a three-dimensional space without interruptions or intervals.

[0083] In this embodiment, after determining the target point, the workspace determination device may input the position of the target point into a preset spatial algorithm to obtain a continuous area. The spatial algorithm may be an algorithm for determining a continuous area composed of points, and this embodiment does not limit the continuous area algorithm.

[0084] In some embodiments of the present disclosure, the workspace determination method further includes:

[0085] In the calculation initial space, the robot arm moves with the target tool based on the initial posture, and multiple exclusion points that the target tool cannot reach in the working posture.

[0086] The exclusion point may be a position point at which the posture of the target tool does not satisfy the working posture.

[0087] In this embodiment, the working space determination device can determine other initial points in the preset space except the target point as exclusion points. It can be understood that the exclusion point is an initial point excluded in the process of determining the target point, that is, the posture of the target tool at the exclusion point cannot contain the working sub-posture.

[0088] Accordingly, according to the target point, a continuous area is determined, including:

[0089] The target point and multiple exclusion points are visually displayed to the user; the continuous area information input by the user is obtained, and the continuous area is determined according to the continuous area information.

[0090] The continuous region information may be information characterizing the continuous region that is determined by the user based on the visualized target points and exclusion points and is used to interact with the workspace determination device. The continuous region information may be boundary line information or boundary point information of the continuous region.

[0091] In this embodiment, the workspace determination device can visualize the target points and exclusion points in the initial space to the user through three-dimensional software, and the display styles of the target points and exclusion points can be different. The user visually inspects the continuous area formed by the target points in the initial space, and generates continuous area information through touch, mouse input, keyboard input, etc., and sends the continuous area information to the workspace determination device. After receiving the continuous area information, the workspace determination device performs space fitting according to the continuous area information to obtain a continuous area.

[0092] In the above solution, by visually displaying the exclusion points and the target points to the user at the same time, the exclusion points can contrast the discontinuous areas, so that the user can observe the target points more intuitively, thereby improving the accuracy of the subsequent determined continuous areas.

[0093] Step 402: extract envelope points of the continuous region, perform surface reconstruction on the envelope points, and obtain a workspace.

[0094] The envelope point may be a point defining the boundary of the continuous region. The inside and outside of the continuous region may be separated by the envelope point. The shape, size, position, etc. of the continuous region may be characterized by the envelope point.

[0095] In this embodiment, the workspace determination device can extract the envelope points located at the boundary of the continuous region, delete other points in the continuous region, and calculate the envelope points through a preset surface reconstruction algorithm to obtain a three-dimensional patch mesh model, and the space within the patch mesh model is the workspace. There are many surface reconstruction algorithms, which are not limited in this embodiment. For example, the surface reconstruction algorithm can include: any one of: Poisson surface reconstruction algorithm, ball pivot surface reconstruction algorithm, and surface reconstruction algorithm built into the three-dimensional software.

[0096] In some embodiments of the present disclosure, extracting envelope points of a continuous region includes:

[0097] A continuous area is divided into a plurality of sections according to a first preset distance in a first preset direction; for each section, the section is divided into a plurality of line segments according to a second preset distance in a second preset direction; an envelope point is determined according to a first maximum point and a first minimum point of the continuous area in the first preset direction, a second maximum point and a second minimum point of each section in the second preset direction, and a third maximum point and a third minimum point of each line segment in a third preset direction; wherein the first preset direction, the second preset direction, and the third preset direction are different directions.

[0098] Among them, the first preset direction, the second preset direction, and the third preset direction may be three directions perpendicular to each other, for example, the first preset direction, the second preset direction, and the third preset direction may be horizontal, vertical, and longitudinal, respectively. The first preset distance may be the distance between adjacent sections into which the continuous area is divided in the first preset direction, and the second preset distance may be the distance between adjacent line segments into which the section is divided in the second preset direction. The values ​​of the first preset distance and the second preset distance may be the same. Optionally, the values ​​of the first preset distance, the second preset distance, and the preset distance step may all be the same.

[0099] In this embodiment, the workspace determination device can divide the continuous area into multiple sections perpendicular to the first preset direction according to the first preset distance in the first preset direction, and determine the point corresponding to the maximum value of the continuous area in the first preset direction as the first maximum point, determine the point corresponding to the minimum value of the continuous area in the first preset direction as the first minimum point, and determine the first maximum point and the first minimum point as envelope points.

[0100] For each section, the workspace determination device can divide the section into multiple line segments perpendicular to the second preset direction according to the second preset distance in the second preset direction, and determine the point corresponding to the maximum value of the section in the second preset direction as the second maximum point, determine the point corresponding to the minimum value of the section in the second preset direction as the second minimum point, and determine the second maximum point and the second minimum point as envelope points.

[0101] For each line segment, the point corresponding to the maximum value of the line segment in the third preset direction is determined as the third maximum point, the point corresponding to the minimum value of the line segment in the third preset direction is determined as the third minimum point, and the third maximum point and the third minimum point are determined as envelope points.

[0102] Figure 5 A schematic diagram of extracting envelope points provided by an embodiment of the present disclosure, such as Figure 5As shown, the workspace determination device can traverse the continuous area corresponding to the target task in the X-axis direction, the Y-axis direction, and the Z-axis direction respectively. For example, if the first preset direction is the Y-axis direction, the second preset direction is the Z-axis direction, and the third preset direction is the X-axis direction, the first maximum point corresponding to the maximum value in the first preset direction and the first minimum point corresponding to the minimum value are retained. The first preset direction is traversed according to the first preset distance to obtain multiple sections that are perpendicular to the first preset direction and separated by the first preset distance. For each section cut by the first preset direction, the second maximum point corresponding to the maximum value in the second preset direction and the second minimum point corresponding to the minimum value are retained. For the line segment cut by the second preset direction, the third maximum point corresponding to the maximum value in the third preset direction in the section determined by traversing the third preset distance on the third preset direction and the third minimum point corresponding to the minimum value in the third preset direction are determined. The third maximum point and the third minimum point are retained. Further, the retained first maximum point, first minimum point, second maximum point, second minimum point, third maximum point, and third minimum point are determined as envelope points.

[0103] In the above scheme, the continuous area is divided according to the first preset distance in the first preset direction, and the maximum point and the minimum point in the first preset direction are obtained; the section is divided according to the second preset distance in the second preset direction, and the maximum point and the minimum point in the second preset direction are obtained; the maximum point and the minimum point are obtained in the third preset direction, thereby realizing the acquisition of the maximum point and the minimum point based on multiple directional dimensions, so that the finally determined envelope point can more accurately characterize the continuous area.

[0104] A method for determining a workspace according to an embodiment of the present disclosure obtains the initial posture of the robotic arm when the target tool carried by the robotic arm is to perform a target task; determines the target point reached by the target tool when the robotic arm carries the target tool based on the initial posture; wherein the target point is the position point where the posture of the target tool satisfies the working posture corresponding to the target task; and determines the workspace corresponding to the target task according to the target point. Thus, the target point where the robotic arm drives the target tool to move in the working posture is determined, and the workspace capable of performing the target task is determined according to the target point, so that the points within the workspace are points capable of completing the target task, and subsequently the position point for performing the target task is directly determined within the workspace, thereby avoiding repeated adjustment and verification of the position point and improving the operation efficiency of the robotic arm.

[0105] In addition, by using virtual target points and inversely calculating the workspace, the workspace calculation method is simplified, creating a basis for more directly establishing the correspondence between the execution space and the workspace.

[0106] Figure 6A schematic diagram of a coordinate system and space provided in an embodiment of the present disclosure, such as Figure 6 As shown, Figure 6 Coordinate system B represents the base coordinate system of the robot; coordinate system E represents the flange coordinate system at the end of the robot; coordinate system T represents the tool coordinate system at the end of the robot; coordinate system O is the coordinate system of the target object of the vision-guided robot. Coordinate system C represents the vision coordinate system of the vision-guided robot.

[0107] In addition, the tool parameters of the end-of-arm tool can be expressed using the relationship between the flange coordinate system at the end of the arm and the tool coordinate system at the end of the arm. Describe it; the description of the end tool coordinate system of the robot arm relative to the base coordinate system of the robot arm is The position of the target object's coordinate system relative to the base coordinate system of the robot can be described as The position of the flange coordinate system at the end of the robot arm relative to the base coordinate system of the robot arm can be described as When the end tool coordinate system coincides with the target object coordinate system, we have

[0108] In some embodiments of the present disclosure, the workspace determination method further includes: determining, within the workspace, an execution space for the robotic arm to perform the target task.

[0109] The execution space may be a three-dimensional space in which the target tool actually executes the target task. It can be understood that the target task is actually executed in the execution space. The execution space is a three-dimensional space contained in the workspace, such as Figure 6 As shown, Figure 6 The middle space St represents the execution space of the vision-guided robot arm, which is also called the task space; the space Sw represents the working space of the robot arm, which is contained in the working space.

[0110] In this embodiment, after the calculation of the workspace is completed, the workspace can be displayed in the form of a three-dimensional model through three-dimensional software, and the execution space can be determined within the workspace. Specifically, before the target task of the visually guided robot arm is performed, the workspace determination device can analyze the position and size of the workspace, and recommend the placement of the target object, so that the task space in the workspace is reasonably set, and the execution space is completely contained in the workspace.

[0111] In the above scheme, the workspace is determined in advance, and the workspace is directly used to determine the execution space in the visual guidance robot arm operation process, which improves the efficiency of the operation process of executing the target task. In addition, if the robot arm and the target tool are not replaced, the workspace can be calculated once and used throughout the life cycle of the visual guidance robot arm, with a high reuse rate.

[0112] Optionally, in the process of visually guiding the robot arm to perform the target task, the workspace determination device can visualize the workspace, and when visually displaying the operation point on the manually selected target object, it can be intuitively observed whether the operation point is inside the robot arm workspace. If it is inside the workspace model, the operation point is reachable by the target tool and can be operated in a working posture. If the operation point is outside the workspace, it is less likely that the target tool can work in a working posture at the operation point. The workspace determination device can generate prompt information to prompt the user to adjust the operation point.

[0113] Figure 7 A schematic diagram of a workspace determination method provided by an embodiment of the present disclosure is shown as follows: Figure 7 As shown, the workspace determination device can determine the initial space. The initial space is large enough. Optionally, the initial space can be a rectangular space. The initial space can be located in the positive direction of the X-axis direction, and all points on the maximum plane in the X-axis direction, the maximum plane in the Y-axis direction, and the maximum plane in the Z-axis direction, as well as all points on the minimum plane in the X-axis direction, the minimum plane in the Y-axis direction, and the minimum plane in the Z-axis direction are points that the target tool cannot reach. Alternatively, the initial space can select a suitable range according to the actual space requirements of the target task.

[0114] Determine the initial position and posture of the robot arm. Specifically, the initial position and posture can be the position and posture of the robot arm when the target tool is located at the transition point when the vision guides the robot arm to perform the target task.

[0115] For each initial point in the initial area, it is determined whether the robot arm can reach it, and the point that the robot arm can reach is determined as the target point. Specifically, for each initial point, combined with the working posture corresponding to the target task, it is determined whether the target tool of the robot arm can reach the working posture at the initial point, and the initial point where the target tool can reach the working posture is determined as the target point.

[0116] Determine the continuous area based on the target points. Specifically, the position points where the target tool cannot reach the working posture are determined as exclusion points, and the target points and exclusion points are visualized in the form of point clouds through 3D software. The user visually determines the continuous area formed by the target points to ensure that the target tool can reach the working posture for all points in the workspace calculated later.

[0117] Extracting the envelope points of the continuous region. Specifically, the workspace determination device may extract the outermost envelope points of the continuous region and discard all points inside the continuous region.

[0118] The working range is determined according to the envelope points. Specifically, the envelope points are reconstructed by any one of the Poisson surface reconstruction algorithm, the ball pivot surface reconstruction algorithm, and the surface reconstruction algorithm provided by the three-dimensional software to obtain a three-dimensional triangular patch mesh model, and the space within the three-dimensional triangular patch mesh model is the working space, and the three-dimensional triangular patch mesh model can be understood as a three-dimensional model of the working space.

[0119] The disclosed embodiment is based on the basic idea that the execution space needs to be included in the workspace, and the workspace is determined according to the target point. Specifically, a continuous area that meets the actual target task requirements is screened according to the target point, and the envelope points of the continuous area are extracted, and the envelope points are converted into the workspace. Then, the workspace is determined by back-calculating the workspace according to the virtual target point. If the workspace is visualized, and the target object in the task space under visual guidance is also visualized, by moving the target object, it is ensured that the execution space is included in the workspace, and the success rate of the subsequent visual guidance process is improved. Therefore, by determining the workspace, the repeated calculation of the target point when setting the target object is avoided, and the calculation efficiency is improved. By visually displaying the workspace, the fluency of executing the target task is improved, and the workspace determination method has a relatively broad application scenario. The representation of the workspace when the target tool is limited to the working posture is accurately given, and an efficient judgment is given on whether the target tool can operate on the target object during the process of visually guiding the robotic arm to perform the target task. It can give an intuitive prompt whether the operation point is in the workspace, which greatly improves the efficiency of the operation process of the visual guidance robot arm motion control related work.

[0120] In addition, by generating a workspace based on the target point, the three-dimensionalization and visualization of the workspace is conveniently realized. Through the workspace, the placement of the target object in the execution space is recommended. By displaying the workspace in three dimensions, it is convenient and quick to determine whether the target object in the execution space is in the workspace.

[0121] Figure 8 A schematic structural diagram of a workspace determination device provided in an embodiment of the present disclosure is shown.

[0122] like Figure 8 As shown, the workspace determining device 800 may include:

[0123] An acquisition module 801 is used to acquire the initial position and posture of the robotic arm when a target tool carried by the robotic arm is to perform a target task;

[0124] The first determination module 802 is used to determine the target point reached by the target tool when the robot arm carries the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task;

[0125] The second determination module 803 is used to determine the workspace corresponding to the target task according to the target point.

[0126] Optionally, the first determining module 802 includes:

[0127] The discrete processing submodule is used to discretize the initial space according to a preset distance step to obtain multiple initial points;

[0128] A first determination submodule, configured to determine, according to the multiple initial points and the working postures, a plurality of working postures corresponding to each of the initial points;

[0129] The second determination submodule is used to determine the initial point as the target point if the robot arm moves with the target tool based on the initial posture and the target tool reaches a plurality of working postures corresponding to the initial point at the initial point.

[0130] Optionally, the first determining submodule is used to:

[0131] Dividing the working posture according to a preset angle step to obtain a plurality of working angles;

[0132] For each of the initial points, the initial point and the multiple working angles are respectively combined to obtain multiple working postures corresponding to the initial point.

[0133] Optionally, the second determining submodule is used to:

[0134] Determining the multiple working postures as postures to be processed respectively;

[0135] Performing inverse kinematics solution on the initial posture and the posture to be processed, and if a solution result exists, the solution result is within the joint motion range of the robotic arm, and the posture to be processed is not a singular position of the robotic arm, then determining that the posture to be processed passes the detection;

[0136] If the multiple working postures corresponding to the initial point all pass the detection, the initial point is determined as the target point.

[0137] Optionally, there are multiple target points, and the second determining module 803 includes:

[0138] A third determination submodule is used to determine a continuous area according to the target point;

[0139] The reconstruction submodule is used to extract the envelope points of the continuous area, perform surface reconstruction on the envelope points, and obtain the workspace.

[0140] Optionally, the device further comprises:

[0141] A calculation module, configured to calculate, in an initial space, a plurality of exclusion points that the target tool cannot reach in the working posture when the robot arm moves with the target tool based on the initial posture;

[0142] Accordingly, the third determining submodule is used to:

[0143] Visually displaying the target point and the plurality of exclusion points to a user;

[0144] The continuous region information input by the user is obtained, and the continuous region is determined according to the continuous region information.

[0145] Optionally, extracting the envelope point of the continuous area includes:

[0146] Dividing the continuous area into a plurality of sections according to a first preset distance in a first preset direction;

[0147] For each of the sections, dividing the section into a plurality of line segments in a second preset direction according to a second preset distance;

[0148] The envelope point is determined according to the first maximum point and the first minimum point of the continuous area in the first preset direction, the second maximum point and the second minimum point of each of the sections in the second preset direction, and the third maximum point and the third maximum point of each of the line segments in the third preset direction; wherein the first preset direction, the second preset direction, and the third preset direction are different directions.

[0149] Optionally, the device further comprises:

[0150] The third determination module is used to determine the execution space of the robot arm to perform the target task within the workspace.

[0151] It should be noted that Figure 8The workspace determination device 800 shown can execute each step in the above workspace determination method embodiment, and realize each process and effect in the above workspace determination method embodiment, which will not be described in detail here.

[0152] Fig. 9 A schematic structural diagram of an electronic device provided by an embodiment of the present disclosure is shown.

[0153] like Fig. 9 As shown, the electronic device may include a processor 901 and a memory 902 storing computer program instructions.

[0154] Specifically, the processor 901 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0155] The memory 902 may include a large capacity memory for information or instructions. By way of example and not limitation, the memory 902 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory 902 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 902 may be inside or outside the integrated gateway device. In a particular embodiment, the memory 902 is a non-volatile solid-state memory. In a particular embodiment, the memory 902 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (Electrically Erasable Programmable ROM, EEPROM), an electrically rewritable ROM (EAROM) or a flash memory, or a combination of two or more of these.

[0156] The processor 901 reads and executes the computer program instructions stored in the memory 902 to perform the steps of the workspace determination method provided in the embodiment of the present disclosure.

[0157] In one example, the electronic device may further include a transceiver 903 and a bus 904. Fig. 9 As shown, the processor 901, the memory 902 and the transceiver 903 are connected via a bus 904 and communicate with each other.

[0158] The bus 904 includes hardware, software or both. For example, but not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a Memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses or a combination of two or more of these. Where appropriate, the bus 904 may include one or more buses. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.

[0159] The following is an embodiment of a computer-readable storage medium provided in an embodiment of the present disclosure. The computer-readable storage medium and the workspace determination method of the above-mentioned embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the computer-readable storage medium, please refer to the embodiment of the above-mentioned workspace determination method.

[0160] This embodiment provides a storage medium including computer executable instructions, which are used to perform a workspace determination method when executed by a computer processor.

[0161] Of course, the storage medium containing computer executable instructions provided by the embodiment of the present disclosure, whose computer executable instructions are not limited to the above method operations, can also execute related operations in the workspace determination method provided by any embodiment of the present disclosure.

[0162] Through the above description of the implementation methods, the technical personnel in the relevant field can clearly understand that the present disclosure can be implemented with the help of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for a computer cloud platform (which can be a personal computer, server, or network cloud platform, etc.) to execute the workspace determination method provided by each embodiment of the present disclosure.

[0163] Note that the above are only preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art will understand that the present disclosure is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present disclosure. Therefore, although the present disclosure is described in more detail through the above embodiments, the present disclosure is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present disclosure, and the scope of the present disclosure is determined by the scope of the appended claims.

Claims

1. A method for determining a workspace, characterized in that: include: Acquire the initial position of the robotic arm when a target tool carried by the robotic arm is to perform a target task; Determine the target point reached by the target tool when the robot arm carries the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task, and the working posture is the angle range reached by the target tool during the execution of the target task; According to the target point, determining a workspace corresponding to the target task; Wherein, determining that the robot arm moves with the target tool based on the initial posture, and the target point reached by the target tool includes: The initial space is discretized according to a preset distance step to obtain multiple initial points; based on the multiple initial points and the working postures, multiple working postures corresponding to each of the initial points are determined; if the robot arm moves with the target tool based on the initial posture, and the target tool reaches multiple working postures corresponding to the initial point at the initial point, the initial point is determined as the target point.

2. The method according to claim 1, characterized in that The step of determining, based on the multiple initial points and the working postures, multiple working postures corresponding to each of the initial points comprises: Dividing the working posture according to a preset angle step to obtain a plurality of working angles; For each of the initial points, the initial point and the multiple working angles are respectively combined to obtain multiple working postures corresponding to the initial point.

3. The method according to claim 1, characterized in that If the robot arm moves with the target tool based on the initial posture, and the target tool reaches a plurality of working postures corresponding to the initial point at the initial point, then the initial point is determined as the target point, including: Determining the multiple working postures as postures to be processed respectively; Performing inverse kinematics solution on the initial posture and the posture to be processed, and if a solution result exists, the solution result is within the joint motion range of the robotic arm, and the posture to be processed is not a singular position of the robotic arm, then determining that the posture to be processed passes the detection; If the multiple working postures corresponding to the initial point all pass the detection, the initial point is determined as the target point.

4. The method according to claim 1, characterized in that: There are multiple target points, and determining the workspace corresponding to the target task according to the target points includes: Determine a continuous area according to the target point; The envelope points of the continuous area are extracted, and the surface of the envelope points is reconstructed to obtain the workspace.

5. The method according to claim 4, characterized in that The method further comprises: Calculating, in the initial space, a plurality of exclusion points that the target tool cannot reach in the working posture when the robot arm moves with the target tool based on the initial posture; Accordingly, determining a continuous area according to the target point includes: Visually displaying the target point and the plurality of exclusion points to a user; The continuous region information input by the user is obtained, and the continuous region is determined according to the continuous region information.

6. The method according to claim 4, characterized in that The extracting the envelope point of the continuous area comprises: Dividing the continuous area into a plurality of sections according to a first preset distance in a first preset direction; For each of the sections, dividing the section into a plurality of line segments in a second preset direction according to a second preset distance; The envelope point is determined according to the first maximum point and the first minimum point of the continuous area in the first preset direction, the second maximum point and the second minimum point of each of the sections in the second preset direction, and the third maximum point and the third maximum point of each of the line segments in the third preset direction; wherein the first preset direction, the second preset direction, and the third preset direction are different directions.

7. The method according to claim 1, characterized in that The method further comprises: Within the workspace, an execution space for the robot arm to perform the target task is determined.

8. A working space determination device, characterized in that: include: An acquisition module, used to acquire the initial position and posture of the robotic arm when a target tool carried by the robotic arm is to perform a target task; A first determination module is used to determine the target point reached by the target tool when the robot arm carries the target tool based on the initial posture; wherein the target point is a position point where the posture of the target tool satisfies the working posture corresponding to the target task, and the working posture is an angle range reached by the target tool during the execution of the target task; A second determination module is used to determine the workspace corresponding to the target task according to the target point; Wherein, the first determining module includes: The discrete processing submodule is used to discretize the initial space according to a preset distance step to obtain multiple initial points; A first determination submodule, configured to determine, according to the multiple initial points and the working postures, a plurality of working postures corresponding to each of the initial points; The second determination submodule is used to determine the initial point as the target point if the robot arm moves with the target tool based on the initial posture and the target tool reaches a plurality of working postures corresponding to the initial point at the initial point.

9. An electronic device, characterized in that: include: processor; A memory for storing executable instructions; The processor is used to read the executable instructions from the memory and execute the executable instructions to implement the method described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the method according to any one of claims 1 to 7.