Configuration system of grabbing process

Abstract

The invention provides a grabbing process configuration system, which comprises an image identification unit, a grabbing strategy generation unit, a display unit and a grabbing process configuration unit, and is characterized in that the image identification unit is used for determining two or more to-be-grabbed materials from an image shot by a visual system; the grabbing strategy generation unit is used for carrying out grabbing planning on each to-be-grabbed material in a grabbing setting interface of the display unit to obtain a plurality of grabbing strategies; the grabbing process configuration unit is used for determining a grabbing strategy and generating a corresponding grabbing process configuration file. Therefore, in one grabbing beat, a plurality of to-be-grabbed materials can be identified and positioned, grabbing strategies of two or more to-be-grabbed materials are determined at the same time, the generated grabbing strategies are screened according to field process requirements, the grabbing process configuration file is generated, the grabbing process configuration file is easy to transfer and edit, and the grabbing efficiency is improved. The method can be suitable for various complex grabbing scenes, and the grabbing efficiency and success rate are effectively improved.

Description

Background Art

[0002] At present, the sorting of materials still mainly relies on manual operation. This primitive manual sorting method is inefficient and difficult to adapt to the needs of large-scale sorting. Using a robot to sort materials instead of manual operation can effectively speed up work efficiency and reduce errors in manual sorting. The prerequisite for using a robot to replace manual operation is that the material needs to be accurately identified and located. After the material is located, the robot arm is controlled to perform grabbing and placement.

[0003] The existing grasping process generally determines the location of multiple materials through the visual system first, then selects the location of the material with the highest priority according to the optimization algorithm, and controls the robot arm to grasp the material. Then repeat the above process until the grasping task of all the materials to be grasped is completed.

[0004] However, the above method needs to identify and locate the position of the material every time a grasping task is executed, which is inefficient and cannot complete the grasping strategy planning for multiple materials within one grasping cycle. Summary of the invention

[0005] In view of the defects in the prior art, an object of the present invention is to provide a configuration system for a crawling process.

[0006] In a first aspect, an embodiment of the present application provides a configuration system for a grasping process, which is applied to a robot including a visual system, wherein the visual system is used to obtain an image of the robot's working environment and send the working environment image to the robot, and the configuration system for the grasping process includes: an image recognition unit, a grasping strategy generation unit, a display unit, and a grasping process configuration unit, wherein:

[0007] The image recognition unit is used to determine two or more materials to be grasped from the images taken by the visual system;

[0008] The grabbing strategy generating unit is used to carry out grabbing planning for each material to be grabbed in the grabbing setting interface of the display unit to obtain multiple grabbing strategies;

[0009] The grasping process configuration unit is used to determine the grasping strategy according to the on-site process requirements and generate a corresponding grasping process configuration file so that the robot performs the grasping task according to the grasping process configuration file.

[0010] Optionally, the image recognition unit is specifically used to:

[0011] Identify the images captured by the visual system and mark two or more materials to be grabbed;

[0012] Determine the position of each material to be grasped, and calculate the occlusion rate of each material to be grasped.

[0013] Optionally, it also includes: a filtering unit, which is used to filter the materials to be grasped according to the occlusion rate of the materials to be grasped before determining the grasping strategy according to the on-site process requirements, and remove the materials to be grasped whose occlusion rate is greater than a preset threshold from the grasping list.

[0014] Optionally, the grabbing strategy generating unit is specifically used to:

[0015] Determine a grasping method according to any one or more factors of the type, size, weight, material, and occlusion rate of the material to be grasped, wherein the grasping method includes: clamping, adsorption, and lifting;

[0016] According to the grasping method, the posture of the actuator of the robot arm when each material to be grasped is grasped is determined respectively; wherein the execution posture of the robot arm includes: the rotation angle and / or height of the flange of the robot arm when grasping;

[0017] According to the position and posture of the robot arm actuator, the grabbing order of each material to be grabbed is determined.

[0018] Optionally, it also includes:

[0019] A receiving unit, used to receive a jump instruction input by a user, so that the display unit jumps from the grabbing setting interface to the placing setting interface;

[0020] A grab and release setting unit is used to select a placement pose source and a grab and release combination method according to a determined grab strategy;

[0021] The Run Test unit is used to run the test and view the running results after selecting the grab and place workspace.

[0022] Optionally, it also includes:

[0023] A storage unit, used for storing the corresponding grabbing process configuration file after generating the corresponding grabbing process configuration file, and establishing an association relationship between the material to be grabbed, the grabbing process configuration file, and the on-site process requirements;

[0024] The recommendation unit is used to directly import or recommend the grabbing process configuration file when executing the grabbing task for the same type of materials or running under the same on-site process requirements.

[0025] Optionally, the grabbing process configuration file is divided into: selecting a pre-processing strategy, generating a grabbing plan, and selecting a post-processing strategy according to different stages of grabbing.

[0026] Optionally, it further includes: a process editing processing unit, which is used to edit different stages of grabbing in the grabbing setting interface of the display unit, wherein the editing processing includes any one or more of the following methods:

[0027] Modify the grabbing method of all or part of the materials to be grabbed;

[0028] Add or delete materials to be grabbed in the grab list;

[0029] Modify the grabbing order of all or part of the materials to be grabbed.

[0030] Optionally, the modifying of the grabbing order of all or part of the materials to be grabbed includes:

[0031] Select two or more materials to be grasped, and set the priority considerations and corresponding weights, wherein the considerations include: occlusion rate, robot arm flange height, and robot arm flange rotation angle;

[0032] Calculate the priority of each material to be grabbed based on the set considerations and corresponding weights;

[0033] Modify the order of grabbing materials to be grabbed according to priority.

[0034] In a second aspect, an embodiment of the present application provides a robot, comprising: a visual system, a robot body, a drive system, and a robotic arm, wherein the visual system can be arranged on the robot body or the robotic arm, and is used to capture an image of the robot's working environment; a processor in the robot body, or a computer remotely connected to the robot body, is loaded with a configuration system of a grasping process as described in any one of the first aspects, and is used to determine two or more materials to be grasped from the image captured by the visual system;

[0035] Carry out grabbing planning for each material to be grabbed in the grabbing setting interface to obtain multiple grabbing strategies;

[0036] According to the on-site process requirements, the grasping strategy is determined, and a corresponding grasping process configuration file is generated so that the robot can perform the grasping task according to the grasping process configuration file.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] In this application, two or more materials to be grasped are determined from the images taken by the visual system; grasping planning is performed for each material to be grasped in the grasping setting interface to obtain multiple grasping strategies; grasping strategies are determined according to on-site process requirements, and corresponding grasping process configuration files are generated. In this way, the identification and positioning of multiple materials to be grasped can be completed within one grasping cycle, and grasping strategies for two or more materials to be grasped can be determined at the same time. According to on-site process requirements, the generated grasping strategies are screened to generate a grasping process configuration file, which is easy to transfer and edit, and can be applied to various complex grasping scenarios, so that the robot can continuously perform multiple grasping operations after one visual recognition, effectively improving the efficiency and success rate of grasping. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings in the following descriptions are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work. By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the present invention will become more obvious:

[0040] Figure 1 Schematic diagram of the setting interface of the crawling process provided in the embodiment of the present application Figure 1 ;

[0041] Figure 2 Schematic diagram of the setting interface of the crawling process provided in the embodiment of the present application Figure 2 ;

[0042] Figure 3 A configuration system for a crawling process provided in an embodiment of the present application;

[0043] Figure 4 A schematic diagram of the principle of the grabbing strategy provided in the embodiment of the present application;

[0044] Figure 5 A schematic diagram of the structure of another system for configuring a crawling process provided in an embodiment of the present application;

[0045] Figure 6 A structural diagram of another system for configuring a crawling process provided in an embodiment of the present application;

[0046] Figure 7 A structural diagram of a configuration system for another capture process provided in an embodiment of the present application;

[0047] Figure 8A schematic diagram of the structure of a configuration device for a capture process provided in an embodiment of the present application;

[0048] Fig. 9 It is a schematic diagram of the structure of a computer-readable storage medium in an embodiment of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0050] It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or there can be a central component. When a component is said to be "connected to" another component, it can be directly connected to the other component or there can be a central component at the same time.

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0052] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein, for example, can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] The following specific embodiments are used to describe in detail the technical solution of the present invention and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0054] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0055] Figure 1 Schematic diagram of the setting interface of the crawling process provided in the embodiment of the present application Figure 1 , Figure 2 Schematic diagram of the setting interface of the crawling process provided in the embodiment of the present application Figure 2 ,like Figure 1 , Figure 2 As shown, the entire grabbing setting can be divided into three stages: selecting the pre-processing strategy, generating the grabbing plan, and selecting the post-processing strategy. In the first step, you can select the pre-processing strategy and select the preset processing strategy in the drop-down box (the default is no processing). In the second step, select the material to be grabbed in the grab registration set in the drop-down box and generate the grabbing plan. In the third step, you can select the post-processing strategy and select the preset processing strategy in the drop-down box. After the grabbing setting is completed, the background will generate the corresponding grabbing process configuration file, which can be directly called the next time a similar material is grabbed, or saved as a user-defined template and shared with other users.

[0056] Furthermore, after completing the grabbing settings, you can also make placement settings. First, set the placement pose source, such as selecting the slot of the workspace as the placement pose source. The first step is to select the processing strategy for the slot of the workspace. The second step is to determine the grabbing and releasing combination method, such as giving priority to placing the corner points of the workspace. Finally, perform a test run to view the running results.

[0057] This embodiment can flexibly configure the material grabbing process and subdivide the grabbing process. Before and after the grabbing planning, you can choose to add grabbing strategies from the preset strategies. After the grabbing settings are completed, you can also set the placement process, so as to run the complete grabbing and placing process of the robot arm to ensure the success rate of the robot arm in performing grabbing operations in the real environment.

[0058] Figure 3A grasping process configuration system provided in an embodiment of the present application is applied to a robot 100 including a visual system 110, wherein the visual system 110 is used to obtain an image of the robot's working environment and send the image of the working environment to the robot 100, and the grasping process configuration system 300 includes: an image recognition unit 310, a grasping strategy generation unit 320, a display unit 330, and a grasping process configuration unit 340, wherein: the image recognition unit 310 is used to determine two or more materials to be grasped from the image taken by the visual system; the grasping strategy generation unit 320 is used to carry out grasping planning for each material to be grasped in the grasping setting interface of the display unit 330, and obtain multiple grasping strategies; the grasping process configuration unit 340 is used to determine the grasping strategy according to the on-site process requirements, and generate a corresponding grasping process configuration file so that the robot performs the grasping task according to the grasping process configuration file.

[0059] Exemplarily, the image recognition unit 310 is specifically used to: recognize the image taken by the visual system and mark two or more materials to be grasped; determine the position of each material to be grasped, and calculate the occlusion rate of each material to be grasped.

[0060] In this embodiment, an image of the material to be grasped can be captured by a visual system arranged on the robotic arm, or a visual system arranged in the working space of the robotic arm (for example, a material frame is photographed to obtain an image containing multiple materials to be grasped), and then the image is recognized to mark two or more materials to be grasped; the position of each material to be grasped is determined, and the occlusion rate of each material to be grasped is calculated.

[0061] Exemplarily, the grasping strategy generation unit 320 is specifically used to: determine the grasping method according to any one or more factors of the type, size, weight, material, and occlusion rate of the material to be grasped, the grasping methods including: clamping, adsorption, and lifting; according to the grasping method, determine the position and posture of the robot arm actuator when each material to be grasped is grasped; wherein the execution posture of the robot arm includes: the rotation angle and / or height of the flange of the robot arm when executing the grasping; according to the posture of the robot arm actuator, determine the grasping order of each material to be grasped.

[0062] In this embodiment, for different on-site process requirements, the best strategy is selected from the generated multiple grasping strategies, and a grasping process configuration file is generated. The grasping process configuration file records in detail the grasping method of the material to be grasped under the on-site process requirements, and the method for determining the material grasping order (for example, setting multiple grasping priorities, giving priority to grasping the material with the smallest occlusion rate, and then grasping the material with the highest robot arm flange height, or the material with the smallest robot arm flange rotation angle).

[0063] In an optional implementation, the grabbing method can be determined based on the type, size, weight, material, etc. of the material. For example, a suction cup can be used to grab light and large materials, a clamp can be used to grab heavy, small, or irregular materials, and a lifting method can be used to grab neatly stacked and heavy materials. Furthermore, factors to consider in the grabbing order (such as occlusion rate, robot arm flange height, robot arm flange rotation angle, etc.) are added, and then the weight of each factor is set to calculate the priority of each material to be grabbed.

[0064] Figure 4 The schematic diagram of the principle of the grabbing strategy provided in the embodiment of the present application is as follows: Figure 4 As shown in the figure, numbers 1 to 12 represent the grasping order of cylindrical workpieces, and the workpieces shown by the dotted lines in the figure are the workpieces filtered out from the grasping list. For example, an upper limit on the number of workpieces participating in the sequence arrangement can be set, for example, it is stipulated that the grasping sequence planning is only performed for 2 or more and less than 15 materials to be grasped at a time. This is because the occlusion rate of the material will change as the grasping operation proceeds. Limiting the number can simplify the difficulty of grasping sequence planning. As the number of grasping times of the robot arm increases, the probability of the posture of the workpiece in the material frame being affected will gradually increase. If the workpiece posture initially identified is still used for grasping, the probability of grasping failure is likely to increase. Therefore, by limiting the number of materials participating in the grasping sequence planning each time, this problem can be well solved, while ensuring the grasping efficiency of the robot arm, maintaining a high grasping success rate.

[0065] In this embodiment, two or more materials to be grasped are determined from the images taken by the visual system; grasping planning is performed for each material to be grasped in the grasping setting interface to obtain multiple grasping strategies; grasping strategies are determined according to on-site process requirements, and corresponding grasping process configuration files are generated. Thus, within one grasping cycle, the identification and positioning of multiple materials to be grasped can be completed, and grasping strategies for two or more materials to be grasped can be determined at the same time. According to on-site process requirements, the generated grasping strategies are screened to generate a grasping process configuration file, which is easy to transfer and edit, and can be applied to various complex grasping scenarios, so that the robot can continuously perform multiple grasping operations after one visual recognition, effectively improving the efficiency and success rate of grasping.

[0066] Figure 5 A structural diagram of another configuration system for a crawling process provided in an embodiment of the present application, such as Figure 5As shown, the configuration system 300 of the grabbing process in this embodiment includes: an image recognition unit 310, a grabbing strategy generation unit 320, a display unit 330, a grabbing process configuration unit 340, and a filtering unit 350, wherein: the filtering unit 350 is used to filter the materials to be grabbed according to the occlusion rate of the materials to be grabbed before determining the grabbing strategy according to the on-site process requirements, and remove the materials to be grabbed whose occlusion rate is greater than a preset threshold from the grabbing list.

[0067] In this embodiment, before determining the grabbing strategy according to the on-site process requirements, the materials to be grabbed are first filtered according to the occlusion rate of the materials to be grabbed, and the materials to be grabbed with an occlusion rate greater than a preset threshold are removed from the grabbing list. This method can perform a preliminary screening of the materials to be grabbed, remove materials with high occlusion rates, and improve the success rate of the robot arm grabbing.

[0068] Figure 6 A structural diagram of another configuration system for a crawling process provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the configuration system 300 of the grabbing process in this embodiment includes: an image recognition unit 310, a grabbing strategy generation unit 320, a display unit 330, a grabbing process configuration unit 340, a filtering unit 350, a receiving unit 360, a grab and release setting unit 370, and a running test unit 380, wherein: the receiving unit 360 is used to receive a jump instruction input by a user so that the display unit jumps from the grabbing setting interface to the placement setting interface; the grab and release setting unit 370 is used to select the placement posture source and the grab and release combination method according to the determined grabbing strategy; the running test unit 380 is used to perform a running test and view the running results after selecting the grabbing and placing workspace.

[0069] In this embodiment, after completing the configuration of the grabbing process, you can further set the placement process by jumping from the grabbing setting interface to the placement setting interface, selecting the placement pose source and the grabbing and placing combination mode according to the determined grabbing strategy; selecting the grabbing and placing workspaces, and performing a running test; and viewing the running results. In this way, the previously configured grabbing process can be combined with the placement process to verify the feasibility and success rate as a whole.

[0070] Figure 7 A structural diagram of another configuration system for a capture process provided in an embodiment of the present application is shown in FIG. Figure 7As shown, the grabbing process configuration system 300 in this embodiment includes: an image recognition unit 310, a grabbing strategy generation unit 320, a display unit 330, a grabbing process configuration unit 340, a filtering unit 350, a receiving unit 360, a grabbing and releasing setting unit 370, an operation test unit 380, a storage unit 390, and a recommendation unit 3100, wherein: the storage unit 390 is used to store the grabbing process configuration file after generating the corresponding grabbing process configuration file, and establish an association relationship between the material to be grabbed and the grabbing process configuration file and the on-site process requirements; the recommendation unit 3100 is used to directly import or recommend the grabbing process configuration file when executing the grabbing task for the same type of materials or running under the same on-site process requirements.

[0071] In this embodiment, the generated grabbing process configuration file can be uploaded and shared, or it can be directly imported and used when the next grabbing plan is performed, avoiding repeated settings and simplifying the operation process. When executing the grabbing task of the same type of material, or running under the same on-site process requirements, the background can recommend the most suitable grabbing process configuration file for the user to use.

[0072] In an optional implementation, the grabbing process configuration file is divided into: selecting a pre-processing strategy, generating a grabbing plan, and selecting a post-processing strategy according to different stages of grabbing; after determining the grabbing strategy according to the on-site process requirements and generating the corresponding grabbing process configuration file, the different stages of grabbing can be edited in the grabbing setting interface, wherein the editing process includes any one or more of the following methods:

[0073] Modify the grabbing method of all or part of the materials to be grabbed;

[0074] Add or delete materials to be grabbed in the grab list;

[0075] Modify the grabbing order of all or part of the materials to be grabbed.

[0076] Exemplarily, by selecting two or more materials to be grasped, priority considerations and corresponding weights can be set, and the considerations include: occlusion rate, robot arm flange height, and robot arm flange rotation angle; the priority of each material to be grasped is calculated based on the set considerations and corresponding weights; and the grasping order of the materials to be grasped is modified according to the priority.

[0077] In this embodiment, by editing the crawling process configuration file, the crawling strategy can be flexibly modified, thereby greatly improving the applicability to complex crawling scenarios and achieving higher crawling efficiency.

[0078] The present application also provides a method for configuring a crawling process, which may include the following steps:

[0079] Step S1, determining two or more materials to be grasped from images captured by a visual system.

[0080] In this embodiment, an image of the material to be grasped can be captured by a visual system arranged on the robotic arm, or a visual system arranged in the working space of the robotic arm (for example, a material frame is photographed to obtain an image containing multiple materials to be grasped), and then the image is recognized to mark two or more materials to be grasped; the position of each material to be grasped is determined, and the occlusion rate of each material to be grasped is calculated.

[0081] Step S2: Carry out grabbing planning for each material to be grabbed in the grabbing setting interface to obtain multiple grabbing strategies.

[0082] In this embodiment, the grasping method is determined according to any one or more factors including the type, size, weight, material, and occlusion rate of the material to be grasped, and the grasping methods include: clamping, adsorption, and lifting; according to the grasping method, the position and posture of the robot arm actuator when each material to be grasped is grasped is determined respectively; wherein, the execution posture of the robot arm includes: the rotation angle and / or height of the flange of the robot arm when executing the grasping; according to the posture of the robot arm actuator, the grasping order of each material to be grasped is determined.

[0083] Step S3: Determine the grabbing strategy according to the on-site process requirements and generate a corresponding grabbing process configuration file.

[0084] In this embodiment, for different on-site process requirements, the best strategy is selected from the generated multiple grasping strategies, and a grasping process configuration file is generated. The grasping process configuration file records in detail the grasping method of the material to be grasped under the on-site process requirements, and the method for determining the material grasping order (for example, setting multiple grasping priorities, giving priority to grasping the material with the smallest occlusion rate, and then grasping the material with the highest robot arm flange height, or the material with the smallest robot arm flange rotation angle).

[0085] In an optional implementation, the grabbing method can be determined based on the type, size, weight, material, etc. of the material. For example, a suction cup can be used to grab light and large materials, a clamp can be used to grab heavy, small, or irregular materials, and a lifting method can be used to grab neatly stacked and heavy materials. Furthermore, factors to consider in the grabbing order (such as occlusion rate, robot arm flange height, robot arm flange rotation angle, etc.) are added, and then the weight of each factor is set to calculate the priority of each material to be grabbed.

[0086] In another optional implementation, before determining the grabbing strategy according to the on-site process requirements, the materials to be grabbed are first filtered according to the occlusion rate of the materials to be grabbed, and the materials to be grabbed with an occlusion rate greater than a preset threshold are removed from the grabbing list. This method can perform a preliminary screening of the materials to be grabbed, remove materials with high occlusion rates, and improve the success rate of the robot arm's grabbing.

[0087] Step S4: Jump from the grabbing setting interface to the placement setting interface, and select the placement pose source and the grab and release combination method according to the determined grabbing strategy.

[0088] Step S5: Select the grab and place workspace and perform a run test.

[0089] Step S6: Check the operation results.

[0090] In this embodiment, after completing the configuration of the grabbing process, you can further set the placement process by jumping from the grabbing setting interface to the placement setting interface, selecting the placement pose source and the grabbing and placing combination mode according to the determined grabbing strategy; selecting the grabbing and placing workspaces, and performing a running test; and viewing the running results. In this way, the previously configured grabbing process can be combined with the placement process to verify the feasibility and success rate as a whole.

[0091] Step S7: Establishing the association between the material to be grasped, the grasping process configuration file, and the on-site process requirements.

[0092] In this embodiment, a correspondence may be established between the generated grabbing process configuration file and the on-site process requirements, and the corresponding grabbing process configuration file may be saved to facilitate subsequent direct search for the corresponding grabbing process configuration file according to the process requirements.

[0093] Step S8: When executing the grabbing task for the same type of materials or operating under the same on-site process requirements, directly import or recommend the grabbing process configuration file.

[0094] In this embodiment, the generated grabbing process configuration file can be uploaded and shared, or it can be directly imported and used when the next grabbing plan is performed, avoiding repeated settings and simplifying the operation process. When executing the grabbing task of the same type of material, or running under the same on-site process requirements, the background can recommend the most suitable grabbing process configuration file for the user to use.

[0095] In this embodiment, the grabbing process configuration file is divided into: selecting a pre-processing strategy, generating a grabbing plan, and selecting a post-processing strategy according to different stages of grabbing. After determining the grabbing strategy according to the on-site process requirements and generating the corresponding grabbing process configuration file, the different stages of grabbing can be edited in the grabbing setting interface, wherein the editing process includes any one or more of the following methods:

[0096] Modify the grabbing method of all or part of the materials to be grabbed;

[0097] Add or delete materials to be grabbed in the grab list;

[0098] Modify the grabbing order of all or part of the materials to be grabbed.

[0099] In this embodiment, by editing the crawling process configuration file, the crawling strategy can be flexibly modified, thereby greatly improving the applicability to complex crawling scenarios and achieving higher crawling efficiency.

[0100] The embodiment of the present application further provides a robot, characterized in that it includes: a visual system, a robot body, a drive system and a mechanical arm, wherein the visual system can be arranged on the robot body or the mechanical arm, and is used to capture images of the robot's working environment, and a processor in the robot body, or a computer remotely connected to the robot body, is loaded with a configuration system of the above-mentioned grasping process, and is used to determine two or more materials to be grasped from the images captured by the visual system;

[0101] Carry out grabbing planning for each material to be grabbed in the grabbing setting interface to obtain multiple grabbing strategies;

[0102] According to the on-site process requirements, the grasping strategy is determined and the corresponding grasping process configuration file is generated so that the robot can perform the grasping task according to the grasping process configuration file.

[0103] Figure 8 This is a schematic diagram of the structure of a configuration device for a capture process provided in an embodiment of the present application. The configuration device 800 for the capture process in this embodiment may include: a processor 801 and a memory 802.

[0104] The memory 802 is used to store programs; the memory 802 may include volatile memory (English: volatile memory), such as random-access memory (English: random-access memory, abbreviated: RAM), such as static random-access memory (English: static random-access memory, abbreviated: SRAM), double data rate synchronous dynamic random access memory (English: Double Data Rate Synchronous Dynamic Random Access Memory, abbreviated: DDR SDRAM), etc.; the memory may also include non-volatile memory (English: non-volatile memory), such as flash memory (English: flash memory). The memory 802 is used to store computer programs (such as applications, functional modules, etc. that implement the above method), computer instructions, etc., and the above computer programs, computer instructions, etc. can be partitioned and stored in one or more memories 802. And the above computer programs, computer instructions, data, etc. can be called by the processor 801.

[0105] The above-mentioned computer programs, computer instructions, etc. may be stored in partitions in one or more memories 802 . And the above-mentioned computer programs, computer instructions, data, etc. may be called by the processor 801 .

[0106] The processor 801 is used to execute the computer program stored in the memory 802 to implement each step of the method involved in the above embodiment.

[0107] For details, please refer to the relevant description in the previous method embodiment.

[0108] The processor 801 and the memory 802 may be independent structures or integrated structures. When the processor 801 and the memory 802 are independent structures, the memory 802 and the processor 801 may be coupled and connected via a bus 803 .

[0109] The workpiece contour marking device 800 of this embodiment can execute the technical solution in the above method. Its specific implementation process and technical principles refer to the relevant description in the above method, which will not be repeated here.

[0110] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as systems, methods or program products. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits", "modules" or "platforms".

[0111] In addition, an embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored. When at least one processor of a user device executes the computer-executable instructions, the user device executes the above-mentioned various possible methods.

[0112] Among them, computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of computer programs from one place to another. The storage medium can be any available medium that can be accessed by a general or special-purpose computer. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a user device. Of course, the processor and the storage medium can also be present in a communication device as discrete components.

[0113] The present application also provides a program product, which includes a computer program. The computer program is stored in a readable storage medium. At least one processor of the server can read the computer program from the readable storage medium. At least one processor executes the computer program so that the server implements any method of the above-mentioned embodiments of the present invention.

[0114] Those skilled in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc. Various media that can store program codes.

[0115] Fig. 9 Schematic diagram of the structure of a computer-readable storage medium in an embodiment of the present invention. Fig. 9 As shown, a program product 900 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0116] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0117] Computer readable storage media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program codes are carried. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program codes contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.

[0118] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0119] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.

[0120] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art may make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A configuration system for a capture process, characterized in that: Applied to a robot including a visual system, the visual system is used to obtain an image of the robot's working environment and send the working environment image to the robot, the configuration system of the grasping process includes: an image recognition unit, a grasping strategy generation unit, a display unit, and a grasping process configuration unit, wherein: The image recognition unit is used to determine two or more materials to be grasped from the images taken by the visual system; The grabbing strategy generating unit is used to carry out grabbing planning for each material to be grabbed in the grabbing setting interface of the display unit to obtain multiple grabbing strategies; The grasping process configuration unit is used to determine the grasping strategy according to the on-site process requirements and generate a corresponding grasping process configuration file so that the robot performs the grasping task according to the grasping process configuration file.

2. The system for configuring the crawling process according to claim 1, characterized in that: The image recognition unit is specifically used for: Identify the images captured by the visual system and mark two or more materials to be grabbed; Determine the position of each material to be grasped, and calculate the occlusion rate of each material to be grasped.

3. The system for configuring the crawling process according to claim 1, characterized in that: Also includes: The filtering unit is used to filter the materials to be grasped according to the occlusion rate of the materials to be grasped before determining the grasping strategy according to the on-site process requirements, and remove the materials to be grasped whose occlusion rate is greater than a preset threshold from the grasping list.

4. The system for configuring the crawling process according to claim 1, characterized in that: The grabbing strategy generating unit is specifically used for: Determine a grasping method according to any one or more factors of the type, size, weight, material, and occlusion rate of the material to be grasped, wherein the grasping method includes: clamping, adsorption, and lifting; According to the grasping method, the posture of the actuator of the robot arm when each material to be grasped is grasped is determined respectively; wherein the execution posture of the robot arm includes: the rotation angle and / or height of the flange of the robot arm when grasping; According to the position and posture of the robot arm actuator, the grabbing order of each material to be grabbed is determined.

5. The system for configuring the crawling process according to claim 1, characterized in that: Also includes: A receiving unit, configured to receive a jump instruction input by a user, so that the display unit jumps from the grabbing setting interface to the placing setting interface; A grab and release setting unit is used to select a placement pose source and a grab and release combination method according to a determined grab strategy; The Run Test unit is used to run the test and view the running results after selecting the grab and place workspace.

6. The system for configuring a grabbing process according to any one of claims 1 to 5, characterized in that: Also includes: A storage unit, used for storing the corresponding grabbing process configuration file after generating the corresponding grabbing process configuration file, and establishing an association relationship between the material to be grabbed, the grabbing process configuration file, and the on-site process requirements; The recommendation unit is used to directly import or recommend the grabbing process configuration file when executing the grabbing task for the same type of materials or running under the same on-site process requirements.

7. The system for configuring a grabbing process according to any one of claims 1 to 5, characterized in that: The grabbing process configuration file is divided into: selecting a pre-processing strategy, generating a grabbing plan, and selecting a post-processing strategy according to different stages of grabbing.

8. The system for configuring the crawling process according to claim 7, characterized in that: It also includes: a process editing processing unit, which is used to edit different stages of grabbing on the grabbing setting interface of the display unit, wherein the editing processing includes any one or more of the following methods: Modify the grabbing method of all or part of the materials to be grabbed; Add or delete materials to be grabbed in the grab list; Modify the grabbing order of all or part of the materials to be grabbed.

9. The system for configuring the crawling process according to claim 8, characterized in that: The modification of the grabbing order of all or part of the materials to be grabbed includes: Select two or more materials to be grasped, and set the priority considerations and corresponding weights, wherein the considerations include: occlusion rate, robot arm flange height, and robot arm flange rotation angle; Calculate the priority of each material to be grabbed based on the set considerations and corresponding weights; Modify the order of grabbing materials to be grabbed according to priority.

10. A robot, characterized in that: include: A visual system, a robot body, a drive system and a robotic arm, wherein the visual system can be arranged on the robot body or the robotic arm, and is used to capture images of the robot's working environment; a processor in the robot body, or a computer remotely connected to the robot body, is loaded with a configuration system for the grasping process according to any one of claims 1 to 9, and is used to determine two or more materials to be grasped from the images captured by the visual system; Carry out grabbing planning for each material to be grabbed in the grabbing setting interface to obtain multiple grabbing strategies; According to the on-site process requirements, the grasping strategy is determined, and a corresponding grasping process configuration file is generated so that the robot can perform the grasping task according to the grasping process configuration file.

Images