Mitigating accidental multi-pickup using multi-component robot end effectors
By using a multi-element end effector to cycle the clamping elements and sensor detection, the problem of multiple pick-ups is solved, the accuracy and efficiency of pick-ups are improved, and the system complexity and cost are reduced.
Patent Information
- Application Number
- CN202480091011.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-01
- Publication Date
- 2026-11-17
AI Technical Summary
Multi-element end effectors are prone to accidental multiple pickups when picking up objects. Existing technologies such as force sensors are costly, complex, and have long detection times.
A multi-element end effector equipped with sensors is used to cyclically detect multiple picks by the clamping element, and the picking cycle is stopped or continued when multiple picks are detected. The clamping status is detected by sensors such as pressure sensors or cameras.
It effectively reduces the occurrence of multiple picks, improves the accuracy and efficiency of picking, reduces accidental object migration, and simplifies system complexity and cost.
Smart Images

Figure CN123125083A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to robots and methods of operating robots. Background Technology
[0002] Robots can be used to pick up objects and transport them to their destination. For example, in a warehouse, a robot can be used to pick up goods from pick-up bags (such as storage bins) and place them on a conveyor belt or into placement bags (such as shipping containers). Such a robot may include an end effector configured to pick up objects from pick-up bags, hold the objects as the end effector moves across the placement bag, and then place the objects into the placement bag. The end effector may include one or more gripping elements for gripping the objects. Multi-element end effectors can offer several advantages compared to single-element end effectors. For example, multi-element end effectors can have greater lifting capacity, provide stability, and allow for a larger gripping area. However, multi-element end effectors are more likely to inadvertently pick up multiple objects simultaneously. One solution for detecting multiple pick-ups is to include a force sensor at the end effector. For example, if the weight is higher than the expected weight at the end effector, it can be determined that an accidental multiple pick-up may have occurred, and the robot can take appropriate action. However, weighing equipment may add additional cost and complexity. Force sensors are also precision-based and may require a long stabilization time before they can accurately detect weight. Summary of the Invention
[0003] Embodiments of the present invention provide a robot. The robot includes an end effector comprising a plurality of gripping elements. The robot is configured to, in each pick-up cycle, pick up an object from a pick-up area via the plurality of gripping elements during a gripping phase, lift the object during a lifting phase, and transport the object to a destination area during a transport phase. The robot further includes: at least one sensor configured to measure a sensor signal indicating whether any of the plurality of gripping elements is not gripping any object; and a controller. The controller is configured to: in each corresponding pick-up cycle, enable all gripping elements of the plurality of gripping elements during the gripping phase; after the gripping phase, deactivate and enable each of the plurality of gripping elements according to a series of cyclic phases, thereby performing element cycling; and during and / or after element cycling, determine whether multiple pick-ups have occurred based on the sensor signal measured by the at least one sensor.
[0004] Embodiments of the present invention also provide a method for operating a robot. The robot includes an end effector comprising a plurality of gripping elements. The robot is configured to pick up an object from a pickup area via the plurality of gripping elements in each pickup cycle and transport the object to a destination area. The method includes: in each respective pickup cycle, activating all gripping elements of the plurality of gripping elements during a gripping phase; after the gripping phase, deactivating and activating each of the plurality of gripping elements according to a series of cyclic phases, thereby performing an element cycle; during and / or after the element cycle is completed, detecting a sensor signal using at least one sensor indicating whether any of the plurality of gripping elements is not gripping any object; and determining whether multiple pickups have occurred based on the sensor signal detected by the at least one sensor. Attached Figure Description
[0005] Figure 1 An exemplary robot is shown, having an end effector that includes two gripping elements.
[0006] Figure 2A An exemplary four-suction cup end effector is shown for picking up a package of clothing.
[0007] Figure 2B An exemplary four-suction-cup end effector with four vacuum suction cups is shown.
[0008] Figure 3A An example of a dual-element end effector is shown, in which objects are arranged so that dual picking is unlikely to occur.
[0009] Figure 3B An example of a dual-element end effector is shown, in which two objects are arranged adjacent to each other, where dual picking is more likely to occur.
[0010] Figure 4A and Figure 4B The illustration shows an example of using a robot to move an object from a pickup bag to a placement bag.
[0011] Figure 5A The illustration shows how a single pickup, according to some embodiments, is unaffected by element cycling.
[0012] Figure 5B The illustration shows how dual pickup, according to some embodiments, can be detected cyclically by elements in a dual suction cup end effector.
[0013] Figure 6 The illustration shows how dual pickup, according to some embodiments, can be detected cyclically by elements in a three-suction end effector.
[0014] Figure 7The illustration shows how dual pickup, according to some embodiments, can be detected cyclically by elements in a four-suction-cup end effector.
[0015] Figures 8A to 8C The illustrations show some examples of edge cases for a three-suction cup end effector according to some embodiments.
[0016] Figure 9 The illustration shows an example where two irregularly shaped objects are placed next to each other.
[0017] Figure 10A and Figure 10B The illustration shows timing considerations for a vacuum chuck end effector according to some embodiments.
[0018] Figure 11A and Figure 11B The illustration shows the dynamic effects of a vacuum chuck according to some embodiments.
[0019] Figure 12 This is a flowchart of method steps for operating a robot to mitigate accidental over-picking according to some embodiments. Detailed Implementation
[0020] Embodiments of the present invention provide robot controllers and methods to mitigate accidental multi-pickup using a multi-element end effector (also referred to herein as a multi-element gripper). Each pickup cycle may include a gripping phase, a lifting phase, and a transport phase. In the gripping phase, the end effector grips an object in the pickup area. In the lifting phase, the end effector lifts the object primarily in the vertical upward direction. In the transport phase, the end effector moves laterally to the destination area, where the object falls.
[0021] During the gripping phase, all gripping elements are activated simultaneously. Preferably, a single object is gripped by all gripping elements initially activated in each pick cycle, so that the object is securely held by the end effector. In dual or multiple pick-up scenarios, one object may be gripped by only one gripping element or partially gripped by one or more gripping elements.
[0022] According to embodiments of the invention, after the initial gripping phase, the gripping elements are deactivated and activated in a predetermined sequence. For example, for each end effector comprising multiple vacuum suction cups and operating by suction from the vacuum suction cups, each vacuum suction cup can be activated by opening a valve to allow air to flow from the vacuum suction cup to the vacuum system, and deactivated by closing the valve. For grippers with jaws, each jaw can be activated by closing the jaw, and deactivated by opening the jaw. If multiple pickups are present, objects held by only one gripping element or partially held by one or more gripping elements may fall during element cycling. Therefore, the likelihood of transporting more objects to their destination can be reduced compared to the intended purpose. It may be advantageous to perform element cycling during the lifting phase of the pickup cycle while the end effector is still above the pickup area, so that the object falls back into the pickup area rather than an uncontrolled area, such as the ground. Preferably, element cycling is completed before or shortly after the start of the transport phase.
[0023] According to some embodiments, the robot includes sensors configured to measure sensor signals indicating whether any of the gripping elements is not holding any object during an element cycle. For example, if the gripping element is a vacuum suction cup, a pressure sensor can measure the pressure of the vacuum system associated with the vacuum suction cup. If an object falls during an element cycle, the pressure will increase compared to when all vacuum suction cups are holding the object. Therefore, when the robot detects an increase in pressure, it can determine that a double pick-up has occurred. According to some embodiments, when a double pick-up is determined to have occurred, the robot can abort the current pick-up cycle and begin a new pick-up cycle. In this case, the current pick-up cycle resulted in a missed pick-up (i.e., the end effector failed to pick up any object). Missed pick-ups are considered preferable to double pick-ups or multiple pick-ups because the accidental migration of an object is a more serious error than dropping the object back into the pick-up area. According to some embodiments, when a double pick-up is determined to have occurred and an object falls during an element cycle, the robot can continue to complete the current pick-up cycle.
[0024] As described above and below, embodiments of the present invention provide a robot, method, and computer-readable medium for mitigating accidental multi-pickup using a multi-element robot end effector.
[0025] In a first aspect, embodiments of the present invention provide a robot. The robot includes an end effector having a plurality of gripping elements. The robot is configured to, in each pickup cycle, pick up an object from a pickup area via the plurality of gripping elements during a gripping phase, lift the object during a lifting phase, and transport the object to a destination area during a transport phase. The robot further includes: at least one sensor configured to measure a sensor signal indicating whether any of the plurality of gripping elements is not gripping any object; and a controller. The controller is configured to: in each respective pickup cycle, enable all gripping elements of the plurality of gripping elements during the gripping phase; after the gripping phase, deactivate and enable each of the plurality of gripping elements according to a series of cyclic phases, thereby performing element cycling; and during and / or after element cycling, determine whether multiple pickups have occurred based on the sensor signal measured by the at least one sensor.
[0026] In a second aspect, the present invention provides a robot according to the first aspect, wherein the controller is further configured to, upon determining that multiple pickups have occurred, suspend the corresponding pickup cycle and begin a new pickup cycle.
[0027] In a third aspect, the present invention provides a robot according to the first aspect, wherein the controller is further configured to continue completing the corresponding pickup cycle when it is determined that multiple pickups have occurred and the object has fallen during the element cycle.
[0028] In a fourth aspect, the present invention provides a robot according to the first aspect, wherein the element cycle is performed during the lifting phase of the respective pick-up cycle.
[0029] In a fifth aspect, the invention provides a robot according to the first aspect, wherein a plurality of gripping elements include a plurality of vacuum suction cups, and at least one sensor includes a pressure sensor configured to measure the pressure of a vacuum system associated with the plurality of vacuum suction cups.
[0030] In a sixth aspect, the invention provides a robot according to the first aspect, wherein a plurality of gripping elements include a plurality of vacuum suction cups, and wherein at least one sensor includes a plurality of pressure sensors, each respective pressure sensor being configured to measure a corresponding pressure associated with a respective vacuum suction cup.
[0031] In a seventh aspect, the present invention provides a robot according to the first aspect, wherein a plurality of gripping elements include a gripping element with jaws, a soft gripping element or a magnetic gripping element, and at least one sensor includes a proximity sensor, an impedance sensor or a magnetic sensor.
[0032] In an eighth aspect, the present invention provides a robot according to the first aspect, wherein a plurality of gripping elements include two gripping elements, and an execution element cycle includes alternately deactivating one of the two gripping elements according to a series of cycle phases.
[0033] In a ninth aspect, the present invention provides a robot according to the first aspect, wherein a plurality of gripping elements include three gripping elements, and an execution element cycle includes sequentially deactivating one of the three gripping elements according to a series of cycle phases.
[0034] In a tenth aspect, the present invention provides a robot according to the first aspect, wherein a plurality of gripping elements include four gripping elements, and the execution element cycle includes, in each cycle phase, deactivating two of the four gripping elements.
[0035] In an eleventh aspect, embodiments of the present invention provide a method for operating a robot. The robot includes an end effector having a plurality of gripping elements. The robot is configured to pick up an object from a pickup area via the plurality of gripping elements in each pickup cycle and transport the object to a destination area. The method includes: in each respective pickup cycle, activating all gripping elements of the plurality of gripping elements during a gripping phase; after the gripping phase, deactivating and activating each of the plurality of gripping elements according to a series of cyclic phases, thereby performing an element cycle; during and / or after the element cycle is completed, detecting a sensor signal using at least one sensor indicating whether any of the plurality of gripping elements is not gripping any object; and determining whether multiple pickups have occurred based on the sensor signal detected by the at least one sensor.
[0036] In a twelfth aspect, the present invention provides a method according to the eleventh aspect, wherein the method further includes, upon determining that multiple pickups have occurred, terminating the corresponding pickup cycle and initiating a new pickup cycle.
[0037] In a thirteenth aspect, the present invention provides a method according to an eleventh aspect, wherein the method further includes continuing to complete the corresponding pickup cycle when it is determined that multiple pickups have occurred and the object has fallen during the element cycle.
[0038] In a fourteenth aspect, the present invention provides a method according to an eleventh aspect, wherein element cycling is performed during the up-phase of a corresponding pick-up cycle.
[0039] In a fifteenth aspect, the invention provides a method according to an eleventh aspect, wherein a plurality of clamping elements include a plurality of vacuum chucks, and at least one sensor includes a pressure sensor configured to measure the pressure of a vacuum system associated with the plurality of vacuum chucks.
[0040] In a sixteenth aspect, the invention provides a method according to an eleventh aspect, wherein the method further includes activating all vacuum chucks among a plurality of vacuum chucks upon completion of an element cycle. Detection of a sensor signal is performed after all vacuum chucks among the plurality of vacuum chucks are activated. Determining whether multiple pickup has occurred includes comparing the pressure of the vacuum system with a reference pressure, and determining that multiple pickup has occurred when the pressure is determined to be greater than the reference pressure.
[0041] In a seventeenth aspect, the invention provides a method according to an eleventh aspect, wherein a plurality of clamping elements include a plurality of vacuum suction cups, and at least one sensor includes a plurality of pressure sensors. Each corresponding pressure sensor is configured to measure a corresponding pressure associated with the corresponding vacuum suction cup. Determining whether multiple pickup has occurred includes: after the corresponding vacuum suction cup is reactivated from a deactivated state, comparing the corresponding pressure associated with the corresponding vacuum suction cup with a reference pressure, and determining that multiple pickup has occurred when it is determined that the corresponding pressure is greater than the reference pressure.
[0042] In an eighteenth aspect, the invention provides a method according to an eleventh aspect, wherein a plurality of clamping elements comprises two or three clamping elements, and the execution of element cycling comprises, in each of a series of cycling phases, deactivating one clamping element.
[0043] In a nineteenth aspect, the invention provides a method according to an eleventh aspect, wherein a plurality of clamping elements includes four clamping elements, and performing element cycling includes, in each of a series of cycling phases, deactivating two of the four clamping elements.
[0044] In a twentieth aspect, embodiments of the present invention provide a non-transitory computer-readable medium having program code stored thereon. When executed by a computer processor, the program code causes execution according to the method of the eleventh aspect.
[0045] In the following description, embodiments of the invention will be presented in the context of using a multi-suction cup gripper in a vacuum. Embodiments of the invention can also be applied to other types of multi-element end effectors, such as grippers with jaws, soft robot grippers, magnetic grippers, etc. Sensors may include proximity sensors, impedance sensors, or magnetic sensors.
[0046] Figure 1 An exemplary robot is shown, having an end effector 110 including two gripping elements 110 and 120. In this example, the two gripping elements 110 and 120 operate via vacuum suction. Each gripping element 110 or 120 includes a tube with a suction cup 112 or 122 at its end. The tube can be connected to a vacuum pump. When the suction cups 112 and 122 are placed on the surface of an object, the pressure inside the tube may drop, causing the object to be gripped by the suction cups 112 and 122. Figure 2AAn exemplary four-suction cup end effector 210 is shown for picking up a bag of clothing 212. Figure 2B An exemplary four-suction-cup end effector 220 with four vacuum suction cups 222 is shown.
[0047] Figure 3A An example is shown where objects are arranged so that double picking is less likely to occur. In this top view, three objects 310, 320, and 330 (e.g., three boxes) are well separated from each other. A dual-element end effector with two gripping elements 302 and 304 is more likely to pick up a single object (e.g., object 310). Figure 3B An example is shown where two objects 340 and 350 are arranged adjacent to each other. If the two objects 340 and 350 are approximately the same height, a dual-element end effector can pick up objects 340 and 350 simultaneously, with each gripping element 302 or 304 gripping each object 340 or 350. Dual picking can also occur when two thin objects (e.g., two thin envelopes) partially overlap each other.
[0048] Figure 4A The illustration shows an example of using a robot to move an object from a pickup area 410 (e.g., picking up a bag) to a destination area 420 (e.g., placing a bag). In each pickup cycle, the robot's end effector first picks up an object from pickup area 410. This phase of the pickup cycle can be referred to as the pickup phase. As the robot moves the picked-up object from pickup area 410 to destination area 420, the object can follow a trajectory described in two phases. In the lifting phase 430, the object is lifted vertically upwards. Next is the transport phase 440, where the object is moved laterally to destination area 420. Subsequently, the object is delivered to destination area 420. Figure 4B The illustration shows an exemplary trajectory that is more likely to occur in a real-world scenario. The definition of the transition from lifting phase 430 to transport phase 440 is not clear enough here. In lifting phase 430, the trajectory is primarily vertical, then smoothly transitions to a predominantly lateral trajectory in transport phase 440.
[0049] The transport phase 440 carries a greater risk because if an object falls during this phase, it may land in an uncontrolled location (e.g., on the ground). Conversely, if an object falls during the lifting phase 430, it will fall back into the pickup area 410. Therefore, according to an embodiment of the invention, it is advantageous to perform element cycling during the lifting phase 430. Preferably, element cycling is completed before or shortly after the start of the transport phase 440. In this way, multi-pickup is detected and stopped while the object is still above the pickup area 410, ensuring that the object falls back into the pickup area 410 and not into an uncontrolled area.
[0050] Figure 5A The illustration shows how good pickup, according to some embodiments, is unaffected by element cycling. Good pickup refers to single pickup, where all gripping elements of the end effector grip the same object. Figure 5A A top view of an object 502 (e.g., a box) is shown, gripped by an end effector having two vacuum suction cups 510 and 520 (represented by two dots 510 and 520, respectively). Each vacuum suction cup 510 or 520 can be individually enabled or disabled (e.g., by opening or closing a valve). Solid dots indicate a vacuum suction cup is enabled, while hollow dots indicate a vacuum suction cup is disabled. During the initial gripping phase, both vacuum suction cups 510 and 520 are enabled. During good pickup, both vacuum suction cups 510 and 520 grip the same object 502. Next, the robot begins a series of suction cup cycles. First, the first vacuum suction cup 510 is disabled, while the second vacuum suction cup 520 remains enabled. The object 502 is held by the end effector via the second vacuum suction cup 520. Next, the first vacuum suction cup 510 is re-enabled, while the second vacuum suction cup 520 is disabled. When the first vacuum suction cup 510 is deactivated, the second vacuum suction cup 520 holds the object 502 close to the first vacuum suction cup 510. When the first vacuum suction cup 510 is reactivated, it picks up the object 502 again, thus holding the object 502 close to the second vacuum suction cup 520 when the second vacuum suction cup 520 is deactivated. After the suction cup cycle is completed, both vacuum suction cups 510 and 520 are reactivated and continue to pick up the object 502.
[0051] According to some embodiments, the end effector is equipped with at least one pressure sensor. The pressure sensor is configured to measure the pressure of the vacuum system associated with vacuum cups 510 and 520. When both vacuum cups 510 and 520 are reactivated after a cup cycle is completed, if the pressure is low to a expected level (e.g., compared to a reference pressure in a single pick-up), the robot can determine that this was a single pick-up (the object did not fall during the cup cycle). The robot can then proceed to transport the picked-up object 502 to the destination area. As described above, it is desirable that the cup cycle is performed during the lifting phase of the pick-up cycle and is completed before or shortly after the start of the transport phase.
[0052] Figure 5BThe illustration shows how dual pickup, according to some embodiments, can be detected through a cycle of elements in a dual-suction cup end effector. In this example, two objects 502 and 504 are placed adjacent to each other in the pickup area. If the two objects 502 and 504 are approximately the same height and close enough to each other (in this example, the two boxes are adjacent to each other), then during the gripping phase, the dual-suction cup end effector can potentially pick up both objects simultaneously, with each vacuum suction cup 510 or 520 gripping each corresponding object 502 or 504. After the gripping phase, the robot begins a suction cup cycle. First, the second vacuum suction cup 520 is deactivated, while the first vacuum suction cup 510 remains activated. The second object 504, gripped by the second vacuum suction cup 520, may fall. The first object 502, gripped by the first vacuum suction cup 510, remains held by the end effector via the first vacuum suction cup 510. Next, the second vacuum suction cup 520 is reactivated, while the first vacuum suction cup 510 is deactivated. The first object 502 held by the first vacuum suction cup 510 may fall. Therefore, the suction cup cycle leads to missed pickup and avoids double pickup.
[0053] After the suction cup cycle is completed, the two vacuum suction cups 510 and 520 are reactivated. Because neither of the two vacuum suction cups 510 and 520 is holding any object, the pressure sensor detects a higher-than-expected pressure (e.g., compared to the reference pressure in a single pickup). The robot can determine that a double pickup has occurred. According to some embodiments, when a double pickup is determined to have occurred, the robot aborts the current pickup cycle and begins a new pickup cycle. As described above, if the suction cup cycle is performed during the lifting phase of the pickup cycle, the two objects 510 and 520 will fall back into the pickup area. In some embodiments, instead of pressure sensors, the robot may be equipped with a camera and image processing software configured to detect whether an object has fallen during the suction cup cycle. In some embodiments, the end effector may include a weighing device. If the weight decreases, the robot can detect that an object has fallen during the suction cup cycle. In some embodiments, the pickup bag is equipped with a weighing device. If the weight increases, the robot can detect that an object has fallen during the suction cup cycle. In some embodiments, after the first phase of the suction cup cycle, the robot briefly activates the second vacuum suction cup 504 and detects that an object has fallen. According to some embodiments, when it is determined that an object has fallen during the suction cup cycle (e.g., when the second object 520 falls after the first phase of the suction cup cycle), the robot can continue to complete the pickup cycle without going through the remaining phases of the suction cup cycle (e.g., by transporting the first object 510 to the destination).
[0054] Figure 6 The illustration shows how dual pickup, according to some embodiments, can be detected cyclically by elements in a three-suction-cup end effector. Figure 5BThe example shown is similar, with two highly similar objects 602 and 604 placed adjacent to each other in the pickup area. During the gripping phase, all three vacuum suction cups 610, 620, and 630 are activated. The end effector picks up objects 602 and 604 simultaneously, with the first vacuum suction cup 610 and the second vacuum suction cup 620 gripping the first object 602, while the third vacuum suction cup 630 grips the second object 604.
[0055] After the gripping phase, the robot begins the suction cup cycle. In the first phase, the first vacuum suction cup 610 is deactivated, while the second vacuum suction cup 620 and the third vacuum suction cup 630 remain activated. Objects 602 and 604 are both held by the end effector, as object 602 is still gripped by the second vacuum suction cup 620, and object 604 is still gripped by the third vacuum suction cup 630. In the second phase, the second vacuum suction cup 620 is deactivated, while the first vacuum suction cup 610 and the third vacuum suction cup 630 remain activated. Again, objects 602 and 604 are both held by the end effector, as object 602 is still gripped by the first vacuum suction cup 610, and object 604 is still gripped by the third vacuum suction cup 630. In the third phase, the third vacuum suction cup 630 is deactivated, while the first vacuum suction cup 610 and the second vacuum suction cup 620 remain activated. When the third vacuum suction cup 630 is deactivated, the second object 604, which was only held by the third vacuum suction cup 630, falls off.
[0056] After the suction cup cycle is complete, all three vacuum suction cups 610, 620, and 630 are reactivated. Because the third vacuum suction cup 630 is not holding any object, the pressure sensor detects higher-than-expected pressure (e.g., compared to the reference pressure in a single pickup). The robot can then determine that a double pickup has occurred. According to some embodiments, when a double pickup is determined to have occurred, the robot is programmed to abort the current pickup cycle and begin a new pickup cycle.
[0057] According to some embodiments, the end effector includes a pressure sensor for each of the vacuum suction cups 610, 620, and 630. Each corresponding pressure sensor is configured to measure the pressure associated with the corresponding vacuum suction cup 610, 620, or 630. When it is determined that a double pick-up has occurred and the remaining object is still held by both vacuum suction cups, the robot is programmed to continue transporting the remaining object to the destination area.
[0058] Figure 7 The illustration shows how dual pickup, according to some embodiments, can be detected cyclically by elements in a four-suction-cup end effector. Figure 6The example shown is similar, with two highly similar objects 702 and 704 placed adjacent to each other in the pickup area. During the gripping phase, all four vacuum suction cups 710, 720, 730, and 740 are activated. The end effector simultaneously picks up objects 602 and 604, with the first vacuum suction cup 710 and the second vacuum suction cup 720 gripping the first object 602, while the third vacuum suction cup 730 and the fourth vacuum suction cup 740 grip the second object 604.
[0059] After the gripping phase, the robot begins the suction cup cycle. In the first phase, the first vacuum suction cup 710 and the third vacuum suction cup 730 are deactivated, while the second vacuum suction cup 720 and the fourth vacuum suction cup 740 remain active. Objects 702 and 704 are both held by the end effector, as object 702 is still gripped by the second vacuum suction cup 720, and object 704 is still gripped by the fourth vacuum suction cup 740. In the second phase, the second vacuum suction cup 720 and the fourth vacuum suction cup 740 are deactivated, while the first vacuum suction cup 710 and the third vacuum suction cup 730 remain active. Furthermore, both objects 702 and 704 remain held by the end effector, as object 702 is still gripped by the first vacuum suction cup 710, and object 704 is still gripped by the third vacuum suction cup 730. In the third phase, the first vacuum suction cup 710 and the fourth vacuum suction cup 740 are deactivated, while the second vacuum suction cup 720 and the third vacuum suction cup 730 remain active. Furthermore, objects 702 and 704 are both held by clamps, as the first object 702 remains held by the second vacuum suction cup 720, and the second object 704 remains held by the third vacuum suction cup 730. In the fourth stage, the second vacuum suction cup 720 and the third vacuum suction cup 730 are deactivated, while the first vacuum suction cup 710 and the fourth vacuum suction cup 740 remain activated. In the fifth stage, the third vacuum suction cup 730 and the fourth vacuum suction cup 740 are deactivated, while the first vacuum suction cup 710 and the second vacuum suction cup 720 remain activated. At this point, the second object 704 falls. In the sixth stage, the first vacuum suction cup 710 and the second vacuum suction cup 720 are deactivated, while the third vacuum suction cup 730 and the fourth vacuum suction cup 740 remain activated. At this point, the first object 702 falls.
[0060] After the suction cup cycle is complete, all four vacuum suction cups 710, 720, 730, and 740 are reactivated. Because none of the vacuum suction cups 710, 720, 730, and 740 are holding any object, the pressure sensors will detect higher-than-expected pressure (e.g., compared to the reference pressure in a single pick-up). The robot can determine that a double pick-up has occurred and can abort the current pick-up cycle and begin a new one. In this example, when the third vacuum suction cup 730 and the fourth vacuum suction cup 740 are activated, but neither is holding any object, the robot may be able to detect a double pick-up as early as the sixth stage of the suction cup cycle.
[0061] In this example of a four-suction-cup end effector, dual pickup is detected only in the sixth stage of the suction cycle. Depending on the order of the suction cycles, dual pickup may be detected as early as the second stage of the suction cycle. The chosen order of the suction cycles can affect the final state of the pickup cycle. Generally, the number of stages required to complete a suction cycle increases with the number of vacuum suction cups in the end effector.
[0062] Figures 8A to 8C The illustrations show some examples of edge cases for a three-suction-cup end effector. Figure 6 The example shown is similar, with the end effector having three vacuum suction cups 610, 620, and 630. Two objects 602 and 604 of the same height are placed adjacent to each other in the pickup area. Figure 8A In the example shown, the third vacuum suction cup 630 is located at the edge between the two objects 602 and 604. Figure 6 The example shown is similar; in the third phase of the suction cup cycle, the second object 604 may fall off. After the suction cup cycle is complete, all three vacuum suction cups 610, 620, and 630 are reactivated. The pressure sensor can only detect an increase in pressure when the third vacuum suction cup 630 partially grips the first object 602. Therefore, the robot can determine that double pickup has occurred. Figure 6 The example shown is similar; the robot can be programmed to abort the current picking cycle and start a new picking cycle, or to transport the remaining object 602 to the destination area (if the end effector includes a pressure sensor for each vacuum cup).
[0063] exist Figure 8BIn the example shown, both the first vacuum suction cup 610 and the second vacuum suction cup 620 are located at the edge between the two objects 602 and 604. The first object 602 may fall off in the first stage of the suction cup cycle because the second vacuum suction cup 620, being in partial contact with the first object 602, may not be able to hold it. In the third stage of the suction cup cycle, the second object 604 falls off. If the end effector is equipped with a pressure sensor for each vacuum suction cup, the robot may be able to determine that double pickup has occurred in the first stage of the suction cup cycle because the second vacuum suction cup 620 is only in partial contact with the second object 604 when activated. Therefore, the robot can immediately abort the current pickup cycle and begin a new pickup cycle.
[0064] exist Figure 8C In the example shown, the third vacuum suction cup 630 is located at the edge between the two objects 602 and 604. During the first phase of the suction cup cycle, the first object 602 may fall. If the end effector is equipped with a pressure sensor for each vacuum suction cup, the robot may be able to determine that a double pick-up has occurred during the first phase of the suction cup cycle because the third vacuum suction cup 630 is only partially in contact with the second object 604 when activated. If the robot is programmed to abort in the event of a double pick-up, it can immediately terminate the current pick-up cycle and begin a new one. However, if the robot is programmed to continue transporting the remaining object 604 to the destination area, it can complete the suction cup cycle and then continue the transport phase.
[0065] In some cases, the above-described element loop may not be able to avoid multiple picks. The effectiveness of the method may depend on the shape of the object to be picked up. For example, if objects are entangled in the pick area, additional objects being picked up may not detach from the end effector during the element loop. Figure 9 The illustration shows an example where two irregularly shaped objects, 902 and 904, are placed adjacent to each other. In this example, the irregular shapes of the two objects 902 and 904 almost resemble a jigsaw puzzle. Figure 1 The elements are mutually compatible. Each of the three vacuum suction cups 910, 920, and 930 of the end effector simultaneously contacts objects 902 and 904. As shown, objects 902 and 904 are held by the end effector at each stage of the suction cup cycle. Therefore, element cycle can mitigate multiply-picking, but cannot prevent multiply-picking in all cases. According to some embodiments, element cycle can be combined with other multiply-picking mitigation methods.
[0066] As described above with respect to Figure 4, it can be advantageous to perform component cycling during the lifting phase of the pick-up cycle and to complete the component cycling before or shortly after the start of the transport phase. This ensures that any additional objects that fall during component cycling will fall back into the pick-up area 410 rather than into uncontrolled areas such as the ground. The duration required to complete the suction cup cycle may depend on the number of gripping components and the transient time used to enable and deactivate each gripping component.
[0067] Figure 10A and Figure 10B The diagram illustrates the timing considerations for a vacuum chuck end effector. Figure 10A In the middle, the vacuum suction cup 1020 is activated and clamps object 1010. Figure 10B In the current scenario, vacuum suction cup 1020 has been deactivated, and object 1010 has fallen. It is assumed that vacuum suction cup 1020 should not be reactivated until object 1010 is separated from vacuum suction cup 1020 by a distance of at least 3 mm. D Until then (otherwise, object 1010 can be gripped again by vacuum suction cup 1020). Use equations ,in g = 9.8 m / s 2 It is Earth's gravity that allows us to calculate the time required for an object to fall 3 mm. t (0.003) = 0.025 seconds. Therefore, the vacuum suction cup 1020 should remain disabled for at least 0.025 seconds before being reactivated. This minimum time can vary depending on other factors, such as air resistance or end effector acceleration.
[0068] Assume the robot is programmed to vertically lift an object 30 cm during the lifting phase, then move the object laterally to transport it to its destination. Also assume the robot moves the end effector at a speed of 1000 mm / s. This would make the time to complete the suction cup cycle during the lifting phase approximately 0.3 seconds. Assume the vacuum transient time when the vacuum suction cup is activated is 0.010 seconds, and the vacuum transient time when it is deactivated is 0.012 seconds. (The vacuum transient time is also referred to as the time constant in this paper.) The total cycle time for one vacuum suction cup is equal to 0.010 + 0.012 + 0.025 = 0.047 seconds. Based on these assumptions, 0.3 seconds allows for approximately 6.4 cycle phases. Figure 7 The exemplary suction cup cycle sequence of the four-suction cup end effector shown indicates that the six-stage suction cup cycle can be completed during the lift phase of the pick-up cycle. The duration of 0.3 seconds is also sufficient to complete the cycle. Figure 5A , Figure 5B and Figure 6 The suction cup cycles shown are for dual-suction cup end effectors or triple-suction cup end effectors, which require fewer cycle stages.
[0069] The effectiveness of a mitigation method can be evaluated by the following rates: the rate at which single-pickups (good pickups) are successfully executed (the picked-up object falls during the suction cup cycle and is transported to the destination area) and the rate at which double-pickups are aborted (the picked-up object falls during the suction cup cycle). A mitigation method is considered effective if most single-pickups are successfully executed and most double-pickups are aborted. Conversely, a mitigation method is considered ineffective if most single-pickups are also aborted (the picked-up object falls during the suction cup cycle), or if the robot cannot abort most double-pickups. The effectiveness of a mitigation method can be affected by suction cup size, suction cup shape, gas flow rate through the suction cup, object weight, and object packaging. For example, tests indicate that the mitigation method is effective for envelopes and boxes. Tests also indicate that the time constant of a large-capacity suction cup or pneumatic hose is greater than that of a smaller suction cup and a shorter hose because it takes longer to evacuate air from a long tube with a large suction cup. If the suction cup cycle speed is not fast enough, single-pickups may be aborted. Shortening the time between cycle phases can prevent single pickup from being aborted, but it may also prevent double pickup from being aborted, because the object will not be completely separated from the suction cup until the suction cup is reactivated.
[0070] Figure 11A and Figure 11B The diagram illustrates the dynamic effects of a vacuum chuck. The horizontal axis represents time, and the vertical axis represents the pressure of the vacuum system. The dashed curve 1110 represents an ideal situation where the pressure responds instantly to the switch between activation and deactivation (time constant is zero). The solid curves 1120 and 1130 represent the responses under actual conditions. In reality, the pressure takes some time to decrease after the chuck is activated, and also takes some time to rise after the chuck is deactivated. These considerations for vacuum chucks also apply to other similar clamping elements, which are also dynamic systems. Figure 11A In the example shown, the system was driven too quickly. The pressure had not fully decreased to the target negative pressure before the suction cup was deactivated again. Similarly, the pressure had not fully increased to the target ambient pressure before the suction cup was reactivated. Figure 11B In the example shown, the system is driven slowly enough that the pressure drops to the target negative pressure before the suction cup is deactivated again, and rises to the target ambient pressure before the suction cup is reactivated. Figure 11B Curve 1130 in the figure represents suction cup dynamics that are superior to those of the curve. Figure 11A The curve 1120 in the figure represents the suction cup dynamics.
[0071] Figure 12This is a flowchart of method steps for operating a robot to mitigate unintended multi-pickup according to some embodiments. The robot includes an end effector having multiple gripping elements. The robot is configured to pick up an object from a pickup area via the multiple gripping elements in each pickup cycle and transport the object to a destination area. The method includes: in each respective pickup cycle, at 1210, during a gripping phase, activating the multiple gripping elements. The method further includes: at 1220, after the gripping phase, deactivating and activating each of the multiple gripping elements according to a predetermined sequence of cyclic phases, thereby performing element cycling. The method further includes: at 1230, during and / or after element cycling, using at least one sensor to detect a sensor signal indicating whether any of the multiple gripping elements is not gripping any object. The method further includes: at 1240, determining whether multi-pickup has occurred based on the sensor signal detected by the at least one sensor.
[0072] As described above, according to embodiments of the invention, unintended multiple pick-ups by a multi-element end effector can be detected and avoided by performing a series of element cycles after the clamping phase. Performing and completing the element cycles during the lifting phase of the pick-up cycle can be advantageous, as any objects dropped during the element cycles will fall back into the pick-up area rather than an uncontrolled area.
[0073] All references cited in this document, including publications, patent applications and patents, are incorporated herein by reference as if each reference were individually and explicitly indicated as incorporated herein by reference and is described herein in its entirety.
[0074] In the context of describing the invention (particularly in the context of the following claims), the terms “a,” “an,” “the,” “at least one,” and similar expressions are to be interpreted as covering both singular and plural forms, unless otherwise stated herein or the context clearly contradicts this. The use of the term “at least one” (e.g., “at least one of A and B”) preceding a list of one or more items is to be interpreted as one item selected from the listed items (A or B) or any combination of two or more of the listed items (A or B), unless otherwise stated herein or the context clearly contradicts this. The terms “comprising,” “having,” “containing,” and “including” are to be interpreted as open-ended terms (i.e., meaning “including but not limited to”), unless otherwise stated. The enumeration of value ranges herein is intended merely as a shortcut for individually referring to each independent value within the range, and each independent value is incorporated herein as a separate listing.
[0075] All methods described herein may be performed in any suitable order unless otherwise stated herein or the context clearly contradicts it. The use of any and all examples or exemplary language (e.g., “such as”) provided herein is merely intended to better describe the invention and does not constitute a limitation on the scope of the invention unless otherwise stated. No language in this specification should be construed as indicating any unclaimed element necessary for the practice of the invention.
[0076] Preferred embodiments of the invention have been described herein. Variations of these preferred embodiments may become apparent to those skilled in the art upon reading the above description. The inventors expect skilled craftsmen to adopt such variations as needed, and the inventors intend to practice the invention in ways different from those specifically described herein. Therefore, the invention includes all modifications and equivalents of the subject matter referenced in the appended claims as permitted by applicable law. Furthermore, any combination of the foregoing elements in all possible variations is included in the invention unless otherwise stated herein or the context clearly contradicts it.
[0077] It should be understood that the original applicant of this document decides which technologies to use and / or commercialize based on their practicality and relevance in the evolving field, as well as what is most beneficial to itself, relevant parties, and users. Therefore, it is possible that the systems and methods described herein have not been and / or will not be used and / or commercialized by the original applicant. It should also be understood that if the original applicant implements and uses the systems and methods described herein, it will be in accordance with its privacy policy. These policies aim to respect and prioritize player privacy and are considered to comply with or exceed the governmental and legal requirements of the relevant jurisdictions. Given that the implementation or use of these systems and methods can or needs to process user personal information, such processing will be carried out in accordance with: (i) as described in the privacy policy; (ii) in accordance with effective legal mechanisms, including (but not limited to) providing advance notice or obtaining the consent of the relevant user where necessary; and (iii) according to the player's or user's privacy settings or preferences. It should also be understood that the original applicant expects that if the systems and methods described herein are implemented or used by other entities, they should comply with its privacy policy and practices consistent with its goal of respecting player and user privacy.
Claims
1. A robot, comprising: An end effector including multiple gripping elements, the robot being configured to: in each pick-up cycle, during a gripping phase, pick up an object from a pick-up area via the multiple gripping elements; and during a lifting phase, lift the object. And during the transportation phase, the object is transported to its destination area; At least one sensor is configured to measure a sensor signal indicating whether any of the plurality of clamping elements is not clamping any object; as well as The controller is configured to, in each corresponding pickup cycle, During the clamping phase, all of the plurality of clamping elements are activated; After the clamping phase, each of the plurality of clamping elements is deactivated and activated according to a series of cyclic phases to perform element cycling; as well as During the element cycle and / or at the completion of the element cycle, it is determined whether multiple pickups have occurred based on the sensor signals measured by the at least one sensor.
2. The robot of claim 1, wherein the controller is further configured to, upon determining that the multiple pickups have occurred, terminate the corresponding pickup cycle and begin a new pickup cycle.
3. The robot of claim 1, wherein the controller is further configured to continue the respective pickup cycle when it is determined that the multiple pickups have occurred and the object has fallen during the element cycle.
4. The robot of claim 1, wherein the element cycle is performed during the lifting phase of the respective pick-up cycle.
5. The robot of claim 1, wherein the plurality of gripping elements comprises a plurality of vacuum suction cups, and the at least one sensor comprises a pressure sensor configured to measure the pressure of a vacuum system associated with the plurality of vacuum suction cups.
6. The robot of claim 1, wherein the plurality of gripping elements comprises a plurality of vacuum suction cups, and wherein the at least one sensor comprises a plurality of pressure sensors, each respective pressure sensor being configured to measure a corresponding pressure associated with a respective vacuum suction cup.
7. The robot of claim 1, wherein each of the plurality of gripping elements comprises a gripping element with jaws, a soft gripping element, or a magnetic gripping element, and the at least one sensor comprises a proximity sensor, an impedance sensor, or a magnetic sensor.
8. The robot of claim 1, wherein the plurality of gripping elements comprises two gripping elements, and performing the element cycle comprises alternately deactivating one of the two gripping elements in the series of cycle phases.
9. The robot of claim 1, wherein the plurality of gripping elements comprises three gripping elements, and performing the element cycle comprises sequentially deactivating one of the three gripping elements in the series of cycle phases.
10. The robot of claim 1, wherein the plurality of gripping elements comprises four gripping elements, and performing the element cycle comprises: In each cycle phase, two of the four clamping elements are deactivated.
11. A method of operating a robot, the robot including an end effector comprising a plurality of gripping elements, the robot being configured to, in each pick-up cycle, pick up an object from a pick-up area via the plurality of gripping elements and transport the object to a destination area, the method comprising: In each corresponding pickup cycle, During the clamping phase, all of the plurality of clamping elements are activated; Following the clamping phase, an element cycle is performed by deactivating and activating each of the plurality of clamping elements according to a series of cyclic phases; During the element cycle and / or when the element cycle is completed, at least one sensor is used to detect a sensor signal indicating whether any of the plurality of clamping elements is not clamping any object; as well as It is determined whether multiple pickups have occurred based on the sensor signals detected by the at least one sensor.
12. The method of claim 11, further comprising: When it is determined that the multi-pickup has occurred, the corresponding pickup cycle is terminated and a new pickup cycle is started.
13. The method of claim 11, further comprising: When it is determined that the multi-pickup has occurred and the object has fallen during the element cycle, the corresponding pickup cycle continues.
14. The method of claim 11, wherein the element cycle is performed during the lift phase of the respective pick-up cycle.
15. The method of claim 11, wherein the plurality of clamping elements comprises a plurality of vacuum suction cups, and the at least one sensor comprises a pressure sensor configured to measure pressure of a vacuum system associated with the plurality of vacuum suction cups.
16. The method of claim 15, further comprising: When the element cycle is completed, all vacuum suction cups of the plurality of vacuum suction cups are activated, wherein the detection of the sensor signal is performed after all vacuum suction cups of the plurality of vacuum suction cups are activated, and wherein determining whether multiple pickup has occurred includes: comparing the pressure of the vacuum system with a reference pressure, and determining that the multiple pickup has occurred when it is determined that the pressure is greater than the reference pressure.
17. The method of claim 11, wherein the plurality of clamping elements comprises a plurality of vacuum suction cups, wherein the at least one sensor comprises a plurality of pressure sensors, each respective pressure sensor being configured to measure a corresponding pressure associated with a respective vacuum suction cup, and wherein determining whether multiple pickups have occurred comprises: When the corresponding vacuum suction cup is reactivated after being deactivated, the corresponding pressure associated with the corresponding vacuum suction cup is compared with the reference pressure. as well as When it is determined that the corresponding pressure is greater than the reference pressure, it is determined that the multi-pickup has occurred.
18. The method of claim 11, wherein the plurality of clamping elements comprises two or three clamping elements, and performing the element cycle comprises deactivating one clamping element in each of the series of cycle phases.
19. The method of claim 11, wherein the plurality of clamping elements comprises four clamping elements, and performing the element cycle comprises: In each of the series of cyclic phases, two of the four clamping elements are deactivated.
20. A non-transitory computer-readable medium having program code stored thereon, the program code, when executed by a computer processor, causing the method of claim 11 to be performed.
