ROBOTIC SYSTEM AND METHOD FOR GRASPING AND / OR SORTING OBJECTS - Patent application
A robotic system with collaborative grabbers and advanced processing capabilities addresses inefficiencies and health risks in waste processing by accurately identifying and sorting waste, enhancing efficiency and safety in material recovery facilities.
Patent Information
- Application Number
- JP2024527160
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-08-11
- Filing Date
- 2022-11-09
- Publication Date
- 2024-11-26
AI Technical Summary
Current waste processing systems, particularly in material recovery facilities, rely heavily on manual labor for tasks such as picking up contaminated materials and sorting waste, leading to inefficiencies, human error, and health risks due to proximity to machinery and hazardous substances, with limited performance metrics for evaluation.
A robotic system comprising collaborative robot grabbers with a processing system that uses sensor data and object detection algorithms to identify and grasp specific waste types, allowing multiple robotic grabbers to work together efficiently and reduce human intervention.
The robotic system enhances operational efficiency, reduces human exposure to hazardous substances, improves sorting accuracy, and facilitates scalable deployment in various facilities, minimizing contamination and increasing the effectiveness of waste processing.
Smart Images

Figure 2024543834000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a robotic system for picking and / or sorting objects, and to a method for picking and / or sorting objects using a robotic system, and in particular, but not exclusively, to a robotic system suitable for use for picking and / or sorting waste materials, for example in a materials recovery facility, and to a method for picking and / or sorting such waste materials using a robotic system. [Background technology]
[0002] The treatment of household waste plays an important role in achieving environmental goals, for example by reducing the amount of material sent to landfills and increasing the amount of material for recycling and / or reuse.
[0003] However, treating household waste on an industrial scale presents significant challenges.
[0004] For example, many waste disposal companies are classified as small or medium-sized businesses and rely on manual labor to grab and / or sort waste.
[0005] Existing / larger waste operators may invest in materials recovery facilities (MRFs) to process and recycle household waste, which may employ automation, but MRFs still utilise human workers to perform certain tasks.
[0006] One such area where human workers are still utilized today is at the start of the waste disposal process where workers are needed to pick out contaminants such as tape, wire, diapers, plastic bags, etc.
[0007] Another area where human workers are still used today is at the end of the waste treatment process where workers are needed to ensure that different waste materials are correctly sorted. If the wrong type of material is identified, the worker needs to grab it and place it in the correct bin, hopper, etc.
[0008] Both manual processes are highly inefficient and inevitably subject to human error, which can result in reduced recycling performance. Moreover, such manual processes pose significant health risks to personnel working near the waste treatment system, both in terms of their proximity to machinery and potential exposure to hazardous materials.
[0009] In a typical recycling facility, there are currently few performance indicators available for waste operators to evaluate their performance. One current indicator is a comparison of the total weight of input materials to the weight of recyclables produced at the end of the process. Another current indicator is the purity level of the recyclables produced, which is estimated by human observation. As such, there is generally not enough information volume and precision for stakeholders to adequately understand the waste treatment and / or recycling process. Summary of the Invention
[0010] Aspects of the present disclosure relate to robotic systems for picking and / or sorting objects and methods for picking and / or sorting objects using robotic systems, and particularly, but not exclusively, to robotic systems suitable for use in picking and / or sorting waste materials, for example, in materials recovery facilities, and methods for picking and / or sorting such waste materials using robotic systems.
[0011] According to a first aspect, there is provided a robotic system for picking and / or sorting objects, the system comprising: a collaborative robotic picker arrangement operatively associated with a conveyor arrangement for transporting objects to be sorted, the robotic picker arrangement comprising a plurality of robotic pickers each configured to pick one or more of the objects selected from the conveyor arrangement; Processing system and Equipped with the processing system is configured to receive sensor data relating to objects being transported by the conveyor arrangement from a sensor arrangement forming part of, coupled to, or operatively associated with the robotic system; the processing system is configured to query the received sensor data using one or more object detection algorithms to determine from the received sensor data whether any one of the objects being transported by the conveyor arrangement corresponds to a predetermined class of object to be picked and / or sorted by the robotic system; the processing system is configured to receive position data relating to objects to be picked and / or sorted from the sensor arrangement and velocity data relating to objects to be picked and / or sorted from the sensor arrangement and / or the conveyor arrangement; the processing system is configured to interrogate the received position and velocity data to determine a predicted location of an object to be picked and / or sorted as it passes through the robotic picker arrangement; The processing system is configured to position one of the robotic pickers relative to the conveyor arrangement so as to output one or more command signals to the robotic pickers to enable the robotic picker to pick selected objects to be picked and / or sorted from the conveyor arrangement.
[0012] In use, a robotic system is positioned relative to a conveyor arrangement such that a robotic picker arrangement of the robotic system can pick objects from the conveyor arrangement. A processing system of the robotic system receives sensor data from the sensor arrangement relating to objects conveyed by the conveyor arrangement. The processing system of the robotic system then uses one or more object detection algorithms on the sensor data to determine whether any one of the objects conveyed by the conveyor arrangement corresponds to a predetermined class of objects to be picked and / or sorted by the robotic system. The processing system also receives position data relating to the objects to be picked and / or sorted from the sensor arrangement and velocity data relating to the objects to be picked and / or sorted from the sensor arrangement and / or conveyor arrangement, which is processed by the robotic system to determine a predicted position of the objects to be picked and / or sorted as they pass through the robotic picker arrangement. The processing system then outputs one or more command signals to the robotic picking devices to position one of the robotic pickers relative to the conveyor arrangement to enable the robotic picker to pick selected objects to be picked and / or sorted from the conveyor arrangement.
[0013] The robotic system may comprise or take the form of an integrated robotic picker and / or sorting system, e.g., a central operating system of the robotic system may be configured and / or operable to communicate high level instructions to and receive feedback from each of a plurality of robotic pickers.
[0014] The robotic system may comprise or take the form of distributed robotic pickers and / or sorting systems, for example where the robotic pickers each form a component part of a robotic system rather than being an independent robotic system.
[0015] The robotic system may comprise or take the form of a modular robotic picker and / or sorting system, for example, a plurality of robotic pickers each having its own local operating system and configured and / or operable to execute instructions transmitted by and / or in communication with a central operating system of the robotic system.
[0016] The robotic system offers many important advantages compared to conventional systems and techniques for picking and / or sorting objects. For example, the system can operate as one integrated system for sorting different items, e.g., waste, simultaneously. Instead of a collection of independent robots, the robotic pickers of the robotic system operate as an organized team. In particular, this offers advantages in terms of the greater flexibility that the robotic system can provide compared to conventional systems and methods. Each robotic picker may have its own area of expertise, and each robotic picker may be individually designed to perform several unique picking tasks.
[0017] For example, in the waste disposal and recycling field, a grabber may be specialized to grab wire, tape, and plastic bags. Another grabber may be designed to pick up diapers. Another grabber may be designed to pick up batteries or other electronic waste.
[0018] It will be appreciated that the robotic system may be configured and / or operable to pick up and / or sort objects in a variety of fields, including, for example, but not limited to, the construction field, the e-waste field, and / or the textile field. For example, in the construction field, the robotic system may be configured and / or operable to pick up and / or sort objects such as waste materials, tarpaulins, metal bars, metal box sections, and / or rubble. For example, in the e-waste field, the robotic system may be configured and / or operable to pick up and / or sort objects such as printed circuit boards, valves, wires, and / or electrical components such as capacitors, resistors, diodes, etc. For example, in the textile field, the robotic system may be configured and / or operable to pick up and / or sort objects such as cotton materials, nylon materials, synthetic materials, linen materials, uniforms, and / or accessories such as belts.
[0019] Furthermore, the robotic system may have any number of robotic grabbers as required and may be configured as required to process a particular type of object, e.g. a particular type of waste. Thus, the robotic system is easily scalable, i.e. to have as many robotic grabbers as required, while still being one system. Providing a distributed system also means that the grabbers are appropriately distributed among the grabbers and are assigned the grabbers according to their specialization. Thus, all grabbers perform their tasks simultaneously and in parallel.
[0020] For example, a processing system of a robotic system may provide command signals to multiple robotic pickers so that the robotic system can operate the robotic pickers in a coordinated manner, facilitating a greater capacity in terms of the amount of objects that may be picked and / or sorted and / or a greater capacity in terms of the types of objects that may be picked and / or sorted at one time.
[0021] Although each robotic picker may be assigned a single class of objects to be picked up and / or sorted, providing a collaborative robotic picker configuration means that each robotic picker may be assigned multiple classes of objects to be picked up and / or sorted.
[0022] In certain embodiments, each robotic picker may be capable of picking and / or sorting all required classes of objects to be picked and / or sorted, and a selected robotic picker assigned to a given object to be picked and / or sorted may be selected by the processing system.
[0023] The robotic picker may be selected by the processing system according to a number of factors.
[0024] A processing system of the robotic system may be configured to receive position data and / or operational status data for each robotic picker. The processing system may query the position data and / or operational status for each robotic picker to determine which robotic picker to assign to a selected object to be picked and / or sorted. For example, the processing system may query the position data and / or operational status associated with each robotic picker to determine which robotic picker is available at a predicted time that an object will pass through the robotic picker arrangement and / or which robotic picker is closest to the object to be picked and / or sorted. The processing system may then assign the selected object to be picked and / or sorted to one of the selected robotic pickers.
[0025] Beneficially, robotic pickers, by working together as a team, promote greater operational efficiency because they can be selected to reduce redundancy of each robotic picker and / or to reduce distance traveled for a given object to be picked and / or sorted, thereby increasing response time and reducing energy usage.
[0026] As mentioned above, in the waste disposal and recycling field, human workers are currently involved in picking out contaminants such as tape, wire, diapers and plastic bags, ensuring that various waste materials are correctly sorted, and taking corrective action as necessary. As mentioned above, such manual processes pose significant health risks to workers working near waste disposal systems, both in terms of their proximity to machinery and potential exposure to hazardous substances.
[0027] The robotic system facilitates efficient picking and / or sorting of such contaminants, thereby eliminating or at least reducing personnel exposure to these potentially hazardous materials. The robotic system also facilitates efficient identification of the objects picked, thereby eliminating or at least reducing the need for manual verification. Efficient identification of the objects picked may reduce the presence of contaminants (i.e., objects that should have been picked) among recyclables that would otherwise reduce their value and / or in some cases mean that they would have to be reprocessed, or in some cases mean that they would be unsuitable for further processing and would have to be sent to a landfill.
[0028] As described above, the robotic system includes a robotic grabber arrangement operably associated with the conveyor arrangement for transporting objects to be sorted, which includes a plurality of robotic grabbers, each configured to grab one or more selected objects from the conveyor arrangement.
[0029] The robotic system may comprise a conveyor arrangement, be coupled to a conveyor arrangement, or be operatively associated with a conveyor arrangement.
[0030] The conveyor arrangement may include one or more conveyors. At least one conveyor may include or take the form of a conveyor belt.
[0031] A robotic picker configuration may include any suitable number (greater than two) of robotic pickers. For example, a system may include two robotic pickers, three robotic pickers, four robotic pickers, five robotic pickers, six robotic pickers, seven robotic pickers, eight robotic pickers, or more than eight robotic pickers.
[0032] Beneficially, since the processing system is configured to operate with a robotic picker arrangement comprising multiple robotic pickers, the robotic system can be easily scaled such that the robotic system is very flexible with respect to the size and / or type of facility in which it can be installed and / or utilized. For example, the robotic system can be easily adapted if the size of a given facility increases without requiring major changes to the processing system infrastructure. Alternatively, the robotic system can be used in facilities that were otherwise considered too small or too remote to merit the investment required for an automated system. For example, in the case of waste management and / or recycling facilities, the robotic system may be used in MRFs that were otherwise considered unsuitable for an automated system where waste would be transported to more distant centralized facilities requiring additional carbon footprints.
[0033] The one or more robotic pickers may include or take the form of a floor-mounted robot.
[0034] The one or more robotic pickers may include a frame. The robotic picker may be configured such that at least a portion of the frame extends or at least partially extends over one or more conveyors of the conveyor arrangement. The robotic picker may be configured such that at least a portion of the frame extends or at least partially extends over a conveyor. Alternatively, the robotic picker may be configured such that at least a portion of the frame extends or at least partially extends over multiple conveyors of the conveyor arrangement.
[0035] The frame may include one or more ground engaging members. The one or more ground engaging members may include or take the form of upright or substantially upright members, posts, or the like. The frame may include horizontal or substantially horizontal members. The horizontal or substantially horizontal members may be coupled to the one or more ground engaging members.
[0036] The one or more robotic pickers may include one or more robotic arms. The one or more robotic arms may be attached to and supported by the frame.
[0037] The robotic picker may be configured to move, e.g., translate, the robotic arm relative to the frame. The robotic picker may be configured to move, e.g., translate, the robotic arm horizontally relative to the frame. Alternatively or additionally, the robotic picker may be configured to move, e.g., translate, the robotic arm vertically relative to the frame.
[0038] In use, the robotic picker may be configured to translate the robotic arm relative to the frame to position the robotic arm laterally and / or vertically relative to the conveyor arrangement.
[0039] The robotic picker may include an actuator arrangement for translating the robotic arm relative to the frame. The actuator arrangement may include or take the form of one or more linear actuators. The linear actuators may include or take the form of one or more belt driven linear actuators.
[0040] The one or more belt driven linear actuators may include a belt. The one or more belt driven linear actuators may include a first pulley. The one or more belt driven linear actuators may include a second pulley. The belt may be disposed over and around the first pulley and the second pulley.
[0041] The robotic picker may include a rail. The rail may include or define a linear plain bearing. The rail may form or form part of a horizontal or substantially horizontal member of a frame. The rail may form part of an actuator arrangement.
[0042] The robotic picker may include a drive arrangement, which may be coupled to or form part of the actuator arrangement, and which may be operable under the control of a processing system.
[0043] The drive arrangement may include one or more drive devices. The one or more drive devices may include or take the form of a motor. In certain embodiments, the one or more drive devices may include or take the form of a servo motor.
[0044] The drive arrangement may include one or more drives, e.g., servo motors, configured to move the robot arm from a first vertical position to a second vertical position. More specifically, the one or more drives configured to move the robot arm from the first vertical position to the second vertical position may move a horizontal or substantially horizontal member relative to the one or more ground engaging members to move the robot arm from the first vertical position to the second vertical position. The one or more drives configured to move the robot arm from the first vertical position to the second vertical position may define one or more first drives of the drive arrangement.
[0045] The drive arrangement may include one or more drives, e.g., servo motors, configured to move the robot arm from a first lateral position to a second lateral position. More specifically, the one or more drives configured to move the robot arm from the first lateral position to the second lateral position may move the robot arm relative to the horizontal or substantially horizontal member. The one or more drives configured to move the robot arm from the first lateral position to the second lateral position may define one or more second drives of the drive arrangement.
[0046] The drive arrangement may be configured to move the robotic arm vertically and / or laterally.
[0047] In some cases, vertical and / or lateral movement may position the robotic arm at a selected location to pick up an object, in other cases the robotic arm itself may accomplish the movement required to pick up an object.
[0048] The drive arrangement may be configured and / or operable to move the robot arm vertically faster than it moves the robot arm laterally.
[0049] In use, the drive arrangement may be operable to rapidly move the robot arm from a first vertical position to a second vertical position, and then move the robot arm from the first lateral position to the second lateral position at a slower speed, i.e. a speed slower than the vertical movement.
[0050] Advantageously, this allows the system to quickly move the robot arm to the required position relative to the conveyor while at the same time providing greater control over the final positioning of the robot arm to accurately pick up selected objects to be picked and / or sorted.
[0051] If the robot arm itself accomplishes the movement to the position required to grasp the object, the drive arrangement may be configured and / or operable to move the robot arm from the first lateral position to the second lateral position faster than the rate of movement of the robot arm when accomplishing the movement to grasp the object.
[0052] Advantageously, this allows the system to quickly move the robot arm to the required position relative to the conveyor while at the same time providing greater control over the final positioning of the robot arm to accurately pick up selected objects to be picked and / or sorted.
[0053] The robotic picker may include a coupling arrangement for coupling the robotic arm to the actuator arrangement. The coupling arrangement may include or take the form of a carriage configured to couple to the actuator arrangement on one hand and to the robotic arm on the other hand. The robotic arm may be removably coupled to the carriage. Beneficially, this allows the robotic arm to be easily removed for repair and / or replaced with an alternative robotic arm.
[0054] The carriage may be disposed on a rail.
[0055] The robotic arm may include a first member. The robotic arm may include a second member. The second member may be coupled to and supported by the first member.
[0056] The robotic arm may include a manipulator. The manipulator 68b may be coupled to and supported by a second member. The manipulator may be configured to grasp the objects to be picked and / or sorted. The manipulator may include or take the form of a mechanical grasper. The manipulator may include or take the form of a vacuum gripper.
[0057] As discussed above, the system may include a sensor arrangement and may be coupled to or operatively associated with the sensor arrangement.
[0058] A sensor arrangement may include one or more sensors configured to obtain the sensor data relating to the objects conveyed by the conveyor arrangement.
[0059] The sensor arrangement may include one or more sensors configured to obtain position data regarding the objects being picked and / or sorted.
[0060] The sensor arrangement may include one or more sensors configured to obtain velocity data regarding the objects being picked and / or sorted.
[0061] The sensor arrangement may include or take the form of a sensor array.
[0062] The sensor arrangement may be configured to obtain visual data regarding objects on the conveyor.
[0063] The sensor arrangement may comprise or take the form of a vision system. The sensor arrangement may comprise a camera. The camera may comprise or take the form of a stereo camera. The camera may comprise or take the form of a 2D camera. The sensor arrangement may include a remote sensing device such as a LIDAR. The sensor arrangement may include an RGB sensor.
[0064] In certain embodiments, the sensor configuration includes a vision system including one or more cameras, one or more remote sensing devices such as LIDAR, and one or more RGB sensors, and the processing system may utilize sensor fusion techniques such as sensor fusion algorithms.
[0065] The sensor arrangement may include one or more sensors configured to measure the electrical resistance of objects on the conveyor.
[0066] The sensor arrangement may include one or more sensors configured to measure optical refraction of objects on the conveyor.
[0067] The sensor arrangement may include one or more sensors configured to generate 3D point cloud data regarding objects on the conveyor.
[0068] At least a portion of the sensor arrangement may be located at an upstream location relative to the plurality of robotic pickers.
[0069] At least a portion of the sensor arrangement may be disposed on a frame, a pole, an upright member, or the like. In certain embodiments, at least a portion of the sensor arrangement may be disposed on the frame. The robotic system may be configured such that at least a portion of the frame extends or at least partially extends over one or more conveyors of the conveyor arrangement. The robotic system may be configured such that at least a portion of the frame extends or at least partially extends over a conveyor. Alternatively, the robotic system may be configured such that at least a portion of the frame extends or at least partially extends over multiple conveyors of the conveyor arrangement.
[0070] The frame may include one or more ground engaging members. The one or more ground engaging members may include or take the form of upright or substantially upright members, posts, or the like. The frame may include a horizontal or substantially horizontal member. The horizontal or substantially horizontal member may be coupled to the one or more ground engaging members. The horizontal or substantially horizontal member may be integrally formed with the one or more ground engaging members.
[0071] Part of the sensor arrangement may be located on the robot arm. The sensor arrangement may include one or more sensors located on the robot arm. The one or more sensors may comprise or take the form of a camera.
[0072] Alternatively or additionally, part of the sensor arrangement may be located on the frame of the robotic picker. The sensor arrangement may include one or more sensors located on the frame of the robotic picker. The one or more sensors may comprise or take the form of a camera.
[0073] In use, a sensor arrangement located on the robot arm and / or robotic picker frame may be utilized to supplement data from a sensor arrangement located upstream of the robotic picker arrangement, thereby providing a more accurate indication of the position of the robotic picker and / or the objects being picked and / or sorted.
[0074] As described above, the processing system receives sensor data from the sensor arrangement regarding objects being transported by the conveyor arrangement, and the processing system uses one or more object detection algorithms on the sensor data to determine whether any of the objects being transported by the conveyor arrangement correspond to a predetermined class of objects to be picked up and / or sorted by the robotic system.
[0075] Beneficially, by using one or more object detection algorithms, the robotic system can identify a wide range of objects, such as, for example, waste and / or contaminants on a conveyor.
[0076] The processing system, or parts of the processing system, may implement artificial intelligence, for example, one or more object detection algorithms may be trained on a labeled training set.
[0077] The processing system uses deep neural networks, deep reinforcement learning algorithms, and
[0078] The received data may be processed using one or more object detection algorithms.
[0079] Each robotic picker of a robotic picker arrangement may include an operating system.
[0080] Beneficially, each robotic picker has an operating system, facilitating distributed computing.
[0081] The robotic system may include a control system, which may include or take the form of hardware components configured to operate some or all of the processes of the processing system.
[0082] The control system may include one or more central processing units (CPUs).
[0083] The control system may include one or more graphics processing units (GPUs).
[0084] The control system may include one or more memory units.
[0085] At least one of the CPU, GPU and memory unit may be cloud-based.
[0086] Alternatively or additionally, at least one of the CPU, GPU and memory unit may be local to the robotic system, which may be located on the robotic system.
[0087] The control system may include or take the form of one or more programmable logic controllers (PLCs).
[0088] The control system, or parts of the control system, may form part of a robotic system.
[0089] The control system or a portion of the control system may be coupled to or operatively associated with the robotic system. For example, the control system may be located at one or more remote locations. The remote locations may include or take the form of a control room. Alternatively or additionally, the remote locations may include or take the form of a mobile device, such as a tablet, cell phone, etc. Alternatively or additionally, the remote locations may include or take the form of a data store, such as an online data store.
[0090] The robotic system may include a communication arrangement.
[0091] The communication arrangement may include or take the form of a wireless communication arrangement. The wireless communication arrangement may include a radio frequency communication arrangement. The communication arrangement may include or take the form of a transmitter or transceiver.
[0092] The communication arrangement may include or take the form of a wired communication arrangement. The wired communication arrangement may include or take the form of an electrical wire and / or an optical fiber communication arrangement.
[0093] The communication arrangement may include or take the form of a two-way communication arrangement. The communication arrangement may include or take the form of a transceiver.
[0094] In use, the processing system may receive information from the sensor arrangement and / or the conveyor arrangement, e.g. a control system of the conveyor arrangement, via the communications arrangement, and communicate one or more command signals to the robotic grabber arrangement via the communications arrangement.
[0095] The robotic system may include one or more human machine interfaces. The human machine interfaces may include or take the form of one or more workstations. The human machine interfaces may include or take the form of one or more graphical user interfaces. The human machine interfaces may include or take the form of a dashboard.
[0096] According to a second aspect, there is provided an object picking and / or sorting system including one or more robotic systems according to the first aspect.
[0097] The object picking and / or sorting system may form part of a materials recovery facility. Alternatively, the object picking and / or sorting system may take the form of a stand-alone system.
[0098] The object picking and / or sorting system may comprise a conveyor arrangement or may be coupled or operably associated with a conveyor arrangement. Where the object picking and / or sorting system forms part of a material recovery facility, the object picking and / or sorting system may be coupled to or operably associated with a conveyor arrangement of the material recovery facility. The conveyor arrangement may include one or more conveyors. At least one conveyor may include or take the form of a conveyor belt.
[0099] The object picking and / or sorting system may include, and may be coupled to or operatively associated with, one or more bins, or hoppers, etc. Where the object picking and / or sorting system forms part of a materials recovery facility, the object picking and / or sorting system may be coupled to or operatively associated with bins, hoppers, etc. of the materials recovery facility. The object picking and / or sorting system may include, and may be coupled to or operatively associated with multiple bins, hoppers, etc.
[0100] In use, the robotic system is operable to pick up one or more selected objects and place them into one of the bins, hoppers, or the like.
[0101] According to a third aspect there is provided a materials recovery facility comprising one or more robotic systems according to the first aspect and / or one or more object picking and / or sorting systems according to the second aspect.
[0102] The materials recovery facility may include a conveyor arrangement. The conveyor arrangement may include one or more conveyors. At least one conveyor may include or take the form of a conveyor belt.
[0103] The material recovery facility may include one or more bins, hoppers, etc. The material recovery facility may include multiple bins, hoppers, etc.
[0104] In use, the robotic system is operable to pick up one or more selected objects and place them into one of the bins, hoppers, or the like.
[0105] According to a fourth aspect, there is provided a method of picking and / or sorting objects using the robotic system of the first aspect and / or the object picking and / or sorting system according to the second aspect.
[0106] In use, a robotic system is positioned relative to a conveyor arrangement such that a robotic picker arrangement of the robotic system can pick objects from the conveyor arrangement. A processing system of the robotic system receives sensor data from the sensor arrangement relating to objects conveyed by the conveyor arrangement. The processing system of the robotic system then uses one or more object detection algorithms on the sensor data to determine whether any one of the objects conveyed by the conveyor arrangement corresponds to a predetermined class of objects to be picked and / or sorted by the robotic system. The processing system also receives position data relating to the objects to be picked and / or sorted from the sensor arrangement and velocity data relating to the objects to be picked and / or sorted from the sensor arrangement and / or conveyor arrangement, which is processed by the robotic system to determine a predicted position of the objects to be picked and / or sorted as they pass through the robotic picker arrangement. The processing system then outputs one or more command signals to the robotic picking devices to position one of the robotic pickers relative to the conveyor arrangement to enable the robotic picker to pick selected objects to be picked and / or sorted from the conveyor arrangement.
[0107] According to a fifth aspect there is provided a robotic picker for picking and / or sorting objects from a conveyor arrangement, the robotic picker comprising: a frame comprising one or more ground engaging members and a horizontal or substantially horizontal member configured to extend or at least partially extend over one or more conveyors of the conveyor arrangement; a robot arm attached to and supported by the frame; an actuator arrangement for translating the robot arm relative to the frame, the actuator arrangement comprising or taking the form of one or more belt driven linear actuators; Equipped with.
[0108] According to a sixth aspect, there is provided a robotic system for picking and / or sorting objects including one or more of the robotic pickers of the fifth aspect.
[0109] According to a seventh aspect, there is provided an object picking and / or sorting system including one or more robotic systems according to the sixth aspect.
[0110] According to an eighth aspect there is provided a materials recovery facility comprising one or more robotic systems according to the sixth aspect and / or one or more object picking and / or sorting systems according to the seventh aspect.
[0111] According to a ninth aspect, there is provided a method of picking and / or sorting objects using the robotic picker of the fifth aspect.
[0112] According to another aspect, there is provided a processing system configured to implement one or more of the above-mentioned aspects.
[0113] The processing system may include at least one processor. The processing system may include and / or be configured to access at least one data store or memory. The data store or memory may include or be configured to receive operational instructions or programs that specify operations of the at least one processor. The at least one processor may be configured to process and implement the operational instructions or programs.
[0114] The at least one data store may include an optical storage device or disk such as a CD or DVD, a flash drive, an SD device, one or more memory chips such as DRAM, a network attached drive (NAD), cloud storage, a tape or magnetic storage device such as a magnetic disk or hard drive, and / or may include a reader, drive or other means configured to access the same.
[0115] The processing system may include a network or interface module. The network or interface module may be connected or connectable to a network connection or data carrier, which may include a wired or wireless network connection or data carrier, such as a data cable, a power line data carrier, Wi-Fi, Bluetooth, Zigbee, an Internet connection or other similar connection. The network interface may include a router, modem, gateway, and / or the like. The system or processing system may be configured to transmit or provide audio signals via the network or interface module, for example, via the Internet, an intranet, a network, or a cloud.
[0116] A processing system may include one processing device or multiple processing devices. Each processing device may include at least one processor and optional memory or data store, and / or network or interface modules. Multiple processing devices may communicate via respective network or interface modules. Multiple processing devices may form, include, or be included in a distributed or server / client based processing system.
[0117] According to another aspect, there is provided a computer program product arranged, when processed by a suitable processing system, to configure the processing system to implement one or more of the above-mentioned aspects.
[0118] The computer program product may be provided on or contained in a carrier medium. The carrier medium may be transitory or non-transitory. The carrier medium may be tangible or non-tangible. The carrier medium may include a signal, such as an electromagnetic or electronic signal. The carrier medium may include a physical medium, such as a disk, a memory card, a memory, etc.
[0119] According to another aspect, a carrier medium is provided, the carrier medium comprising a signal that, when processed by a suitable processing system, causes the processing system to implement one or more of the above-mentioned aspects.
[0120] It will be appreciated by those skilled in the art that certain functions of some embodiments may be implemented by a computer program having computer-readable instructions executable to perform the method of the embodiment. The functions of the computer program may be implemented by hardware (e.g., by a CPU or one or more ASICs (application-specific integrated circuits)), or by a mixture of hardware and software.
[0121] Although specific apparatus components are described herein, in alternative embodiments, one or more of the functions of these apparatus components may be provided by a single unit, processing resource, or other component, or functions provided by a single unit may be provided by a combination of two or more units or other components. For example, one or more functions of a processing system may be performed by a single processing device, such as a personal computer, or one or more functions, or each function, may be performed in a distributed manner by multiple processing devices, which may be locally connected or remotely distributed.
[0122] The present invention is defined by the appended claims. However, for the purposes of this disclosure, it will be understood that any of the features described above or below may be used alone or in combination. For example, features described above in connection with one of the above aspects or below in connection with the following detailed description may be used in any other aspect or may be used together to form a new aspect. [Brief description of the drawings]
[0123] These and other aspects will now be described, by way of example only, with reference to the accompanying drawings.
[0124] [Figure 1] FIG. 1 illustrates a perspective view of a robotic system for picking and / or sorting objects according to the present disclosure.
[0125] [Diagram 2] FIG. 2 shows a schematic diagram of the system topology of the robot system shown in FIG.
[0126] [Diagram 3] 2 illustrates a first robotic picker of the system shown in FIG. 1.
[0127] [Figure 4] FIG. 4 shows an enlarged view of the robot arm of the first robotic picker shown in FIG.
[0128] [Diagram 5] 2 illustrates a second robotic picker of the system shown in FIG. 1.
[0129] [Figure 6] FIG. 6 shows an enlarged view of the robot arm of the second robotic picker shown in FIG.
[0130] [Figure 7] FIG. 2 shows an enlarged view of the sensor configuration of the robot system.
[0131] [Figure 8] FIG. 1 illustrates a perspective view of an alternative robotic system for picking and / or sorting objects according to the present disclosure.
[0132] [Figure 9] FIG. 1 shows a perspective view of an alternative robotic system for picking and / or sorting objects.
[0133] [Figure 10] FIG. 10 illustrates a perspective view of a portion of the robotic picker of the robotic system shown in FIG.
[0134] [Figure 11] FIG. 10 shows a schematic diagram of the system topology of the robotic system shown in FIG.
[0135] [Figure 12] 1 illustrates an object picking and / or sorting system according to the present disclosure.
[0136] [Figure 13] 1 illustrates a materials recovery facility with a robotic system according to the present disclosure.
[0137] [Figure 14] FIG. 1 shows a perspective view of an alternative robotic system for picking and / or sorting objects. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0138] Referring initially to FIG. 1 of the accompanying drawings, there is shown a robotic system, generally designated 10, for picking and / or sorting objects 16.
[0139] As shown, the robotic system 10 is operatively associated with a conveyor arrangement, generally indicated at 12, which includes a conveyor 14 for transporting objects 16p that are desired to be picked up and / or sorted, such as objects 16 including waste and / or recyclables, as shown in Fig. 1. The illustrated conveyor 14 takes the form of a belt conveyor; however, it will be understood that the robotic system 10 is operable with various types of conveyors.
[0140] The conveyor arrangement 12 shown in Figure 1 forms part of a materials recovery facility MRF (see Figure 13). However, it will be appreciated that alternative robotic systems according to the present disclosure may be provided in combination with or include conveyor portions that form or form part of a stand-alone object picking and / or sorting system 1000 (see Figure 12).
[0141] In use, the robotic system 10 is operable to pick up selected objects 16p from the conveyor 14 and place them in a selected bin or hopper (not shown).
[0142] As shown in FIG. 1 , the robotic system 10 includes a collaborative robotic grabber arrangement, generally designated 20, that includes a plurality of robotic grabbers 22a, 22b, each configured to grab one or more objects 16p from a conveyor 14.
[0143] 2 of the accompanying drawings, the robotic system 10 further includes a processing system 24. The processing system 24 is configured to receive sensor data 26a, 26b, 26c relating to the conveyed objects 16 from sensors 28a, 28b, 28c of a sensor arrangement 30 forming part of, coupled to, or operatively associated with the robotic system 10. The processing system 24 is configured to query the received sensor data 26a, 26b, 26c using one or more object detection algorithms to determine whether any of the conveyed objects 16 correspond to a predetermined class of objects 16p to be picked and / or sorted by the robotic system 10.
[0144] The processing system 24 is also configured to receive position data 26d, 26e, 26f relating to the object(s) 16p being grasped and / or sorted from sensors 28d, 28e, 28f of the sensor arrangement 30, and velocity data 26g, 26h, 26i relating to the object(s) 16p being grasped and / or sorted from sensors 28g, 28h, 28i of the sensor arrangement 30.
[0145] In the illustrated robotic system 10, the processing system 24 is also configured to receive velocity data 32 regarding the object(s) 16p being picked and / or sorted from one or more sensors 34 on the conveyor 14.
[0146] The processing system 24 is configured to consult the received position data 26d, 26e, 26f and velocity data 26g, 26h, 26i to determine a predicted position of the object(s) 16p to be picked up and / or sorted as they pass through the robotic picker arrangement 20.
[0147] The processing system 24 is configured to output one or more command signals 36a, 36b, 38a, 38b to the robotic grabber arrangement 20 to position one of the robotic grabbers 22a, 22b relative to the conveyor 14 to enable the robotic grabber 22a, 22b to grab an object 16p to be grabbed and / or sorted from the conveyor 14.
[0148] In use, the robotic system 10 is positioned relative to the conveyor 14 such that the robotic picker arrangement 20 of the robotic system 10 is able to pick up objects 16p from the conveyor 14. The processing system 24 of the robotic system 10 receives sensor data 26a, 26b, 26c relating to the objects 16 being transported by the conveyor 14 and uses one or more object detection algorithms on the sensor data 26a, 26b, 26c to determine whether any of the objects 16 being transported by the conveyor 14 corresponds to a predetermined class of objects 16p to be picked and / or sorted by the robotic system 10. The processing system 24 also receives position data 26d, 26e, 26f relating to the objects to be picked and / or sorted 16p and velocity data 26g, 26h, 26i, 32 relating to the objects to be picked and / or sorted 16p, which are processed by the processing system 24 to determine a predicted position of the objects to be picked and / or sorted 16p as they pass through the robotic picker arrangement 20. The processing system 24 then outputs one or more command signals 36a, 36b, 38a, 38b to the robotic picker arrangement 20 to position one of the robotic pickers 22a, 22b relative to the conveyor 14 such that the robotic picker 22a, 22b can pick a selected object to be picked and / or sorted 16p from the conveyor 14 and transport the object 16p to a bin or hopper (not shown).
[0149] The robotic system 10 provides many significant advantages over conventional systems and techniques for picking and / or sorting objects 16. For example, the processing system 24 of the robotic system 10 provides command signals 36a, 36b, 38a, 38b to the multiple robotic pickers 22a, 22b, such that the robotic system 10 can operate the robotic pickers 22a, 22b in a coordinated manner. This facilitates a greater capacity in terms of the amount of objects 16p that can be picked and / or sorted and / or a greater capacity in terms of the types of objects 16p that can be picked and / or sorted at one time.
[0150] The provision of a collaborative robotic grabber arrangement 20 means that each robotic grabber 22a, 22b can be assigned multiple classes of objects 16p to be grabbed and / or sorted. In the illustrated robotic system 10, each robotic grabber 22a, 22b is capable of picking and / or sorting all required classes of objects 16p to be grabbed and / or sorted, and the selected robotic grabber 22a, 22b assigned to a given object 16p to be grabbed and / or sorted is selected by the processing system 24.
[0151] The robotic picker 22a, 22b may be selected by the processing system 24 according to a number of factors. The processing system 24 may be configured to receive position data 40a, 40b and / or operating status data 42a, 42b for each robotic picker 22a, 22b. The processing system may query the position data 40a, 40b and / or operating status data 42a, 42b for each robotic picker 22a, 22b to determine which robotic picker 22a, 22b to assign to pick and / or sort the selected object 16p.
[0152] Beneficially, the robotic pickers 22a, 22b working together as a team promotes greater operational efficiency because the robotic pickers 22a, 22b can be selected to reduce redundancy of each robotic picker 22a, 22b and / or to reduce the distance traveled for a given object 16p to be picked and / or sorted, thereby increasing response time and reducing energy usage.
[0153] As mentioned above, in the waste disposal and recycling field, human workers are currently involved in picking out contaminants such as tape, wire, diapers and plastic bags, ensuring that various waste materials are correctly sorted, and taking corrective action as necessary. As mentioned above, such manual processes pose significant health risks to workers working near waste disposal systems, both in terms of their proximity to machinery and potential exposure to hazardous substances.
[0154] The robotic system 10 facilitates efficient picking and / or sorting of such contaminants, thereby eliminating or at least reducing personnel exposure to these potentially hazardous materials. The robotic system 10 also facilitates efficient identification of the objects 16p to be picked, thereby eliminating or at least reducing the need for manual verification. Efficient identification of the objects 16p to be picked may reduce the presence of contaminants (i.e., objects 16p that should have been removed) among the recyclables, which would otherwise reduce their value and / or in some cases mean that they would have to be reprocessed, or in some cases mean that they would be unsuitable for further processing and would have to be sent to a landfill.
[0155] As described above, the robotic system 10 includes a robotic picker arrangement 20 operably associated with the conveyor 14 for transporting the objects 16 to be sorted, which includes a plurality of robotic pickers 22a, 22b, each configured to pick up one or more selected objects 16p from the conveyor 14.
[0156] In the illustrated robotic device 10, the device 10 includes two robotic pickers 22a, 22b. However, it will be understood that the robotic device 10 may include any suitable number of robotic pickers 22a, 22b.
[0157] Beneficially, because the processing system 24 is configured to operate with the robotic picker arrangement 20 comprising multiple robotic pickers 22a, 22b, the robotic system 10 can be easily scaled such that the robotic system 10 is very flexible with respect to the size and / or type of facility in which the robotic system 10 can be installed and / or utilized. For example, the robotic system 10 can be easily adapted if the size of a given facility increases without requiring major changes to the processing system infrastructure. Alternatively, the robotic system 10 can be used in facilities that would otherwise be considered too small or too remote to merit the investment required for an automated system. For example, in the case of waste management and / or recycling facilities, the robotic system 10 may be used in MRFs that would otherwise be considered unsuitable for an automated system where waste would be transported to more distant centralized facilities requiring additional carbon footprints.
[0158] Figures 3 and 4 of the accompanying drawings show a robotic picker 22a.
[0159] As shown in Figure 3, the robotic picker 22a takes the form of a floor mounted robot. The robotic picker 22a includes a frame 44a that extends over the conveyor 14. The frame 44a includes one or more ground engaging members 46a in the form of upright posts and a horizontal member 48a. The horizontal member 48a is coupled to and movable relative to the ground engaging member 46a.
[0160] As shown in FIG. 3, the robotic picker 22a further includes a robotic arm 50a that is mounted and supported by the frame 44a.
[0161] In use, the robotic picker 22a is configured to translate the robotic arm 50a horizontally and vertically relative to the frame 44a to position the robotic arm 50a laterally and vertically relative to the conveyor 14.
[0162] The robotic picker 22a includes an actuator arrangement, generally designated 52a, for translating the robotic arm 50a relative to the frame 44a. In the illustrated robotic system 10, the actuator arrangement 52a includes belt-driven linear actuators 54a, 56a operable by servo motors 58a, 60a. The actuator 54a is configured to translate the robotic arm 50a horizontally / laterally relative to the frame 44a. The actuator 56a is configured to translate the robotic arm 50a vertically relative to the frame 44a. Although the robotic system 10 includes actuators 54a, 56a for translating the robotic arm 50a horizontally and vertically, in alternative robotic systems according to the present disclosure, the robotic system may include actuators for only translating the robotic arm horizontally. In such an embodiment, the robotic arm may perform all of the vertical translation required to pick up a selected object.
[0163] In use, the robot system 10 is operable to rapidly move the robot arm 50a from a first position relative to the frame 44a to a second position relative to the frame 44a, and then achieve the movement to the position required to grasp the object 16p.
[0164] 4, the robotic picker 22a includes a coupling arrangement 62a for coupling the robotic arm 50a to the actuator 54a. In the illustrated robotic system 10, the coupling arrangement 62a takes the form of a carriage configured to couple to the actuator 54a on one hand and to the robotic arm 50a on the other hand. In the illustrated robotic system 10, the robotic arm 50a is removably coupled to the coupling arrangement 62a. Beneficially, this allows the robotic arm 50a to be easily removed for repair and / or replaced with an alternative robotic arm.
[0165] As shown in FIG. 4, the robot arm 50a of the robotic picker 22a takes the form of a six-axis robot including a first member 64a rotatably coupled at a proximal end to the frame 44a via a coupling arrangement 62a and at a distal end to a second member 66a.
[0166] The robotic arm 50a further comprises a manipulator 68a coupled to and supported by the second member 66a. In the illustrated robotic device 10, the manipulator 68a takes the form of a vacuum gripper configured to grasp objects 16p to be picked and / or sorted.
[0167] Figures 5 and 6 of the accompanying drawings show a robotic picker 22b.
[0168] As shown in Figure 5, the robotic picker 22b takes the form of a floor mounted robot. The robotic picker 22b comprises a frame 44b that extends over the conveyor 14. The frame 44b comprises one or more ground engaging members 46b in the form of upright posts and a horizontal member 48b. The horizontal member is coupled to the ground engaging members 46b and is movable relative to the ground engaging members.
[0169] As shown in FIG. 5, the robotic picker 22b further includes a robotic arm 50b that is mounted and supported by the frame 44b.
[0170] In use, the robotic picker 22b is configured to translate the robotic arm 50b horizontally and vertically relative to the frame 44b to position the robotic arm 50b laterally and vertically relative to the conveyor 14.
[0171] The robotic picker 22b includes an actuator arrangement, generally designated 52b, for translating the robotic arm 50b relative to the frame 44b. In the illustrated robotic system 10, the actuator arrangement 52b includes belt-driven linear actuators 54b, 56b operable by servo motors 58b, 60b. The actuator 54b is configured to translate the robotic arm 50b horizontally / laterally relative to the frame 44b. The actuator 56b is configured to translate the robotic arm 50b vertically relative to the frame 44b.
[0172] In use, the robotic system 10 is operable to rapidly move the robot arm 50b from a first position relative to the frame 44b to a second position relative to the frame 44b, and then achieve the movement to the position required to grasp the object 16p.
[0173] 6, the robotic picker 22b includes a coupling arrangement 62b for coupling the robotic arm 50b to the actuator 54b. In the illustrated robotic system 10, the coupling arrangement 62b takes the form of a carriage configured to couple to the actuator 54b on one hand and to the robotic arm 50b on the other hand. In the illustrated robotic system 10, the robotic arm 50b is removably coupled to the coupling arrangement 62b. Beneficially, this allows the robotic arm 50b to be easily removed for repair and / or replaced with an alternative robotic arm.
[0174] As shown in FIG. 6, the robot arm 50b of the robotic picker 22b takes the form of a six-axis robot having a first member 64b rotatably coupled at a proximal end to the frame 44b via a coupling arrangement 62b and at a distal end to a second member 66b.
[0175] The robotic arm 50b further comprises a manipulator 68b coupled to and supported by a second member 66b. In the illustrated robotic device 10, the manipulator 68b takes the form of a mechanical gripper configured to grasp objects 16p to be picked and / or sorted.
[0176] 1 and 2, and also with reference to Figure 7 of the accompanying drawings, the sensor arrangement 30 of the illustrated robotic system 10 comprises a vision system arranged on a frame 70 upstream of the robotic picker arrangement 20, with sensor 28a taking the form of a 2D camera, sensor 28b taking the form of a remote sensing device, e.g. a LIDAR, and sensor 28c taking the form of an RGB sensor. In use, the processing system 24 utilises sensor fusion techniques, e.g. sensor fusion algorithms.
[0177] 2, the sensor arrangement 30 further comprises a sensor 72a in the form of a camera disposed on the robot arm 50a and a sensor 72b in the form of a camera disposed on the robot arm 50b. The sensor arrangement 30 of the illustrated robotic system 10 further comprises a sensor 74a in the form of a camera disposed on the frame 44a and a sensor 74b in the form of a camera disposed on the frame 44b.
[0178] In use, sensors 72a, 72b, 74a, 74b are utilized to supplement data from sensors positioned upstream of the robotic picker arrangement 20, thereby providing a more accurate indication of the position of the robotic pickers 22a, 22b and / or the object 16p being picked and / or sorted.
[0179] As described above, the processing system 24 receives sensor data regarding the objects 16 being transported by the conveyor 14 from the sensor arrangement 30, and the processing system 24 uses one or more object detection algorithms on the sensor data to determine whether any of the objects 16 being transported by the conveyor 14 correspond to a predetermined class of objects 16p to be picked up and / or sorted by the robotic system 10.
[0180] Beneficially, by using one or more object detection algorithms, the robotic system 10 can identify a wide range of objects 16p, such as waste and / or contaminants, that are present on the conveyor 14.
[0181] The processing system 24 implements artificial intelligence, and the processing system 24 may process the received data using one or more of deep neural networks, deep reinforcement learning algorithms, and object detection algorithms.
[0182] 1, the robotic system 10 includes a communication arrangement, generally indicated at 76. In the illustrated robotic system 10, the communication arrangement includes a wireless communication arrangement in the form of a two-way radio frequency communication arrangement. However, it will be appreciated that the communication arrangement may alternatively or additionally include or employ a form of wired communication arrangement, such as an electrical wire and / or optical fiber communication arrangement and / or a one-way communication arrangement.
[0183] In use, the processing system 24 receives information from the sensor arrangement 30 and / or the conveyor 12 via the communications arrangement 76 and communicates one or more command signals to the robotic picker arrangement 20 via the communications arrangement 76 .
[0184] The communications arrangement 76 may be utilized to communicate information to a remote location. In the illustrated robotic system 10, the remote location takes the form of a control room 78 and / or a mobile device 80.
[0185] The robotic system 10 further includes a human machine interface in the form of a workstation 82 .
[0186] Various modifications may be made without departing from the scope of the invention as defined in the claims.
[0187] For example, Figure 8 of the accompanying drawings illustrates an alternative robotic system 110. The robotic device 110 is similar to system 10. As noted above, the robotic device is easily expandable and includes a collaborative robot picker arrangement 120 that includes four robotic pickers 122a, 122b, 122c, 122d operatively associated with the conveyor 114 of the conveyor arrangement 112, rather than the two robotic pickers 22a, 22b in robotic system 10.
[0188] 9, 10 and 11 of the accompanying drawings show an alternative robotic system 210 for picking and / or sorting objects 16.
[0189] As shown, the robotic system 210 is operatively associated with a conveyor arrangement, generally indicated at 212, which includes a conveyor 214 for transporting objects 16p to be picked and / or sorted, e.g., objects 16 including waste and / or recyclables, as shown in Figure 9. The illustrated conveyor 214 takes the form of a belt conveyor; however, it will be understood that the robotic system 210 can operate with various types of conveyors.
[0190] In use, the robotic system 210 is operable to pick up a selected object 16p from the conveyor 214 and place it in a selected bin or hopper (not shown).
[0191] The robotic system 210 includes a collaborative robotic picker arrangement, generally designated 220, that includes multiple robotic pickers 222 (only one of the robotic pickers 222 is shown for clarity and ease of reference).
[0192] 11, the robotic system 210 further includes a processing system 224. The processing system 224 is similar to the processing system 24 described above. The processing system 224 is configured to receive sensor data 226a, 226b, 226c relating to the conveyed objects 16 from sensors 228a, 228b, 228c of a sensor arrangement 230 forming part of, coupled to, or operatively associated with the robotic system 210. The processing system 224 is configured to query the received sensor data 226a, 226b, 226c using one or more object detection algorithms to determine whether any of the conveyed objects 16 correspond to a predetermined class of objects 16p to be picked and / or sorted by the robotic system 210.
[0193] The processing system 224 is also configured to receive position data 226d, 226e, 226f relating to the object(s) 16p being grabbed and / or sorted from the sensors 228d, 228e, 228f of the sensor configuration 230, and velocity data 226g, 226h, 226i relating to the object(s) 16p being grabbed and / or sorted from the sensors 228g, 228h, 228i of the sensor configuration 230.
[0194] In the illustrated robotic system 210 , the processing system 224 is also configured to receive velocity data 232 regarding the object(s) 16 p being picked and / or sorted from one or more sensors 234 on the conveyor 214 .
[0195] The processing system 224 is configured to interrogate the received position data 226d, 226e, 226f and velocity data 226g, 226h, 226i to determine a predicted position of the object(s) 16p to be picked up and / or sorted as they pass through the robotic picker arrangement 220.
[0196] The processing system 224 is configured to output one or more command signals 236a, 236b, 238a, 238b to the robotic grabber arrangement 220 to position one of the robotic grabbers 222 relative to the conveyor 214 so as to enable a selected robotic grabber 222 to grab an object 16p to be grabbed and / or sorted from the conveyor 214.
[0197] In use, the robotic system 210 is positioned relative to the conveyor 214 such that the robotic picker arrangement 220 of the robotic system 210 can pick objects 16 from the conveyor 214. The processing system 224 of the robotic system 210 receives sensor data 226a, 226b, 226c relating to the objects 16 being transported by the conveyor 214 and uses one or more object detection algorithms on the sensor data 226a, 226b, 226c to determine whether any of the objects 16 being transported by the conveyor 214 correspond to a predetermined class of objects 16p to be picked and / or sorted by the robotic system 210. The processing system 224 also receives position data 226d, 226e, 226f for the objects to be picked and / or sorted 16p and velocity data 226g, 226h, 226i, 232 for the objects to be picked and / or sorted 16p, which are processed by the processing system 224 to determine a predicted position of the objects to be picked and / or sorted 16p as they pass through the robotic picker arrangement 220. The processing system 224 then outputs one or more command signals 236a, 236b, 238a, 238b to the robotic picker arrangement 220 to position one of the robotic pickers 222 with respect to the conveyor 214 such that the robotic picker 222 can pick a selected object to be picked and / or sorted 16p from the conveyor 214 and transport the object 16p to a bin or hopper (not shown).
[0198] 9 and 10, robotic picker 222 takes the form of a floor mounted robot. Robotic picker 222 comprises a frame 244 that extends over conveyor 214. Frame 244 comprises ground engaging members 246 in the form of upright posts and horizontal members 248. Horizontal members 248 are coupled to ground engaging members 246 and are movable relative to the ground engaging members.
[0199] The robotic picker 222 further includes a robotic arm 250 that is mounted and supported by the frame 244 .
[0200] In use, the robotic picker 222 is configured to translate the robotic arm 250 horizontally to position the robotic arm 250 laterally relative to the conveyor 214 .
[0201] The robotic picker 222 further includes an actuator arrangement, generally indicated at 252, for translating the robotic arm 250 relative to the frame 244. In the illustrated robotic system 210, the actuator arrangement 252 comprises or takes the form of a belt-driven linear actuator.
[0202] As shown, the robotic grabber 222 includes a rotary drive 284, which in the illustrated system 210 takes the form of a motor. The rotary drive 284 is coupled to one of the ground engaging members 246 via a bracket 286. A first pulley 288, which in operation defines a drive pulley of the actuator arrangement 252, is disposed on a drive shaft 290 of the rotary drive 284 such that the first pulley 288 is driven by the rotary drive 284.
[0203] A belt 292 is disposed about the first pulley 288 and extends about a second pulley 294 which, when activated, defines a driven pulley of the actuator arrangement 252. As shown, the second pulley 294 is rotatably mounted to the other ground engaging member 246 via a shaft 296 and a bracket 298.
[0204] In the illustrated system, the horizontal members 248 include or take the form of rails that extend between the ground engaging members 246 .
[0205] The robotic picker 222 includes a coupling arrangement 262 for coupling the robotic arm 250 to the actuator arrangement 252. In the illustrated robotic system 210, the coupling arrangement 262 takes the form of a carriage that is slidably mounted to the horizontal member 248. The coupling arrangement 262 is configured to engage and be driven by the belt 292.
[0206] 9 and 10, the robotic arm 250 of the robotic picker 222 takes the form of a six-axis robot and includes a manipulator 268. In the illustrated robotic device 210, the manipulator 268 takes the form of a gripper configured to grasp the objects 16p to be picked and / or sorted.
[0207] In use, the rotational drive 284 and actuator arrangement 252 are operable to move the robot arm 250 from a first lateral position to a second lateral position. In moving the robot arm 250 from the first position to the second position, the robot arm 250 achieves itself in the position required to grasp the object 16p.
[0208] Advantageously, the system 210 is configured and / or operable to rapidly move the robotic arm 250 from a first position to a second position, with the robotic arm 250 providing slower, more precise movements as the robotic arm 250 approaches an object 16p to be grasped and / or sorted.
[0209] 12 of the accompanying drawings illustrates an object picking and / or sorting system 1000. As mentioned above, whereas the above-described robotic system 10 is operatively associated with a conveyor arrangement 12 including a conveyor 14, the object picking and / or sorting system 1000 includes a robotic system 1110 and a conveyor arrangement 1112 including a conveyor 1114. The robotic system 1110 corresponds to the robotic system 110 and includes a robotic picker arrangement 1120 including four robotic pickers 1122a, 1122b, 1122c, 1122d. However, it will be appreciated that the robotic system 1110 may alternatively include or take the form of the robotic system 10.
[0210] Beneficially, the object picking and / or sorting system 1000 may provide a stand-alone system for picking and / or sorting objects 16.
[0211] As noted above, the robotic systems 10, 110 are particularly beneficial for use in picking up objects 16p in a materials recovery facility (MRF). Figure 13 of the accompanying drawings illustrates a materials recovery facility MRF that includes multiple robotic systems, more specifically, one of two agent robotic systems 10 and one of four agent robotic systems 110. However, it will be appreciated that a materials recovery facility MRF may include one of the robotic systems 10 or 110, one or more of the object picking and / or sorting systems 1000, or any combination of the robotic systems 10, 110 and the object picking and / or sorting system 1000.
[0212] It will be appreciated that the robotic systems described herein are configured and / or operable to pick up and / or sort objects in a variety of fields, including, for example, but not limited to, construction, e-waste, and / or textile fields. For example, in the construction field, the robotic system may be configured and / or operable to pick up and / or sort objects such as waste materials, tarpaulins, metal bars, metal box sections, and / or rubble. For example, in the e-waste field, the robotic system may be configured and / or operable to pick up and / or sort objects such as printed circuit boards, valves, wires, and / or electrical components such as capacitors, resistors, diodes, etc. For example, in the textile field, the robotic system may be configured and / or operable to pick up and / or sort objects such as cotton materials, nylon materials, synthetic materials, linen materials, uniforms, and / or accessories such as belts.
[0213] As an example, Figure 14 of the accompanying drawings shows a robotic system, generally designated 310, for picking and / or sorting objects 16'.
[0214] As shown, the robotic system 310 is operatively associated with a conveyor arrangement generally designated 312 including a conveyor 314 for transporting objects 16', which as shown in FIG. 14 includes objects 16p' in the form of items of construction waste to be picked up and / or sorted.
[0215] In use, the robotic system 310 is operable to pick up a selected object 16p from the conveyor 314 and place it in a selected bin or hopper (not shown).
[0216] The robotic system 310 includes a collaborative robotic grabber arrangement generally designated 320 that includes a plurality of robotic grabbers 322 (only one of the robotic grabbers 322 is shown for clarity and ease of reference). As shown in Figure 14, the robotic system 310 substantially corresponds to the robotic system 210 described above. However, it will be understood that any of the robotic systems may be used to grab and / or sort other types of objects, such as objects 16' or objects from the e-waste and / or textile fields.
Claims
1. 1. A robotic system for picking and / or sorting objects, comprising: a collaborative robotic picker arrangement operatively associated with a conveyor arrangement for transporting objects to be sorted, the robotic picker arrangement comprising a plurality of robotic pickers each configured to pick one or more selected objects from the conveyor arrangement; Processing system and Equipped with the processing system is configured to receive sensor data relating to objects being transported by the conveyor arrangement from a sensor arrangement forming part of, coupled to, or operatively associated with the robotic system; the processing system is configured to query the received sensor data using one or more object detection algorithms to determine from the received sensor data whether any one of the objects being conveyed by the conveyor arrangement corresponds to a predefined class of object to be picked and / or sorted by the robotic system; the processing system is configured to receive position data relating to objects to be picked and / or sorted from the sensor arrangement and velocity data relating to objects to be picked and / or sorted from the sensor arrangement and / or the conveyor arrangement; the processing system is configured to interrogate the received position and velocity data to determine predicted positions of objects to be picked and / or sorted as they pass through the robotic picker arrangement; A robotic system, wherein the processing system is configured to output one or more command signals to the robotic picking devices to position one of the robotic pickers relative to the conveyor arrangement to enable the robotic picker to pick selected objects to be picked and / or sorted from the conveyor arrangement.
2. The robotic system of claim 1 , wherein the robotic system comprises or takes the form of an integrated robotic picking and / or sorting system.
3. 3. The robotic system of claim 1 or 2, wherein the robotic system comprises or takes the form of a distributed robotic picking and / or sorting system.
4. The robotic system of claim 1 , 2 or 3 , wherein the robotic system is modular.
5. 5. The robotic system of claim 1, wherein the processing system of the robotic system is configured to receive position data and / or operational status data associated with each robotic picker, and the processing system is configured to query the position data and / or operational status associated with each robotic picker to determine which robotic picker to assign to selected objects to be picked and / or sorted.
6. The robotic system of any one of claims 1 to 5, wherein the robotic system comprises the conveyor arrangement and is coupled to or operatively associated with the conveyor arrangement, the conveyor arrangement comprising one or more conveyors.
7. 7. The robotic system of claim 1, wherein one or more of the robotic pickers comprises a frame and one or more robotic arms, the one or more robotic arms being attached to and supported by the frame.
8. The robotic system of claim 7 , wherein the robotic picker is configured to move the robotic arm horizontally and / or vertically relative to the frame.
9. The robotic system of claim 8 , wherein the robotic picker comprises an actuator arrangement for translating the robotic arm relative to the frame.
10. 10. The robotic system of claim 7, 8 or 9, wherein the robotic picker comprises a drive arrangement including one or more first drives configured to move the robot arm from a first position relative to the frame to a second position relative to the frame, and one or more second drives configured to move the robot arm from the second position relative to the frame to a third position relative to the frame.
11. The sensor configuration includes: one or more sensors configured to acquire the sensor data relating to the objects conveyed by the conveyor arrangement; one or more sensors configured to acquire the position data regarding the objects to be picked and / or sorted; and one or more sensors configured to obtain the velocity data regarding the objects being picked and / or sorted. The robot system according to any one of claims 1 to 9, comprising at least one of the following:
12. A robotic system according to any preceding claim, wherein the sensor arrangement comprises or takes the form of a vision system.
13. The robotic system of any one of claims 1 to 12, wherein the sensor arrangement comprises a camera.
14. The robotic system of claim 13 , wherein the camera comprises or takes the form of a 2D camera.
15. The robotic system of any one of claims 1 to 14, wherein the sensor arrangement comprises a remote sensing device.
16. The robotic system of claim 15 , wherein the remote sensing device comprises or takes the form of a LIDAR.
17. The robot system of any one of claims 1 to 16, wherein the sensor configuration comprises an RGB sensor.
18. The robotic system of any one of claims 1 to 17, wherein at least a portion of the sensor arrangement is disposed on a frame, a pole, or an upright member.
19. The robot system of any one of claims 7 to 18, wherein the sensor arrangement further comprises one or more sensors disposed on the robot arm, and / or the sensor arrangement comprises one or more sensors disposed on a frame of the robotic picker.
20. The robotic system of any one of claims 1 to 19, wherein the processing system or part of the processing system implements artificial intelligence, and the processing system processes the received data using one or more of a deep neural network, a deep reinforcement learning algorithm, and an object detection algorithm.
21. The robotic system of any one of claims 1 to 20, wherein each of the robotic pickers of the robotic picker arrangement comprises an operating system.
22. The robot system according to any one of claims 1 to 20, comprising a wired or wireless communication configuration.
23. 1. A robotic picker for picking and / or sorting objects from a conveyor arrangement, comprising: a frame comprising one or more ground engaging members and a horizontal or substantially horizontal member configured to extend or at least partially extend over one or more conveyors of the conveyor arrangement; a robot arm attached to and supported by the frame; an actuator arrangement for translating the robot arm relative to the frame, the actuator arrangement comprising or taking the form of one or more belt driven linear actuators; The robotic pick-up machine includes:
24. 24. The robotic picker of claim 23, wherein the robotic picker is configured to move the robotic arm horizontally and / or vertically relative to the frame.
25. 25. The robotic picker of claim 23 or 24, wherein the robotic picker comprises a drive arrangement.
26. the drive arrangement comprises one or more drives configured to move the robot arm from a first vertical position to a second vertical position; 26. The robotic picker of claim 25, wherein the one or more drives configured to move the robotic arm from the first vertical position to the second vertical position move the robotic arm by moving the horizontal or substantially horizontal member relative to the one or more ground engaging members.
27. the drive arrangement comprises one or more drives configured to move the robotic arm from a first lateral position to a second lateral position; 27. The robotic picker of claim 25 or 26, wherein the one or more drives configured to move the robotic arm from the first lateral position to the second lateral position move the robotic arm relative to the horizontal or substantially horizontal member.
28. 28. The robotic picker of claim 27 when dependent on claim 26, wherein the drive arrangement is configured and / or operable to move the robot arm vertically at a faster rate than the drive arrangement moves the robot arm laterally.
29. 30. The robotic picker of claim 26, 27 or 28, wherein the robotic arm achieves the movements necessary to pick up the object.
30. 30. The robotic picking machine of claim 29, wherein the drive arrangement is configured and / or operable to move the robotic arm vertically and / or horizontally at a rate faster than a rate at which the robotic arm will achieve the movement required to pick up the object.
31. A robotic system for picking and / or sorting objects comprising one or more robotic pickers according to any one of claims 23 to 30.
32. a collaborative robotic picker arrangement operatively associated with a conveyor arrangement for transporting objects to be sorted, the robotic picker arrangement comprising a plurality of robotic pickers each configured to pick one or more selected objects from the conveyor arrangement; Processing system and Equipped with the processing system is configured to receive sensor data relating to objects being transported by the conveyor arrangement from a sensor arrangement forming part of, coupled to, or operatively associated with the robotic system; the processing system is configured to query the received sensor data using one or more object detection algorithms to determine from the received sensor data whether any one of the objects being conveyed by the conveyor arrangement corresponds to a predefined class of object to be picked and / or sorted by the robotic system; the processing system is configured to receive position data relating to objects to be picked and / or sorted from the sensor arrangement and velocity data relating to objects to be picked and / or sorted from the sensor arrangement and / or the conveyor arrangement; the processing system is configured to interrogate the received position and velocity data to determine predicted positions of objects to be picked and / or sorted as they pass through the robotic picker arrangement; 32. The robotic system of claim 31, wherein the processing system is configured to output one or more command signals to the robotic pickers to position one of the robotic pickers relative to the conveyor arrangement to enable the robotic picker to pick selected objects to be picked and / or sorted from the conveyor arrangement.
33. 33. A robotic system according to claim 31 or 32, comprising or taking the form of an integrated robotic picking and / or sorting system.
34. 34. A robotic system according to claim 31, 32 or 33, wherein the robotic system comprises or takes the form of a distributed robotic picking and / or sorting system.
35. The robotic system of any one of claims 31 to 34, wherein the robotic system is modular.
36. 36. The robotic system of claim 32, wherein the processing system of the robotic system is configured to receive position data and / or operational state data associated with each robotic picker, and the processing system is configured to query the position data and / or operational state associated with each robotic picker to determine which robotic picker to assign to selected objects to be picked and / or sorted.
37. The robotic system of any one of claims 31 to 36, wherein the robotic system comprises the conveyor arrangement and is coupled to or operatively associated with the conveyor arrangement, the conveyor arrangement comprising one or more conveyors.
38. The sensor configuration includes: one or more sensors configured to acquire the sensor data relating to the objects conveyed by the conveyor arrangement; one or more sensors configured to acquire the position data regarding the objects to be picked and / or sorted; and one or more sensors configured to obtain the velocity data regarding the objects being picked and / or sorted. The robot system according to any one of claims 32 to 37, comprising at least one of the following:
39. A robotic system according to any one of claims 32 to 38, wherein the sensor arrangement comprises or takes the form of a vision system.
40. The robot system of any one of claims 32 to 39, wherein the sensor arrangement comprises a camera.
41. 41. The robotic system of claim 40, wherein the camera comprises or takes the form of a 2D camera.
42. The robotic system of any one of claims 32 to 41, wherein the sensor arrangement includes a remote sensing device, the remote sensing device including or taking the form of a LIDAR.
43. The robot system of any one of claims 32 to 42, wherein the sensor configuration comprises an RGB sensor.
44. The robotic system of any one of claims 32 to 43, wherein at least a portion of the sensor arrangement is disposed on a frame, a pole, or an upright member.
45. The robot system of any one of claims 32 to 44, wherein the sensor arrangement further comprises one or more sensors disposed on the robot arm, and / or the sensor arrangement comprises one or more sensors disposed on a frame of the robotic picker.
46. The robotic system of any one of claims 32 to 45, wherein the processing system or a part of the processing system implements artificial intelligence, and the processing system processes the received data using one or more of a deep neural network, a deep reinforcement learning algorithm, and an object detection algorithm.
47. The robotic system of any one of claims 31 to 46, wherein each of the robotic pickers of the robotic picker arrangement comprises an operating system.
48. The robot system according to any one of claims 31 to 47, comprising a wired or wireless communication configuration.
49. One or more robotic systems according to any one of claims 1 to 22; One or more robotic pickers according to any one of claims 23 to 30, and / or One or more robotic systems according to any one of claims 31 to 48. A system for picking and / or sorting objects comprising:
50. One or more robotic systems according to any one of claims 1 to 22; One or more robotic pickers according to any one of claims 23 to 30, and / or One or more robotic systems according to any one of claims 31 to 48. A material recovery facility comprising:
51. The robot system according to any one of claims 1 to 22. A robotic picking machine according to any one of claims 23 to 30, The robot system according to any one of claims 31 to 48. A system for picking and / or sorting objects according to claim 49, and / or 51. The materials recovery facility of claim 50.
23. A method for picking and / or sorting objects using a pick-up device.
Citation Information
Patent Citations
Device for sorting waste
EP0439674A2
