Robot-assisted people routing
Through the autonomous robot system in the warehouse, the task is detected and recommended, and the status information is used to guide human operators to improve efficiency, solving the problem of inefficient human operators when looking for robots in large warehouses, optimizing task flow and reducing residence time.
Patent Information
- Application Number
- CN202080021296.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-02-01
- Filing Date
- 2020-01-31
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-01-31
AI Technical Summary
In large warehouses, human operators are inefficient when looking for robots that need assistance without guidance, resulting in increased residence time and serious congestion, affecting task completion efficiency.
Through autonomous robots running in the navigation space, using processors and memory to detect the human operator completing tasks and receive status information of other robots, determine and recommend the next task, presenting location information through the display to guide the operator to improve efficiency, considerations Including the robot's residence time, location, congestion level, etc.
It improves the task completion efficiency of human operators, reduces the residence time of unattended robots, optimizes task flow in navigation space, and reduces the risk of congestion.
Smart Images

Figure CN113574553B_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to U.S. Application No. 16 / 265,348, filed on February 1, 2019, which is incorporated herein by reference. Technical Field
[0003] The present invention relates to people routing, and more particularly to robot-assisted people routing. Background Art
[0004] Ordering products over the Internet for home delivery is an extremely popular way to shop. Fulfilling these orders in a timely, accurate and efficient manner is a logistical challenge, to say the least. Clicking the "Checkout" button in a virtual shopping cart creates an "order." The order includes a list of items to be shipped to a specific address. The process of "fulfillment" involves physically removing or "picking" these items from a large warehouse, packaging them, and shipping them to the specified address. Therefore, an important goal of the order fulfillment process is to ship as many items as possible in the shortest possible time.
[0005] The order fulfillment process typically takes place in a large warehouse containing many products, including the products listed in the order. Therefore, one of the tasks of order fulfillment is to traverse the warehouse to find and collect the various items listed in the order. In addition, the products that will ultimately be shipped need to be contained in the warehouse in the first place and stored or "placed" in storage bins throughout the warehouse in an orderly manner so that they can be easily retrieved for delivery.
[0006] In large warehouses, goods being delivered and ordered can be stored very far apart from each other in the warehouse and scattered among a large number of other goods. The order fulfillment process that utilizes only human operators to place and pick up goods requires operators to do a lot of walking and can be inefficient and time-consuming. Since the efficiency of the fulfillment process is a function of the number of items shipped per unit time, increasing time reduces efficiency.
[0007] To improve efficiency, robots can be used to perform human functions, or they can be used to supplement human activities. For example, a robot can be assigned to "place" multiple items at different locations scattered throughout a warehouse, or to "pick" items from different locations for packaging and delivery. Robots can complete pick and place alone or with the help of human operators. For example, in the case of a pick operation, a human operator picks items from a shelf and places them on the robot, or in the case of a place operation, a human operator picks items from a robot and places them on a shelf.
[0008] If human operators are deployed to assist robots in a shared navigation space, human operators who lack direction may not be fully utilized, thereby reducing the efficiency of human operators, increasing the dwell time of robots, and causing confusion and / or congestion in the shared navigation space. For example, a human operator may complete a task in the current aisle and prepare to assist the next robot, only to find that there is no robot in sight that needs assistance. Such an operator can simply wait for the robot to approach, or can guess and head in a specific direction in the hope of finding the robot that needs help. However, since the operator is just guessing or waiting, this approach is unlikely to always produce efficient results. In addition, in the absence of guidance or guidance, multiple human operators may initially chase the same robot. The operator then wastes the time required to go to the target robot, and when the operator realizes that they are chasing the same robot, the operator needs to waste time coordinating with other human operators which operator will assist the target robot, and go through the process of finding and going to another robot to assist. Summary of the invention
[0009] Systems and methods for robotic-assisted human routing are provided herein.
[0010] In one aspect, a robot-assisted personnel routing system is provided. The system includes a plurality of autonomous robots operating in a navigation space. Each robot includes a processor. Each robot also includes a memory. The memory stores instructions that, when executed by the processor, cause the autonomous robot to detect that a human operator has completed a task operation. The memory also stores instructions that, when executed by the processor, cause the autonomous robot to perform the following operations: receive state information corresponding to at least one other robot, the state information including at least one of a position or a waiting time associated with the other robot. The memory also stores instructions that, when executed by the processor, cause the autonomous robot to perform the following operations: determine at least one next task recommendation for guiding a human operator to a next robot for a next task operation based on the state information. The memory also stores instructions that, when executed by the processor, cause the autonomous robot to perform the following operations: present at least one next task recommendation on a display of the robot for viewing by a human operator, the next task recommendation including the position of the next robot corresponding to the next task.
[0011] In some embodiments, the state information includes the (x, y, z) position of at least one other robot within the navigation space. In some embodiments, the next robot is selected by determining a minimum straight-line distance to the at least one other robot. In some embodiments, the next robot is selected in response to one or more efficiency factors, the one or more efficiency factors including the dwell time of at least one other robot, the straight-line proximity of at least one other robot, the number of human operators approaching at least one other robot, the walking distance to at least one other robot, the priority of the task associated with at least one other robot, the congestion level near at least one other robot, or a combination thereof. In some embodiments, the next task recommendation is presented on the display as an interactive graphic. In some embodiments, in response to human operator input received through the interactive graphic, an expanded graphic is presented to provide additional information about the next task operation associated with the next task recommendation, to present additional next task recommendations to the human operator, or one or more of a combination thereof. In some embodiments, the expanded graphic includes one or more additional interactive graphics.
[0012] In some embodiments, the interactive graphics are configured to record a human operator selecting a next task operation from at least one next task recommendation. In some embodiments, the memory also stores instructions that, when executed by the processor, cause the autonomous robot to perform the following operations: in response to the recording of the next task selection, designate the selected task operation as ongoing within the personnel routing system to avoid redundant recommendations. In some embodiments, if the selected task operation is not completed within the specified time limit, the ongoing designation is removed. In some embodiments, status information is received directly from at least one other robot. In some embodiments, the status information is received from a robot monitoring server for monitoring robots in the navigation space, wherein the robot monitoring service is at least one of the following: integrated with at least one command server of the navigation space, integrated with a warehouse management system of the navigation space, a standalone server, a distributed system including processors and memories of at least two robots of a plurality of robots, or a combination thereof. In some embodiments, the navigation space is a warehouse. In some embodiments, at least one next task operation is at least one of a pick operation, a placement operation, or a combination thereof to be performed in the warehouse.
[0013] In another aspect, a method for robot-assisted personnel routing is provided. The method includes detecting, by a processor and a memory of an autonomous robot among a plurality of autonomous robots operating in a navigation space, that a human operator has completed a task operation. The method also includes: receiving, by a transceiver of the autonomous robot, state information corresponding to at least one other robot, the state information including at least one of a position or a wait time associated with the other robot. The method also includes: determining, based on the state information, at least one next task recommendation for directing the human operator to the next robot for a next task operation. The method also includes: presenting, on a display of the robot for viewing by the human operator, the at least one next task recommendation including a position of the next robot corresponding to the next task.
[0014] In some embodiments, the state information includes the (x, y, z) position of at least one other robot in the navigation space. In some embodiments, the method also includes selecting the next robot by determining the minimum straight-line distance to the at least one other robot. In some embodiments, the method also includes: selecting the next robot in response to one or more efficiency factors, the one or more efficiency factors including the dwell time of at least one other robot, the straight-line proximity of at least one other robot, the number of human operators close to at least one other robot, the walking distance to at least one other robot, the priority of the task associated with at least one other robot, the congestion level near at least one other robot, or a combination thereof. In some embodiments, the method also includes presenting the next task recommendation on the display as an interactive graphic. In some embodiments, the method also includes: in response to human operator input received through the interactive graphic, presenting an extended image to provide additional information about the next task operation associated with the next task recommendation, presenting additional next task recommendations to the human operator, or one or more of a combination thereof. In some embodiments, the extended graphic includes one or more additional interactive graphics. In some embodiments, the method also includes recording, through the interactive graphic, the human operator selecting the next task operation from at least one next task recommendation. In some embodiments, the method also includes, in response to recording of the next task selection, designating the selected task operation as ongoing within the human routing system to avoid redundant recommendations.
[0015] These and other features of the present invention will become apparent from the following detailed description and accompanying drawings, in which: BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is a top-down plan view of the order fulfillment warehouse;
[0017] Figure 2Ayes Figure 1 A front view of a base of one of the robots used in a warehouse is shown in;
[0018] Figure 2B yes Figure 1 A perspective view of the base of one of the robots used in the warehouse shown in FIG.
[0019] Figure 3 is shown equipped with an armature and parked on Figure 1 The front of the shelf shown in Figure 2A and Figure 2B A stereogram of the robot in
[0020] Figure 4 It is generated using the LiDAR on the robot Figure 1 A partial map of the warehouse;
[0021] Figure 5 is a flow chart depicting a process for locating fiducial markers dispersed throughout a warehouse and storing the fiducial marker poses;
[0022] Figure 6 is a table of mappings from fiducial markers to postures;
[0023] Figure 7 It is a table of mappings from positions to benchmark identifiers;
[0024] Figure 8 is a flow chart depicting the product SKU to posture mapping process;
[0025] Fig. 9 It is a map of robot and human activities in the warehouse;
[0026] Fig.10 It shows that Figure 3 Figure 1 shows an example of a next pick recommendation presented on a tablet computer of the robot;
[0027] Fig.11 It shows that Figure 3 FIG. 1 is another example of a next pick recommendation presented on a tablet of the robot shown;
[0028] Fig.12 is a block diagram of an example computing system; and
[0029] Fig.13 is a network diagram of an example distributed network. DETAILED DESCRIPTION
[0030] The present disclosure and its various features and advantageous details will be described in detail with reference to the non-limiting embodiments and examples described and / or shown in the accompanying drawings and in the following description. It should be noted that the features shown in the accompanying drawings are not necessarily drawn to scale, and those skilled in the art will recognize that the features of one embodiment can be used with other embodiments, even if not explicitly stated herein. The description of well-known components and processing techniques may be omitted so as not to unnecessarily obscure the embodiments of the present disclosure. The examples used herein are intended only to facilitate understanding of the ways in which the present disclosure may be practiced and to further enable those skilled in the art to practice the embodiments of the present disclosure. Therefore, the examples and embodiments herein should not be construed as limiting the scope of the present disclosure. In addition, it should be noted that the same reference numerals represent the same components throughout the several views of the accompanying drawings.
[0031] The present invention relates to robotic congestion management. Although not limited to any particular robotic application, one suitable application for which the present invention may be used is order fulfillment. The use of robots in this application will be described as providing context for robotic congestion management, but is not limited to that application.
[0032] refer to Figure 1 , a typical order fulfillment warehouse 10 includes shelves 12 that hold various items that may be included in an order. In operation, an input stream of orders 16 from a warehouse management server 15 arrives at an order server 14. The order server 14 can prioritize and group the orders so that they can be assigned to robots 18 during an induction process. When the robots are guided by an operator, at a processing station (e.g., station 100), the orders 16 are assigned and wirelessly transmitted to the robots 18 for execution. Those skilled in the art will appreciate that the order server 14 can be a separate server with a discrete software system configured to interoperate with the warehouse management system server 15 and the warehouse management software, or the order server functionality can be integrated into the warehouse management software and run on the warehouse management server 15.
[0033] In a preferred embodiment, Figure 2A and Figure 2BThe robot 18 shown in the figure includes an autonomous wheeled base 20 having a lidar 22. The base 20 also has a transceiver (not shown) and a pair of digital optical cameras 24a and 24b that enable the robot 18 to receive instructions from the order server 14 and / or other robots and send data to the order server 14 and / or other robots. The robot base also includes a charging port 26, which is used to charge a battery that powers the autonomous wheeled base 20. The base 20 also has a processor (not shown) that receives data from the lidar and cameras 24a and 24b to capture information representative of the robot's environment. There is a memory (not shown) that operates with the processor to perform various tasks related to navigation within the warehouse 10, and operates with the processor to navigate to reference markers 30 placed on the shelf 12, such as Figure 3 The reference mark 30 (e.g., a two-dimensional barcode) corresponds to the bin / location of the ordered item. Figures 4 to 8 The navigation method of the present invention is described in detail. According to one aspect of the present invention, the fiducial markers are also used to identify the charging station, and the navigation to such charging station fiducial markers is the same as the navigation to the order item bin / location. When the robot navigates to the charging station, a more accurate navigation method will be used to dock the robot with the charging station, and this navigation method is described below.
[0034] Reference again Figure 2B The base 20 includes an upper surface 32 on which a tote or bin may be stored to carry items. A joint 34 is also shown that engages a plurality of interchangeable armatures 40 ( Figure 3 Any one of these interchangeable armatures 40 is shown in FIG. Figure 3 The particular armature 40 in the embodiment has a container holder 42 (in this case, a shelf) for carrying a container 44 for receiving items and a tablet holder 46 for supporting a tablet (or laptop / other user input device) 48. In some embodiments, the armature 40 supports one or more containers 44 for carrying items. In other embodiments, the base 20 supports one or more containers for carrying received items. As used herein, the term "container" includes, but is not limited to, cargo holders, bins, cages, shelves, poles from which items can be hung, cans, crates, racks, racks, shelves, containers, boxes, barrels, vessels, and storage containers.
[0035] While the robot 18 is good at moving around the warehouse 10, the technical difficulties associated with robotic manipulation of objects make it difficult to quickly and efficiently pick items from shelves and place them on the container 44 using current robotic technology. A more efficient way to pick items is to use a local operator 50 (usually a human) to perform the task of physically removing the ordered item from the shelf 12 and placing it on the robot 18 (e.g., in the container 44). The robot 18 communicates the order to the local operator 50 via a tablet computer 48 (or laptop / other user input device) that the local operator 50 can read, or by sending the order to a handheld device used by the local operator 50.
[0036] Upon receiving an order 16 from the order server 14, the robot 18 goes to, for example, Figure 3 . This operation is based on navigation software stored in the memory and executed by the processor. The navigation software relies on data collected by the lidar 22 about the environment, internal tables in the memory, and cameras 24a and 24b to navigate, and the internal table identifies the reference identification ("ID") of the reference marker 30 corresponding to the location in the warehouse 10 where a specific item can be found.
[0037] When the correct position (pose) is reached, the robot 18 parks itself in front of the shelf 12 on which the item is stored, waiting for the local operator 50 to retrieve the item from the shelf 12 and place it in the container 44. If the robot 18 has other items to retrieve, it goes to those locations. The items retrieved by the robot 18 are then delivered to the processing station 100 ( Figure 1 ), at the processing station 100, the items are packaged and shipped. Although the processing station 100 has been described with reference to the figure as being capable of guiding and unloading / packing robots, it can be configured so that the robots are guided or unloaded / packed at one station, that is, they can be limited to performing a single function.
[0038] It will be appreciated by those skilled in the art that each robot can fulfill one or more orders and each order can consist of one or more items. Typically, some form of route optimization software will be included to improve efficiency, but this is beyond the scope of the present invention and is therefore not described herein.
[0039] In order to simplify the description of the present invention, a single robot 18 and operator 50 are described. Figure 1 As can be seen in Figure 1, a typical fulfillment operation consists of many robots and operators working collaboratively in a warehouse to fulfill a continuous stream of orders.
[0040] The following references Figures 4 to 8The baseline navigation method of the present invention is described in detail along with the semantic mapping of the SKU of an item to be retrieved to a fiducial ID / pose associated with a fiducial marker in the warehouse where the item is located.
[0041] Using one or more robots 18, a map of the warehouse 10 must be created and the locations of various fiducial markers scattered throughout the warehouse must be determined. To do this, the one or more robots 18 navigating within the warehouse build / update a map using their lidar 22 and simultaneous localization and mapping (SLAM), which is a computational problem of building or updating a map of an unknown environment. Fig.10 a( Figure 4 ). Popular SLAM approximation methods include particle filters and extended Kalman filters. The preferred method is the SLAM Mapping method, but any suitable SLAM method can be used.
[0042] As the robot 18 travels throughout the space, the robot 18 uses its lidar 22 to create a map of the warehouse 10. Fig.10 a, identifying open space 112, walls 114, objects 116, and other static obstacles such as shelves 12 in the space based on the reflections received by the robot 18 when the lidar scans the environment.
[0043] In the construction Fig.10 At the same time or later than a, one or more robots 18 scan the environment using cameras 26 to locate a bin (such as, Figure 3 The robot 18 navigates through the warehouse 10 by using reference markers (two-dimensional bar codes) on shelves (such as 32 and 34 in FIG. 1 ) scattered throughout the warehouse. The robot 18 uses a known starting point or origin, such as the origin 110, as a reference. When the robot 18 uses its camera 26 to locate a reference marker (such as, Figure 3 and Figure 4 When the reference mark 30 in the warehouse is detected, the position relative to the origin 110 in the warehouse is determined.
[0044] By using the wheel encoders and heading sensors, vector 120 and the position of the robot in the warehouse 10 can be determined. Using the captured image of the fiducial marker / two-dimensional barcode and its known size, the robot 18 can determine the orientation of the robot relative to the fiducial marker / two-dimensional barcode and the distance of the robot from the fiducial marker / two-dimensional barcode (vector 130). With vectors 120 and 130 known, vector 140 between the origin 110 and the fiducial marker 30 can be determined. Based on vector 140 and the determined orientation of the fiducial marker / two-dimensional barcode relative to the robot 18, the pose (position and orientation) of the fiducial marker 30 defined by the quaternion (x, y, z, ω) can be determined.
[0045] Flowchart 200( Figure 5 ) describes the fiducial marker location process. The process is performed in an initial mapping mode and as the robot 18 encounters new fiducial markers in the warehouse while performing pick, place, and / or other tasks. In step 202, the robot 18 using the camera 26 captures an image, and in step 204, the robot 18 searches for fiducial markers within the captured image. In step 206, if a fiducial marker is found in the image (step 204), a determination is made as to whether the fiducial marker has been stored in the fiducial table 300 (located in the memory 34 of the robot 18). Figure 6 ). If the reference information is already stored in the memory, the flowchart returns to step 202 to capture another image. If the reference information is not in the memory, the posture is determined according to the above process, and in step 208, the posture is added to the reference to posture lookup table 300.
[0046] In a lookup table 300 that can be stored in the memory of each robot, the fiducial identification 1, 2, 3, etc. of each fiducial marker and the pose of the fiducial marker / barcode associated with each fiducial marker are included. The pose consists of the x, y, z coordinates in the warehouse together with the orientation or quaternion (x, y, z, ω).
[0047] In another lookup table 400 ( Figure 7 ), there is a list of bins (e.g., 402a-f) within warehouse 10 associated with a particular reference ID 404 (e.g., number "11"). In this example, the bin consists of seven alphanumeric characters. The first six characters (e.g., L01001) pertain to the shelf location within the warehouse, and the last character (e.g., AF) identifies the specific bin at the shelf location. In this example, there are six different bins associated with reference ID "11". There may be one or more bins associated with each reference ID / tag.
[0048] Alphanumeric positions can be used by people (e.g. Figure 3 The operators 50 in the example understand that the locations correspond to physical locations in the warehouse 10 where the items are stored. However, they are meaningless to the robot 18. By mapping the locations to the reference IDs, the robot 18 can use the lookup table 300 ( Figure 6 ) to determine the pose of the reference ID and then navigate to the pose as described in this article.
[0049] In the flowchart 500 ( Figure 8) is depicted in the order fulfillment process according to the present invention. In step 502, the order server 14 obtains an order from the warehouse management system 15, which order may consist of one or more items to be retrieved. It should be noted that the order allocation process is quite complex and beyond the scope of the present disclosure. One such order allocation process is described in commonly owned U.S. patent application serial number 15 / 807,672, entitled “Order Grouping in Warehouse Order Fulfillment Operations,” filed on September 1, 2016, which is incorporated herein by reference in its entirety. It should also be noted that the robot may have an array of containers, one per bin or compartment, which allows a single robot to perform multiple orders. An example of such a container array is described in U.S. patent application serial number 15 / 254,321, entitled “Item Storage Array for Mobile Base in Robot Assisted Order-Fulfillment Operations,” filed on September 1, 2016, which is incorporated herein by reference in its entirety.
[0050] Continue to refer Figure 8 In step 504, the warehouse management system 15 determines the SKU number of the item, and in step 506, the bin is determined according to the SKU number. Then, the bin list of the order is sent to the robot 18. In step 508, the robot 18 associates the bin with the reference ID, and in step 510, obtains the posture of each reference ID according to the reference ID. In step 512, the robot 18 navigates to the bin such as Figure 3 The posture shown, in which the operator can pick up the item to be retrieved from the appropriate bin and place it on the robot.
[0051] Item specific information obtained by the warehouse management system 15 / order server 14 (such as SKU number and bin location) can be sent to the tablet computer 48 on the robot 18 so that when the robot arrives at each benchmark location, the operator 50 can be informed of the specific items to be retrieved.
[0052] With the SLAM map and the poses of the reference IDs known, the robot 18 can easily navigate to any of the reference IDs using a variety of robot navigation techniques. The preferred method involves setting an initial route to the pose of the reference marker, knowing the open space 112 and walls 114, shelves (such as shelf 12), and other obstacles 116 in the warehouse 10. When the robot begins to traverse the warehouse using its lidar 26, it determines whether there are any obstacles (such as other robots 18 and / or operators 50) in its path, whether fixed or dynamic, and repeatedly updates its path to the pose of the reference marker. The robot replans its route approximately every 50 milliseconds, constantly searching for the most efficient path while avoiding obstacles.
[0053] Utilizing the product SKU / benchmark ID to benchmark pose mapping techniques described herein in combination with SLAM navigation technology, the robot 18 is able to navigate the warehouse space very efficiently without having to use the more complex navigation methods commonly used that involve grid lines and intermediate benchmark markers for determining locations within the warehouse.
[0054] Robot-assisted people routing
[0055] Often, without guidance, human operators 50 may be underutilized. For example, a human operator may complete a task in the current aisle and prepare to assist the next robot, only to find that there is no robot in sight that needs assistance. Such an operator may simply wait for the robot to approach, or may guess and head in a specific direction, hoping to find the robot that needs help. However, since the operator is simply guessing or waiting, this approach is unlikely to consistently produce efficient results. For example, without guidance or guidance, multiple human operators 50 may initially chase the same robot 18. The operators 50 then waste time traveling to the target robot 18, and once the operators 50 realize that they are chasing the same robot 18, the operators 50 need to waste time coordinating with the other operators 50 as to which of them will assist the target robot, and the process of finding and traveling to assist another robot 18 needs to be repeated.
[0056] In addition, when many robots gather in a discrete congested location 903, such as Fig. 9As shown, in order to maximize the individual task completion rate and the task completion rate of the robots 18 that serve the cluster, the unguided human operators 50 may also tend to cluster in those areas to perform the tasks associated with those robots 18, thereby creating new congestion areas 903 and / or exacerbating existing congestion problems. In addition, if many human operators 50 and robots 18 are clustered together, unattended robots 918 operating in less active parts of the navigation space (e.g., remote areas 911) may be without the help of human operators 50 for a long time, thereby increasing the dwell time of these robots 18 and further reducing efficiency.
[0057] In order to improve operator 50 efficiency, reduce operator 50 related congestion, and reduce the dwell time of unattended robots 918, systems and methods for personnel routing are described herein. In particular, each robot 18 can be configured to present the next task recommendation to the operator 50 on a display (e.g., a display of a tablet computer 48).
[0058] like Fig. 9 As shown, in some navigation spaces, human operators 50, non-tasked human operators 950, robots 18, and unattended robots 918 may be located in congested areas 903, in remote areas 911, or more generally throughout the navigation space. Fig. 9 As shown, a non-tasked human operator 950 (e.g., an operator 50 who has just completed a task and is looking for a new unattended robot 918 that needs assistance) is positioned in an aisle without an unattended robot 918 that needs assistance. Initially, the non-tasked operator 950 may not know where to go next and may spend time wandering around to find the unattended robot 918.
[0059] exist Fig. 9 In the scenario depicted in , because the unattended operator 950 cannot see any unattended robots 918, the unattended operator 950 may head toward the sounds of other activities to find the unattended robots 918. Fig. 9 In the scenario shown, the operator without a task may therefore go to the nearby congested area 903. However, in Fig. 9 In the congested area 903 of FIG. 1 , there are six human operators 50 and only two unattended robots 918. Therefore, the unassigned operators 950 only exacerbate the congestion and add little value.
[0060] Meanwhile, other unattended robots 918 are located in a remote area 911 away from the congested area 903. Fig. 9As shown, such unattended robots 918 may be far away so that no human operator is close. Therefore, the dwell time of such robots waiting for human operators 50 to assist in completing the current task of each unattended robot 918 may be extended, resulting in inefficient execution of the task list of the unattended robot 918.
[0061] In some embodiments, a human routing system is provided to provide directions to the unattended operator 950 about where to go next, improve the task completion rate of the unattended robot 918, and manage congestion associated with the human operator 50. Specifically, as Fig.10 As shown, once the current task is completed, the robot 18 can receive status information corresponding to at least one unattended robot 918, and can use the status information to determine a next task recommendation 1001 to direct the user to the recommended unattended robot 918.
[0062] In some embodiments, the robot 18 may receive status information directly from each of the at least one unattended robot 918. In some embodiments, the robot 18 may receive status information from a robot monitoring server 902. The robot monitoring server 902 may be any server or computing device capable of tracking robot and / or human operator activities within a navigation space, including, for example, a warehouse management system 15, an order server 14, a standalone server, a network of servers, a cloud, a processor and memory of a robot tablet 48, a processor and memory of a base 20 of a robot 18, a distributed system including memory and processors of at least two robot tablets 48 and / or bases 20. In some embodiments, the status information may be automatically pushed from the robot monitoring server 902 to the robot 18. In other embodiments, the status information may be sent in response to a request from the robot 18.
[0063] After receiving the status information, the robot 18 may use the status information to determine one or more recommendation factors associated with each unattended robot 918. For example, the robot 18 may use the status information to determine whether the posture position of the unattended robot 918 is in a congested state as described above (i.e., located in the congested area 903). Additionally, in some embodiments, efficiency may be improved by minimizing the distance between the robot 18 and the recommended unattended robot 918 for the next task recommendation 1001. In some embodiments, the proximity may be determined based on, for example, a straight-line distance between the (x, y, z) position of the robot 18 and the (x, y, z) position of the unattended robot 918. In some embodiments, the proximity may be determined based on a triangulation calculation between the (x, y, z) position of the robot 18 and the (x, y, z) positions of at least two unattended robots 918. In some embodiments, the proximity may be determined based on a walking / travel distance between the (x, y, z) position of the robot 18 and the (x, y, z) position of the unattended robot 918, based on known obstacles (such as, for example, Figure 1 The proximity may be determined by using the shelf 12 shown) or other no-go zones or other knowledge of the navigation space associated with SLAM.
[0064] Other recommendation factors may include the number of human operators 50 near each unattended robot 918, the ratio of human operators 50 near each unattended robot 918 to unattended robots 918, the priority of the tasks to be completed by each unattended robot 918, the current residence time of the unattended robot 918, or a combination thereof. By considering these recommendation factors, the personnel routing system can improve the efficiency of task completion within the navigation space. For example, such recommendation factors can allow the personnel routing system to minimize travel distance, minimize travel time, minimize the possible residence time of the recommended unattended robot 918, avoid obstacles or congested areas, or a combination thereof. In some embodiments, considering multiple recommendation factors can lead to more optimized results. For example, in the case where the unattended robot 918 is located in a congested area 903, the personnel routing system can default to weighing the guidance of the human operator 50 to the congested area 903. However, if there are not enough human operators 50 in the congested area 903 to service the robots 18, the personnel routing system can determine that the location of the unattended robots 908 in the congested area 903 is conducive to directing the human operators 50 to the congested area 903.
[0065] Similarly, in some embodiments, the default preference may be to direct the human operator 50 to the nearest unattended robot. However, if the robot 18 is located in a congested area, there may be multiple unattended robots 918 located in an area close to the robot 18 (and attended operators 50), and there may be a large number of human operators 50 that can service the unattended robots 918 in their vicinity. At the same time, there may be no (or few) human operators 50 close enough to service other unattended robots 918, such as those located in remote areas 911. The human routing system may then determine that this situation is conducive to directing the human operator 50 to a farther unattended robot 918 located in a remote area 911.
[0066] Reference again Fig.10 , the robot 18 may communicate the next task recommendation 1001 to the operator 50 by presenting the recommendation 1001 on a display 1000 of the robot 18 (e.g., a display of the tablet computer 48). In some embodiments, the next task recommendation 1001 may be presented automatically when the current task is completed, in response to input from the human operator 50, or a combination thereof. For example, Fig.10 As shown, in some embodiments, the next task recommendation 1001 can be automatically presented as an interactive graphical object within the task completion interface 1003, indicating the completion of the current task. The next task recommendation 1001 can generally include the location 1005 and / or robot identification 1007 of the recommended unattended robot 918.
[0067] The location 1005 may generally include one or more of an aisle identifier 1005a, a stack identifier 1005b, a shelf identifier, an (x, y, z) location, any other suitable location indicative information, or a combination thereof. Fig.10 , the location 1005 includes a letter identifying a specific channel 1005a and a number identifying a specific stack 1005b. The robot identification 1007 may generally include any suitable identifier for allowing the operator 50 to verify the identity of the recommended unattended robot 918 when approaching to perform the next task.
[0068] Although the next task is recommended 1001 in Fig.10900 is shown as a scaled-down interactive graphical object (which indicates the location 1005 and identity 1007 of a single recommended unattended robot 918), but it will be apparent in light of this disclosure that the next task recommendation 1001 may be presented at any size and / or the interactive graphical object may be configured to correspond to the number of next task recommendations 1001 (for selection by a human operator) that each corresponds to a recommended unattended robot 918. If there are multiple indicated next task recommendations 1001, the interactive graphical object may be configured to accept input from the human operator 50 that selects which next task recommendation 1001 the human operator 50 will accept and attend to.
[0069] In some embodiments, the interactive graphical object may be configured so that the operator 50 can touch or "click" the object to open a larger interactive recommendation 1101 screen. Fig.11 As shown, the interactive recommendation 1101 may indicate multiple next task recommendations 1001 and corresponding locations 1005 and identifiers 1007. In some embodiments, the interactive recommendation 1101 may advantageously provide a comparison Fig.10 The smaller portion of the screen shown in provides larger, clearer text, especially when multiple next task recommendations 1001 are presented.
[0070] In addition, additional information may be presented to the operator in the interactive recommendation 1101 screen. Fig.11 As shown, a map 1103 is presented for each next task recommendation 1001, thereby providing visual guidance to the operator 50, rather than relying on the operator's recollection of a particular facility layout. In some embodiments, each next task recommendation 1001 within the interactive recommendation 1101 screen may be presented as a separate interactive graphical object. For example, in some embodiments, the map 1103 may be displayed as a plan view of a predetermined area around the robot, which typically represents a portion of a warehouse near the robot, but in some embodiments, may include the entire warehouse. In some embodiments, the entire warehouse layout may be divided into a plurality of areas, and the predetermined area displayed in the map 1103 around the robot may correspond to one of the plurality of areas where the robot is located. In some embodiments, the map 1103 may include a rendering of a shelf unit and a graphical representation of other robots within the predetermined area.
[0071] In some embodiments, the map 1103 may also include a graphical representation of a human operator 50 that is attending orders associated with one or more robots 18 within the field of view of the map 1103. In general, the map 1103 may be used to allow the human operator 50 to determine which next task recommendation 1001 to select based on, for example, the unattended robots 918 associated with the next pick recommendation 1001 and / or the number of additional unattended robots 918 associated with the next pick recommendation 1001 that are in proximity to the unattended robots 918.
[0072] If there are multiple indicated next task recommendations 1001, the interactive recommendation can be configured to accept input from the human operator 50 that selects the next task recommendation 1001 that the human operator 50 will accept and attend. In such an embodiment, the robot 18 can communicate the selection to the robot monitoring system 902, thereby designating the selected task and the unattended robot 918 as "in progress" within the human routing system to avoid redundant recommendations. In such an embodiment, the human routing system can also affect a change in the visual, audio, or other status indicator of the unattended robot 918 associated with the next pick recommendation 1001 selected by the operator 50 to indicate that the robot has been selected for task performance. In particular, such a status indicator can be provided to prevent other human operators in the area from attempting to help / request the unattended robot 918. The status indicator can be represented by changing the display of the tablet computer 48 of the unattended robot 918, a graphical object presented in the display of the tablet computer 48, or the color or intensity of one or more of one or more lights of the unattended robot 918. The status indicator may additionally or alternatively be represented by causing one or more of a display of the tablet computer 48 of the unattended robot 918, a graphical object presented in the display of the tablet computer 48, or one or more lights of the unattended robot 918 to flash, blink, or pulse.
[0073] To account for human error, unexpected events, and / or other performance failures, in some embodiments, the "in progress" designation may be removed by the personnel routing system if the task is not completed within the specified time limit.
[0074] In view of this disclosure, it will be apparent that exemplary personnel routing and congestion management techniques are described above for illustrative purposes only, and that any other beacon messages, beacon configurations, receiver configurations, or proximity operating modes may be implemented in accordance with various embodiments.
[0075] Non-Limiting Example Computing Devices
[0076] Fig.12 Based on the above reference Figures 1 to 11 A block diagram of an exemplary computing device 1210 or portion thereof that may be used, for example, in accordance with various embodiments described herein. The computing device 1210 includes one or more non-transitory computer-readable media for storing one or more computer-executable instructions or software for implementing the exemplary embodiments. The non-transitory computer-readable media may include, but are not limited to, one or more types of hardware memories, non-transitory tangible media (e.g., one or more magnetic storage disks, one or more optical disks, one or more flash drives), etc. For example, the memory 1216 included in the computing device 1210 may store computer-readable and computer-executable instructions or software for performing the operations disclosed herein. For example, the memory may store a software application 1240 that is programmed to perform operations related to the present invention. Figures 1 to 11 The computing device 1210 may also include a configurable and / or programmable processor 1212 and an associated core 1214, and optionally, one or more additional configurable and / or programmable processing devices, such as a processor 1212' and associated core(s) 1214' (e.g., where the computing device has multiple processors / cores), for executing computer-readable and computer-executable instructions or software stored in memory 1216 and other programs for controlling system hardware. The processor 1212 and the processor(s) 1212' may each be a single-core processor or a multi-core (1214 and 1214') processor.
[0077] Virtualization can be used in computing device 1210 so that infrastructure and resources in the computing device can be dynamically shared. A virtual machine 1214 can be provided to manipulate processes running on multiple processors so that the processes appear to use only one computing resource instead of multiple computing resources. Multiple virtual machines can also be used with one processor.
[0078] The memory 1216 may include computer system memory or random access memory, such as DRAM, SRAM, EDORAM, etc. The memory 1216 may also include other types of memory or combinations thereof.
[0079] A user may interact with the computing device 1210 through a visual display device 1201, 111A-D (e.g., a computer monitor that may display one or more graphical user interfaces 1202 that may be configured according to an example embodiment). The computing device 1210 may include other I / O devices for receiving input from a user, such as a keyboard or any suitable multi-touch interface 1218, a pointing device 1220 (e.g., a mouse). The keyboard 1218 and the pointing device 1220 may be coupled to the visual display device 1018. The computing device 1210 may include other suitable conventional I / O peripherals.
[0080] The computing device 1210 may include one or more storage devices 1234, such as, but not limited to, a hard drive, a CD-ROM, or other computer-readable media for storing data and computer-readable instructions and / or software for performing the operations of the present disclosure. The exemplary storage device 1234 may also store one or more databases for storing any suitable information required to implement the exemplary embodiments. The databases may be manually or automatically updated at any suitable time to add, delete, and / or update one or more items in the database.
[0081] The computing device 1210 may include a network interface 1222 configured to interface with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), or the Internet) via one or more network devices 1232, over a variety of connections including, but not limited to, a standard telephone line, a LAN or WAN link (e.g., 802.11, T1, T3, 56kb, X.25), a broadband connection (e.g., ISDN, Frame Relay, ATM), a wireless connection, a controller area network (CAN), or some combination of any or all of the above. The network interface 1222 may include a built-in network adapter, a network interface card, a PCMCIA network card, a card bus network adapter, a wireless network adapter, a USB network adapter, a modem, or any other device suitable for interfacing the computing device 1210 with any type of network capable of communicating and performing the operations described herein. Furthermore, computing device 1210 may be any computing device, such as a workstation, desktop computer, server, laptop computer, handheld computer, tablet computer, or other form of computing or communication device capable of communicating and having sufficient processor power and memory capacity to perform the operations described in the present disclosure.
[0082] The computing device 1210 may run any operating system 1016, such as versions of operating systems (Microsoft, Redmond, Wash.), different distributions of Unix and Linux operating systems, Macintosh computers (Apple Inc., Cupertino, Calif.), any version of , any embedded operating system, any real-time operating system, any open source operating system, any proprietary operating system, or other operating system capable of running a computing device and performing the operations of the present disclosure. In an exemplary embodiment, the operating system 1226 can run in a local mode or an emulated mode. In an exemplary embodiment, the operating system 1226 can run on one or more cloud machine instances.
[0083] Fig.13is an example computing device block diagram of certain distributed embodiments. Figures 1 to 11 Portions of the exemplary discussion above refer to the warehouse management system 15, order server 14, or robot tracking server 902, each of which runs on a separate or common computing device, but it will be appreciated that any of the warehouse management system 15, order server 14, or robot tracking server 902 may alternatively be distributed across the network 1305 in separate server systems 1301a-d and possibly distributed among user systems, such as kiosks, desktop computer devices 1302, or mobile computer devices 1303. For example, the order server 14 may be distributed among the tablets 48 of the robots 18. In some distributed systems, modules of any one or more of the warehouse management system software and / or order server software may be located on server systems 1301a-d, respectively, and may communicate with each other over the network 1305.
[0084] Although the foregoing description of the present invention enables those of ordinary skill in the art to make and use what is currently considered to be the best mode of technology, those of ordinary skill in the art will understand and recognize the existence of variations, combinations, and equivalents of the specific embodiments and examples herein. The above-described embodiments of the present invention are merely examples. Without departing from the scope of the present invention, those skilled in the art may change, modify, and vary the specific embodiments, and the scope of the present invention is limited only by the appended claims. Therefore, the present invention is not limited by the above-described embodiments and examples.
[0085] What is claimed as new and secured by Letters Patent is the invention which has been described and which is a preferred embodiment thereof.
Claims
1. A robot-assisted personnel routing system, comprising: Multiple autonomous robots operating in a navigation space, each robot comprising: Processor; and a memory storing instructions that, when executed by the processor, cause the autonomous robot to: detecting that a human operator has completed a task operation associated with the autonomous robot, receiving state information corresponding to a plurality of other robots operating within the navigation space, the state information comprising at least one of a position or a wait time associated with the plurality of other robots, determining a next robot recommendation from the plurality of other robots based on the state information to guide the human operator to perform a next task operation, presenting on a display of the autonomous robot a recommended position of the next robot for the human operator to perform the next task operation for viewing by the human operator, recording the selection of the next robot recommendation made by the human operator, and In response to the recorded selection of the next robot recommendation, a next task operation associated with the selected next robot recommendation is designated as ongoing within the human routing system to avoid redundant recommendations.
2. The system of claim 1, wherein: The state information includes the (x, y, z) positions of the other robots in the navigation space, and The next robot recommendation is selected by determining a minimum straight-line distance to the plurality of other robots.
3. The system according to claim 1, wherein: The next robot recommendation is selected in response to one or more efficiency factors, the one or more efficiency factors including a dwell time of each of the plurality of other robots, a linear proximity of each of the plurality of other robots, a number of human operators close to each of the plurality of other robots, a walking distance to each of the plurality of other robots, a priority of a task associated with each of the plurality of other robots, a level of congestion near each of the plurality of other robots, or a combination thereof.
4. The system according to claim 1, wherein: The next robot recommendation is presented as an interactive graphic on the display.
5. The system according to claim 4, wherein: In response to human operator input received via the interactive graphic, an expanded graphic is presented to provide one or more of additional information about a next task operation associated with the next robot recommendation, present additional next robot recommendations to the human operator, or a combination thereof.
6. The system according to claim 5, wherein: The extended graphic includes one or more additional interactive graphics.
7. The system according to claim 4, wherein: The interactive graphic is configured to record a selection of the next robot recommendation made by the human operator.
8. The system according to claim 1, wherein: If the next task operation associated with the selected next robot recommendation is not completed within the specified time limit, the ongoing designation is removed.
9. The system according to claim 1, wherein: The status information is received directly from the at least one other robot.
10. The system according to claim 1, wherein: The status information is received from a robot monitoring server for monitoring robots within the navigation space, wherein the robot monitoring service is at least one of: integrated with at least one command server of the navigation space, integrated with a warehouse management system of the navigation space, an independent server, a distributed system including the processor and the memory of at least two of the multiple robots, or a combination thereof.
11. The system according to claim 1, wherein: The navigation space is a warehouse.
12. The system according to claim 11, wherein: The at least one next task operation is at least one of a pick operation, a place operation, or a combination thereof to be performed within the warehouse.
13. A method for robot-assisted personnel routing, comprising: A plurality of autonomous robots operating in a navigation space are provided, each autonomous robot: detecting, by a processor and a memory, completion of a task operation by a human operator, the task operation being associated with the autonomous robot; receiving, by a transceiver of the autonomous robot, status information corresponding to a plurality of other robots, the status information comprising at least one of a position or a latency associated with the plurality of other robots; determining at least one next robot recommendation for guiding the human operator to perform a next task operation based on the state information; presenting the next robot recommended position on a display of the autonomous robot for viewing by the human operator; recording a selection of the next robot recommendation made by the human operator; and In response to the recorded selection, the selected task operation associated with the next robot is designated as ongoing within the human routing system to avoid redundant recommendations.
14. The method according to claim 13, wherein: The state information includes (x, y, z) positions of the multiple other robots in the navigation space, and the method further includes: The next robot recommendation is selected by determining a minimum straight-line distance to the plurality of other robots.
15. The method according to claim 13, further comprising: The next robot recommendation is selected in response to one or more efficiency factors, wherein the one or more efficiency factors include a dwell time of each of the plurality of other robots, a linear proximity of each of the plurality of other robots, a number of human operators close to each of the plurality of other robots, a walking distance to each of the plurality of other robots, a priority of a task associated with each of the plurality of other robots, a level of congestion near each of the plurality of other robots, or a combination thereof.
16. The method of claim 13, further comprising presenting the next robot recommendation as an interactive graphic on the display.
17. The method according to claim 16, further comprising: In response to human operator input received via the interactive graphic, presenting an expanded graphic to provide additional information about a next task operation associated with the next robot recommendation, presenting additional next robot recommendations to the human operator, or one or more of a combination thereof.
18. The method according to claim 17, wherein: The extended graphic includes one or more additional interactive graphics.
19. The method according to claim 16, further comprising: A selection of the next robot recommendation made by the human operator is recorded via the interactive graphic.
Citation Information
Patent Citations
Item storage array for mobile base in robot assisted order-fulfillment operations
US10001768B2
Order grouping in warehouse order fulfillment operations
US20190138978A1
Robot assisted personnel routing
US20200246978A1
Cloud-aided intelligent warehouse management robot system and method
CN106452903A
Intelligent warehouse management method based on central monitoring
CN107705058A
