System and method for controlling work machine
The system allows work machines to autonomously navigate around obstacles by using a controller to generate updated paths, enhancing their operational flexibility and efficiency by integrating manual override features for obstacle avoidance.
Patent Information
- Application Number
- GB2023007580
- Authority / Receiving Office
- GB · GB
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-20
- Publication Date
- 2024-12-04
AI Technical Summary
Current methods for work machines, such as compactors, lack the ability to efficiently navigate around obstacles during operations, limiting their applicability and flexibility, as obstacles like non-workable areas or objects are not accounted for in initial path planning.
A system and method that includes a controller with a processor and memory to autonomously navigate a work machine along an initial path, allowing for manual override to record and generate an updated path around obstacles, enabling the work machine to bypass them and resume autonomous operation.
Enables efficient navigation around obstacles, improving the work machine's applicability and flexibility by allowing it to adapt its path in real-time, reducing operator workload and maintaining operational efficiency.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present disclosure relates to a system and a method for controlling a work machine. Background
[0002] A work machine, such as a compactor, may be used to execute work operations, such as, compaction of materials at a worksite. In some examples, an autonomous or a semi-autonomous compactor may be required to make multiple passes at the worksite to compact the materials present thereat. Further, the work machine may encounter various obstacles while performing the work operation. The obstacles may include for example, areas that aren’t ready to be worked upon, a number of objects, and / or a hole present in a path of the work machine. Such obstacles may not be present while formulating a path plan for performing the work operation. It may be required that the compactor works / moves around such obstacles while performing the work operation. Current methods for performing work operations, such as compaction, do not include any technique of efficiently working / moving around such obstacles, which may significantly limit applicability and flexibility of such methods.
[0003] WO2022209176A1 describes a travel system for a work machine with which the route actually traveled by the work machine can be easily recorded. A travel system for a motor grader comprises a travel device and a controller. The travel device causes the motor grader to travel. The controller automatically performs control so as to record an actual travel route, which is a route actually traveled by the motor grader. Summary of the Disclosure
[0004] In a first aspect of the present disclosure, a system for controlling a work machine is provided. The work machine is adapted to move along an initial work path for performing a work operation. The system includes a controller. The controller includes at least one memory configured to store information corresponding to the initial work path therein. The controller also includes at least one processor communicably coupled to the at least one memory. The at least one processor is configured to retrieve the initial work path from the at least one memory. The at least one processor is also configured to autonomously navigate the work machine along the initial work path for performing the work operation. The at least one processor is further configured to receive a first operator input from an operator of the work machine. The first operator input is received based on a presence of an obstacle in the initial work path. The at least one processor is configured to activate a manual override feature based on the receiving of the first operator input. The manual override feature causes a suspension of the autonomous navigation of the work machine. The manual override feature allows the operator of the work machine to maneuver the work machine around the obstacle. The at least one processor is also configured to record a bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle based on the receiving of the first operator input. The at least one processor is further configured to generate an updated work path. The updated work path includes the bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle.
[0005] In a second aspect of the present disclosure, a work machine is provided. The work machine includes a plurality of ground engaging members. The work machine also includes a steering system. The work machine further includes the system of the first aspect. The at least one processor is configured to transmit one or more control signals to the plurality of ground engaging members and the steering system to autonomously navigate the work machine for performing the work operation.
[0006] In a third aspect of the present disclosure, a method for controlling a work machine is provided. The work machine is adapted to move along an initial work path for performing a work operation. The method includes retrieving, by at least one processor of a controller, the initial work path from at least one memory of the controller. The method also includes autonomously navigating, by at least one processor, the work machine along the initial work path for performing the work operation. The method further includes receiving, by the at least one processor, a first operator input from an operator of the work machine. The first operator input is received based on a presence of an obstacle in the initial work path. The method further includes activating, by the at least one processor, a manual override feature based on the receiving of the first operator input. The manual override feature causes a suspension of the autonomous navigation of the work machine. The manual override feature allows the operator of the work machine to maneuver the work machine around the obstacle. The method also includes recording, by the at least one processor, a bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle based on the receiving of the first operator input. The method further includes generating, by the at least one processor, an updated work path. The updated work path includes the bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle.
[0007] Other features and aspects of this disclosure will be apparent from the following description and the accompanying drawings. Brief Description of the Drawings
[0008] FIG. lisa perspective view of a work machine operating at a worksite, according to an example of the present disclosure;
[0009] FIG. 2 is a block diagram of a system for controlling the work machine of FIG. 1, according to an example of the present disclosure;
[0010] FIG. 3 is an exemplary illustration of the worksite depicting initial work paths and updated work paths for the work machine of FIG. 1, according to an example of the present disclosure; and
[0011] FIG. 4 is a flowchart of a method for controlling the work machine of FIG. 1, according to an example of the present disclosure. Detailed Description
[0012] Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0013] Referring to FIG. 1, a schematic perspective view of an exemplary work machine 100 operating at a worksite 102 is illustrated. In the illustrated example of FIG. 1, the work machine 100 is a compactor. However, the work machine 100 may embody any other machine, such as, a dozer, a motor grader, an excavator, and the like. The work machine 100 may be embodied as an autonomous or a semi-autonomous work machine. The work machine 100 includes a frame 104, a front end 106, and a rear end 108 (the terms front and rear are defined relative to an intended forward direction of travel DI of work machine 100). The frame 104 supports various components of the work machine 100 thereon. The frame 104 defines an enclosure 110 proximate to the rear end 108. The work machine 100 also includes a power source (not shown) disposed within the enclosure 110. Various components of the work machine 100 are driven by the power source. The power source may be an engine, such as, an internal combustion engine, a fuel cell, a battery module, without any limitations.
[0014] The work machine 100 further includes an operator station 112. An operator may be seated within the operator station 112 to perform work operations, such as, compaction of materials. Alternatively, the operator may be present outside the work machine 100 or at a back office (not shown) that may be remote to the work machine 100. The operator station 112 may include an input module 114 (schematically shown in FIG. 2) and an output module 115 (schematically shown in FIG. 2). In an example, the input and output modules 114, 115 may form a part of a user interface. The operator station 112 may include other input devices and output devices to control various machine related operations.
[0015] Further, the work machine 100 includes a number of ground engaging members 116, 118. In the illustrated example of FIG. 1, the number of ground engaging members 116, 118 are embodied as a pair of compactor drums supported by the frame 104 and mounted proximate to the front end 106 and the rear end 108, respectively. In alternate examples, the ground engaging members 116, 118 may include a single compactor drum at the front end 106 and wheels at the rear end 108, without any limitations. The ground engaging members 116, 118 contact ground surfaces during work operations or during mobility of the work machine 100 on ground surfaces. Further, the work machine 100 includes a steering system 120 (schematically shown in FIG. 2). The steering system 120 may be used to steer the work machine 100 in a desired direction, as per application requirements.
[0016] The work machine 100 moves along an initial work path W1 for performing the work operation. The initial work path W1 may include a route that may be generated as part of a work plan for the work machine 100. The work plan may be generated based on compaction requirements at the worksite 102. In some cases, the work machine 100 may be required to make several passes in the forward direction DI and / or a reverse direction D2 for performing the work operation. Thus, in addition to the initial work path Wl, the work plan may also include information pertaining to the number of passes required in the forward direction DI and / or the reverse direction D2, without any limitations. Further, one or more obstacles 122 may be present at the worksite 102 and in the initial work path Wl of the work machine 100. The obstacle 122 may be embodied as any obstruction, feature, or characteristics of the worksite 102 that might impact the work operation. The obstacle 122 may include, for example, non-workable areas (for example, areas that are not ready to be worked upon), a number of objects, and / or holes / depressions, without any limitations. Further, the objects may include a pile of material, a rock, and the like. In the illustrated example of FIG. 1, the obstacle 122 is a hole.
[0017] The present disclosure relates to a system 200 for controlling the work machine 100. Specifically, the system 200 is used to maneuver around the obstacles 122 present at the worksite 102. Referring to FIG. 2, a block diagram of the system 200 for controlling the work machine 100 (see FIG. 1) is illustrated.
[0018] The system 200 includes a controller 204. The controller 204 may be present within the work machine 100, the back office, or any other remote location, without any limitations. The controller 204 includes one or more memories 206. The memories 206 store information corresponding to the initial work path Wl therein. It should be noted that the memories 206 may store all information relevant to execute the work plan. The memories 206 may include any means of storing information, including a hard disk, an optical disk, a floppy disk, ROM (read only memory), RAM (random access memory), PROM (programmable ROM), EEPROM (electrically erasable PROM), and / or other computer-readable memory media. The memories 206 may store data, such as, algorithms, instructions, arithmetic operations, and the like.
[0019] The controller 204 also includes one or more processors 208 communicably coupled to the one or more memories 206. The processors 208 may embody a single microprocessor or multiple microprocessors for receiving various input signals and generating output signals. Numerous commercially available microprocessors may perform the functions of the one or more processors 208. Each processor 208 may further include a general processor, a central processing unit, an application specific integrated circuit (ASIC), a digital signal processor, a field programmable gate array (FPGA), a digital circuit, an analog circuit, a microcontroller, any other type of processor, or any combination thereof. Each processor 208 may include one or more components that may be operable to execute computer executable instructions or computer code that may be stored and retrieved from the one or more memories 206. The processors 208 may execute several types of digitally stored instructions, such as, a software program or an algorithm, retrieved from the memories 206, or a firmware program which may enable the processors 208 to perform a wide variety of operations.
[0020] The processors 208 retrieve the initial work path W1 from the one or more memories 206. Further, the processors 208 autonomously navigate the work machine 100 along the initial work path W1 for performing the work operation. Specifically, the processors 208 may retrieve the work plan from the memories 206 and autonomously execute the work plan which may cause the work machine 100 to move along the initial work path W1 for performing the work operation. It should be noted that the processors 208 may transmit one or more control signals SI to the number of ground engaging members 116, 118 and the steering system 120 to autonomously navigate the work machine 100 for performing the work operation. Thus, the processors 208 may control the ground engaging members 116, 118 and the steering system 120 in order to autonomously navigate the work machine 100 for performing the work operation.
[0021] The processors 208 further receive a first operator input S2 from the operator of the work machine 100. The first operator input S2 may be received via the input module 114 present within the operator station 112 or from an input module present at the back office. The first operator input S2 is received based on the presence of the obstacle 122 in the initial work path Wl. It should be noted that when the operator is seated at the back office, the operator may detect the presence of obstacles via surveillance systems (not shown) associated with the work machine 100 or present at the worksite 100.
[0022] Further, the processors 208 activate a manual override feature based on the receiving of the first operator input S2. The manual override feature causes a suspension of the autonomous navigation of the work machine 100. Further, the manual override feature allows the operator of the work machine 100 to maneuver the work machine 100 around the obstacle 122. Thus, the manual override feature suspends the autonomous movement of the work machine 100 according to the work plan so that the operator may maneuver the work machine 100 around the obstacle 122.
[0023] Further, the processors 208 record a bypass route RI (see FIG. 3) used by the operator of the work machine 100 while maneuvering the work machine 100 around the obstacle 122 based on the receiving of the first operator input S2. Furthermore, the processors 208 generate an updated work path W2 (see FIG. 3). The updated work path W2 includes the bypass route RI used by the operator of the work machine 100 while maneuvering the work machine 100 around the obstacle 122. It should be noted that the updated work path W2 may include a combination of the initial work path W1 and the bypass route RI. It should be noted that the updated work path W2 may be determined by smoothing the points of the bypass route RI recorded during the manual navigation of the work machine 100 around the obstacle 122. Such smoothing may be performed to avoid an excessive / unnecessary amount of steering and / or to ensure the updated work path W2 does not exceed a steering capability of the work machine 100. Further, the updated work path W2 is restricted to not being closer to the initial work path W1 than the operator manually traveled. The updated work path W2 may be stored in the memories 206 of the controller 204.
[0024] Further, the processors 208 receive a second operator input S3 after the operator maneuvers the work machine 100 around the obstacle 122. In other words, the second operator input S3 may be generated by the operator after maneuvering of the work machine 100 around the obstacle 122. The second operator input S3 may be received via the input module 114 present within the operator station 112. The second operator input S3 may be embodied as an authorization by the operator to indicate that the autonomous navigation of the work machine 100 may be resumed as the work machine 100 has maneuvered around the obstacle 122.
[0025] Further, the processors 208 deactivate the manual override feature based on the receiving of the second operator input S3. Furthermore, the processors 208 autonomously navigate the work machine 100 along the updated work path W2 for performing the work operation based on the deactivation of the manual override feature. In other words, once the manual override feature is deactivated and the autonomous navigation is resumed, the work machine 100 may be autonomously navigated along the updated work path W2 for performing the work operation. It should be noted that the processors 208 may transmit one or more control signals SI to the number of ground engaging members 116, 118 and the steering system 120 to autonomously navigate the work machine 100 along the updated work path W2.
[0026] Further, the processors 208 autonomously navigate the work machine 100 along the updated work path W2 in the forward direction DI (see FIG. 1) and / or the reverse direction D2 (see FIG 1) to perform the work operation. More particularly, if the work machine 100 is required to perform multiple passes in the forward and / or reverse directions DI, D2, the processors 208 may autonomously navigate the work machine 100 along the updated work path W2 during each pass to ensure that the work machine 100 maneuvers around the obstacle 122 when the work machine 100 approaches the obstacle 122.
[0027] Referring now to FIGS. 2 and 3, the initial work paths W1 are depicted by dotted lines whereas the updated work paths W2 are depicted by solid lines. While executing the work plan, the work machine 100 may encounter the obstacle 122 along the initial work path(s) Wl. Based on the presence of the obstacle 122 in the initial work path(s) Wl, the processors 208 may generate the updated work path(s) W2 in order to avoid the obstacle 122. That is, as shown in FIG. 3, the work machine 100 (see FIG. 1) may in one pass follow the updated work path W2 to the left of the obstacle 122, and later, in another pass, may follow the updated work path W2 to the right of obstacle 122.
[0028] Further, it may be contemplated that the work machine 100 encounters additional obstacles or new obstacles in the updated work path(s) W2 while moving in the forward or reverse directions DI, D2. In such examples, the operator may identify such obstacles 122 and generate the first operator input S2. Further, the processors 208 may receive the first operator input S2 and activate the manual override feature so that the operator may maneuver the work machine 100 around such additional / new obstacles. Moreover, the processors 208 may generate another updated work path(s) to ensure that the work machine 100 maneuvers around the additional / new obstacles during subsequent passes. Thus, the processors 208 may continuously check for obstacles along the initial and / or updated work paths Wl, W2 in order to maneuver the work machine 100 around such obstacles that may be present in the initial and / or updated work paths Wl, W2.
[0029] Referring again to FIG. 2, in some examples, the system 200 may optionally include one or more sensors 202 to generate a signal S4 indicative of a presence of the obstacle 122 (see FIG. 1) in the initial work path Wl (see FIG. 1). More particularly, the sensors 202 may detect presence of obstacles 122 that are embodied as objects, such as, rocks, piles or materials, and the like. In some examples, the sensors 202 may be mounted on the work machine 100 or the worksite 102 (see FIG. 1). In other examples, the sensors 202 may be mounted on the work machine 100 as well as the worksite 102. The sensors 202 may include one or more of an imaging device, a laser imaging, detection, and ranging (LIDAR) sensor, a radio detection and ranging (RADAR) sensor, an infrared sensor, and an ultrasonic sensor, without any limitations.
[0030] The processors 208 may receive the signal S4 generated by the sensors 202. Based on the receipt of the signal S4, the processors 208 may activate the manual override feature. Additionally, based on the receiving of the signal S4, the processors 208 may generate and transmit a notification signal S5 to the output module 115. The notification signal S5 may provide a notification or an alert to the operator that the manual override feature has been activated based on the detection of the obstacle 122 in the initial work path W1. Based on the notification signal S5 displayed on the output module 115, the operator may manually control the work machine 100 to maneuver the work machine 100 around the obstacle 122. Industrial Applicability
[0031] The present disclosure relates to the system 200 for controlling the work machine 100. The system 200 described herein allows maneuvering of the work machine 100 around various obstacles 122 that may be present at the worksite 102. The system 200 may exhibit improved applicability and flexibility as the system 200 can be used at worksites having various obstacles. The system 200 may be retrofitted on existing work machines without substantial modifications and may be cost-effective.
[0032] Further, the system 200 may be used in conjunction with object detection systems known in the art to allow operators to manually navigate the work machine 100 around various obstacles that may be present at the worksite 100. In such embodiments, the system 200 may improve operator awareness and also may provide a feature to automatically stop / pause autonomous operations whenever operator intervention may be required.
[0033] FIG. 4 illustrates a flowchart of a method 400 for controlling the work machine 100. The work machine 100 can be the compactor herein. Further, the work machine 100 moves along the initial work path W1 for performing the work operation. At step 402, the one or more processors 208 of the controller 204 retrieve the initial work path W1 from the one or more memories 206 of the controller 204. At step 404, the one or more processors 208 autonomously navigate the work machine 100 along the initial work path W1 for performing the work operation. At step 406, the one or more processors 208 receive the first operator input S2 from the operator of the work machine 100. The first operator input S2 is received based on the presence of the obstacle 122 in the initial work path W1. At step 408, the one or more processors 208 activate a manual override feature based on the receiving of the first operator input S2. The manual override feature causes the suspension of the autonomous navigation of the work machine 100. Further, the manual override feature allows the operator of the work machine 100 to maneuver the work machine 100 around the obstacle 122.
[0034] At step 410, the one or more processors 208 record the bypass route RI used by the operator of the work machine 100 while maneuvering the work machine 100 around the obstacle 122 based on the receiving of the first operator input S2. At step 412, the one or more processors 208 generate the updated work path W2. The updated work path W2 includes the bypass route RI used by the operator of the work machine 100 while maneuvering the work machine 100 around the obstacle 122.
[0035] Further, the one or more processors 208 receive the second operator input S3 after the operator maneuvers the work machine 100 around the obstacle 122. The one or more processors 208 also deactivate the manual override feature based on the receiving of the second operator input S3. The one or more processors 208 further autonomously navigate the work machine 100 along the updated work path W2 for performing the work operation based on the deactivation of the manual override feature. Further, the one or more processors 208 autonomously navigate the work machine 100 along the updated work path W2 in the forward direction DI and / or the reverse direction D2 to perform the work operation. Since the work machine 100, after an initial encounter with the obstacle 122, can in subsequent encounters autonomously navigate around the obstacle 122 without the need for additional input by the operator of the work machine 100, the workload of the operator of the work machine 100 can be reduced.
[0036] It may be desirable to perform one or more of the steps shown in FIG. 4 in an order different from that depicted. Furthermore, various steps could be performed together.
[0037] Unless explicitly excluded, the use of the singular to describe a component, structure, or operation does not exclude the use of plural such components, structures, or operations or their equivalents. The use of the terms “a” and “an” and “the” and “at least one” or the term “one or more,” and similar referents in the context of describing the invention (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. The use of the term “at least one” followed by a list of one or more items (for example, “at least one of A and B” or one or more of A and B”) is to be construed to mean one item selected from the listed items (A or B) or any combination of two or more of the listed items (A and B; A, A and B; A, B and B), unless otherwise indicated herein or clearly contradicted by context. Similarly, as used herein, the word “or” refers to any possible permutation of a set of items. For example, the phrase “A, B, or C” refers to at least one of A, B, C, or any combination thereof, such as any of: A; B; C; A and B; A and C; B and C; A, B, and C; or multiple of any item such as A and A; B, B, and C; A, A, B, C, and C; etc.
[0038] While aspects of the present disclosure have been particularly shown and described with reference to the embodiments above, it will be understood by those skilled in the art that various additional embodiments may be contemplated by the modification of the disclosed work machines, systems and methods without departing from the spirit and scope of the disclosure. Such embodiments should be understood to fall within the scope of the present disclosure as determined based upon the claims and any equivalents thereof.
Claims
1. A system for controlling a work machine, wherein the work machine is adapted to move along an initial work path for performing a work operation, the system comprising:a controller including:at least one memory configured to store information corresponding to the initial work path therein; andat least one processor communicably coupled to the at least one memory, wherein the at least one processor is configured to:retrieve the initial work path from the at least one memory;autonomously navigate the work machine along the initial work path for performing the work operation;receive a first operator input from an operator of the work machine, wherein the first operator input is received based on a presence of an obstacle in the initial work path,activate a manual override feature based on the receiving of the first operator input, wherein the manual override feature causes a suspension of the autonomous navigation of the work machine, and wherein the manual override feature allows the operator of the work machine to maneuver the work machine around the obstacle;record a bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle based on the receiving of the first operator input; andgenerate an updated work path, wherein the updated work path includes the bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle.
2. The system of claim 1, wherein the at least one processor is further configured to receive a second operator input after the operator maneuvers the work machine around the obstacle.
3. The system of claim 2, wherein the at least one processor is further configured to deactivate the manual override feature based on the receiving of the second operator input.
4. The system of claim 3, wherein the at least one processor is further configured to autonomously navigate the work machine along the updated work path for performing the work operation based on the deactivation of the manual override feature.
5. The system of any one of claims 1 to 4, wherein the at least one processor is further configured to autonomously navigate the work machine along the updated work path in at least one of a forward direction and a reverse direction to perform the work operation.
6. The system of any one of claims 1 to 5, wherein the work machine is a compactor.
7. A work machine comprising:a plurality of ground engaging members;a steering system; andthe system of any one of claims 1 to 6, wherein the at least one processor is configured to transmit one or more control signals to the plurality of ground engaging members and the steering system to autonomously navigate the work machine for performing the work operation.
8. A method for controlling a work machine, wherein the work machine is adapted to move along an initial work path for performing a work operation, the method comprising:retrieving, by at least one processor of a controller, the initial work path from at least one memory of the controller;autonomously navigating, by at least one processor, the work machine along the initial work path for performing the work operation;receiving, by the at least one processor, a first operator input from an operator of the work machine, wherein the first operator input is received based on a presence of an obstacle in the initial work path;activating, by the at least one processor, a manual override feature based on the receiving of the first operator input, wherein the manual override feature causes a suspension of the autonomous navigation of the work machine, and wherein the manual override feature allows the operator of the work machine to maneuver the work machine around the obstacle;recording, by the at least one processor, a bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle based on the receiving of the first operator input; andgenerating, by the at least one processor, an updated work path, wherein the updated work path includes the bypass route used by the operator of the work machine while maneuvering the work machine around the obstacle.
9. The method of claim 8, further comprising receiving, by the at least one processor, a second operator input after the operator maneuvers the work machine around the obstacle.
10. The method of claim 9, further comprising deactivating, by the at least one processor, the manual override feature based on the receiving of the second operator input.
11. The method of claim 10, further comprising autonomously navigating, by the at least one processor, the work machine along the updated work path for performing the work operation based on the deactivation of the manual override feature.
12. The method of any one of claims 8 to 11, further comprising autonomously navigating, by the at least one processor, the work machine along the updated work path in at least one of a forward direction and a reverse direction to perform the work operation.
13. The method of any one of claims 8 to 12, wherein the work machine is a compactor.
Citation Information
Patent Citations
Travel system for work machine and method for controlling work machine
WO2022209176A1
System and method for controlling a work machine
EP3373096A1
Nudge compensation for curved swath paths
US20080103690A1
Intelligent Control Apparatus, System, and Method of Use
US20160091898A1
