Method and computing unit for operating a mobile work machine - Patents.com

The method and computing unit optimize mobile work machine operations by determining flexible automation modes based on available elements, ensuring safe and efficient operation and compliance, addressing the limitations of conventional systems.

JP7583163B2Active Publication Date: 2024-11-13ROBERT BOSCH GMBH
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023527038
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-03
Filing Date
2021-10-28
Publication Date
2024-11-13
Estimated Expiration
2041-10-28

AI Technical Summary

Technical Problem

Conventional mobile work machines lack flexibility in operating modes, particularly in the event of component failure, and do not efficiently utilize existing hardware and software configurations for automated operations, posing risks to user safety and operational efficiency.

Method used

A method and computing unit that determine possible operating modes based on the available actuator, sensor, and operating elements, allowing for flexible automation levels, including manual, assisted, and autonomous operations, and adapt to machine status and external settings, enabling cost-effective retrofitting and safe mode transitions.

Benefits of technology

Enables safe and efficient operation by optimizing automation levels based on hardware availability, reducing risks, and ensuring seamless transitions between modes, even in the event of component failure, while enhancing user experience and compliance with external regulations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583163000001
    Figure 0007583163000001
  • Figure 0007583163000002
    Figure 0007583163000002
  • Figure 0007583163000003
    Figure 0007583163000003
Patent Text Reader

Abstract

The present invention relates to a method (100) for operating a mobile work machine (200), the method including identifying (110) available elements including actuator elements (230, 260), sensor device elements (220), and operating elements (210); determining (120) at least one possible operating mode based on the identified available actuator elements (230, 260), sensor device elements (220), and operating elements (210); and performing an action (130, 140) dependent on the determined at least one possible operating mode.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method and computing unit and computer program product for operating a mobile work machine. [Background technology]

[0002] 2. Background of the Invention Mobile working machines, such as excavators, wheel loaders, forklifts or the like, are distinguished in that one or more working element movements (e.g. excavator movements) can be performed (e.g. bending the excavator arm, lowering the bucket, etc.) while the machine is moving horizontally. In conventional mobile working machines, such movements can be controlled manually by the user via operating elements, such as pedals and levers. Modern working machines can also provide means for partially automated operation or assistance modes, which partially perform some of these functions automatically or assist the user of the machine in performing the corresponding movements. For example, in an assistance mode, the spatial freedom of movement of the excavator arm can be limited, for example to protect objects, such as buildings, that must not be damaged by the work. Summary of the Invention [Problem to be solved by the invention]

[0003] Disclosure of the Invention According to the invention, against this background, a method for operating a mobile work machine, as well as a computing unit and a computer program product for carrying out said method, are proposed having the features of the independent claims.

[0004] Advantageous configurations are the subject of the respective dependent claims and the following description. [Means for solving the problem]

[0005] The present invention is based on specifically determining possible operating modes of the mobile work machine based on the equipped or available elements of the mobile work machine, including actuator elements, sensor device elements and operating elements, and taking measures based thereon.

[0006] The invention is particularly advantageously related to modified machine configurations. According to the invention, modifications of the machine software are ineffective when the hardware is changed or when full functional utilization is abandoned. Furthermore, in the event of failure of individual machine components, the machine can be operated further in other operating modes, depending on the circumstances. This means that after failure of individual components, depending on the circumstances, the work process can be terminated before the machine is repaired.

[0007] Examples of actuator elements include travel drives, especially hydrostatic ones, linear drives, for example linear motors or hydraulic cylinders, and rotary drives, with adjustment means. The sensor device elements may in particular comprise one or more from the group of distance sensors, inertial measurement units (so-called IMUs), torque sensors, angle sensors (for example encoders), cameras, radar systems, ultrasonic sensors, satellite positioning systems and LiDAR systems. Operating elements are understood to be in particular switches, travel pedals and / or adjustment levers (joysticks). Many such elements are typically built into the current working machine anyway, but due to the change in combination, numerous configurations on the working machine side allow the method to be applied without adapting the machine itself. This allows retrofitting to be carried out particularly cost-effectively, for example in the form of a software update or by incorporating new control devices or computing units.

[0008] In particular, at least one possible operating mode comprises a certain degree of automation of the operation of the mobile work machine. The various operating modes in particular differ in the degree of automation of the operation of the machine. The division of the possible degrees of automation can in particular be made in accordance with or in accordance with the automotive standard SAE J3016, in which in particular up to six different degrees of automation can be distinguished.

[0009] Here, it is advantageously determined that a first operating mode with a low degree of automation is possible if the available operating elements meet the manual condition, and / or that a second operating mode with a high degree of automation is possible if the available sensor device elements and actuator elements meet the automatic condition. For example, a certain degree of operation elements is required for manual operation of the machine, whereas only a minimum of sensor device elements and actuator elements are required for fully automatic or autonomous operation of the machine. For partially automated or assisted operation, operating elements and sensor device elements, respectively, and possibly also actuator elements are required for the operation of the machine. Thus, the manual condition and the automatic condition respectively include the presence of the corresponding operating elements or sensor device elements and actuator elements. In particular, the first degree of automation (Level 0) may correspond to manual machine operation, the second degree of automation (Level 1) to operation using assistive functions, the third degree of automation (Level 2) to operation using partial automation, the fourth degree of automation (Level 3) to operation using conditional automation, the fifth degree of automation (Level 4) to operation using high automation, and the sixth degree of automation (Level 5) to operation using full automation.

[0010] In particular, the step of determining at least one possible operating mode based on the identified available actuator elements, sensor device elements and operating elements comprises a step of determining all possible operating modes, in particular all possible degrees of automation, based on the identified available actuator elements, sensor device elements and operating elements, in this way all possibilities during operation can be taken into account.

[0011] The measures here advantageously include displaying at least one possible operating mode to a user of the mobile work machine on a display means, for example on a screen, so that the user is provided with information about the available operating modes.

[0012] The steps here preferably include requesting a user input, receiving the user input, determining a target operating mode, in particular from among the possible operating modes, depending on the user input, and operating the work machine according to the target operating mode, whereby a user can select a desired operating mode, in particular from among the available operating modes, whereby the work machine can flexibly operate in the operating modes that correspond to the user settings and are possible based on the available hardware.

[0013] The operation of the mobile working machine according to the target operating mode is preferably performed taking into account the actual machine status. In particular, changing between different operating modes, each having a different degree of automation, often involves risks to the health and life of the user and / or to the environment of the working machine. A certain operating mode is therefore only feasible if, for example, a certain machine status is presupposed. For example, such a presupposed machine status may include a stationary state of certain elements of the machine, in particular a stationary state of the vehicle transmission and / or the working implement. This allows the operating risks to be significantly reduced and ensures that changing between the different operating modes is possible.

[0014] Therefore, the method advantageously further includes adjusting or introducing a target machine status if the current machine status prevents operation of the mobile work machine in the target operating mode, whereby, when a target operating mode different from the current operating mode is set, a change from the current operating mode to the target operating mode can be realized when the corresponding preconditions for the machine status are not fulfilled. For example, the adjustment of the target machine status can include, in particular, automatic actuation of the brakes if the preconditions for operation of the machine in the target operating mode include a stationary state of the machine but the machine is not stopped at the set time point.

[0015] Possibly, the respective operating mode can be determined as the target operating mode with the maximum possible degree of automation, for example taking into account the intersection set of all influencing factors. In such a case, user input can also be omitted depending on the situation. By determining the respective maximum possible degree of automation, the capabilities of the respective working machine can be fully utilized and the use experience can be improved. External settings regarding the minimum or maximum permissible degree of automation can also be taken into account. For example, the legal authority or the construction company can stipulate that maximum assistance functions in a certain range should be possible, but autonomous operation of the machine is not permitted. Advantageously, in such a situation, only operating modes that correspond to such external settings are determined as possible operating modes. Thus, the user cannot set a non-matching operating mode as the target operating mode or the method cannot determine a non-matching operating mode as the target operating mode. The external settings can be received, for example, in the form of a so-called geofencing signal, which can be based on satellite-aided positioning or on the range of the transmitter, as a restriction that is entered via the operating unit, in particular in a protected mode (for example by password protection), or the like.

[0016] Identifying the available elements advantageously comprises sending at least one interrogation signal and receiving at least one response signal containing information about the available elements, which allows flexible detection of all available operating modes even if the working machine is subsequently modified, i.e. for example after setup or in the event of a component failure. Such a signal exchange can take place, for example, at every start of the machine and / or can be repeated at periodic intervals, for example at intervals of 1 second, 1 minute, 5 minutes, 10 minutes, 30 minutes or 1 hour. This ensures that the current state is taken into account without causing an overload due to a flood of signal exchanges.

[0017] A computing unit according to the invention, for example a control device of a mobile work machine, is adapted in particular in terms of program technology to carry out the method according to the invention.

[0018] It is also advantageous to implement the method according to the invention in the form of a computer program or computer program product, which contains a program code for carrying out all the method steps. This is because such a computer program or computer program product is particularly low in cost, especially if the control device to be executed is also used for further tasks and is therefore already existing in any case. Suitable data carriers for providing the computer program are, in particular, magnetic, optical and electrical memories, such as hard disks, flash memories, EEPROMs, DVDs, etc. Downloading the program via a computer network (Internet, intranet, etc.) is also possible.

[0019] Further advantages and embodiments of the invention emerge from the description and the accompanying drawings.

[0020] It is to be understood that the features mentioned above and those further described below can also be used in other combinations than those respectively presented, or alone, without departing from the scope of the invention.

[0021] The invention is illustrated diagrammatically in the drawing by way of an embodiment and is explained in more detail below with reference to the drawing. [Brief description of the drawings]

[0022] [Figure 1] FIG. 2 shows an advantageous configuration of the method according to the invention in the form of a schematic flow chart. [Diagram 2] FIG. 1 is a schematic block diagram illustrating an exemplary mobile construction machine usable in connection with the present invention. [Diagram 3] FIG. 2 is a schematic diagram illustrating an exemplary embodiment of a computing unit according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Detailed Description of the Drawings In Figure 1, an advantageous embodiment of a method according to the invention is shown diagrammatically in the form of a flow chart and generally indicated with the reference numeral 100. The method 100 can be applied in connection with a mobile construction machine, for example in a mobile construction machine, generally indicated with the reference numeral 200 in Figure 2 in the form of a simplified block diagram.

[0024] In the following description, references to machine components relate specifically to FIG. 2, whereas references to method steps relate specifically to the method shown in FIG.

[0025] A mobile work machine 200, such as an excavator, may have an operating element 210, an actuator 230, a sensor 220, and a travel drive mechanism 260. Such an excavator 200 typically has an excavator arm 240 to which a work implement 250, such as a bucket, or other work implements, such as a skeleton bucket, hydraulic rod, grasping gripper, etc., may be attached.

[0026] A calculation unit 280, for example a control device as shown in simplified block diagram form in Fig. 3, is configured to control the operation of the excavator 200. For this purpose, the calculation unit 280 is connected to the drive unit 272, for example an internal combustion engine, and to the working unit 274, for example a hydraulic mechanism, and receives signals from the sensors 220 and the operating elements 210 and transmits signals to the actuators 230.

[0027] In particular, controller 280 is configured to implement method 100 as described above and in more detail below.

[0028] The method 100 shown in FIG. 1 comprises a detection step 110 in which a detection of an operating element 112, a detection of a sensor device 114 and a detection of an actuator 116 are performed.

[0029] For example, such detection 112, 114, 116 may be performed by the controller 280 transmitting one or more interrogation signals. When such an interrogation signal is received by the operating element 210, the sensor 220, or the actuator 230, each component transmits a response signal to the controller 280, thereby enabling the controller 280 to identify which components are present and ready for use.

[0030] In step 120, controller 280 determines or identifies possible operating modes based on the detected operating elements 210, sensors 220 and actuators 230. The operating modes are characterized, among other things, by a particular degree of automation. For example, a first operating mode may be determined to be possible if a minimum number and / or type of operating elements 210 are present. In the first operating mode, which in this embodiment may be a manual operating mode, mobile work machine 200 is directly controlled by a user by operational inputs using operating elements 210.

[0031] If in the detection step 110 it is identified that a minimum of the sensor arrangement 220 is present or ready for use, it may be determined that a second operating mode is possible, having a higher degree of automation than the first operating mode, in which, for example, an assistance function may be provided, for example, by limiting the movement freedom of the excavator arm 240 when the excavator arm 240 approaches an obstacle detected by the sensor arrangement 220.

[0032] A third operating mode having an even higher degree of automation than the second operating mode may be determined to be possible in step 120 if detection step 110 identifies that a minimum of actuators 230 are available other than sensor device 220. In the third operating mode, for example, certain work steps may be performed autonomously by the mobile work machine.

[0033] In a further step 130 of the method 100, actions are performed depending on the particular possible operating mode or modes.

[0034] Such measures may include, inter alia, that the currently used operating mode is determined from the possible operating modes determined in step 120. To this end, for example, the possible operating modes may be presented to a user of machine 200 on a display for selection. Based on an operational input 132 including a selection of one of the possible operating modes, the current operating mode may be set accordingly, whereby mobile work machine 200 is subsequently controlled in accordance with the selected operating mode in operational step 140.

[0035] That is, for example, the user of the machine 200 can manually control the machine 200 using the existing operating element 210 in a first operating mode, or can control it with assistance in a second operating mode, whereby the existing sensor device 220 detects, for example, the working environment of the working machine 200 and enables only those user control commands that are to be permitted according to the assistance mode. In the above-mentioned embodiment, in this case, in the second operating mode, the degree of freedom of movement of the excavator arm 240 in particular can be limited, so that the excavator arm 240 can only access a certain geometric space. If a user operation input is made via the operating element 210 such that the excavator arm 240 leaves the permitted geometric area, the control device 280 acts on the hydraulic unit 274 in the second operating mode, so that no control command is executed that triggers the departure of the permitted area, but only a control command is executed that guides the excavator arm in a direction in which the excavator arm reaches the border of the permitted geometric area and then returns to the permitted area again.

[0036] If the above-mentioned third operating mode is set as the current operating mode in step 130, the control device 280 autonomously controls the working machine 200. For this purpose, a movement trajectory of the working device 250 can be calculated based on the signals of the sensor device 220, which can be executed using the actuator element 230, in particular under the supervision of the sensor device 220, so that in the third operating mode, the machine can work, for example, completely without user control. In this case, the third operating mode can be used even if it is determined in the detection step 110 that there is no or insufficient equipment of the operating element 210 for manual control of the working machine 200. Based on the control of the traveling drive 260, the determination of the operating mode can have a corresponding effect, so that the traveling drive 260 and its components can also be considered in this connection as part of the actuator.

[0037] Furthermore, the method 100 can be configured to take into account the current machine status, including in particular the actual readiness of the components for use. This allows for changing the operation mode, for example, if a failure or erroneous operation of one or more components occurs, which operation mode is no longer feasible due to the error or failure. The machine status can also be understood to include the current work environment. For example, in certain areas, e.g. areas of a work site where the mobile work machine 200 is used, a certain degree of automation is possible, whereas in other areas of the work site, e.g. manual operation of all machines is required. In this case, the position of the machine 200 within the work site can be considered as a machine status that can be taken into account in step 130 of setting the current operation mode. Such external settings are represented in FIG. 2 by reference number 134 and can be received, for example, via a wireless interface (not shown).

[0038] Fig. 3 shows, by way of example, a schematic representation of an embodiment of a computing unit 280 for carrying out the method 100 according to the invention. Fig. 3 shows in particular the working scheme of the computing unit 280. The computing unit 280 has respective terminals for the operating element 210, the actuator element 230 and the sensor device element 220, which are used, on the one hand, for determining the available operating modes already explained in connection with Figs. 1 and 2, and, on the other hand, for transmitting corresponding signals between the computing unit 280 and the connected elements during operation of the mobile work machine 200. As shown, cabled or cable-free connections are possible.

[0039] To determine possible operating modes, it is for example detected which elements are connected and / or functional. For example, an interrogation signal can be sent via each terminal and, in response, from the received response signal, the identity and functionality of each element 210, 220, 230 can be deduced. For example, as operating elements 210, a control lever, a pedal, a switch button with display means and a touch screen are shown here.

[0040] For example, once it has been determined that a set minimum of operating units are provided and ready for use, a manual operating mode can be enabled, as indicated by the arrow labeled level 0 in Fig. 3. The manual operating mode includes here control functions 330 and drive control steps 340 executed on the side of the computing unit 280, which interpret and convert the operating inputs detected by the operating element 210 into corresponding control signals, which are transmitted to the actuator element 230, the drive unit 272 and / or the working unit 274 via corresponding terminals.

[0041] If in the detection step 110 it is determined that the minimum required sensor arrangement elements 220 are in a ready-to-use state, the calculation unit 280 also enables the assisted operating mode, represented by the arrow indicated by level 1+2. The assisted operating mode includes, in addition to the control function 330 and the drive control step 340, a trajectory planning function 320 beforehand, by which a movement sequence of a component of the mobile work machine 200, for example the excavator arm 240 or the traveling drive mechanism 260, is planned in advance. During operation in the assisted operating mode, such a planned movement sequence can be communicated to the user of the work machine 200, for example on a display means such as a screen. Particularly advantageously, a display of the actual movements occurring with the operating element 210 is also possible, thereby providing a means for correction by the user.

[0042] At the same time, when the minimum sensor device elements 220 and actuator elements 230 are detected to be in an operation-ready state, the calculation unit 280 also enables an automatic operation mode, represented by an arrow shown as level 3 in Fig. 3. The automatic operation mode can include, for example, the control operation mode 330, the trajectory planning function 320 and the drive control function 340, as well as the presented task planning function 310, which is used to handle more complex tasks for the trajectory planning function 320. For example, a success state to be achieved, for example a hole to be drilled with a set dimension, can be divided into smaller subtasks, so that the trajectory planning function 320 calculates, for example, each individual drilling process, while the task planning function 310 calculates and monitors that the formed hole finally reaches the set dimension.

[0043] A user can select a desired operation mode from the available operation modes, for example by displaying possible operation modes on a display means and presenting them to the user for selection, and the mobile work machine is then controlled in the corresponding operation mode based on the detected operational input.

Claims

1. A method (100) for operating a mobile work machine (200), comprising: automatically identifying (110) available elements (210, 220, 230, 260) of the mobile work machine (200), including actuator elements (230, 260), sensor device elements (220), and operating elements (210); automatically determining (120) at least one possible operating mode of the mobile work machine (200) based on the identified available actuator elements (230, 260), the sensor device elements (220) and the operating elements (210); automatically executing measures (130, 140) depending on said at least one possible operating mode determined; Including, if the available operating elements (210) satisfy a manual condition, it is determined that a first operating mode having a first degree of automation is possible; determining that a second operating mode having a second degree of automation higher than the first degree of automation is possible if the available actuator elements (230, 260) and the sensor device elements (220) satisfy an automation condition; if in the automatically identifying step (110) it is identified that a minimum number of actuator elements (230) are available in addition to the sensor device elements (220), then in the automatically determining step (120) it is determined that a third operation mode having a third degree of automation higher than the second degree of automation is possible, in which a specific work step can be autonomously performed by the mobile work machine (200); Method (100).

2. The method (100) of claim 1, wherein the at least one possible mode of operation includes a particular degree of automation of operation of the mobile work machine (200).

3. The method (100) of claim 2, wherein determining the at least one possible operating mode based on the identified available actuator elements (230, 260), the sensor device elements (220) and the operating elements (210) comprises determining a plurality of possible operating modes each having a different degree of automation.

4. 4. The method (100) of any one of claims 1 to 3, wherein determining (120) at least one possible operating mode of the mobile work machine (200) based on the identified available actuator elements (230, 260), the sensor device elements (220), and the operating elements (210) comprises determining all possible operating modes based on the identified available actuator elements (230, 260), the sensor device elements (220), and the operating elements (210).

5. The method (100) of any one of claims 1 to 4, wherein the action includes displaying the at least one possible operating mode for a user of the mobile work machine (200).

6. 6. The method (100) of any one of claims 1 to 5, wherein the actions include requesting user input (132), receiving the user input (132), determining a target operating mode dependent on the user input (132), and operating (140) the mobile work machine (200) in accordance with the target operating mode.

7. 7. The method (100) of claim 6, wherein operating (140) the mobile work machine (200) in accordance with the target operating mode takes into account a current machine status (134).

8. 8. The method (100) of claim 7, further comprising adjusting a target machine status if the current machine status (134) prevents operation (140) of the mobile work machine (200) in the target mode of operation.

9. said actuator elements (230, 260) comprising one or more of the group consisting of a travelling drive mechanism (260) with adjustment means, a linear drive mechanism (230) and a rotary drive mechanism; and / or The sensor device element (220) includes one or more from the group consisting of a distance sensor, a torque sensor, an angle sensor, a camera, a radar system, an ultrasonic sensor, a satellite positioning system, and a LiDAR system; and / or The operating element (210) includes one or more from the group consisting of a switch, a travel pedal, and an adjustment lever. The method (100) of any one of claims 1 to 8.

10. The actuator element (230, 260) comprises one or more from the group consisting of a hydrostatic travel drive mechanism (260), a linear drive mechanism (230) and a rotary drive mechanism, each having an adjustment means, and / or The sensor device element (220) includes one or more from the group consisting of a distance sensor, a torque sensor, an angle sensor, a camera, a radar system, an ultrasonic sensor, a satellite positioning system, and a LiDAR system; and / or The operating element (210) includes one or more from the group consisting of a switch, a travel pedal, and an adjustment lever. The method (100) of any one of claims 1 to 8.

11. 11. The method (100) of claim 1, wherein identifying (110) the available elements comprises transmitting at least one interrogation signal and receiving at least one response signal comprising information about the available elements.

12. A computing unit (280) configured to perform the method (100) of any one of claims 1 to 11.

13. A computer program product, when executed on a computing unit (280), causing the computing unit (280) to implement the method (100) of any one of claims 1 to 11.

14. A machine-readable storage medium storing the computer program of claim 13.

Citation Information

Patent Citations

  • Position guidance system of hydraulic shovel and control method for position guidance system

    JP2012172424A

  • Autonomous travel working vehicle

    JP2015222503A

  • Agricultural work vehicle

    JP2018117563A

  • Work travel function diagnostic device

    JP2018201347A

  • Work vehicle

    JP2019202615A