Control of Autonomous Work Devices Based on Physical Interaction
Autonomous work devices are enhanced with sensor-actuator systems to detect and respond to physical interactions, addressing interference issues by allowing users to adjust trajectories and work parameters through intuitive gestures, improving collaboration and task efficiency.
Patent Information
- Application Number
- JP2021187915
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-12-14
- Filing Date
- 2021-11-18
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2041-11-18
AI Technical Summary
Existing autonomous work devices, such as lawn mowers, often interfere with humans in their work area, causing irritation due to random movements and lack of intuitive interaction methods, especially when gardeners cannot easily reprogram them using smartphones or tablets.
Implementing sensors and actuators in autonomous work devices to detect and respond to physical interactions like nudges or gestures, allowing users to adjust the device's trajectory and work parameters without requiring additional programming modes.
Enables intuitive and efficient interaction between humans and autonomous devices, optimizing task performance and reducing interference by allowing users to modify work areas and trajectories through simple physical gestures, enhancing collaboration and user experience.
Smart Images

Figure 0007579232000001 
Figure 0007579232000002 
Figure 0007579232000003
Abstract
Description
[Technical field]
[0001] The present invention is in the field of autonomous working devices, and in particular in the field of control of autonomous working devices, such as cleaning robots or autonomous lawnmowers, based on physical interaction with a human. [Background technology]
[0002] An autonomous work device is a device that operates autonomously to perform a task that is useful to humans or equipment, excluding industrial automation applications. The autonomous work device performs its task in a work area where humans are present and may come into contact with the autonomous work device. An autonomous work device is sometimes called a service robot.
[0003] Autonomous work devices are becoming popular in the field of general service robotics. An autonomous work device, such as a vacuum cleaner robot, a window cleaning robot, or an autonomous lawnmower, is typically configured in an initial induction phase by assigning a work area and work parameters, and after a successful induction phase, operates largely autonomously and independently of humans in the assigned work area.
[0004] However, situations may arise where an autonomous work device and a person operate near each other in a work area. For example, an autonomous lawnmower may perform its mowing task in a lawn area of a yard while at the same time a gardener is tending a particular area of the yard, such as a flower bed. While the gardener is concentrating on the flower bed, the autonomous lawnmower may repeatedly bump into the gardener's back, causing the gardener to feel annoyed or even interrupted. Furthermore, the gardener may realize that the autonomous lawnmower performs its mowing task randomly through the work area, moving along its travel path, but leaving certain spots of the lawn area unattended in the meantime. However, the gardener may not have access to an app for reprogramming the autonomous lawnmower or may not have a smartphone or tablet computer running the app readily available. The gardener may also be hesitant to operate a tablet computer with soiled fingers from the flower bed or in the rain to reconfigure the work area or travel path of the autonomous lawnmower.
[0005] In light of these considerations, a need exists for improved means of interacting with and communicating with an autonomous lawnmower to reconfigure its travel trajectory to mow neglected lawn spots or to exclude areas around flower beds from the work zone to avoid continually interfering with a human gardener. Summary of the Invention [Means for solving the problem]
[0006] These problems are addressed by an autonomous work apparatus according to a first aspect, a method for controlling an autonomous work apparatus according to a second aspect, and a program for controlling an autonomous work apparatus according to a third aspect.
[0007] According to a first aspect, an autonomous work device includes at least one sensor configured to generate a sensor signal based on a physical interaction between the autonomous work device and a physical entity. The autonomous work device further includes at least one actuator configured to perform a work task, and a controller configured to generate a control signal for controlling the actuator. The controller is configured to evaluate the sensor signal, identify a pattern of physical interaction between the autonomous work device and a person based on the evaluated sensor signal, and generate the control signal based on the identified pattern of physical interaction.
[0008] A method for controlling an autonomous work device according to a second aspect refers to an autonomous work device comprising at least one sensor, at least one actuator for performing a work task, and a controller. The method includes a step of generating a sensor signal by the at least one sensor based on a physical interaction between the autonomous work device and a physical entity. In a subsequent step, the controller evaluates the sensor signal. The controller generates a control signal based on the evaluated sensor signal. The actuator performs the work task based on the generated control signal. The method includes a step of identifying whether a pattern of physical interaction between the autonomous work device and a person has occurred based on the evaluated sensor signal. If the controller identifies that a pattern of physical interaction between the autonomous work device and a person has occurred, the controller performs a step of generating a control signal based on the evaluated sensor signal. The actuator then performs the work task based on the generated control signal.
[0009] A non-transitory computer readable medium for controlling an autonomous work device stores a program according to a third aspect having program code for performing the steps of the method according to the second aspect when the program is executed on a computer or digital signal processor. [Brief description of the drawings]
[0010] [Figure 1] FIG. 2 is a schematic diagram showing the functional structure of the autonomous work device. [Diagram 2] 1 is a simplified flowchart illustrating a method for controlling an autonomous work device according to an embodiment. [Diagram 3] FIG. 1 is a plan view illustrating control of an autonomous work device according to an embodiment using a press gesture. [Figure 4] 1 is a simplified state graph showing operational states of an autonomous work device according to an embodiment. [Diagram 5] 1A-1C are diagrams illustrating examples of sensor signals for a collision event and a pressing gesture as a physical interaction. [Figure 6] 1 illustrates an example of a sensor signal indicative of a collision event and a press gesture, as well as a discrimination filter for detecting a light press gesture. [Figure 7] FIG. 13 illustrates two examples of sensor signals for knock gestures with different knock duration parameters. [Figure 8] FIG. 1 is a diagram showing a first application scene of an autonomous working device according to an embodiment. [Figure 9] FIG. 11 is a diagram showing a second application scene of the autonomous working device according to the embodiment. [Figure 10] FIG. 13 is a diagram showing a third application scene of the autonomous operating device according to the embodiment. [Figure 11] FIG. 13 is a diagram showing a fourth application scene of the autonomous working device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] In the figures, like reference numbers refer to like or corresponding elements, and repeated discussion of elements with like reference numbers in different figures is omitted where appropriate to improve brevity.
[0012] The autonomous work device according to the first aspect suitably provides a natural human machine interface (HMI) by implementing an interaction method that allows work-related information to be transferred from a user to the autonomous work device. This transfer of information is implemented by using low-cost sensors of limited quality that are already present in many current autonomous work devices. Thus, the autonomous work device can operate in the same work area in which a person walks around, while the person can negotiate key aspects of the collaboration between one autonomous work device and the other person using intuitive gestures based on physical interaction with the autonomous work device. This negotiation is made possible by the autonomous work device's understanding of direct and intuitive input from the person, which allows the person to provide simple commands or guidance to the autonomous work device. Prior art autonomous work devices ignore such commands and guidance, for example by bumping into the person at low speeds, or relying on operating buttons located on the outside of the autonomous work device that can be difficult to operate, for example, and often switch the autonomous work device into a standby or stop mode entirely. Prior art autonomous work devices only provide the ability to use smartphone apps, which in turn need to be installed on a person's smartphone or tablet computer and take time to open and operate. Voice interfaces provide an HMI suitable for intuitive operation, but suffer from poor recognition quality of spoken commands in noisy environments, such as outdoor scenes, especially due to the poor quality of microphone characteristics and poor recognition speed caused by limited processing resources of low-cost robotic devices.
[0013] A physical interaction is a physical gesture performed by a human that includes physical contact between the human and the autonomous work device, for example with at least one hand or foot, or a single finger. A gesture refers to an intentional physical contact between a human (person) and an autonomous work device, and is characterized as being initiated by the human with the intentional goal of conveying information to the autonomous work device.
[0014] A big advantage of an autonomous work device is that it uses physical interaction and gestures to obtain commands. Physical gestures can be provided by a person interacting with the autonomous lawnmower without lowering their head, or even using their hands. Both hands may be occupied, or a disability may prevent the person from using both hands.
[0015] The autonomous work device according to the first aspect enables an intuitive process for altering the autonomous work device's travel trajectory, for example by a light push gesture, which can be easily accomplished even by a person with no knowledge of the autonomous work device's specific functions, for example a guest or gardener / worker, assuming the autonomous work device is operational. Such a light push gesture is easy to learn and does not require bending down to accommodate the autonomous work device, which is typically short, or having to keep both hands free to operate the robot. Physical interaction may require the person's feet to perform the physical interaction with the autonomous work device.
[0016] The autonomous work device according to an advantageous embodiment includes at least one sensor configured to generate a sensor signal while the autonomous work device is operating in a mode other than the programming mode or the learning mode. Thus, the autonomous work device can receive commands or guidance while performing its normal work task. Thus, time-consuming and tedious reprogramming after entering the programming mode or the learning mode is not necessarily required. Even individuals, such as gardeners' assistants or workers, who are not familiar with the autonomous work device or do not have permission to program the autonomous work device, can collaborate with the autonomous work device in the work area.
[0017] The autonomous work device may include at least one sensor configured to generate a sensor signal that measures acceleration in at least one spatial direction.
[0018] Additionally or alternatively, the at least one sensor includes an inertial measurement unit (IMU). Acceleration sensors are present in most current autonomous work devices and are commonly in the form of an IMU that measures acceleration in up to three axes. In addition, an IMU can measure angular velocity about up to three axes. No additional hardware and corresponding costs are required to implement the present invention compared to existing autonomous work devices.
[0019] Additionally or alternatively, the at least one sensor may include a moveable or force-sensitive cover of the autonomous work device.
[0020] Additionally or alternatively, the at least one sensor includes a touch-sensitive area disposed on the autonomous work device.
[0021] Sensors that measure forces applied to at least a portion of the housing of an autonomous work device often already exist for detecting collision events involving an autonomous work device and an object within a work area. No additional hardware and corresponding costs are required to implement the present invention compared to existing autonomous work devices.
[0022] Additionally or alternatively, the at least one sensor includes an auditory sensor, in particular one or more microphones, configured to detect a knock gesture.
[0023] Even if a machine is only equipped with low-cost sensors of limited quality, the knock pattern offers the possibility of encoding multiple different pieces of information, whether spatial patterns, temporal patterns, or a combination thereof, in a way that is easy for the machine to receive and decode.
[0024] Additionally or alternatively, the at least one sensor may include a member disposed on the autonomous work device such that it is externally accessible. A member such as a rod protruding from an upper housing of the autonomous work device may provide an easily recognizable and easily operable sensor for physically interacting with the autonomous work device.
[0025] According to an embodiment, the autonomous work device has at least one physical interaction including pushing the autonomous work device in one direction (nudge gesture, pat gesture). Pushing, nudge, or pat represent intuitive gestures involving physical interactions for conveying directional information from a person to the autonomous device, and at the same time, these gestures can be easily detected and evaluated in the autonomous device without requiring a complex set of sensors in addition to already existing sensors that preferably measure acceleration in multiple acceleration axes.
[0026] Additionally or alternatively, the at least one physical interaction includes a touch gesture of pressing the autonomous work device in one direction against the housing. Using the housing as the sensitive area provides an HMI that is robust and easily accessible to humans, especially in outdoor environments that may include dust, moisture, and humans with their hands full.
[0027] Additionally or alternatively, the at least one physical interaction includes a touch gesture (pet gesture) in at least one direction relative to a housing of the autonomous work device.
[0028] Additionally or alternatively, the at least one physical interaction includes a knock pattern relative to a housing of the autonomous work device. The knock pattern, e.g., a spatially and / or time-dependent pattern, can encode multiple different pieces of information with advantageous transmission and decoding characteristics.
[0029] Additionally or alternatively, the at least one physical interaction includes lifting the autonomous work device, the full or partial lifting of the autonomous work device being particularly easily and reliably identified and thus distinguished from normal accelerations occurring during normal operation of the autonomous work device.
[0030] Additionally or alternatively, the at least one physical interaction includes shaking the autonomous work device.
[0031] Preferably, the autonomous work device may include a controller configured to generate a control signal including data for at least one work parameter based on the interpreted physical interaction. The at least one work parameter may include data defining a work zone within which a work task is to be performed by the autonomous work device.
[0032] Additionally or alternatively, the at least one work parameter may include data about a travel trajectory of the autonomous work device in the work area.
[0033] Additionally or alternatively, the at least one operational parameter may include data regarding an operational mode of the autonomous work device.
[0034] Thus, a human can use physical interaction to provide specific information about the actual work task currently being performed by the autonomous work device without having to enter a tedious programming mode to reprogram the autonomous work device.
[0035] According to an advantageous embodiment, the data defining the working area includes information for at least one of modifying the working area, indicating a new working area, and defining prohibited areas within the working area.
[0036] Redefining the current working area of the autonomous work device provides an advantageous capability to a person working with the work device in the same area to avoid potential interference between the human and the machine, optimizing the task performance of both the human and the autonomous work device.
[0037] The data about the travel trajectory may include information about at least one of correcting (redirecting) the travel trajectory, directing the autonomous device to a particular location, indicating a new travel trajectory, and redirecting from a current travel trajectory. Thus, a person can use physical interaction to direct the work device to an abandoned area in a work zone or an area that needs specific care.
[0038] The data about the operational modes may include information about at least one of a work mode, a sleep mode, a standby mode, a predefined specific work task, a predefined specific behavior, a monitoring mode, a tracking mode for the autonomous work device following a user, a storage mode for storing position and / or status data in a memory, an unlocking process, a programming mode, and a training mode. This embodiment gives a person the option to switch between different operational modes in a particularly intuitive manner without in-depth knowledge of the specific HMI associated with the autonomous work device.
[0039] The controller may be configured to select or modify data for at least one work parameter based on the evaluated sensor signals. Through simple physical interaction between the human and the autonomous work device, the at least one work parameter may be modified or adjusted to improve collaboration between the autonomous work device and the human within the work environment.
[0040] When the controller determines that a physical interaction between the autonomous work device and the human has occurred based on the evaluated sensor signal generated by the first sensor, the controller of the autonomous work device of an advantageous embodiment is configured to select or modify at least one work parameter based on a further evaluated sensor signal obtained via the second sensor. Thus, the human can use the intuitive physical interaction detected by the first sensor to initiate more complex communications that convey more information to the autonomous work device via the second sensor of the autonomous work device.
[0041] An autonomous working device according to a further embodiment includes an output interface. The controller is configured to generate a feedback signal and output the feedback signal to the human via the output interface. The feedback signal communicates the generated and evaluated sensor signal based on the physical interaction to the human. Thus, the autonomous working device can recognize a message communicated from the human via physical interaction and can provide an interpretation of the autonomous working device of the message or guidance provided by the human engaging in the physical interaction. The human may appropriately correct any misinterpretation of the message by repeating the physical interaction or adapting appropriately. The probability of successful communication of information to the autonomous working device is significantly increased by the possibility of the feedback signal without reverting to a less intuitive HMI between the human and the autonomous working device.
[0042] The actuator of the autonomous work device according to the preferred embodiment includes at least one work tool and / or drive device. The work tool of the autonomous work device can be, in particular, a cleaning tool, a suction cleaning tool, an ironing tool, a weeding tool, a maintenance tool.
[0043] In a further advantageous embodiment, the autonomous work device includes a controller configured to identify a first pattern of physical interactions based on the evaluated sensor signals generated based on the first physical interaction as a reward and to identify a second pattern of physical interactions based on the evaluated sensor signals generated based on the second physical interaction as a punishment. The controller can then adapt future behavior of the autonomous work device based on the identified first and second patterns, particularly by using a training algorithm.
[0044] Using physical interactions and gestures to train the autonomous work device is advantageous because some gestures can be considered reward gestures and other gestures as punishment gestures, similar to training a pet. Thus, the autonomous work device can learn to adapt its future behavior to the preferences of the person who communicates with the autonomous work device using physical interactions. For example, the autonomous work device can recognize that it should not enter certain parts of the yard at certain times of the day or week. To do so, the autonomous work device may store location and time information along with recognized physical gestures so that it can learn from them later. For example, when waiting at a base station, the autonomous work device may process computationally intensive learning algorithms based on the stored information and associated physical gestures. Distributing processing in this way is advantageous because the autonomous work device is not currently obligated to perform assigned work tasks and may only need to charge its batteries. There may also be different levels of learning. A first level of learning may be a one-time (or one-shot) learning, for example to teach the autonomous work device not to go near bodies of water such as ponds or pools that may damage the autonomous work device. Another level of learning involves teaching permanent rules, for example to prohibit nighttime operation. Yet another level of learning involves gradual reinforcement learning, where the autonomous work device continually adapts the rules by which it operates to the implicit rules in a person's mind.
[0045] FIG. 1 shows an overview of the functional structure of an autonomous working device. The autonomous working device may be, but is not limited to, an autonomous lawnmower 1. Alternatively, the autonomous working device may be, for example, an autonomous suction cleaning device, an autonomous floor cleaning device, or an autonomous window cleaning device. An autonomous working device or an autonomous working robot (robot device) may perform different work tasks in a work environment. Typically, an autonomous working device performs work tasks in a work area assigned to the autonomous working device. The work area may be separated and defined from a non-work area by a virtual or physical boundary in the environment of the autonomous working device.
[0046] The autonomous work device performs its work tasks using actuators, which are controlled by the controller 3 of the autonomous work device using control signals 9.1, 9.2 generated by the controller 3 and output to the actuators.
[0047] The controller 3 (electronic control unit, ECU for short) typically includes at least one processor, particularly a microprocessor, or signal processor, and may store data such as program files and data generated during operation of the autonomous work apparatus in memory 10. Memory 10 may include different types of memory such as read-only memory (ROM), random access memory (RAM), flash drives, and disk drives, and may also include remote storage means located away from the autonomous work apparatus.
[0048] The remote storage means may be accessible via a communications link, preferably a wireless communications link, using a communication signal 11 to a remote server. The remote storage means may in particular store data such as log data files.
[0049] The autonomous work device may include an output interface 4 for outputting information to a person in the environment of the autonomous work device, either visually via a display or light emitting means such as LEDs, or audibly via a speaker. The controller 3 generates the information to output and generates output control signals 7 for controlling the output of information by the output interface 4.
[0050] The autonomous work device may include different types of actuators. The actuators may include a work tool 6, which the controller 3 controls with a first control signal 9.1. In the case of an autonomous lawnmower 1, the work tool 6 may include a mowing assembly. The work tool 6 is the actuator component that performs the work task.
[0051] The actuators of the autonomous work device include a drive 5, which is controlled by the controller 3 with a second control signal 9.2. The drive 5 may include one or more motors, typically electric motors, a drive train, wheels and / or tracks, and a steering assembly for changing the heading direction of the autonomous work device while it is moving.
[0052] The drives 5 are actuator components that enable the autonomous work device to move about a work area and perform work tasks throughout the work area.
[0053] The controller 3 generates a second control signal 9.2 for performing a navigation task and for navigating the autonomous work device along a navigation trajectory (travel path) based on the sensor signals 7.1, 7.2 in particular. The autonomous work device shown in Figure 1 includes two sensors that generate the sensor signals 7.1, 7.2 based on measurements of physical parameters of the autonomous work device's environment.
[0054] The inertial measurement unit 2 (IMU) may include three basic acceleration sensors to determine the acceleration of the autonomous work device in three independent spatial axes and provide the measured acceleration values to the controller 3 in a first sensor signal 7.1. The IMU 2 is a common sensor and is equipped on most autonomous work devices to enable the autonomous work device to navigate along its travel trajectory through the work area. The IMU 2 may be used as a linear and / or rotational acceleration sensor and typically includes one or more accelerometers and gyroscopes.
[0055] Additionally, the sensors may include an auditory sensor 8 (microphone) that provides auditory input to the controller 3 in a second sensor signal 7.2. The sensors may include one or more camera sensors, a global navigation satellite system receiver (GNSS receiver), a dedicated bump sensor for detecting collisions with objects in the work area, a radar sensor, or other sensors such as an auditory sensor for detecting physical objects in the environment. The sensors generate and provide sensor signals 7.1, 7.2 to the controller 3.
[0056] To sense the physical interaction of the autonomous work device with physical objects or people, the autonomous work device preferably uses simple and common sensors that are already built into the autonomous work device for different purposes, which reduces the complexity and therefore the cost, and only requires additional signal processing in the controller 3 of the autonomous work device.
[0057] The IMU 2 measures acceleration and provides information about the forces acting on the autonomous work device that cause the acceleration. The magnitude and direction measured by the IMU 2 can be used by the controller 3 performing appropriate processing with the sensor signal 7.1 as input to distinguish between a collision event on the one hand and a physical interaction such as a pushing gesture on the other hand. The sensor signal 7.1 also provides the controller 3 with appropriate inputs that are used to identify a shaking gesture or a lifting gesture.
[0058] The shaking gesture involves shaking of the autonomous work device caused by a human. The lifting gesture is when a human grabs the autonomous work device and lifts it off the ground.
[0059] The known autonomous lawnmower 1 is equipped with a separate collision sensor, e.g., a bump sensor or a Hall sensor, that detects the relative movement between the outer cover of the autonomous lawnmower 1 and the inner body of the autonomous lawnmower 1. This can be used to make the distinction between a collision event and a push gesture clearer. For example, if the outer cover is equipped with a magnetic member and the inner body has a Hall sensor appropriately positioned relative to the magnetic member, the sensor signal provided by the Hall sensor may provide corresponding information about the collision event and the push gesture as the sensor signal from the acceleration sensor, e.g., IMU2.
[0060] Auditory sensors 8 are not yet common in the field of autonomous working devices, and in particular in the field of autonomous lawnmowers 1. This situation may change in the future, as there is an increasing trend towards using voice recognition as an input means. Voice commands are language specific, require higher processing power to interpret the raw auditory data, are often not very intuitive, and need to be differentiated from normal speech in the environment of the autonomous working device, and in particular in the case of the autonomous lawnmowers 1, possibly noisy. The auditory sensor 8 is able to identify knocking and stroking gestures from its sensor signal 7.2. The knocking and stroking gestures give rise to distinct sound patterns, which the controller 3 can distinguish from voices or general environmental noise by performing appropriate processing.
[0061] In an embodiment, the autonomous lawnmower 1 may have an auditory sensor 8 positioned, for example integrated into the outer cover of the autonomous lawnmower 1, to robustly and cost-effectively detect certain gestures as physical interactions.
[0062] Alternatively or additionally, the autonomous lawnmower 1 may be equipped with touch-sensitive areas as sensors, for example on its outer cover or body. The touch-sensitive areas may be components of a touch interface, which is a natural and intuitive means of communication for people familiar with the associated interfaces of smart devices such as wireless phones and tablet computers. The touch interface allows the input of multiple commands that can even be configured by its user. Capacitive touch-sensitive areas are advantageous because they reduce unintentional triggering of gestures by normal physical interactions with the environment, for example by low-hanging twigs in a garden environment.
[0063] Alternatively or additionally, the controller 3 is configured to implement robust human-robot interaction by combining physical interaction with the person based on physical gestures with at least one additional sensor input, e.g. sound recognition, voice recognition, and visually detecting pointing gestures using a camera sensor.
[0064] A first gesture may temporarily stop the movement of the autonomous lawnmower 1 along its travel trajectory, resulting in reduced noise by suppressing noise caused by the movement, improving the results of any subsequent voice recognition.
[0065] Alternatively or additionally, the controller 3 processes the sensor signals 7.1, 7.2 providing visual, auditory and / or other sensor inputs only after detecting a physical gesture. This approach results in a reduced computational load on the controller 3. The power consumption of the autonomous lawnmower 1 can be reduced, which is particularly advantageous for autonomous work devices that operate on rechargeable batteries. Furthermore, false positive command recognition, e.g. the possibility of misinterpreting noises as voice commands, can be avoided.
[0066] FIG. 2 illustrates a simplified flow chart of a method for controlling an autonomous work device according to an embodiment.
[0067] The method for controlling an autonomous operating mower 1 includes step S1, in which at least one sensor generates a sensor signal 7.1 based on a physical interaction of the autonomous mower 1 with a physical entity. In particular, an IMU 2 of the autonomous mower 1 may generate the sensor signal 7.1 in step S1, which includes a time-dependent acceleration measurement of the autonomous mower 1.
[0068] The sensor provides the generated sensor signal 7.1 to the controller 3.
[0069] In step S2, the controller 3 evaluates the acquired sensor signal 7.1. In step S3, the controller 3 determines whether a physical interaction between the autonomous lawnmower 1 and a person has occurred. If, by evaluating the sensor signal 7.1, the controller 3 determines that a physical interaction with a person has not been detected, the controller 3 returns to step S1 of generating the sensor signal 7.1.
[0070] In step S3, the controller 3 evaluates the sensor signal 7.1. Evaluating the sensor signal 7.1 may include interpreting the sensor signal 7.1. Evaluating the sensor signal 7.1 may include identifying a predetermined type of physical gesture, for example a push gesture. Evaluating and interpreting the sensor signal 7.1 may further include evaluating the sensor signal 7.1 and calculating a direction vector from the sensor signal 7.1 based on the evaluation. The controller may calculate a direction vector from the sensor signal 7.1 provided by the IMU 2, for example, indicating a spatial direction in which the identified push gesture pushes the autonomous lawnmower. Interpreting the sensor signal 7.1 may include associating the physical gesture with a specific control action of the autonomous lawnmower 1. For example, the identified push gesture may be associated with an action of the autonomous lawnmower 1 continuing to perform its assigned task within the work area along a modified travel trajectory. The modified travel trajectory is oriented in a direction indicated by the calculated direction vector.
[0071] If, in step S3, the controller 3 determines, based on the acquired sensor signal 7.1, that a physical interaction between the autonomous lawnmower 1 and a person has occurred, the controller proceeds to step S4.
[0072] In step S4, the controller 3 proceeds by generating control signals 9.1, 9.2 based on the evaluated sensor signal 7.1. In one example, the controller 3 interpreted the sensor signal 7.1 as a push gesture associated with the autonomous mower 1's movement to continue performing its assigned task in the work area along the modified travel trajectory indicated by the calculated direction vector. The generated control signal 9.2 would then include control data for the drive 5 to change the course of the autonomous mower 1 towards the direction indicated by the calculated direction vector. The generated control signal 9.1, 9.2 for the work tool 6 may include data communicating that the autonomous mower 1 continues to perform the same work task of mowing the grass along the new travel trajectory.
[0073] The generated control signal contains information for the actuators to perform specific actions that result in the autonomous work device adapting its behavior based on the interpreted sensor signal 7.1 and therefore as communicated by the person U through physical interaction.
[0074] The controller 3 outputs the generated control signals 9.1, 9.2 to the actuators in step S5. In this example, the controller 3 outputs the generated control signal 9.2 to the drive 5, which includes a new steering angle for the corrected driving trajectory indicated by the calculated direction vector.
[0075] Based on the generated control signals 9.1, 9.2 the actuators perform the work task in step S6. In this example, the drive 5 turns the autonomous lawnmower towards the corrected direction indicated by the control signal 9.1 and proceeds along the new travel trajectory.
[0076] FIG. 3 shows a top view of control of an autonomous work device according to an embodiment using press gestures.
[0077] The illustrated example autonomous work device is an autonomous lawnmower 1 that performs its mowing task while moving along a planned travel trajectory 12. When the autonomous lawnmower 1 is at point 13 on the planned travel trajectory 12, a person U performs a physical interaction with the autonomous lawnmower 1 in the form of a push gesture. The person U performs the push gesture by pushing the autonomous lawnmower 1 in the direction indicated by the arrow "push."
[0078] The controller 3 interprets the sensor signal 7.1 as indicative of a push gesture, which indicates a modified travel trajectory 15, and together with the push gesture indicates a desired direction of the modified travel trajectory 15. The controller evaluates the sensor signal 7.1 and calculates a direction vector 14 indicating a desired direction of the modified travel trajectory 15. The controller 3 then generates a control signal 9.2 and outputs the generated control signal 9.2 to the drive device 5 of the autonomous lawnmower 1. The drive device 5 changes the course of the autonomous lawnmower 1 based on the control signal 9.2. The autonomous lawnmower 1 proceeds with the performance of its mowing task after the course has been changed along the modified travel trajectory 15, which points in the direction of the direction vector 14 indicating the desired direction.
[0079] The generated control signals 9.1, 9.2 contain information for actuators to perform specific actions that lead to the autonomous work device adapting its behavior based on the interpreted sensor signals and therefore as communicated by the person U through physical interaction.
[0080] For example, an autonomous work device can adapt its work area based on physical interactions. In a typical application, an autonomous work device operates in a specific area as its assigned work area, which is intended for temporary and exclusive use by humans, animals, or objects that are blocked by the autonomous work device, such as a garden party in the backyard, or an area for board games on the floor. For example, a physical gesture may be used to communicate to the autonomous work device that a previously predefined work area, or a specific radius around the autonomous work device's current location, will not be or will be a work area again for a limited period of time, or always until a new command.
[0081] The physical gestures may communicate activation and unlock commands. The autonomous work device may use a secret PIN as an anti-theft measure, which may be replaced by a specific physical gesture or series of physical gestures, e.g., a knock pattern, as a secret shared between the autonomous work device and an authorized person, e.g., the owner of the autonomous work device.
[0082] A physical gesture can orient the autonomous work device towards a work area. Autonomous work devices often operate by random driving within their work area, which can result in small areas remaining untended, e.g., unswept or unmowed, for extended periods of time. Such remaining areas can be frustrating for users. Using physical gestures as physical interactions here, the user can orient the autonomous work device towards such remaining areas. Such a direction can be encoded, for example, by the force direction of a push gesture, by an additional pointing gesture, by a voice command, or by the autonomous work device being commanded to temporarily follow a person to a location or area.
[0083] The physical gesture may indicate to the autonomous work device to go to a parking location, or to go to a charging location, such as a base station, or to go to a different remote work area.
[0084] A physical gesture may indicate to the autonomous work device to pause or temporarily cease operation for a predetermined period of time, such as one hour.
[0085] The physical gesture may indicate to the autonomous work device to change its current mode of operation: the autonomous work device may be commanded to change its behavior to one of a set of predefined behaviors, for example to mowing or sweeping following the perimeter of the work area for boundary cutting, or to switch to spiral cutting, or to enter a monitoring mode.
[0086] The physical gesture may indicate to the autonomous work device to temporarily stop performing its work task, e.g., cutting / mowing motions, and instead begin interactive play behaviors.
[0087] A physical gesture may indicate to the autonomous work device to turn. The autonomous work device is commanded not to continue its current travel trajectory. In the case of a push gesture, the push gesture may be interpreted as causing the autonomous work device to preferably turn away from the direction of the push force. Certain implementations trigger a memory-less, direct action of the autonomous work device to immediately turn in response to the push gesture.
[0088] Alternatively, the autonomous work device may interpret the push gesture as a learning signal and automatically redirect to avoid a similar situation in the future, which may be based on the current position of the push gesture relative to the housing of the autonomous work device, or based on another sensor signal input, such as tilt angle, or visual input of object detection.
[0089] The autonomous work apparatus may interpret the pressing gesture as a command to store something using the storage capabilities of memory 10. For example, controller 3 may store the current position or parameters obtained by sensor signals 7.1, 7.2 to define a specific situation for later training a corresponding behavior of the autonomous work apparatus. Subsequent training may include a person using the smart device to refer to the stored specific situation or situations to teach or reinforce a specific behavior of the autonomous work apparatus.
[0090] The autonomous work device may interpret the push gesture as a command to follow person U to a new location within or outside the work zone.
[0091] A push gesture is a natural and intuitive means of providing a directional command to the autonomous work device to change its current travel trajectory 31 in the direction of the push gesture. Person U may perform the push gesture with his / her hand or with another limb, for example, his / her foot when carrying something. Because most conventional autonomous work devices do not use remote sensors for collision avoidance, such as sonar sensors or cameras, push gestures need to be distinguished from collision events by the autonomous work device, which may occur more frequently. Push gestures differ from collision events in three aspects. First, collision events often lead to strong acceleration of the autonomous work device, whereas light pushes accelerate rather weakly. Second, collision events usually produce peaked acceleration, whereas light push gestures have a smooth profile, which will be discussed in connection with FIG. 5. Third, collision events lead to acceleration, particularly in the opposite direction to the current direction of movement, whereas push gestures are more likely to be directed laterally and thus diagonally away from the current direction of movement. A particular variation of the push gesture is to push from behind the body of the autonomous work device in a direction pointing towards the front of the autonomous work device to indicate to the autonomous work device to move faster.
[0092] Furthermore, it is preferable to use a push gesture so that a randomly misinterpreted (misclassified) collision event does not adversely affect the future operation of the autonomous work device. For example, a front push gesture meaning "stop and turn" is useful for misclassified collision events with stationary objects, whereas "stop and wait for next command" is not as useful.
[0093] FIG. 4 illustrates a simplified state graph of operational states of an autonomous work device according to an embodiment.
[0094] The illustrated operating states are operating states of the autonomous work device in a work operating mode. In particular, the illustrated operating states refer to the states of the drive unit 5 of the autonomous work device.
[0095] The operational states of the work operational mode include a first state of the autonomous work device moving along a straight path in a movement state 16 .
[0096] The second state is the random turn state 19. In the random turn state 19, the autonomous work device changes its current heading direction to a new heading direction by a randomly selected angle.
[0097] The autonomous work device may transition from the moving state 16 to the random turn state 19 if a collision detection event 17 is detected. A further transition event that transitions the autonomous work device from the moving state 16 to the random turn state 19 occurs when the controller 3 determines that the autonomous work device has reached the boundary of its assigned work area (boundary detection event 18).
[0098] The autonomous work apparatus supplements the moving state 16 and the random turn state 19 in the work operation mode with a third state, which is the directional turn state 21. When the controller 3 identifies a push gesture as a physical interaction (push gesture detection event 20), the autonomous work apparatus transitions from the moving state 16 to the directional turn state 21. In the directional turn state 21, the controller 3 may calculate a directional vector indicating the push direction of the identified push gesture, and corrects the current travel trajectory to a new travel trajectory toward the spatial direction indicated by the calculated directional vector of the push gesture. After performing a turn to the new travel trajectory in the corrected direction, the controller 3 controls the transition of the autonomous work apparatus to the first state, i.e., the moving state 16.
[0099] It will be apparent that the states and state transitions discussed in FIG. 4 are merely examples, and that multiple additional states and state transitions may be defined in the task operating state of an autonomous task device.
[0100] FIG. 4 illustrates an improved feature of the autonomous work device over the prior art. In the prior art, it is necessary to teach the autonomous work device in a specific training or programming mode. The training mode may use a method sometimes called "teach-in." A commonly known "teach-in" process for an autonomous work device uses physical interaction with the autonomous work device while being trained. However, teach-in requires setting the autonomous work device in a training mode. In the training mode, the autonomous work device trains an entire travel trajectory before switching to an operational mode and starting to perform a work task. In contrast, the method for controlling the autonomous work device of FIG. 2 provides an intuitive interaction capability with the autonomous work device during the operational mode performing a work task to adapt or change its current behavior. The change in behavior of the autonomous work device can be limited to a time period, for example, requiring the autonomous work device to turn around from its current leading direction and then resume standard operation, for example in the moving state 16.
[0101] 5 provides a basic example of a sensor signal for a crash event and a push gesture. The sensor signal shown is an acceleration sensor signal, shown with acceleration signal amplitude on the ordinate axis over time t shown on the abscissa.
[0102] The acceleration sensor signal curve 22 shows a signal peak characteristic of a crash event.
[0103] The acceleration sensor signal curve 23 shows a characteristic signal curve for a pressing gesture.
[0104] Comparing acceleration sensor signal curve 22 with acceleration sensor signal curve 23, the difference in the signal curves reveals that controller 3 can be configured to distinguish between a crash event on the one hand and a push gesture on the other by evaluating a sensor signal provided by a sensor providing continuous acceleration measurements. Acceleration or force sensors form part of the IMU 2 of many autonomous work devices.
[0105] FIG. 6 shows an example of sensor signals representative of a collision event and a press gesture, as well as a discrimination filter for detecting a light press gesture.
[0106] Prior art autonomous working devices such as the autonomous lawnmower 1 can detect collisions with physical objects by sensor signals provided by sensors, e.g., Hall sensors, dedicated bump sensors, or by monitoring drive motor current. Most autonomous lawnmowers 1 are equipped with a built-in IMU 2. The IMU 2 may be used to distinguish between, on the one hand, passive collision events between the autonomous lawnmower 1 and physical objects in the environment, and, on the other hand, active pushing gestures performed by a person in the form of physical interaction.
[0107] A crash event is characteristically a very sudden event, causing a short peak in the sensor signal curve 24 output by the g-sensor providing the acceleration force measurement, which is part of the IMU 2. In contrast to a crash event, a light push gesture causes a flat signal rise and a long plateau in the sensor signal curve 24 output by the g-sensor.
[0108] FIG. 6 shows a sensor signal curve 24 provided by a g-sensor over time t. The sensor signal curve 24 exhibits a noise component, which is the only signal component in period 25. In period 26, the sensor signal curve 24 exhibits a characteristic crash event characterized by a short peak in the sensor signal curve 24, with a characteristic steep rise and an equally steep fall in the sensor signal curve 24. In period 27, the sensor signal curve 24 exhibits a characteristic push gesture event, with a flat peak, a characteristic gradual rise and an equally gradual fall in the sensor signal curve 24 compared to the sensor signal curve 24 in period 26. The first maximum of the sensor signal curve 24 in period 26, which indicates a crash event, is greater than the second maximum of the sensor signal curve 24 in period 27, which indicates a push gesture event.
[0109] Thus, a push gesture corresponding to a light push by a person and a collision event corresponding to a sudden collision with a physical object can be distinguished from the force curve 24 of the sensor signal, for example by using signal processing, in particular by comparing the sensor signal curve 24 with one or more threshold values.
[0110] The IMU 2 can use g-sensors in three spatial axes. An embodiment of the controller 3 implements signal processing that includes summing the readings of the three axis g-sensors in all three dimensions. Alternatively, the readings of each axis may be processed separately in the controller 3.
[0111] The controller 3 compares the sensor signal, preferably the summed sensor signal, to a first threshold 28. The first threshold 28 is used to filter out noise components of the sensor signal. If the sensor signal is above the first threshold 65, the controller 3 determines that an event of an as yet unknown type has occurred.
[0112] The sensor signal curve 24 of Figure 6 exceeds the first threshold 28 in time period 26 and again in time period 27. Thus, based on the sensor signal curve 24 shown, the controller 3 determines that non-obvious events have occurred in time period 26 and also in time period 27.
[0113] The controller 3 further compares the sensor signal with a second threshold 29. The second threshold 29 allows for distinguishing between minor and sudden events based on the sensor signal. If the sensor signal is above the second threshold 29, the controller 3 determines that a sudden event has occurred. To reliably detect a sudden event, the sensor signal needs to exceed the second threshold 29 for some minimum time, for example 500 ms.
[0114] In a further advantageous embodiment, the autonomous lawnmower 1 uses additional sensor signals generated and output by additional sensors for detecting a collision event and for distinguishing between a collision event and a push gesture. The additional sensors may include at least one of a Hall sensor and a current sensor monitoring a drive motor current of an electric motor of a drive device of the autonomous lawnmower 1. The controller 3 can use these additional sensor signals in signal processing to achieve a more stable detection of a collision event and the distinction between a collision event and a push gesture.
[0115] When the controller 3 detects a sudden event, the controller 3 processes the detected sudden event as a collision event. In this case, the controller 3 will control the autonomous lawnmower 1 according to a standard collision behavior implemented by the autonomous lawnmower 1. The standard collision behavior may include random turning of the autonomous lawnmower 1.
[0116] If the controller 3 detects a light press event, it processes the light press event as an identified press gesture. The controller 3 proceeds to calculate the direction of the press gesture, in particular the direction vector, by summing the sensor signal readings from the three axes of the IMU 2. The controller 3 may interpret the identified press gesture as an instruction provided by a person through physical interaction to drive in a spatial direction defined by the calculated direction vector. The controller 3 then generates an appropriate control signal 9.2 to turn the autonomous lawnmower 1 in the direction indicated by the calculated direction vector, and outputs this control signal 9.2 to the actuator, in this case the drive 5. The autonomous lawnmower 1 can then continue its standard movement pattern performing its work task and starting its travel trajectory towards the direction indicated by the calculated direction vector.
[0117] Furthermore, the controller 3 may implement a process whereby the controller 3 can interpret this sequence of push gesture events such that if a predetermined number of push gesture events are detected within a predetermined time window, the autonomous lawnmower 1 may be disturbing a human at work. The controller 3 may then proceed in response to the detected sequence of push gesture events by triggering the autonomous lawnmower 1 to return to the base station and sleep there in sleep mode for a period of time.
[0118] The predetermined number of press gesture events, the length of the predetermined time window, and the fixed waiting time at the base station may be configurable. Exemplary values include a predetermined number of three press gesture events within a five minute time window, and a one hour dwell time.
[0119] FIG. 7 shows two examples of sensor signals of knock gestures with different knock time patterns.
[0120] The knock gestures may be detected by the controller 3 by using a sensor signal 7.2 generated and provided by one or more microphones 8. Each particular knock pattern is characterized by a particular sensor signal curve 30, 31.
[0121] Sensor signal curve 30 illustrates a first knock time pattern that includes two groups of knocks separated by a first period, with each group including two single knocks separated by a second period that is shorter than the first period.
[0122] Sensor signal curve 31 illustrates a second knock time pattern including a first knock separated by a first period from a group of knocks, the group of knocks including three single knocks separated from each other by a second period, the second period being shorter than the first period.
[0123] The sensor signal curves 30, 31 use a time pattern to encode information that is communicated to the autonomous lawnmower 1.
[0124] Alternatively or additionally, spatial knock patterns may be used, which require a sensor arrangement and / or type that allows the controller 3 to distinguish between spatially different knock patterns, for example by using a sensor signal comprised of sensor signal components provided by multiple touch-sensitive surfaces disposed on the housing of the autonomous lawnmower 1.
[0125] The knock gesture is a very versatile gesture since different knock patterns allow for the communication of commands from a set of predefined commands, which may be predefined and stored in memory 10 in association with corresponding knock patterns. Alternatively or additionally, the set of commands may be customized by a user of autonomous lawnmower 1.
[0126] A knock gesture having a particular knock pattern may be used as a substitute for a PIN to unlock the autonomous lawnmower 1.
[0127] Preferably, the autonomous lawnmower 1 provides feedback to the user in response to the knock gesture detected by the identified knock pattern. The controller 3 may generate and output a feedback signal 7 to the output interface 4 based on the knock gesture detected by the identified knock pattern. The output interface 4 outputs information of the knock gesture detected by the identified knock pattern to the user. The output interface 4 may provide a visual or audible output, allowing the user to understand what the autonomous lawnmower 1 detected and how the autonomous lawnmower 1 interpreted the detected knock gesture. The user may adapt their knock gesture accordingly, for example, if the autonomous lawnmower 1 misinterprets the knock gesture or if the user intended a different command.
[0128] Alternatively or additionally, the controller 3 and the sensors implement input means which, in combination with the controller 3 and output interface 4 implementing an output device for a human machine interface (HMI), present to the person U a menu structure that visually or audibly displays menu items representing control options for the autonomous lawnmower 1. In this particular embodiment, the person U can use the input means to select one of the presented control options.
[0129] FIG. 8 shows a first application scenario of an autonomous working device, in particular an autonomous lawnmower 1 according to an embodiment.
[0130] The autonomous lawnmower 1 performs its mowing task while moving along a travel trajectory 33 in a work area 32. The travel trajectory 33 consists of a series of straight line path segments 33i, where i=1, 2, 3, . . .
[0131] Each time the autonomous lawnmower 1, moving along a straight path segment along the travel trajectory 33, reaches a boundary 32.1 of the working area 32, the autonomous lawnmower 1 performs a turn and proceeds along a new straight path segment 33.i within the working area 32. During the turn, which is performed upon reaching the boundary 32.1, the change in movement direction performed by the autonomous lawnmower 1 is selected randomly.
[0132] However, as shown in the upper portion of FIG. 8, this may result in patches of grass 34 remaining uncut for extended periods of time.
[0133] The lower part of FIG. 8 shows that the person U can use a push gesture implemented as a physical interaction with the autonomous lawnmower 1 to direct the travel trajectory 33 of the autonomous lawnmower 1 towards the patch of grass 34. In particular, the person U may implement the push gesture at a current position 35 on the travel trajectory 33 by pushing the autonomous lawnmower 1 in a direction pointing from the current position 35 towards the patch of grass 34. As explained when discussing FIG. 2 and FIG. 3, the controller 3 identifies that a physical interaction with the person is occurring, identifies this physical interaction as a push gesture, and calculates a direction vector 14 of the identified push gesture. The controller 3 proceeds by generating an appropriate control signal 9.2 to control the drive 5 of the autonomous lawnmower 1 to proceed on the modified travel trajectory 33 by continuing along a new path segment 33.i that guides the autonomous lawnmower 1 directly to the patch of grass 34. Thus, without having to enter a specific programming mode, person U can ensure with a simple push gesture that the patch of grass 34 is mowed as quickly as possible.
[0134] FIG. 9 shows a second application scenario of the autonomous working device, in particular the autonomous lawnmower 1 according to the embodiment.
[0135] The autonomous lawnmower 1 performs its mowing task while moving along a travel path 33 in a working area 32'. The travel path 33 consists of a series of straight path segments 33i, i=1, 2, 3, .... The working area 32' shown in Fig. 9 has a different shape compared to the working area 32 shown in Fig. 8. In Fig. 9, the boundary 32.1 defines a working area consisting of a first partial area 32A and a second partial area 32B, which are interconnected by a third partial area 32C in the form of a small rectangular corridor.
[0136] The upper part of Fig. 9 shows that the autonomous lawnmower 1, having started in the second partial area 32B, moves only along the travel trajectory 33 of the second area 32B while proceeding while performing its mowing task. Thus, the autonomous lawnmower 1 leaves behind the first partial area 32A and the third partial area 32C.
[0137] The lower part of Fig. 9 illustrates how the person U uses a push gesture performed as a physical interaction with the autonomous lawnmower 1 to move the travel trajectory 33 of the autonomous lawnmower 1 toward the third partial area 32C at the current position 35' of the second partial area 32B. In particular, the person U performs the push gesture by pushing the autonomous lawnmower 1 at the current position 35' on the travel trajectory 33 in a direction pointing from the current position 35' toward the third partial area 32C. As explained when discussing Figs. 2 and 3, the controller 3 identifies that a physical interaction with the person is occurring, identifies the physical interaction as a push gesture, and calculates a direction vector 14 of the identified push gesture. The controller 3 proceeds by generating an appropriate control signal 9.2 to control the drive 5 of the autonomous lawnmower 1 to move on the modified travel trajectory 33 by directing the autonomous lawnmower 1 towards the third partial area 32C and continuing along the new path segment 33.i that leads through the third partial area 32C directly to the first partial area 32A. Thus, the person U achieves by using a simple push gesture that the abandoned third partial area 32C and the first partial area 32A are also mowed.
[0138] FIG. 10 shows a third application scenario of the autonomous work device, in particular the autonomous lawnmower 1, according to the embodiment.
[0139] The autonomous lawnmower 1 performs its mowing task while moving along a travel trajectory 33 in a working area 32. The travel trajectory 33 consists of a series of straight line path segments 33i, where i=1, 2, 3, .... A person U is working simultaneously in the working area 32.
[0140] 10 shows that while the autonomous lawnmower 1 is performing its mowing task and traveling along its travel trajectory 33, it repeatedly bumps into the person U, resulting in four collision events 101. These collision events may be annoying to the person U or may even put the person U in danger.
[0141] The lower portion of FIG. 10 illustrates how the person U uses a push gesture implemented as a physical interaction with the autonomous lawnmower 1 to direct the travel path 33 of the autonomous lawnmower 1 toward the base station 100 at the current position 35″ to signal that an obstacle-free working area 32 is being requested. In particular, the person U may implement the push gesture by pushing the autonomous lawnmower 1 at the current position 35″ on the travel path 33 in a direction pointing from the current position 35″ toward the position of the base station 100. As described when discussing FIGS. 2 and 3, the controller 3 may determine that a physical interaction with the person is occurring, determine that the physical interaction is a push gesture, calculate a direction vector 14 of the identified push gesture, and determine that the direction vector 14 from the current position 35″ points toward the base station 100. The controller 3 may interpret this particular push gesture as a signal that an obstacle-free working area 32 is being requested by the person U. The controller 3 proceeds by generating an appropriate control signal 9.2 to control the drive 5 of the autonomous lawnmower 1 to redirect the modified travel trajectory 33 by continuing along the new path segment 33.i that leads the autonomous lawnmower 1 directly towards the location of the base station 100. Additionally or alternatively, the autonomous lawnmower 1 and the base station 100 may use the communication link 102 established between the autonomous lawnmower 1 and the base station 100 to steer the autonomous lawnmower 1 towards the base station 100. The autonomous lawnmower 1 may remain at the base station 100 in a dormant mode for a predetermined period of time.
[0142] Alternatively, the controller 3 may interpret the identified pressing gesture towards the base station as defining a prohibited zone of a predefined shape and extending a predefined range around the current position 35''. The autonomous lawnmower 1 may then control the drive 5 by issuing control signals from the controller 3 as appropriate to avoid entering the prohibited zone for a predefined period of time.
[0143] Thus, by using a simple push gesture, person U achieves that person U and autonomous lawnmower 1 do not interfere with each other within work area 32.
[0144] FIG. 11 shows a fourth application scenario of the autonomous working device, which is an autonomous suction cleaning device 36. The autonomous suction cleaning device 36 performs its cleaning task in a working area 32 corresponding to a room. The autonomous suction cleaning device 36 performs its cleaning task while moving along a travel trajectory 33 in the working area 32. The travel trajectory 33 is composed of a series of straight line path segments 33i, where i=1, 2, 3, . . . The performance of the cleaning task is essentially performed by the autonomous suction cleaning device 36, which corresponds to the autonomous lawnmower 1 performing its mowing task, as discussed with respect to FIG. 8.
[0145] As shown in the upper part of figure 11, this can result in plot 37 remaining uncleaned for long periods of time. Plot 37 corresponds to grassy plot 34 of figure 8.
[0146] The lower part of FIG. 11 shows that the person U can use a push gesture implemented as a physical interaction with the autonomous suction cleaning device 36 to move the travel trajectory 33 of the autonomous suction cleaning device 36 toward the small lot 37, which fully corresponds to the method discussed with respect to FIG. 8. In particular, the person U may implement a push gesture by pushing the autonomous suction cleaning device 36 at a current position 35''' on the travel trajectory 33 in a direction pointing from the current position 35''' to the small lot 37. The controller 3 identifies that a physical interaction with the person has occurred, identifies that the physical interaction is a push gesture, and calculates a direction vector 14 of the identified push gesture. The controller 3 proceeds by generating an appropriate control signal 9.2 to control the drive device 5 of the autonomous suction cleaning device 36 to proceed on the modified travel trajectory 33 by continuing along a new path segment 33.i that guides the autonomous suction cleaning device 36 to the small lot 37.
[0147] The embodiment of the autonomous lawnmower 1 discussed in the figures is one particular example of an autonomous work device implementing the claimed invention. All aspects and techniques are equally applicable to other types of autonomous work devices and service robots, such as an autonomous suction cleaner 36, other types of floor cleaning robots, and window cleaning robots. These examples of autonomous work devices perform their assigned work tasks within a confined work area 33 and typically have a base station 100 for recharging their batteries.
Claims
1. 1. An autonomous operating device, comprising: at least one sensor (2, 8) configured to generate a sensor signal (7.1, 7.2) based on a physical interaction of the autonomous work device with a physical entity; at least one actuator (5, 6) configured to perform a work task; a controller (3) configured to generate control signals (9.1, 9.2) for controlling the actuators (5, 6), to evaluate the sensor signals (7.1, 7.2), to identify a pattern of physical interaction between the autonomous work device and a person based on the evaluated sensor signals (7.1, 7.2), and to generate the control signals (9.1, 9.2) based on the identified pattern of physical interaction; Equipped with said controller (3) being configured to generate said control signals (9.1, 9.2) comprising data on working parameters based on the interpreted physical interactions; the work parameters include data defining a work area in which the work task is to be performed by the autonomous work device, and data regarding a travel trajectory of the autonomous work device in the work area; the data defining the work area includes information interpreted from the identified pattern of physical interactions defining a prohibited area of a predetermined shape within the work area that prohibits entry of the autonomous work device for a predetermined period of time; An autonomous work device, wherein the data about the travel trajectory includes information about at least one of correcting the travel trajectory, directing the autonomous work device to a specific location, and indicating a new travel trajectory.
2. 2. The autonomous work device of claim 1, wherein the at least one sensor (2, 8) is configured to generate the sensor signal (7.1, 7.2) while the autonomous work device is operating in a work operating mode other than a programming mode or a learning mode.
3. the at least one sensor (2, 8) is configured to acquire a sensor signal (7.1, 7.2) measuring an acceleration in at least one direction, or the at least one sensor includes an inertial measurement unit (IMU) (2); or the at least one sensor includes a movable or force-sensitive cover of the autonomous work device; or the at least one sensor includes a touch-sensitive area disposed on the autonomous work device; or the at least one sensor includes an auditory sensor (8) configured to detect a knock gesture; or The autonomous work device of claim 1 or 2, wherein the at least one sensor includes a member disposed on the autonomous work device so as to be accessible from the outside.
4. The at least one physical interaction Pushing the autonomous work device in one direction; a unidirectional touch gesture on a housing of the autonomous work device; a touch gesture in at least one direction on the housing of the autonomous work device; a knock pattern of the autonomous operating device against the housing; Lifting the autonomous work device; and Shaking the autonomous work device. The autonomous work device according to claim 1 , further comprising at least one of:
5. The control signal (9.1, 9.2) further includes data regarding an operating mode of the autonomous work device. The autonomous work device according to any one of claims 1 to 4.
6. An autonomous work device as described in claim 1, wherein the data defining the work area further includes information about modifying the work area or indicating a new work area.
7. The work parameters include the data regarding a work operation mode of the autonomous work device, 2. The autonomous work device of claim 1, wherein the data about the operational mode includes information about at least one of a work mode, a sleep mode, a standby mode, a predefined specific work task, a predefined specific behavior, a monitor mode, a tracking mode for the autonomous work device following a user, a storage mode for storing position and / or status data in a memory, an unlocking process, a programming mode, and a training mode.
8. 2. The autonomous work device of claim 1, wherein the controller (3) is configured to select or modify the data for the work parameters based on the evaluated sensor signals.
9. 2. The autonomous work device of claim 1, wherein if the controller (3) determines based on the evaluated sensor signal (7.1) generated by a first sensor (2) that a physical interaction between the autonomous work device and a person has occurred, the controller (3) is configured to select or modify the data of the work parameters based on a further evaluated sensor signal (7.2) obtained via a second sensor (8).
10. The autonomous work device includes an output interface (4); The controller (3) generates a feedback signal and the output interface 10. The autonomous work device of claim 1, configured to output the feedback signal to the person via (4), the feedback signal communicating the evaluated sensor signal generated based on the physical interaction.
11. The actuator, At least one work tool (6), in particular at least one of a cleaning tool, a suction cleaning tool, an ironing tool, a weeding tool, and a maintenance tool; and A drive device (5) for the autonomous operating device The autonomous work device according to claim 1 , further comprising at least one of:
12. the controller (3) is configured to identify a first pattern of physical interactions included in the identified pattern of physical interactions as a reward based on the evaluated sensor signal (7.1, 7.2) generated based on the first physical interaction, and to identify a second pattern of physical interactions included in the identified pattern of physical interactions as a punishment based on the evaluated sensor signal (7.1, 7.2) generated based on a second physical interaction, 12. The autonomous work device of claim 1, wherein the controller is configured to adapt future behavior of the autonomous work device by using a training algorithm based on the identified first and second patterns.
13. A method for controlling an autonomous work device (1) comprising at least one sensor (2, 8), at least one actuator (5, 6) for performing a work task, and a controller (3), comprising: generating (S1) a sensor signal (7.1, 7.2) by said at least one sensor (2, 8) based on a physical interaction of said autonomous work device (1) with a physical entity; - evaluating (S2) said sensor signals (7.1, 7.2) by said controller (3); generating (S4) control signals (9.1, 9.2) by said controller (3) based on said evaluated sensor signals (7.1, 7.2); performing (S6) said work task by said actuators (5, 6) based on said generated control signals (9.1, 9.2); determining (S3) by the controller (3) whether a pattern of physical interaction between the autonomous work device (1) and a person has occurred based on the evaluated sensor signals (7.1, 7.2); generating (S4) the control signals (9.1, 9.2) based on the evaluated sensor signals (7.1, 7.2) in response to identifying that the pattern of physical interaction between the autonomous work device (1) and a person has occurred; The method further comprises generating, by the controller (3), the control signals (9.1, 9.2) containing data on working parameters based on the interpreted physical interactions; the work parameters include data defining a work area in which the work task is to be performed by the autonomous work device, and data regarding a travel trajectory of the autonomous work device in the work area; the data defining the work area includes information interpreted from the identified pattern of physical interactions defining a prohibited area of a predetermined shape within the work area that prohibits entry of the autonomous work device for a predetermined period of time; The method, wherein the data about the travel trajectory includes information about at least one of correcting the travel trajectory, directing the autonomous work device to a specific location, and indicating a new travel trajectory.
14. 14. A program comprising program code means for carrying out the steps according to claim 13 when said program is executed on a computer or digital signal processor.
Citation Information
Patent Citations
Self-propelled cleaner
JP2005211360A
Self-propelled vacuum cleaner
JP2019136255A
Autonomous traveling work apparatus and autonomous traveling work system
JP2020181434A
