Controlling a household appliance

Abstract

Method (200) for controlling a household appliance (105) in a household (110), wherein the method (200) comprises the following steps: - Recording (205) an operating state of the household appliance (105); - Scanning (210) of a user (115); - Determining (210) a viewing direction (140) of the user (115); and - Control (225) of the household appliance (105) depending on the operating state and the detected direction of view (140); characterized in that - the household appliance (105) is set up to process an object in a processing area (810) and the processing by the household appliance (105) is reduced if it is determined that the viewing direction (140) of the user (115) is outside the processing area (810).

Description

[0001] The invention relates to the control of a household appliance. In particular, the invention relates to a hands-free interaction between a user and a household appliance.

[0002] A household appliance is designed for use in a household and may, in particular, include a kitchen appliance. A user handling food in the kitchen often cannot use their hands to operate the appliance without contaminating it. Conversely, it is undesirable to contaminate a user's hand through contact with the appliance, for example, allowing bacteria accumulated there to reach the food.

[0003] The kitchen appliance can be operated hands-free using voice control. However, it has been shown that voice control does not always deliver satisfactory results. Operating the appliance can be difficult in loud background noise or when several people are talking. Occasionally, the voice control unintentionally responds to a perceived command or rejects an actual command. If operated incorrectly, the appliance can pose a danger to the user, making voice control risky as the sole method of interaction.

[0004] In this context, DE 10 2015 221 860 A1 and EP 3 120 741 A1 each describe a system consisting of smart glasses and a household appliance. DE 10 2015 117 310 A1 deals with a method for controlling the interior lighting of an oven. DE 10 2014 107 163 A1 relates to a Thermomix with an optical detection device. US 2016 / 0 154 996 A1 discloses an autonomous cleaning robot with gesture recognition.

[0005] There is therefore a need for an improved interaction concept between a user and a household appliance. The present invention fulfills this need by means of the subject matter of the independent claims. Subclaims specify preferred embodiments.

[0006] A method according to the invention for controlling a household appliance in a household comprises steps of detecting an operating state of the household appliance; scanning a user of the household appliance; determining a viewing direction of the user; and controlling the household appliance depending on the operating state and the detected viewing direction. The household appliance is configured to process an object in a processing area, and the processing by the household appliance is reduced if it is determined that the user's viewing direction lies outside the processing area.

[0007] The appliance can preferably be operated hands-free, allowing the required level of hygiene to be maintained. The user can control the appliance from a certain distance. By linking the operating state to the direction of view, the appliance can be controlled in a way that is appropriate for the given context. Controlling the appliance can be particularly intuitive. The appliance can be integrated into a higher-level control concept that can allow the control of multiple appliances.

[0008] The household appliance is preferably electrically operated and can, in particular, comprise a kitchen appliance such as an extractor hood, an oven, a stove, or a microwave. A small electrical appliance such as a mixer or slicer, a toaster, or a coffee machine can also be included. Furthermore, the household appliance can, for example, comprise a dishwasher, a washing machine, or a tumble dryer. In some embodiments, the household appliance is robotic, meaning it can move itself within the household or has a movable actuator. Optionally, an electrical tool can also be considered a household appliance.

[0009] Preferably, the user's gaze direction is determined based on an optical scan of one or both of the user's eyes. The scan is preferably carried out from a fixed position relative to the household. This eliminates the need for a sensor mounted on the user's head. Furthermore, it may be easier to determine the position and / or gaze direction of the user's eye from a position that is fixed relative to the household. The sensor can be attached to the household appliance, whereby the household appliance can be fixed or mobile relative to the household. If necessary, the determination of the position and / or gaze direction can be calibrated, particularly after the sensor has been moved relative to the household.

[0010] The sensor can, in particular, comprise a depth camera that operates based on the speed of light propagation or on the superposition of several images taken from different positions. In particular, the sensor can be used to determine the position of the eye relative to the household. Furthermore, the curvature of the eye's cornea can be detected to determine the direction in which the user is looking.

[0011] Preferably, an object that the user is looking at is determined. Starting from the eye, a half-line along the line of sight can be determined. The first object that intersects the half-line can comprise the object being viewed by the user. The object can comprise an object or a section of an object. The section can also be understood as a point. In one embodiment, three-dimensional coordinates of the point at which the half-line intersects the first object can be determined. In this way, in particular, it can be determined at which point on an object the user is looking.

[0012] The object can comprise a predetermined control surface, wherein the household appliance is controlled by means of a predetermined function assigned to the control surface. The control surface can be fixedly predetermined or dynamically formed. In one embodiment, a particularly visual indication of the control surface can be issued to the user. For example, a virtual control element can be displayed on any surface. If the user looks at this control element, the predetermined function can be triggered. The function can be indicated symbolically or textually on the control surface, for example. For example, a control surface can be provided that bears a switch-off symbol, wherein the function associated with the control surface relates to switching off the household appliance - or another predetermined household appliance.

[0013] The household appliance can be moved toward the object the user is looking at. This is particularly useful for a mobile household appliance such as an autonomous floor cleaner or a autonomous vacuum cleaner. In various embodiments, the household appliance can move away from or toward an object the user is looking at. For example, the household appliance can be instructed to avoid a predetermined position or area or to perform a predetermined operation at a different position or area.

[0014] The household appliance is designed to process an object in a processing area, whereby the processing by the household appliance is reduced if it determines that the user's line of sight is outside the processing area. The object being processed could be, for example, whipped cream in a mixer, a cake in an oven, or a pot on a stove. Particularly if the operating state of the household appliance indicates a delicate processing step, reducing the processing speed in the event of a lack of attention on the part of the user can prevent damage. The whipped cream can be whipped to stiff peaks but not butter, the cake can brown but not burn, or the contents of the pot can be heated without touching the bottom of the pot.Depending on the type and processing operation of the household appliance, the reduction may include, for example, interrupting or stopping the processing, reducing the power or heat applied, or slowing down the movement of the household appliance.

[0015] A household appliance according to the invention comprises a first scanning device for detecting an operating state of the household appliance; a second scanning device for scanning a user's eye; and a processing device. The processing device is configured to determine a user's viewing direction and to control the household appliance depending on the operating state and the detected viewing direction. The household appliance is configured to process an object in a processing area, wherein the processing by the household appliance is reduced if it is determined that the user's viewing direction lies outside the processing area.

[0016] The processing device can be configured to carry out a method described herein in whole or in part. For this purpose, the processing device can comprise a programmable microcomputer or microcontroller, and the method can be in the form of a computer program product with program code means. The computer program product can also be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device, or vice versa.

[0017] The household appliance can include a projector for displaying visual data on a surface, with the data display being controlled by the projector. In particular, the projector can project one or more virtual controls onto the surface, and a function associated with a surface viewed by the user can then be activated. However, the projector can also display, for example, a slide show or a film. Both can, for example, show the user steps of a cooking recipe. Playback can be controlled by the direction of gaze, for example, by pausing or playing, canceling, or searching forward or backward.

[0018] The household appliance may further comprise a device for detecting a spoken instruction, wherein an instruction is only detected after the user has looked at a predetermined object. Thus, voice control can be combined with gaze detection or gaze control as described herein. The user no longer needs to speak a specific keyword to activate voice control. Operation of the household appliance can thus be more secure; a control performed can more reliably follow the user's intention.

[0019] The household appliance can comprise a stove with a surface for placing a pot. The viewing direction relative to the surface can be determined, for example, to activate a predetermined control surface. This allows the stove to be controlled. In one variant, the viewing direction is determined relative to a pot placed on the surface. This allows the user to select one of several pots. A setting associated with the pot, particularly regarding a heating output, can then be controlled.

[0020] The household appliance may comprise a power tool, with the viewing direction being determined relative to a working area of ​​the power tool. The power tool may, for example, comprise a circular saw, a jigsaw, a drill, or another processing device. If the user's gaze wanders away from the working area of ​​the power tool, particularly for longer than a predetermined period, a warning signal may be issued, or the power tool may be reduced in power or switched off. An accident caused by carelessness can thus be avoided.

[0021] The household appliance can also comprise a cleaning device for cleaning a floor area, wherein the viewing direction relative to a section of the floor area is determined and the cleaning device is controlled to clean that section. This allows the user to easily and unobtrusively give instructions for cleaning the floor area. In another variant, the user can also look at a section of the floor area that the cleaning device subsequently avoids. For example, a walking route in a room of the household can be marked in this way if people may move in that area during a cleaning process.

[0022] Embodiments of the invention will now be described in more detail with reference to the accompanying figures, by way of example and not by way of limitation, in which: Fig. 1 a system with a household appliance; Fig. 2 a flowchart of a method for controlling a household appliance; Fig. 3 a first controllable household appliance; Fig. 4 a second controllable household appliance; Fig. 5 a third controllable household appliance; Fig. 6 a fourth controllable household appliance; Fig. 7 a fifth controllable household appliance; Fig. 8 a sixth controllable household appliance; and Fig. 9 represents a seventh controllable household appliance.

[0023] Fig. 1 shows a system 100 with a household appliance 105 in a household 110. The household appliance 105 is configured to perform or support a predetermined task in the household 110, for example, cleaning or cooking. For this purpose, the household appliance 105 can have its own interface for interacting with a user 115, which can include, for example, an input device such as a switch or button and / or an output device such as a lamp or LED. It is proposed to control the interaction with the user in an improved manner by means of a device 120. The device 120 can be implemented independently or can be partially or entirely included in the household appliance 105.

[0024] The device 120 comprises a processing device 125 connected to a sensor 130 for determining a viewing direction of the user 115 of the household appliance 105 and to a sensor or interface 135 for detecting an operating state of the household appliance 105. The viewing direction is typically determined using a combination of images from a depth camera and a two-dimensional camera. The depth camera detects, for example, a position of the head and eyeballs of the user 115. The 2D camera can be used to localize the iris on the eye. In combination with the information from the depth camera, the viewing direction can then be determined.

[0025] The operating state can, in particular, comprise an activation state, a processing progress, or an operating mode of the household appliance 105. The sensor 130 preferably operates optically and can comprise a light source, in particular for invisible light such as infrared light. The sensor 130 can be configured to determine an image with depth information, i.e., an image with pixels, for each of which the distance from the sensor 130 of an object represented by a pixel is determined. The distance can be determined based on the speed of propagation of light (TOF: Time Of Flight), based on a phase shift of a light beam reflected from the object compared to a direct light beam, or based on a stereo recording. For the stereo recording, two cameras can be directed at a common area at a predetermined distance, the baseline.Distances can be determined using triangulation.

[0026] The sensor 130 is preferably configured to scan an eye of the user 115 and determine a viewing direction 140. For this purpose, a position of the eye or of the user 115 and an orientation of the eye can be determined. The sensor 130 is preferably permanently attached in the household 110, for example, to a piece of furniture, a wall, or the household appliance 105. The position and orientation of the eye of the user 115 are preferably determined relative to the household 110, i.e., in a coordinate system oriented toward the household 110. Based on the viewing direction 140, optionally with the aid of the position of the eye, the sensor 130 or the processing device 125 can determine an object 145 that the user 105 is looking at. The object 145 is typically an opaque object that is closest to the user 105 on a half-line emanating from the eye of the user 105 along the viewing direction 140.The object 145 can have different dimensions; in one variant, it can be a manageable object such as an apple or a wooden spoon, while in a second variant, it can represent a section of an object, in particular a position on a surface of an object. For the purposes of the technique presented herein, this position, and thus the dimension of the object 145, can be assumed to be arbitrarily small in this variant.

[0027] The object 145 can be part of a display area 150, which can be controllable by the household appliance 105 or the device 110. For example, an image displayed on the display area 150 can be controlled by means of a projector or a graphic display. The image can carry any information and include, for example, a photograph or text. In one variant, the image can include a virtual control element, which can be linked to a predetermined function. If the user 105 looks at the control element, the function can be triggered and the household appliance 105 can thereby be controlled. The control element can, for example, be graphically labeled. Preferably, the control element can be dynamically influenced in terms of shape, size, form, or assigned function, in particular based on the operating state of the household appliance 105 or an upcoming activity related to the household appliance 105.The control element can be superimposed on or separate from the information to be displayed.

[0028] The processing device 125 can also be connected to one or more input and / or output devices for interaction with the user 115. By way of example, a microphone 155 is shown as the input device and a loudspeaker 160 is shown as the output device, which can be configured in particular for natural language input and / or output.

[0029] The device 120 may include a communication device 165 that may allow communication with a remote location 170. The location 170 may be implemented, for example, as a server or as a service in a cloud and perform part of the processing required to determine an intention of the user 115. In particular, the location 170 may perform speech recognition or speech synthesis. Communication between the central location 170 may use a data network such as the Internet or a cellular network. Part of the communication link between the device 120 and the location 170 may be bridged wirelessly.

[0030] In one embodiment, the central location 170 is communicatively connected to another household appliance 105 in the same household 110. A detected intention of the user 115 can lead to the control of multiple household appliances 105. The operating state of one household appliance 105 can control the operating state of another household appliance 105 in the same way. For example, a stove can be switched off when smoke occurs in that area, and subsequently, an extractor hood above the stove can be switched on to extract the smoke. Furthermore, the location 170 can provide information on the basis of which one of the household appliances 105 can be controlled. This information can, for example, include a habit, specification, or preference of the user 115 regarding the use of the household appliance 105.

[0031] Fig. 2 shows a flowchart of a method 100 for controlling a household appliance 105. The method can be used in particular in connection with the system 100 of Fig. 1 should be carried out.

[0032] In a step 205, an operating state of the household appliance 105 is detected. In a step 210, a viewing direction 140 of the user 115 is determined. To do this, it can first be determined whether the user 115 is within a scanning range of the sensor 130. If so, their eye can be scanned. The viewing direction 140 can then be determined from the scanned information.

[0033] Preferably, in a step 215, an object 145 that the user 115 is looking at is determined. For this purpose, a position of the user 115 or their eye can first be determined. Furthermore, the household 110 can be scanned to identify possible objects 145 that lie within the range of the determined viewing direction 140.

[0034] In a step 220, a further utterance from user 115 related to the operation or use of household appliance 105 can be detected. For example, an acoustic instruction can be detected that may accompany viewing an object 145. The utterance can be processed locally by processing device 125 or transmitted to location 170 for analysis, which can transmit a determination result back to device 120 or directly control household appliance 105.

[0035] Below, some exemplary use cases of a technique presented herein are presented in more detail. It should be noted that features or advantages provided with respect to one of the use cases can be transferred to another. Furthermore, elements of the use cases can be combined with one another, particularly through control by means of device 110 or central location 170.

[0036] Fig. 3 shows a first application in which the household appliance 105 comprises a standalone device with a projector 150. In particular, the household appliance 105 can comprise a social assistant configured to adapt to the behavior of a user 115 and / or their current mood or a current need. The appliance 105 is configured to display information on a surface, for example, on a wall or a tiled surface, by means of the projector 150. The device 120 can be comprised by the household appliance 105 or arranged separately. In the illustration of Fig. 1 only the sensor 130 is visible, which is attached here, for example, to another household appliance 105, namely an extractor hood.

[0037] The reproduction of information by means of the projector 150 can be controlled depending on the specific viewing direction 140 of the user 115. In particular, the reproduction of a stream of information can be interrupted or aborted if the user 115 does not look in the direction of the projected image for longer than a predetermined period of time. The reproduction can be resumed, for example, if the user 115 looks in the direction of the location to which the projector 150 can project for longer than a further predetermined period of time. Stopping or starting the reproduction can additionally depend on a further utterance by the user 115. This utterance can include, for example, a vocal utterance or a gesture, a head posture, or a head movement that can be sensed by a camera or the sensor 130.

[0038] Control of the household appliance 105 after determining a predetermined viewing direction 140, for example, starting or stopping the playback of information using the projector 150, can be preceded by a confirmation request. The confirmation request can be output acoustically, for example, via the loudspeaker 160. A response from the user 115 can be provided in any desired manner, for example acoustically. A corresponding confirmation request can be made before pausing or aborting playback if the viewing direction 140 of the user 115 no longer meets the projection area of ​​the projector 150, and a corresponding confirmation can be evaluated before controlling the household appliance 105. By determining two statements from the user 115, erroneous control of the household appliance 105 can be avoided.

[0039] The sensor 130 can be activated manually by the user 115 or be permanently activated. To calibrate the sensor 130, the user 115 can be asked to look at a predetermined point in the projection field of the projector 150. One or more such points can be displayed consecutively by the projector 150. Alternatively, the user 115 can be asked to look at another designated point, for example, a corner of a wall. The viewing direction 140 of the user 115 can be determined by the device 110 or, after a corresponding data transmission, by the central location 170. The transmission of sensor data or determined viewing directions 140 to the location 170 can be on-demand, permanent, or periodic.

[0040] Fig. 4 shows a second application in which the household appliance 105 again comprises a standalone device with a projector 150. In addition to the embodiment of Fig. 3, the device 110 can be configured to sense a movement of the lips of the user 115. A dedicated camera or the sensor 130 can be used for this purpose. However, it is preferably optically detected that the user 115 is making eye contact with the device 110 and that the user 115 is speaking. The speech content can then be sensed using a microphone.

[0041] In one embodiment, speech recognition is implemented, which can be activated when the user 115 directs their gaze in a predetermined direction 140 or at a predetermined object 145 and speaks simultaneously. Speech can be determined based on lip movement and / or data sampled by the microphone 155. The user 115 does not need to speak a signal word to activate speech recognition. The household appliance 105 can indicate that it has detected the start of a voice input, for example, through a signal tone or a visual display.

[0042] The gaze direction, lip movement, or facial expression of user 115 can be determined, in particular, by means of a joint analysis based on an image or image stream of a face of user 115 with depth information. This analysis can be performed by device 120 or location 170. The acoustic information can be evaluated based on the lip movements, facial expression, and / or gaze direction. An intention of user 115 can be determined, and household appliance 105 can be controlled accordingly.

[0043] Fig. 5 shows a third application in which the household appliance 105 comprises a stove. Optionally, a projector 150 can be provided, which is directed towards the stove 105. The projector 150 and the sensor 130 are preferably mounted above the stove 105, for example, on a wall or an extractor hood. The device 120 can be permanently active, manually switched on or off by the user 115, or activated whenever the extractor hood is switched on. The viewing direction 140 of the user 115 can be determined as long as the user 115 is cooking, is in the area of ​​the stove 105, or the device 110 is switched on.

[0044] The projector 150 can optically highlight an object 145 that the user 115 is looking at, for example, by means of a light spot in a predetermined color. For example, by looking for a longer time, the user 115 can select a cooking vessel 505 placed on the stove 105, so that a function of the stove 105 that affects the selected cooking vessel 505 can subsequently be controlled. The selection of the cooking vessel can be signaled by changing the color of the light spot, for example, from green to blue or from yellow to red. The function can, in particular, comprise a heating output of the stove 105. The heating output is preferably controlled contactlessly, for example, by means of voice input, as described above. Example spoken instructions include "Cook at level six" or "Simmer at level 4" or "Stop" to turn off.

[0045] A calibration of the device can be performed with respect to the stove 105. For this purpose, the user 115 can be asked to follow a light spot of the projector 150 in the area of ​​the surface of the stove 105. A cooking vessel 505 on the stove 105 can be detected using a camera or the sensor 130. The projector 150 can optically highlight an outline of a cooking vessel 550. Other objects can also be detected in a similar manner and highlighted if necessary, for example, a spoon or a ladle.

[0046] The gaze-assisted control of the stove 105 can allow for simple and precise control without the need for manual operation. The user 115 can more easily control multiple processes simultaneously, as is often required during cooking.

[0047] Fig. 6 shows a fourth application in which the household appliance 105 as in the embodiment of Fig. 5, comprises a stove. A duration can be determined during which the user 115 does not direct their gaze at a predetermined cooking vessel 505 on the stove 105. If the user 115 looks at the cooking vessel 505, the determined duration can be reset to zero. If the duration exceeds a predetermined threshold, a warning can be issued to the user 115, for example, an acoustic warning via the loudspeaker 160. The warning can include a signal tone or a spoken message.

[0048] In a further embodiment, a camera or a humidity sensor may be provided to determine whether a food item in the cooking vessel 505 is boiling or boiling over. If this occurs while the user 115 is not looking at the cooking vessel, a warning may be issued. In yet another embodiment, image recognition of an image taken of the contents of the cooking vessel may be performed. For example, if the browning level of a potato reaches a predetermined value and the user 115 does not look into the cooking vessel for more than a predetermined period, a further warning may be issued. This embodiment may also be used to assist the user 115 in stepping through a recipe.

[0049] Fig. 7 shows a fifth, unclaimed application in which the household appliance 105 comprises a cooling device. The cooling device 105 can in particular comprise a refrigerator, a freezer, or a combination of both. Food can be accommodated in an interior of the cooling device 105. A display device 150 or a projector can be provided on an exterior of the cooling device 105. Preferably, an image can thus be displayed on a wall or door of the cooling device 105. The display device 150 can be designed such that it is visually unobtrusively integrated into the cooling device, as long as it does not display an image.

[0050] One or more cameras 705 can be provided in the interior of the cooling device 105 for optically capturing the contents. The user 115 can gain insight into the contents of the cooling device 105 by directing their gaze at a predetermined object 145, which is located in particular on the cooling device 105. In addition, lip movements and / or spoken instructions from the user 115 can be sensed. Depending on the sensed information, an image from the interior of the cooling device 105 captured by one of the cameras 705 can be displayed on the exterior. The user can influence the display, for example, through a voice command, a gesture, or a head position. Different perspectives or image sections can thus be selected. One possible instruction is "show contents of shelf two." A camera 705 in the area of ​​shelf two can then capture an image that can be displayed on the display device 150.The determination of user intention may be performed by device 120 or location 170.

[0051] By detecting the direction of view, the contents of the cooling device 105 can be displayed on its exterior. This allows the user 115 to visually perceive the contents more quickly. Furthermore, while searching for a specific item inside the cooling device, for example, the door or lid can remain closed, so that the interior remains cool. By attaching the display device 150 directly to the cooling device, a large potential display area can be utilized. Unlike a solution that displays an image of the interior on a mobile device, hands-free operation can be realized.

[0052] Fig. Figure 8 shows a sixth application in which the household appliance 105 comprises a power tool. Purely as an example, this is a circular saw; other power tools 105 may also be included.

[0053] As soon as the power tool 105 is put into operation, the viewing direction 140 of the user 115 can be determined by means of the sensor 130. As long as the user 115 keeps their gaze within a predetermined area, in which a working area of ​​the power tool 105 lies, no immediate danger can be determined. This condition can be signaled, for example, by means of a signal light 805 by emitting light of a predetermined color, for example, green. The working area of ​​the power tool 105 typically comprises the location where processing is taking place, as well as preferably a predetermined area around it. In addition, a further predetermined area can be included in which processing is imminent. In the case of the circular saw, the processing area 810 can in particular comprise a cutting surface of a saw blade, which can be extended in one or more directions by a predetermined safety area.The machining area 810 can also be extended in the cutting direction of the circular saw.

[0054] Should the user 115 take their eyes off the processing area 810, for example because they are distracted, a second state can be determined in which danger is imminent. A warning, for example, optical and / or acoustic, can be issued immediately or after a predetermined period of time in which the user 115 does not direct their eyes back to the processing area 810. The signal light 805 can emit light in a different color, for example, red. Alternatively, or after a further period of time in which the user 115 does not direct their eyes back to the processing area 810, the power tool 105 can be reduced in power or switched off. The power tool 105 can then be restarted as it was when first started.

[0055] By warning in case of inattention of the user 115 when processing with the power tool 105, injury to the user 115 or another person in the area of ​​the power tool 105 can be avoided.

[0056] Fig. 9 shows a seventh application in which the household appliance 105 comprises a cleaning device 105 for cleaning a floor surface 905. The cleaning device 105 can, in particular, comprise a mopping or vacuuming robot. The sensor 130 is attached here, for example, to the cleaning device 105, but can also be attached anywhere else in the household 110. In a further embodiment, the sensor 130 is attached to the head of the user 115, for example in the form of data glasses. The data glasses can provide the user 115 with further information, for example, map data, on the basis of which the cleaning device 105 can orient itself in the household 110.

[0057] The user 115 can direct their gaze toward a predetermined object 145 to cause the cleaning device 105 to clean the object 145. The object 145 can encompass a predetermined area around a position, or the object 145 can be determined, for example, by tracking the user's line of sight 140. The cleaning device 105 can access a map of the household 110. The map can be predetermined or created or enhanced using an on-board sensor of the cleaning device 105. The map can, in particular, include three-dimensional information about the household 110. In addition, movable or immobile objects, floor types, or frequently heavily soiled areas can be noted on the map. In one embodiment, the map is accessible to multiple household appliances 105, for example, by being stored by the central location 170.

[0058] The user 115 can look at multiple objects 145 or locations on the floor surface to determine a series of areas to be cleaned. Alternatively, an area can be specified that the cleaning device 105 should avoid. The specification of the areas can be supported, for example, using voice or gesture control, for example, to distinguish an area to be cleaned from one to be avoided or to start or end a gaze-direction-controlled input. Reference symbol 100 systems 105 household appliances 110 households 115 users 120 device 125 processing facility 130 sensors 135 Interface 140 Viewing direction 145 objects 150 display area 155 Microphone 160 speakers 165 Communication device 170 central location, server, service 200 procedures 205 Recording operating status of household appliance 210 Scanning a user's eye and determining the direction of gaze 215 Determine position or object the user is looking at 220 Recording further user statements 225 Taxes household appliances 505 Cooking vessel: pot, pan, casserole, stew pot, etc. 805 Signal light 810 processing area

Claims

[1] Method (200) for controlling a household appliance (105) in a household (110), the method (200) comprising the following steps: - detecting (205) an operating state of the household appliance (105); - scanning (210) a user (115); - determining (210) a viewing direction (140) of the user (115); and - controlling (225) the household appliance (105) depending on the operating state and the detected viewing direction (140); characterized by , that - the household appliance (105) is configured to process an object in a processing area (810) and the processing by the household appliance (105) is reduced if it is determined that the viewing direction (140) of the user (115) lies outside the processing area (810). [2] The method (200) of claim 1, wherein the viewing direction is determined based on a scan of an eye of the user (115) from a fixed position relative to the household (110). [3] The method (200) of claim 1 or 2, wherein an object (145) that the user (115) is looking at is determined. [4] Method (200) according to claim 3, wherein the object (145) comprises a predetermined control surface and the household appliance (105) is controlled by means of a predetermined function associated with the control surface. [5] Method (200) according to one of the preceding claims, wherein the household appliance (105) is moved in the direction of the object (145) viewed by the user (115). [6] Household appliance (105), comprising: - a first scanning device (135) for detecting an operating state of the household appliance (105); - a second scanning device (130) for scanning a user (115); and - a processing device (125) which is configured to determine a viewing direction (140) of the user (115) and to control the household appliance (105) depending on the operating state and the detected viewing direction (140); characterized by , that - the household appliance (105) is configured to process an object in a processing area (810) and the processing by the household appliance (105) is reduced if it is determined that the viewing direction (140) of the user (115) lies outside the processing area (810). [7] Household appliance (105) according to claim 6, wherein the household appliance (105) comprises a projector (150) for displaying visual data on a surface and the display of data is controlled by the projector (150). [8] A household appliance (105) according to claim 6 or 7, further comprising means (155) for detecting a spoken instruction, wherein an instruction is detected only after the user (115) has looked at a predetermined object (145). [9] Domestic appliance (105) according to one of claims 6 to 8, wherein the domestic appliance (105) comprises a stove with a surface for placing a cooking vessel (505) and the viewing direction (140) is determined with respect to the surface. [10] Domestic appliance (105) according to one of claims 6 to 9, wherein the domestic appliance (105) comprises a stove with a surface for placing a cooking vessel (505) and the viewing direction (140) is determined with respect to a cooking vessel (505) placed on the surface. [11] Household appliance (105) according to one of claims 6 to 8, wherein the household appliance (105) comprises a power tool and the viewing direction (140) is determined with respect to a working area (810) of the power tool.

Images