Demonstration of a domestic appliance

Abstract

The invention relates to a method (200) for demonstrating a function of a domestic appliance (105), having the steps of scanning an image of the domestic appliance (105); detecting the type of domestic appliance (105) in the image; determining an operating element (140) of the domestic appliance (105) in the image; superimposing the operating element (140) in the image with a virtual operating element (145) assigned to said type; and providing the superimposed image to a user (110).

Description

[0001] Demonstration of a household appliance

[0002] The present invention relates to the demonstration of a household appliance. In particular, the invention relates to the representation of a function of the household appliance when it cannot be operated.

[0003] Household appliances, such as a washing machine, tumble dryer, dishwasher, or oven, are often sold in large stores where many different appliances are available for viewing. Especially when a household appliance requires a connection to high-voltage electricity, fresh water, or wastewater, it is unusual to make the appliance available for viewing in a fully functional state. A prospective buyer can touch the appliance and operate a control element, and possibly open an appliance door, but cannot perform any other functions of the household appliance.

[0004] Typically, additional information about the device is provided in writing or images. However, it can be difficult to express a device's distinguishing feature regarding its function statically, visually, or textually. It can be difficult for a user to grasp relevant information about the device and make an informed purchasing decision.

[0005] It has been proposed to attach a graphic code to a device containing a link to a central location from which a video about the device's functions can be downloaded. However, the information conveyed is also static, and not every user is willing to invest several minutes in watching a descriptive video.

[0006] An object underlying the present invention is to provide an improved technique for demonstrating or operating a household appliance. The invention solves this problem by means of the subject matter of the independent claims. Subclaims specify preferred embodiments. A method for demonstrating or operating a function of a household appliance comprises steps of scanning an image of the household appliance; recognizing a type of household appliance in the image; determining an operating element of the household appliance in the image; overlaying the operating element on the image with a virtual operating element associated with the type; and providing the overlaid image to a user.

[0007] A user can view the household appliance directly or in an image. The virtual control element displayed there can give the user a better impression of a household appliance's function. This allows the user to experience a function of the household appliance directly and without any detours. The user can be informed about an essential function of the household appliance in an improved manner. Both the breadth and depth of information can be increased. This can solve, among other things, the technical problem of operating and experiencing a household appliance that is not even connected to a power supply.

[0008] Preferably, an area of ​​the image outside the control element remains unchanged. The virtual control element can be presented in the image of the household appliance in the manner of virtual reality (VR) or augmented reality (AR). Areas of the image where no user interaction with the household appliance is intended can be left unchanged. If, for example, a sign, a user's hand, or additional information is located in such an area, these elements can be shown unchanged in the image. This can result in a more realistic impression of the household appliance during use.

[0009] It is further preferred that the image is continuously scanned, superimposed, and provided to the user. This allows an impression of the household appliance to be conveyed with improved realism. For example, a perspective of the household appliance can be interactively controlled by the user. The representation can be updated several times per second, thus providing the user with an improved, realistic experience of the household appliance. In a further embodiment, the scanning and representation takes place in real time. Preferably, the virtual control element is formed by displaying the control element of the household appliance while it is executing a predetermined function. On a washing machine, the predetermined function can, for example, comprise executing a predetermined washing program. On a dishwasher, the execution of a cleaning program can also be emulated.The virtual control element can represent the appliance's function in a modified form. In particular, sections of a function run during which no new information is generated can be abbreviated. For example, a function run can be shortened to several consecutive phases, each lasting only a few seconds instead of the real-life many minutes or several hours.

[0010] It is preferred that the emulated function of the household appliance continues even if the image display is interrupted, for example, because a perspective was selected during image scanning such that the control element is not visible. In another embodiment, the function can only be executed as long as the virtual control element can be displayed in the image. If the control element moves out of the camera's detection range, the emulation of the function run can be paused or aborted.

[0011] In a further embodiment, an additional control element is shown on the image, wherein the predetermined function is controlled depending on an actuation of the additional control element. In other words, an additional control element can be provided for controlling an emulated function or an emulated functional sequence of the household appliance. The additional control element can, for example, control the playback speed of a predetermined sequence. Such a function can also be referred to as time-lapse or slow motion. In a further embodiment, a displayed sequence can be fast-forwarded or rewound, or a position in a chronological sequence can be changed forwards or backwards in time.In a further embodiment, the representation of a functional sequence can be changed or aborted, wherein a change or abort sequence that may be required for the actual function of the household appliance can be skipped. It is also preferred that the function or functional sequence of the household appliance can be controlled interactively. The displayed virtual control element can be configured not only for output, but also for input from a user. Actuation of a virtual control element can influence the displayed function or functional sequence in the same way as actuation of a corresponding actual control element on a running household appliance. In this way, the user can interactively control the demonstration of the function of the household appliance and explore its handling as desired.It is also conceivable that a fully connected household appliance could, in addition to the emulation, simultaneously execute the behavior shown in real life.

[0012] In a further embodiment, an optical code is applied to the household appliance, which refers to an external resource from which the virtual control element can be downloaded. The external resource can in particular be a central location such as a server or a cloud. The optical code can, for example, be provided two-dimensionally in the form of a barcode or three-dimensionally in the form of a QR code. The reference can be specified in the form of a URL. By managing the virtual control element at the central location, its appearance can be improved and updated or adapted to a changed range of functions of the household appliance. It can also be prevented that a virtual control element belonging to a household appliance other than the one in question is downloaded.

[0013] The optical code or a dedicated optical code may point to an external resource from which a program can be downloaded to overlay and provide the image with the virtual control.

[0014] In one embodiment, the program may be configured to run on a handheld device such as a smartphone, laptop computer, or tablet computer. In another embodiment, a headset, smart glasses, or other wearable device may also be used.

[0015] In another embodiment, the external resource can deliver the program dynamically. In particular, a web page can be displayed that contains the required program code, for example, in the form of an applet. In yet another embodiment, the program can also run on the external resource, with only its output being transmitted to the user. This type of technology is known as WebAR (Augmented Web).

[0016] The optical code, or another dedicated optical code, can also be used to identify a type of household appliance. A virtual control element associated with that type can then be easily requested from the external resource.

[0017] A device for demonstrating a function of a household appliance comprises a camera for scanning an image of the household appliance; a display device; and a processing device. The processing device is configured to recognize a type of household appliance in the image; determine a control element of the household appliance in the image; overlay the control element in the image with a virtual control element associated with the type; and provide the overlaid image to a user.

[0018] The device may, for example, be based on a handheld device such as a smartphone. Another portable or body-worn device may also be used. In a further embodiment, a known smartphone or similar handheld device may be used in a manner described herein to demonstrate a function of a household appliance.

[0019] The processing device can be configured to partially or completely execute a method described herein. For this purpose, the processing device can be implemented electronically and, for example, comprise a programmable microcomputer or microcontroller. The method can be in the form of a computer program product with program code means. The computer program product can also be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device, or vice versa.

[0020] A system comprises a device described herein and a central location configured to provide the virtual control element depending on the specific type of household appliance. The central location can be configured to emulate or visualize a function of the household appliance and provide a visual output using the virtual control element. In another embodiment, a program or applet can be delivered that runs on a device described herein and emulates or visualizes the function of the household appliance.

[0021] A household appliance comprises a control element, wherein an optical code is attached to the household appliance, which refers to an external resource configured to provide a virtual control element depending on a specific type of the household appliance. The code may include an indication of the type. The code is preferably optical and more preferably binary. A combined code may bundle different information.

[0022] According to a further aspect, the invention can comprise a computer program product, which can in particular be an app that can be run on a mobile device and is preferably downloaded from an app store. The computer program product comprises instructions that, when executed on said computer, cause a computer, in particular a mobile device, to execute the method described above.

[0023] Embodiments of the invention will now be described in more detail with reference to the accompanying figures, in which:

[0024] Figure 1 shows a system with a household appliance;

[0025] Figures 2 and 3 show steps of a method for demonstrating a household appliance; and

[0026] Figure 4 shows an exemplary view of a household appliance in an augmented reality manner.

[0027] Figure 1 shows a system 100 with a household appliance 105. The household appliance 105 is usually not connected and ready for use and can, for example, be arranged in a sales area together with other household appliances 105. Example household appliances 105 include a dishwasher, a washing machine, and a tumble dryer. Other household appliances, in particular those that, in addition to a power grid, must also be connected to a water supply or disposal network, are also possible. The system 100 is configured to give a potential user 110 an impression of an operation, a function, a functional sequence, or a benefit of the household appliance 105. For this purpose, the system 100 comprises an external resource 115, which can be embodied, in particular, as a server or as a service in a cloud. Furthermore, a device 120 that can be handled by the user 110 is provided, which is embodied, for example, as a smartphone.

[0028] The device 120 includes a camera 125 and a display 130. Furthermore, the device 120 is configured to communicate with the external resource 115, preferably via a wireless network.

[0029] A code 135 can be attached to the household appliance 105, which is preferably visually recognizable and more preferably represented in binary form. The code 135 can include an indication of an address of the external resource 115. The code 135 can be captured and evaluated by the camera 125 of the device 120. The device 120 can then connect to the resource 115 using the address. The code 135 can also include an indication of a type or variant of the present household appliance 105. The indication can be part of the address or provided as a separate argument from the device 120 to the external resource 115. The external resource 115 then provides the device 120 with information to display a virtual control element 145 on the display 130 of the device 120, which virtual control element covers, overlays, or replaces a view of a control element 140 of the household appliance 105.

[0030] The device 120 can scan an image of the household appliance 105 using the camera 125, determine the operating element 140 on the image, overlay it with the virtual operating element 145, and provide the overlaid image to the user 110 on the display 130. The image can be processed by the device 120. For this purpose, the device 120 can download a corresponding computer program from the external resource 115. The computer program can be provided in the form of an application (app) or in the form of functionality embedded in a website. Furthermore, the resource 115 can provide the virtual operating element 145 appropriate for the type of household appliance 105. In another embodiment, an image scanned by the camera 125 can be transmitted to the external resource 115, processed there, transmitted back to the device 120, and displayed there on the display 130.

[0031] In the exemplary embodiment shown, a first operating element 140 comprises a receptacle of the household appliance 105 for detergents or care products. Another operating element 140 can be dynamically displayed on a display surface of the household appliance 105. The display surface is preferably coupled to an input surface, in particular as a touchscreen, and an element displayed on the display surface that can be actuated by the user 110 can also be understood as an operating element 140. Another illustrated operating element 140 comprises a display device that cannot simultaneously be used as an input device, for example, a temperature at which the household appliance 105 processes laundry. Yet another operating element 140 comprises an input, here in the form of a rotary knob, which cannot simultaneously be used as an output.

[0032] The virtual control element 145 is preferably modeled in its visual appearance on the real or dynamic control elements 140. The virtual control element 145 can be actuated by the user 110 using an input element of the device 120. This can, in particular, be formed by a touch-sensitive screen that implements the display 130.

[0033] Figures 2 and 3 show steps of a method 200 for demonstrating a household appliance 105. The method 200 can be carried out by means of a system 100.

[0034] In a step 205, a household appliance 105 may be selected. The household appliance 105 may, for example, be one of a plurality of household appliances 105 arranged on a sales floor. In a step 210, the device 120 may be used to detect the code 135 affixed to the household appliance 105. In a step 215, the code may be recognized and processed to determine an indication contained therein of the external resource 115. The code may also include an indication of the individual household appliance 105, its type, or its model. The information may be provided in the form of a URL so that it can be evaluated by an internet browser of the device 120.

[0035] In a step 220, the specific external resource 115 can be presented to the user 110 for confirmation. If the user 110 confirms the URL, the browser of the device 120 can contact the resource 115. The resource 115 can initially display a welcome page, which is illustrated by way of example in a step 225. The welcome page can already take into account the type of household appliance 105 used by the user 110. Furthermore, the user 110 can be given an indication of how to proceed in the proposed method 200 or which options they can use.

[0036] In a step 230, the user 110 can initiate the execution of a program that can control the demonstration of the household appliance 105 on the device 120 using virtual or augmented reality methods. It should be noted that, in various embodiments, a computer program that controls the demonstration can be executed on the device 120 or the external resource 115. Interaction with the user 110 occurs during the demonstration or emulation by the device 120.

[0037] In a step 235 shown in Figure 3, an image is captured using the camera 125 of the device 120 and displayed on the display 130. Optionally, a calibration mark can be displayed in order to enable a later overlay of a portion of the captured image to be carried out with precision. The user 110 can be asked to align the device 120 with the household appliance 105 such that the displayed calibration mark is congruent with a calibration mark provided on the household appliance 105. The code 135 on the household appliance 105 can be used as the calibration mark. In a step 240, the user 110 can comply with the request and calibrate the device 120 with the household appliance 105. In a step 245, a control element 140 of the household appliance 105 can be identified on the captured image.In a step 250, the operating element 140 on the image can be replaced or superimposed by a virtual operating element 145. The superimposed image is provided to the user 110 so that the user can perceive the household appliance 105 on the display 130 with the virtual operating element 145 instead of the actual operating element 140. The virtual operating element 145 can be operated by the user 110. In a step 255, the virtual operating element 145 can be operated, in the example shown by pressing a power or start button. To do so, the user 110 touches a surface of the display 130 in the area of ​​the virtual operating element 145, and an effect of the actuation is determined with reference to a predetermined range of functions of the household appliance 105. A predetermined function of the household appliance 105 can then be emulated, for example, a cleaning cycle of a washing machine.The function can also be part of an interaction concept, so that the actuation of the virtual control element 145 can cause an output on another virtual control element 145. In a step 260, a virtually executed function of the household appliance 105 can be displayed on the display 130. For this purpose, an output can be provided using one or more virtual control elements 145, matching the emulated state of the household appliance 105.

[0038] Figure 4 shows an exemplary view 400 of a household appliance 105 in the manner of an augmented reality. An image of a household appliance 105 is visible on the display 130 of the device 120. A control element 140 is superimposed on the image by a virtual control element 145. In addition to the possibilities described herein for demonstrating or emulating operating and execution steps of the household appliance 105, exemplary symbols are shown on the superimposed image, which can indicate functions, advantages, or options of the household appliance 105.

[0039] The household appliance 105, illustrated by way of example as a washing machine, can, for example, have a washing program that enables particularly easy ironing of treated laundry. A first metaphor 405 in the form of an iron can be represented as a representative example. By touching the first metaphor 405, further information about the washing program can be retrieved. In particular, the setting or execution of a corresponding washing program can be emulated. A second metaphor 410 in the form of a bottle of detergent can, for example, indicate a dosing system in which a supply of detergent is filled into the washing machine 105, from which the correct amount can be withdrawn and processed for a multitude of washing processes.

[0040] A third exemplary metaphor 415 is depicted as a football and may indicate a treatment program particularly suitable for sportswear.

[0041] A fourth metaphor 420 shows a cosmetic product as a reference to a washing program that aims to gently remove soiling caused, for example, by lipstick on clothing.

[0042] A fifth metaphor 425 includes, for example, a clock. The clock can symbolically display a virtual time that elapses during the emulation of a functional program. Thus, a long waiting time of, for example, 30 minutes can be represented within a few seconds, with the current time expressed by the clock 425 changing correspondingly quickly. Optionally, the speed of the emulation can also be changed by the user 110 via the fifth metaphor 425.

[0043] Reference symbol

[0044] 100 systems

[0045] 105 household appliances

[0046] 110 users

[0047] 115 external resource

[0048] 120 device

[0049] 125 Camera

[0050] 130 ad

[0051] 135 Code

[0052] 140 Control element

[0053] 145 virtual control element

[0054] 200 procedures

[0055] 205 Select household appliance

[0056] 210 Enter code

[0057] 215 determine external resource

[0058] 220 Confirm external resource

[0059] 225 Welcome page of the external resource

[0060] 230 Start program

[0061] 235 Display calibration mark

[0062] 240 Calibrate view

[0063] 245 Detect control element

[0064] 250 display virtual control element

[0065] 255 operate virtual control element

[0066] 260 Show function

[0067] 400 views

[0068] 405 first metaphor: iron

[0069] 410 second metaphor: detergent

[0070] 415 third metaphor: football

[0071] 420 fourth metaphor: cosmetics

[0072] 425 fifth metaphor: clock

Claims

PATENT CLAIMS 1. A method (200) for demonstrating a function of a household appliance (105), the method (200) comprising the following steps: - scanning (245) an image of the household appliance (105); - recognizing (210) a type of household appliance (105) in the image; - determining (245) an operating element (140) of the household appliance (105) on the image; - overlaying (250) the control element (140) on the image with a virtual control element (145) associated with the type; and - Providing (250) the overlaid image to a user (110).

2. The method (200) according to claim 1, wherein a region of the image lying outside the operating element (140) remains unchanged.

3. The method (200) of claim 1 or 2, wherein the image is continuously scanned, overlaid and provided to the user (110).

4. Method (200) according to one of the preceding claims, wherein the virtual operating element (145) is formed by displaying the operating element (140) of the household appliance (105) during the execution of a predetermined function.

5. The method (200) according to any one of the preceding claims, wherein an additional control element (405-425) is displayed on the image; and wherein the predetermined function is controlled in dependence on an actuation of the additional control element (405-425).

6. The method (200) according to any one of the preceding claims, wherein an operation of the virtual operating element (145) displayed on the image is detected (255); and wherein the execution of a function of the household appliance (105) associated with the operation is emulated (260) on the virtual operating element (145).

7. The method (200) according to any one of the preceding claims, wherein an optical code (135) is applied to the household appliance (105) which refers to an external resource (115) from which the virtual control element (145) can be downloaded.

8. The method (200) according to any one of the preceding claims, wherein an optical code (135) is mounted on the household appliance (105) which refers to an external resource (115) from which a program for overlaying and providing the image with the virtual control element (145) can be downloaded.

9. Method (200) according to one of the preceding claims, wherein the type of household appliance (105) is recognized on the basis of an optical code (135) attached thereto.

10. Device (120) for demonstrating a function of a household appliance (105), the device comprising: - a camera (125) for scanning an image of the household appliance (105); - a display device (130); - a processing device configured to recognize a type of the household appliance (105) in the image; to determine an operating element (140) of the household appliance (105) in the image; to overlay the operating element (140) on the image with a virtual operating element (145) associated with the type; and to provide the overlaid image to a user (110).

11. System (100) comprising a device according to claim 10 and a central location configured to provide the virtual control element (145) depending on the specific type of household appliance (105).

12. A household appliance (105) comprising an operating element (140); wherein an optical code (135) is attached to the household appliance, which refers to an external resource (115) configured to provide a virtual operating element (145) depending on a specific type of the household appliance (105).

13. Computer program product, in particular an app that can be run on a mobile device and can preferably be downloaded from an app store, wherein the computer program product comprises instructions which cause a computer, in particular a mobile terminal, to carry out the method according to one of claims 1 to 9 when they are executed on this computer.

Images