Demonstration of household appliance

Abstract

The invention relates to a method (200) for demonstrating a function of a household appliance (105), comprising the following steps: scanning an image of the household appliance (105); identifying a type of the household appliance (105) on the image; determining an operating element (140) of the household appliance (105) on the image; superimposing the operating element (140) on the image with a virtual operating element (145) associated with the type; and providing the superimposed image to the user (110).

Description

Technical Field

[0001] The present invention relates to the demonstration of household appliances. In particular, the present invention relates to the display of the functions of a household appliance when the household appliance cannot be put into operation. Background Art

[0002] Household appliances (such as washing machines, clothes dryers, dishwashers or ovens) are often sold in large markets where many different appliances are placed for viewing. Especially when the household appliance needs to be connected to a strong current, fresh water or waste water, the appliance is usually not provided to the viewer in a functionally connected state for observation. Interested customers can touch the appliance and operate the operating elements. If necessary, they can open the appliance door, however, the further functions of the household appliance cannot be executed.

[0003] Normally, further information about the appliance is presented in written or image form. However, it may be difficult to statically express the outstanding features of the appliance in terms of its functions through images or words. It may be difficult for users to obtain relevant information about these appliances and make an informed purchasing decision.

[0004] It has been proposed that a graphic code is attached to the appliance, which contains a link to a central position from which a film about the functions of the appliance can be downloaded. However, the information transmitted in this way is also static, and not every user is willing to spend several minutes watching the description film. Summary of the Invention

[0005] One task on which the present invention is based is to propose an improved technical solution for the demonstration (or operation) of household appliances compared with the prior art. The present invention solves this task by means of the subject matter of the independent claims. The dependent claims give preferred embodiments.

[0006] A method for demonstrating (or operating) the functions of a household appliance includes the following steps: scanning an image of the household appliance; identifying the type of the household appliance on the image; determining the operating elements of the household appliance on the image; superimposing the operating elements on the image with virtual operating elements assigned to this type; and providing the superimposed image to the user.

[0007] The user can observe the household appliance directly or on an image. The virtual operating elements shown on the image can give the user an improved impression of the functions of the household appliance. Thereby, the user can directly and effortlessly understand the functions of the household appliance. The user can obtain information about the basic functions of the household appliance in an improved manner. Both the breadth and the depth of the information can be expanded. In this way, technical problems that can be solved include: operating and experiencing the household appliance even if the household appliance is not connected to a power supply.

[0008] Preferably, the image area located outside the operating element remains unchanged. The virtual operating element can present the image of the household appliance in a virtual reality (VR) or augmented reality (AR) manner. The image area where no interaction of the user with the household appliance is expected can remain unchanged in the image. For example, if there are signs, the user's hand, or additional information in such an area, these elements can be shown unchanged on the image. Thereby, during the use of the household appliance, an improved sense of reality impression of the household appliance can be generated.

[0009] Further preferably, the image is continuously scanned, superimposed, and provided to the user. The impression of the household appliance can thus be conveyed with an improved sense of reality. For example, the user can interactively control the perspective on the household appliance. This display can be updated multiple times per second, thereby providing the user with an improved sense of reality experience of the household appliance. In another embodiment, the scanning and display are performed in real time.

[0010] Preferably, the virtual operating element is formed by displaying the operating elements of the household appliance during the execution of a predetermined function. For example, on a washing machine, the predetermined function can include executing a predetermined washing program. On a dishwasher, the execution of a cleaning program can likewise be simulated. The virtual operating element can display the functions of the household appliance in a modified manner. In particular, parts where no new information is generated during the function run can be shortened. For example, the function run can be simplified into multiple consecutive stages, each of which lasts only a few seconds, instead of lasting several minutes or hours in reality.

[0011] Preferably, even when the display of the image is interrupted, for example because the perspective selected during the scanning of the image makes the operating element invisible, the simulated function of the household appliance continues. In another embodiment, the function is only executed when the virtual operating element can be displayed on the image. If the operating element is out of the detection range of the camera, the simulation of the function run can be paused or terminated.

[0012] In another embodiment, additional operating elements are presented on the image, wherein a predefined function is controlled in accordance with the manipulation of the additional operating elements. In other words, additional operating elements can be provided for controlling the simulation function or the operation of the simulation function of the household appliance. The additional operating elements can, for example, control the playback speed of a predefined process. Such a function can also be referred to as fast forward or slow motion. In another embodiment, the presented process can be played forward or backward, or the position in the time sequence can be changed in a jump-like manner forward or backward in time. In another embodiment, the presentation of the function operation can be changed or terminated, wherein a change or termination sequence that may be required in the actual function of the household appliance can be skipped.

[0013] Furthermore, preferably, the function or the operation of the function of the household appliance is interactively controllable. For this purpose, the presented virtual operating elements can be configured not only for output but also for user input. Manipulating the virtual operating elements can affect the presented function or the function sequence in the same way as manipulating the corresponding actual operating elements on the running household appliance. Thereby, the user can interactively control the demonstration of the household appliance function and explore the manipulation methods at will. It is also conceivable that a fully connected household appliance not only simulates but also actually performs the shown behavior at the same time.

[0014] In another embodiment, an optical code is attached to the household appliance, which points to an external resource from which virtual operating elements can be downloaded. The external resource can in particular be a central location, such as a server or a cloud. The optical code can be provided two-dimensionally in the form of a barcode, for example, or three-dimensionally in the form of a QR code. The link can be provided in the form of a URL. By managing the virtual operating elements at a central location, the presentation of the virtual operating elements can be updated in an improved manner, or the virtual operating elements can be adapted to the changed function range of the household appliance. It is also possible to prevent the download of virtual operating elements that do not match the current household appliance.

[0015] The optical code or a dedicated optical code can point to an external resource from which a program for superimposing and providing images by means of virtual operating elements can be downloaded.

[0016] In one embodiment, the program can be configured to run on a handheld device, such as a smartphone, a laptop or a tablet. In another embodiment, a head-mounted device, smart glasses or other wearable devices can also be used.

[0017] In another embodiment, the external resource can deliver the program dynamically. Here, in particular, a web page can be presented, which contains the required program code, for example in the form of applets. In yet another embodiment, the program can also run on the side of the external resource, and only the output of the program is transmitted to the user. This technology is called WebAR (Enhanced Web).

[0018] The optical coding or another dedicated optical coding can also be used to identify the type of the household appliance. Subsequently, virtual operating elements that match this type can be easily requested from an external resource.

[0019] A device for demonstrating the functions of a household appliance includes: a camera for scanning an image of the household appliance; a display device and a processing device. Here, the processing device is configured to: identify the type of the household appliance on the image; determine the operating elements of the household appliance on the image; superimpose virtual operating elements that match this type on the operating elements on the image; and provide the superimposed image to the user.

[0020] Such a device can be formed, for example, based on a handheld device (such as a smartphone). Other portable or wearable devices can also be used. In another embodiment, a known smartphone or a similar handheld device can be used to demonstrate the functions of a household appliance in the manner described herein.

[0021] The processing device can be configured to partially or fully execute the methods described herein. For this purpose, the processing device can be electronically implemented, for example, including a programmable microcomputer or a microcontroller. The method can exist in the form of a computer program product having program code units. The computer program product can also be stored on a computer-readable data carrier. The features or advantages of the method can be transferred to the device, and vice versa.

[0022] A system includes the device described herein and a central location, which is configured to provide virtual operating elements according to the determined type of the household appliance. The central location can be configured to simulate (or visualize) the functions of the household appliance and provide an optical output by means of the virtual operating elements. In another embodiment, a program or an applet can be delivered, which runs on the device described herein and simulates (or visualizes) the functions of the household appliance.

[0023] A household appliance includes operating elements, wherein an optical coding is attached to the household appliance, and this optical coding points to such an external resource: the external resource is configured to provide virtual operating elements according to the determined type of the household appliance. The coding can contain a hint about this type. Preferably, the coding is in optical form, and further preferably in binary execution. The combined coding can bundle different information.

[0024] According to another aspect, the present invention may include a computer program product, which may particularly relate to an application program that can run on a mobile terminal, and the application program is preferably downloaded from an application store. The computer program product includes instructions that cause a computer (particularly a mobile terminal) to execute the above method when the instructions are run on the computer. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Embodiments of the present invention will be described in more detail with reference to the accompanying drawings, in which:

[0026] Figure 1 A system with household appliances is shown;

[0027] Figure 2 and Figure 3 Steps for demonstrating a method of household appliances are shown; and

[0028] Figure 4 An example view of a household appliance in an augmented reality manner is shown. DETAILED DESCRIPTION

[0029] Figure 1 A system 100 with a household appliance 105 is shown. The household appliance 105 is generally not connected in a ready-to-run state and may be arranged, for example, in a sales area together with other household appliances 105. Exemplary household appliances 105 include dishwashers, washing machines, and clothes dryers. Other household appliances (especially those that need to be connected to a water supply or drainage network in addition to being connected to the power grid) are equally applicable. The system 100 is configured to provide a potential user 110 with an impression of the operation, function, functional process, or advantages of the household appliance 105. For this purpose, the system 100 includes an external resource 115, which may particularly be formed as a server or a service in the cloud. In addition, there is a device 120 that can be manipulated by the user 110, and the device 120 is exemplary formed as a smartphone.

[0030] The device 120 includes a camera 125 and a display 130. In addition, the device 120 is configured to communicate with the external resource 115, preferably by means of a wireless network.

[0031] On the household appliance 105, a code 135 can be attached, which is preferably optically recognizable and further preferably presented in binary. The code 135 can contain a hint of the address of the external resource 115. The code 135 can be detected and analyzed by means of the camera 125 of the device 120. The device 120 can then use this address to connect to the external resource 115. The code 135 can also contain a hint about the type or variant of the current household appliance 105. Such a hint can be part of the address or provided as a separate parameter by the device 120 to the external resource 115. The external resource 115 then provides information to the device 120 in order to display a virtual operating element 145 on the display 130 of the device 120, which virtual operating element 145 covers, superimposes or replaces the view of the operating element 140 of the household appliance 105.

[0032] The device 120 can scan an image of the household appliance 105 by means of the camera 125, determine the operating element 140 on this image, superimpose it with the virtual operating element 145, and provide the superimposed image to the user 110 on the display 130.

[0033] The processing of the image can be carried out at the device 120 side. For this purpose, the device 120 can download a corresponding computer program from the external resource 115. The computer program can be provided in the form of an application (App) or in the form of a function embedded in a web page. In addition, the resource 115 can provide virtual operating elements 145 that match the type of the household appliance 105. In another embodiment, the image scanned by means of the camera 125 can be transmitted to the external resource 115, processed at this external resource 115, transmitted back to the device 120, and displayed on the display 130.

[0034] In the exemplary embodiment shown, the first operating element 140 includes a receptacle for detergents or care agents of the household appliance 105. Another operating element 140 can be dynamically displayed on the display surface of the household appliance 105. The display surface is preferably coupled to the input surface, in particular as a touch-sensitive screen (Touchscreen), and the elements that can be manipulated by the user 110 and are displayed on the display surface can also be regarded as operating elements 140. Another displayed operating element 140 includes a display device that cannot be used as an input device at the same time, for example, to display the temperature at which the household appliance 105 processes the laundry. Another operating element 140 includes an input device, presented here in the form of a knob, which cannot be used as an output device at the same time.

[0035] The virtual operating element 145 preferably mimics a real or dynamic operating element 140 in its appearance. The virtual operating element 145 can be manipulated by the user 110 in such a way that the user 110 uses an input element of the device 120. In particular, the input element can be formed by a touch-sensitive screen that implements the display 130.

[0036] Figure 2 and Figure 3 Steps of a method 200 for demonstrating a household appliance 105 are shown. The method 200 can be executed by means of the system 100.

[0037] In step 205, a household appliance 105 can be selected. For example, the household appliance 105 can be one of a plurality of household appliances 105 arranged in a sales area. In step 210, the device 120 can be used to detect a code 135 attached to the household appliance 105. In step 215, the code 135 can be identified and processed in order to determine a hint regarding an external resource 115 contained therein. The code 135 can also contain a hint regarding the individualized household appliance 105, the type of the household appliance 105 or the execution (Ausführung) of the household appliance 105. This information can be provided in the form of a URL, so that this information can be analyzed and processed by an Internet browser of the device 120.

[0038] In step 220, the determined external resource 115 can be submitted to the user 110 for confirmation. If the user 110 confirms the URL, the browser of the device 120 can establish contact with the resource 115. The resource 115 can first display a welcome page, which is exemplarily shown in step 225. The welcome page can already take into account the type of the household appliance 105 that the user 110 is facing. In addition, a hint regarding how to continue in the proposed method 200 or which options he can apply here can be provided to the user 110.

[0039] In step 230, the user 110 can trigger the execution of a program that can control the demonstration of the household appliance 105 on the device 120 by means of virtual or augmented reality methods. It should be noted that the computer program for controlling the demonstration can be executed on the device 120 or on the external resource 115 in different embodiments. The interaction with the user 110 takes place via the device 120 during the demonstration or simulation.

[0040] In Figure 3In step 235 shown in [description], the camera 125 of device 120 is used to detect an image and display it on the display 130. Optionally, calibration marks can be displayed so that the superposition of the detected image can be precisely performed later. The user 110 can be requested to orient the device 120 relative to the household appliance 105 such that the displayed calibration marks coincide with the calibration marks provided on the household appliance 105. Here, the coding 135 on the household appliance 105 can be used as the calibration mark. In step 240, the user 110 can comply with the request and calibrate the device 120 relative to the household appliance 105.

[0041] In step 245, the operating element 140 of the household appliance 105 can be determined on the detected image. In step 250, the operating element 140 on the image can be replaced or superimposed by the virtual operating element 145. The superimposed image is provided to the user 110 so that the user 110 can perceive the household appliance 105 with the virtual operating element 145 on the display 130 instead of the actual operating element 140. The virtual operating element 145 can be operated by the user 110. In step 255, the virtual operating element 145 can be operated, in the example shown by pressing the on or start button. For this purpose, the user 110 touches the surface of the display 130 in the area of the virtual operating element 145 and determines the effect of the manipulation with reference to the predetermined function range of the household appliance 105. Subsequently, the predetermined function of the household appliance 105 can be simulated, such as the cleaning operation of a washing machine. This function can also be part of an interactive concept such that manipulating the virtual operating element 145 can result in an output on another virtual operating element 145. In step 260, the virtual execution function of the household appliance 105 can be displayed on the display 130. For this purpose, output can be performed by adapting one or more virtual operating elements 145 to the simulated state of the household appliance 105.

[0042] Figure 4 An exemplary view 400 of the household appliance 105 in augmented reality is shown. The image of the household appliance 105 can be seen on the display 130 of the device 120. The operating element 140 is superimposed on the image by the virtual operating element 145. In addition to the possibility of demonstrating (or simulating) the operation and execution steps of the household appliance 105 on the superimposed image described herein, exemplary symbols are also shown, which can indicate the functions, advantages, or options of the household appliance 105.

[0043] The household appliance 105, which is exemplarily shown as a washing machine, can for example have a washing program that enables the laundry to be particularly easy to iron after processing. As a representative example in this regard, a first metaphor 405 in the form of an iron can be shown. By touching the first metaphor 405, further information about the washing program can be retrieved. In particular, the corresponding washing program can be simulated for setting or execution.

[0044] A second metaphor 410 in the form of a detergent bottle can for example indicate a metering system for which a detergent reserve is filled in the washing machine 105 and from which the correct amount can be taken out and processed separately for a plurality of washing processes.

[0045] A third exemplary metaphor 415 is shown as a football and can indicate a processing program that is particularly suitable for sports clothing.

[0046] A fourth metaphor 420 shows cosmetics as a hint for a washing program that is intended to gently remove stains caused, for example, by lipstick on the laundry.

[0047] A fifth metaphor 425 exemplarily includes a clock. The clock can symbolically display the virtual time elapsed during the simulated function program. For example, a waiting time of up to 30 minutes can be shown within a few seconds, where the current time expressed by means of the clock 425 changes accordingly quickly. Optionally, via the fifth metaphor 425, the user 110 can also change the speed of the simulation.

[0048] List of reference numerals

[0049] 100 System

[0050] 105 Household appliance

[0051] 110 User

[0052] 115 External resource

[0053] 120 Device

[0054] 125 Camera

[0055] 130 Display

[0056] 135 Encoding

[0057] 140 Operating element

[0058] 145 Virtual operating element

[0059] 200 Method

[0060] 205 Select household appliance

[0061] 210 Detect encoding

[0062] 215 Determine external resources

[0063] 220 Confirm external resources

[0064] 225 Welcome page for external resources

[0065] 230 Start program

[0066] 235 Display calibration marks

[0067] 240 Calibration view

[0068] 245 Detect operating elements

[0069] 250 Display virtual operating elements

[0070] 255 Manipulate virtual operating elements

[0071] 260 Display function

[0072] 400 View

[0073] 405 First metaphor: Iron

[0074] 410 Second metaphor: Detergent

[0075] 415 Third metaphor: Football

[0076] 420 Fourth metaphor: Cosmetics

[0077] 425 Fifth metaphor: Clock

Claims

1. A method (200) for demonstrating the functions of a household appliance (105), wherein, The method (200) comprises the following steps: - Scanning (245) an image of the household appliance (105); - Identifying (210) the type of the household appliance (105) on the image; - Determining (245) the operating elements (140) of the household appliance (105) on the image; - Superimposing (250) the operating elements (140) on the image with virtual operating elements (145) assigned to the type; and - Providing (250) the superimposed image to the user (110).

2. The method (200) according to claim 1, wherein The area of the image located outside the operating element (140) remains unchanged.

3. The method (200) according to claim 1 or 2, wherein, The image is continuously scanned, superimposed and provided to the user (110).

4. The method (200) according to one of the preceding claims, wherein, The virtual operating elements (145) are formed by displaying the operating elements (140) of the household appliance (105) during the execution of a predetermined function.

5. The method (200) according to one of the preceding claims, wherein, Additional operating elements (405 - 425) are presented on the image; and wherein the predetermined function is controlled according to the manipulation of the additional operating elements (405 - 425).

6. The method (200) according to one of the preceding claims, wherein, Detecting (255) an operation on the virtual operating elements (145) presented on the image; and wherein the execution of the function assigned to the operation of the household appliance (105) is simulated (260) on the virtual operating elements (145).

7. The method (200) according to one of the preceding claims, wherein, An optical code (135) is attached to the household appliance (105), which optical code points to an external resource (115) from which the virtual operating elements (145) can be downloaded.

8. The method (200) according to one of the preceding claims, wherein, An optical code (135) is attached to the household appliance (105), which optical code points to an external resource (115) from which a program for superimposing and providing an image with the virtual operating elements (145) can be downloaded.

9. The method (200) according to one of the preceding claims, wherein, The type of the household appliance (105) is identified based on an optical code (135) attached to the household appliance.

10. A device (120) for demonstrating the functions of a household appliance (105), wherein, The device comprises the following: - A camera (125) for scanning an image of the household appliance (105); - A display device (130); - A processing device configured to: identify the type of the household appliance (105) on the image; determine the operating elements (140) of the household appliance (105) on the image; superimpose the operating elements (140) on the image with virtual operating elements (145) assigned to the type; and provide the superimposed image to the user (110).

11. A system (100) comprising the device according to claim 10 and a central location, the central location being configured to provide the virtual operating elements (145) according to the determined type of the household appliance (105).

12. A household appliance (105), comprising an operating element (140); wherein, An optical code (135) is attached to the household appliance, which optical code points to an external resource (115), the external resource being configured to provide virtual operating elements (145) according to the determined type of the household appliance (105).

13. A computer program product, in particular an application program capable of running on a mobile terminal, preferably being able to be downloaded from an application store, wherein, The computer program product includes instructions which, when executed on a computer, particularly a mobile terminal, cause the computer to perform the method according to one of claims 1 to 9.

Images