COUPLING A HOUSEHOLD APPLIANCE WITH A MOBILE DEVICE
Patent Information
- Application Number
- DE502021010838
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-11-02
- Filing Date
- 2021-10-11
- Publication Date
- 2026-08-13
- Estimated Expiration
- 2041-10-11
AI Technical Summary
Household appliances face challenges in maintaining additional functions beyond their primary operations due to the mismatch between their lifespan and the lifespan of the platform providing these functions, and equipping them with high-performance processing units is costly and uncertain for future requirements.
Wirelessly pair a household appliance with a mobile device, using the mobile device's processing capabilities to execute additional functions, where the appliance's sensor is configured as a local device for the mobile device, allowing flexible access and control through predefined policies.
Enables the use of mobile device processing power to maintain and update additional functions, extending the appliance's functionality without the need for costly upgrades, while ensuring secure and efficient interaction between appliances and mobile devices.
Description
[0001] The invention relates to a household appliance. In particular, the invention relates to a wireless coupling of a household appliance with a mobile device.
[0002] A household appliance includes a graphic display that can show the appliance's status. For example, the display on a refrigerator might show the internal temperature, fill level, current energy consumption, or operating mode. Household appliances are typically operated via a locally located input device, such as a switch or knob. The input device can be integrated with the output device, for example, in the form of a touchscreen.
[0003] The graphical display can be used to provide a user with an additional function that goes beyond simply controlling the appliance. For example, a recipe could be displayed. However, it has been shown that providing this additional function—in this example, maintaining a collection of recipes—can be complex to implement. The function typically requires regular updates at both the functional and data levels. Furthermore, the lifespan of the appliance can far exceed the lifespan of a conventional platform used to provide this function. Therefore, the appliance may no longer be able to reliably perform the additional function in its current form well before the end of its service life.
[0004] Equipping a household appliance with a high-performance processing unit can be costly; furthermore, it is usually unknown what specific future requirements will be for providing this function, meaning the processing unit may still be undersized in a necessary aspect. The following publications reveal the use of sensors in household appliances by mobile devices: "SOUL: An Edge-Cloud System for Mobile Applications in a Sensor-Rich World", in 2016 IEEE / ACM SYMPOSIUM ON EDGE COMPUTING (SEC), IEEE, 27. Oktober 2016, von JANG MINSUNG ET AL, "Integrating remote sensors in a smartphone: The project "sensors for ANDROID in embedded systems" in 2016 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS), IEEE, 20. April 2016, von RINALDI STEFANO ET AL und "Sensor Virtualization Module: Virtualizing loT Devices on Mobile Smartphones for Effective Sensor Data Management", in INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, Bd. 2015, 4. Oktober 2015, von JEONGGIL KO ET AL.
[0005] DE102010060650 A1 offenbart die Darstellung eines Kochrezepts in einem Haushaltsgerät.
[0006] One of the problems underlying the present invention is to provide an improved technology for connecting a household appliance to a mobile device. The invention can achieve this problem, for example, by means of the subject matter of the independent claims. Dependent claims may describe preferred embodiments.
[0007] According to one aspect of the present invention, a first method comprises the steps of wirelessly pairing a household appliance with a mobile device; and providing a sensor of the household appliance as a local device of the mobile device for a function running on the mobile device. The sensor can be configured as a sensor module and can be addressed as an input and / or output device. In particular, the behavior of the sensor can be configured by means of the output function. An output device, an input device, or a combination of an input device and an output device can also be provided to the mobile device as a local device.
[0008] According to the invention, the sensor of the household appliance can be used by a function, for example an application ("app"), running on the mobile device, essentially as if the sensor were encompassed by the mobile device. For this function, the physical location of the sensor may be irrelevant or undetermined. This type of provision allows the sensor to be used for a wider range of purposes. For this, the sensor can be made available by the operating system of the mobile device, for example in the form of a readable and / or writable device file. In one embodiment, the household appliance may not have any function that uses the sensor other than making the sensor available to the mobile device. The sensor, or a sensor value that can be acquired by it, is typically associated with a function of the household appliance.
[0009] The function of a household appliance can be either a primary or an auxiliary function. For example, a dishwasher's primary function is cleaning dishes; an auxiliary function might include scheduling a cleaning time or reordering detergent. The auxiliary function is not always necessary for the primary function. If the auxiliary function cannot be performed, the primary function can usually still be used. Often, the auxiliary function can also be performed in a way other than by means of the household appliance. In the example above, for instance, obtaining detergent could also be done by a person. The primary function usually characterizes the household appliance; if the primary function fails, the household appliance can usually no longer fulfill its purpose, and an auxiliary function can no longer function or becomes pointless.For example, scheduling a cleaning time would be pointless if the cleaning function cannot be performed.
[0010] By means of the present invention, for example, a barcode reader attached to a refrigerator can be used by a function running on the mobile device that manages a household's food inventory.
[0011] The sensor is designed to scan an area of the household appliance and provide a sensor reading, which is then transmitted to the mobile device and made available to the appliance's function. The area can be located in the vicinity of the appliance, in which case the sensor might include, for example, a camera, radar, or LiDAR sensor. Alternatively, the area can be located within the appliance itself, in which case the sensor might include, for example, a switch or a temperature sensor. A function of the household appliance can then be controlled based on a sensor reading provided by the sensor. The sensor can be connected to the appliance via a wired or wireless connection.
[0012] The sensor can be deployed depending on a predefined policy. This policy can specify, in particular, which function should have access to which household appliance or sensor, under which user a function accessing the sensor should run, or what type of access to the sensor should be granted. The policy can be a simple if-then statement, or it can be a set of rules that determines access rights based on one or more parameters.
[0013] Providing the sensor to the function can be controlled by a mobile device user. In one option, the user can define default access rights; in another, the user can interactively grant or deny access rights. For example, user confirmation can be obtained before the function accesses the sensor.
[0014] The policy can also be obtained from a central location. This central location can manage the appliance or multiple appliances, preferably those belonging to the same household. This allows permissions that control the interaction between appliances and with a mobile device to be stored centrally. This facilitates consistency checks and policy changes. Furthermore, if a new appliance becomes available, its capabilities can be improved and aligned with those of existing appliances.
[0015] The procedure may also include controlling a sampling criterion or sensor parameter through the function. This control may require the transmission of a parameter from the mobile device to the household appliance. The control can specify how the sensor is used or set a boundary condition for its use. The setting of such a parameter can be aligned with predetermined conditions by the directive. For example, if the sensor is a camera, the parameter could relate to color, brightness, contrast, orientation, focal length, illumination, refresh rate, or trigger time.
[0016] According to a further aspect of the present invention, a second method comprises the steps of wirelessly pairing a household appliance with a mobile device; receiving a message by the mobile device; transmitting a notification of the received message from the mobile device to the household appliance; and making the notification available from the household appliance to a user. This aspect is not necessarily dependent on the aforementioned first aspect of the invention but can be implemented together with it.
[0017] The message can be sent proactively from an external source, even without being explicitly requested by the mobile device ("push notification"). Such a message could be an SMS, an email, a WhatsApp message, or an RSS feed. The message itself can be held by the external source or forwarded to the mobile device. The notification can, for example, indicate the type of message, the sender, the number of messages, or when a message was sent. Ideally, the message itself is not initially forwarded to the appliance. This allows a user who is engaged in a task for which they are using the appliance, or who is at least near it (e.g., cooking), to be informed promptly of the arrival of a message. For example, one could be briefly notified while cooking that their mother has sent them a WhatsApp message.
[0018] The transmission can occur depending on a predetermined policy. The policy can be structured similarly to the one described above. For example, the policy can specify which message should be sent to which user on which household appliance.
[0019] The message can also be made available on the household appliance. A user can control the download of the message in response to the notification, or the message can be sent to the household appliance along with the notification.
[0020] For this purpose, the household appliance can be paired with a voice interface, such as a smart speaker like an Amazon Alexa Echo. Content transmitted to the appliance can be adapted according to a predefined policy. For example, a specific type of notification (e.g., SMS or WhatsApp), a particular data format (e.g., PDF or MP3), or a message from a specific sender can be blocked. This protects the appliance from potentially dangerous content being executed. The appliance's resources can be conserved. Information that cannot be displayed can be prevented from being transmitted to the appliance altogether. A key function of the appliance can remain easily accessible.
[0021] In one embodiment, the mobile device automatically pairs with the household appliance if a notification needs to be transmitted. The pairing can also be automatically disconnected after the notification has been transmitted.
[0022] According to a further aspect of the present invention, a household appliance comprises a sensor; a communication device for wireless communication; and a processing device. The processing device is configured to wirelessly connect the mobile device to the household appliance and to provide a sensor value acquired by means of the sensor to the mobile device.
[0023] According to yet another aspect of the present invention, a mobile device comprises a communication device for wireless communication and a processing device. The processing device is configured to wirelessly couple the mobile device with the household appliance containing a sensor and to provide the sensor as a local device to a function running on the mobile device.
[0024] According to yet another aspect of the invention, a system comprises a household appliance and a mobile device as described herein. Features of the system can be transferred to a household appliance and / or a mobile device, or vice versa.
[0025] According to yet another aspect of the present invention, a household appliance comprises a wireless communication device; an output device; an input device; and a processing device. The processing device is configured to wirelessly connect a mobile device to the household appliance, to provide an output from the mobile device via the output device, and to provide an input to the mobile device via the input device.
[0026] It was recognized that, for the execution of an additional function that can be performed on the household appliance, a mobile device might be a more suitable platform than the processing unit of the household appliance itself. The household appliance could be implemented relatively simply as a "dumb terminal" that can only transmit outputs from the mobile device to a user and user inputs back to the mobile device.
[0027] The additional function can be improved, maintained, updated, or synchronized with an external database on the mobile device. This mobile device can be a smartphone, in particular. Should the function's performance requirements exceed the mobile device's capabilities, it can be updated relatively easily. The updated mobile device can then be paired with the appliance in the same way as the original one. This allows the appliance to be used for a long time without significant limitations in the functionality of the function.
[0028] The household appliance can support two-way interaction with a user, meaning the mobile device does not need to be directly operated by the user to utilize the function. For example, the user can carry the mobile device with them or place it in a charging station and use the function on the household appliance. The function can be related to the use of the household appliance, such as the appliance being used to prepare a meal and the function displaying a recipe. The relationship can also be indirect, such as when the function includes a calendar and the completion of a meal is to be coordinated with a specific date in the calendar. In yet another embodiment, there is no classic functional relationship, for example, when the household appliance is a refrigerator and the function involves playing music.Nevertheless, a user can use both functionalities at the same time and in the same place.
[0029] In one embodiment, the household appliance does not specify the type of additional function, so that practically any function of the mobile device can be used via the household appliance. For example, a first function of the mobile device can be interrupted or replaced by a second one in response to an event, such as when music playback is interrupted because a phone call is to be answered.
[0030] The input device of the household appliance is typically designed for direct operation by the user and may include, for example, a push button, a switch, a rotary knob, or a touchscreen. In another embodiment, the input device may also be designed for indirect operation and may, for example, include a barcode reader to which the user can present a barcode, such as from food packaging, so that the barcode reader provides an input depending on the detected barcode. Other exemplary input devices that can be used in conjunction with the technology presented herein include gesture recognition, an olfactory sensor (VOC: volatile organic compound), or an accelerometer.
[0031] The output device preferably includes an optical output area that can provide textual, numerical, alphanumeric, or graphical output. In particular, the output device may include a display or a projector. However, the output device may also support other forms of output to the user, such as acoustic or haptic output.
[0032] The output device can include an optical display with at least two display areas. The processing unit can be configured to display information from the household appliance on a first display area and the output from the mobile device on a second display area.
[0033] By dividing the output device into areas, a function of the household appliance and a function of the mobile device can be made accessible to a user simultaneously. The information can, in particular, relate to an operating parameter or a working state of the household appliance, so that the household appliance remains controllable independently of a function of the mobile device. In a first variant, the display areas can be located next to each other, and in a second variant, one of the display areas can overlay another. If more than one function of the mobile device is to be supported on the household appliance, a corresponding number of display areas can be created on the output device. Preferably, the display area for the function of the household appliance is always visible, while a display area for a function of the mobile device on the output device can also be reduced in size, obscured, or hidden.For example, three display areas can be created, one of which can be assigned to information from the household appliance and another to a function of the mobile device. The third display area can be assigned to one or more functions of the mobile device, whereby the assignment of a function to a display area can be event-driven or controlled by the user.
[0034] The input device can comprise a first and a second control element, with the processing unit being configured to control a function of the household appliance depending on the activation of the first control element and to transmit the activation of the second control element to the mobile device. This ensures immediate controllability of the household appliance independently of the control of a function of the mobile device. In particular, if the household appliance can perform a potentially hazardous operation, such as heating, kneading, or chopping, the use of the mobile device's function cannot compromise the operational or user safety of the household appliance.
[0035] The processing unit can also be configured to establish two independent wireless data connections, one for output from the mobile device and the other for input to the mobile device. The data connections can use different standards, thus facilitating the use of a familiar mobile device. For example, output from the mobile device can be transmitted via Miracast, AirPlay, Google Cast, Screen Mirroring, VLC, or Wireless Display (WiDi), while input to the mobile device can be achieved, for instance, by pairing the household appliance with the mobile device as a Bluetooth input device. Different technologies can also be used for the different data connections, such as Wi-Fi, Bluetooth, ZigBee, or infrared transmission.In a particularly preferred embodiment, one of the data connections uses the Home Connect protocol, which can also be used to network several household appliances together.
[0036] The processing unit can be configured to initiate pairing with the mobile device only when the distance between the mobile device and the household appliance falls below a first predetermined threshold. Pairing can occur automatically when a user carrying the mobile device approaches the household appliance. User intervention, for example, to confirm or authorize the pairing process, may not be required. In another embodiment, confirmation may be required only by the household appliance. In yet another embodiment, confirmation may be required but remain in effect for a predetermined period, during which no further confirmation is necessary for subsequent pairing.Automatic pairing allows the mobile device's interface to follow the user as they move around a household with multiple household appliances that offer the pairing described herein.
[0037] The processing unit can be configured to disconnect an existing connection to a mobile device if the distance between the mobile device and the appliance exceeds a second predetermined threshold that is greater than the first threshold. The connection can be distance-controlled with a predetermined hysteresis. This ensures that connection and disconnection do not occur in rapid succession when the mobile device is close to the first threshold value from the appliance.
[0038] It should be noted that in one embodiment, the coupling described herein may involve establishing a data connection, for example, on one or more of layers 1 to 7 in the ISO / OSI model, while in another embodiment, the coupling only concerns the representation of the output or the transmission of the input, both of which require an established data connection. In other words, an established data connection between the household appliance and the mobile device can be maintained even if the mobile device is located further away from the household appliance than specified by the second threshold; however, in this case, outputs from the mobile device may be suppressed or inputs to the mobile device may not be forwarded.
[0039] The processing unit can also be configured to wirelessly pair another mobile device with the household appliance, provide output from the other mobile device via the output device, and provide input to the other mobile device via the input device. This allows multiple mobile devices, which may be assigned to different users, to be paired with the household appliance simultaneously. The household appliance can support the simultaneous use of functions from both mobile devices.
[0040] In particular, the processing unit can be configured to map outputs from mobile devices to the output device and / or to map inputs to the mobile device. This mapping can be rule-based. A rule can take an event into account, such as the current distance of a mobile device from the household appliance. The mapping or a rule can be controlled by a user. Different users can define different rules. In one embodiment, multiple functions of different mobile devices can be controlled simultaneously via the household appliance. In another embodiment, only one function can be controlled at a time, and this function can be selected from several possible functions of the mobile devices.It is preferred that the mobile devices are data-technically separated from each other, so that one mobile device cannot influence another of the mobile devices through the household appliance.
[0041] According to a further aspect of the present invention, a system comprises several household appliances described herein, wherein processing units of the household appliances are each configured to determine the distance between the associated household appliance and the mobile device, with only one input being provided from the nearest household appliance to the mobile device. This allows a user to carry a mobile device and control a function running on it from whichever household appliance is closest to them. A user interface for the function can follow the user from appliance to appliance within the household. If the household appliances support pairing with multiple mobile devices, several users can be mobile simultaneously within the household and conveniently and elegantly control their respective assigned functions via the household appliances.
[0042] To determine which household appliance is closest to a mobile device, the appliances can be connected to each other via data transmission. This can be done wirelessly or with a wired connection. The appliances can also be connected via a central component, such as a router or server. In particular, the appliances can be connected using Home Connect. In one embodiment, the appliances can exchange information about their distances to a mobile device. One appliance can inform another when it wants to control a function of the mobile device or relinquish control.
[0043] According to yet another aspect of the invention, a further system comprises several household appliances described herein, wherein the processing units of the household appliances are each configured to provide output from the mobile device via an associated output device. The output can, for example, be displayed on all household appliances in a household or in a room of the household. In one embodiment, output is displayed on all household appliances whose distance to the mobile device is below a predetermined threshold.
[0044] According to yet another aspect of the present invention, a third method for controlling a household appliance comprises steps of establishing a wireless coupling of the household appliance with a mobile device; of capturing an input at an input device of the household appliance and providing the input to the mobile device; and of capturing an output of the mobile device and providing the output by means of an output device of the household appliance.
[0045] The establishment and / or termination of wireless coupling and the transmission of inputs and / or outputs between the household appliance and the mobile device may depend on other factors, as described herein for example with regard to a household appliance and a system with at least one household appliance.
[0046] According to yet another aspect of the invention, a household appliance comprises a communication device for wireless communication; an output device; and a processing device. The processing device is configured to wirelessly connect a mobile device to the household appliance and to provide output from the mobile device to the output device based on a predetermined set of rules.
[0047] Based on the rule set, it can be determined which output should appear on the output device and which should not. This can, for example, prevent misuse of the appliance by an unauthorized mobile device. It can also prevent the output device from becoming cluttered with received content. For instance, a predetermined section of the output device can be reserved to display a parameter that controls a function of the appliance. If the output device is a touchscreen, the functionality of the function can be ensured simultaneously. The appliance can remain controllable by a user regardless of whether a received output is being displayed.In another embodiment, the controllability can be used to change the rule set so that content provided on the output device can always remain controllable by a user.
[0048] The processing unit is preferably configured to download or update the rule set from an external source. This external source can be, in particular, a central server or a service, which, for example, might be implemented in the cloud. The external source can be authenticated using cryptographic methods, thus preventing the downloading of a compromised rule set. The processing unit can be configured to connect to another mobile device, and a priority for mobile device outputs can be determined based on the rule set. In principle, any number of mobile devices can be connected to the household appliance.The space available for displaying content on an optical output device is limited, so prioritizing outputs can ensure that one or more of the outputs are displayed at an appropriate size, while others may be displayed only partially or not at all.
[0049] In one embodiment, output from a mobile device is provided if no higher-priority output is available. In other words, only the highest-priority output can be provided at any given time. Lower-priority outputs cannot be displayed until they themselves are highest-priority. For example, output can be removed from the output device by a user's confirmation.
[0050] In yet another embodiment, a lower-priority output from a mobile device is overlaid by a higher-priority output. This overlay can be graphical. The higher-priority output can, for example, be provided in the form of a pop-up window, a modal dialog, or a foreground message.
[0051] The rule set can be defined based on predetermined specifications, with each specification being predefined in list form. For example, the rule set can include an initial list of mobile devices whose output must not be made available on the output device. This initial list can also be called a negative list, blacklist, or blacklist. Mobile device identification is typically performed when the connection to the household appliance is established and can be repeated during information transmission. Using this initial list, for example, a mobile device classified as malicious can be excluded from the output device.
[0052] The rules may include a second list of mobile devices whose output may be made available on the output device. This second list may also be referred to as an enable list, whitelist, or whitelist.
[0053] The rules may include a third specification of mobile device functions whose outputs may be provided on the output device. In other words, the third specification may comprise an allowable list of functions. A mobile device function may be provided by a program or application ("app"). Similarly, a disallowed list of mobile device functions may also be provided.
[0054] The rules may include a fourth specification of content that may be provided on the output device. Permitted content may include, for example, text or graphics. This may specify, for example, a scope, size, resolution, color depth, or other content that may be provided on the output device. In the form of a list, this fourth specification may be a positive list of content. Similarly, a negative list of content that may not be provided on the output device may also be provided.
[0055] It should be noted that the rule set may include different sets of information or lists. These sets of information can be considered in a predetermined order. In particular, the information can be processed like a firewall for a computer network, whereby a set of information applicable to a received output can optionally be applied directly without checking further information. A suitable positive set of information can lead to the immediate provision of the output on the output device, while a suitable negative set of information can lead to the immediate rejection of the output.
[0056] In a manner similar to how output from the mobile device is transmitted to and made available on the household appliance, input from the household appliance can be transmitted to and processed on the mobile device. In one embodiment, input captured on the household appliance can also be subjected to verification by the rule set.
[0057] The household appliance can include an input device, the processing unit being configured to provide input at the input device to the mobile device based on the rule set. In one embodiment, different rule sets are assigned to an input and an output; in another embodiment, only one rule set is defined for both inputs and outputs. A rejected input or output can be discarded, or the transmission of information with the relevant function or mobile device can be aborted.
[0058] The appliance may also include a storage device to record input in case the wireless connection or pairing is temporarily interrupted. For example, the connection may be interrupted or disrupted if a person carrying the mobile device moves within range of the appliance. The temporary interruption may be transparent to the appliance and the mobile device, or to the functions running on each. The wireless connection may be terminated only if it is interrupted or disrupted for more than a predetermined duration. Then, for example, the appliance may release space on the output device occupied by an output from the mobile device.
[0059] According to yet another aspect of the present invention, a system comprises a household appliance as described herein and a mobile device, which are wirelessly coupled. Through this coupling, input from the household appliance can be transmitted to the mobile device and processed there. Furthermore, output from the mobile device can be transmitted to the household appliance and made available to a user there. The household appliance can be implemented relatively simply as a "dumb terminal" that can only provide output from the mobile device to a user and input from the user to the mobile device. Since the execution of the function is performed by the mobile device, the household appliance can operate with minimal processing power.
[0060] In one embodiment, a first component for generating the output is executed on the mobile device, and a second component for providing the output to the output device is executed on the household appliance. The household appliance and the mobile device are configured to re-establish a temporarily interrupted wireless connection without affecting the function of either the first or the second component. In other words, the mobile device and the household appliance can transparently maintain a wireless connection even during temporary disruptions, without requiring any read or write component on either the household appliance or the mobile device to be informed of a brief interruption or disruption.
[0061] According to yet another aspect of the present invention, a fourth method for providing an output from a mobile device on an output device of a household appliance, which is wirelessly coupled to the mobile device, comprises steps of receiving an output from the mobile device; checking, based on a predetermined set of rules, whether the output may be provided on the output device; and providing the output depending on a test result.
[0062] According to yet another aspect of the present invention, a fifth method for providing an input from an input device of a household appliance, which is wirelessly coupled to a mobile device, to the mobile device comprises steps of acquiring an input at the input device; checking, based on a predetermined set of rules, whether the input may be provided to the mobile device; and providing the input to the mobile device depending on a test result. The fourth and / or fifth methods can each be carried out on a household appliance.
[0063] According to a further aspect of the present invention, a household appliance comprises a communication device for wireless communication; an output device; a device for determining a distance to a mobile device; a processing device which is configured to wirelessly couple the mobile device with the household appliance and to provide an output from the mobile device on the output device depending on the determined distance.
[0064] A user can carry the mobile device and move freely within the vicinity of the appliance. The mobile device's output to the appliance can be configured so that the user's perception of the output is adapted to their distance from the appliance. This allows the user to better perceive the output and, if necessary, respond more effectively. For example, if the output includes information related to an appliance function, the user can control that function more effectively.
[0065] The distance-determining device can include a dedicated sensor such as an ultrasonic sensor, a radar sensor, or a LiDAR sensor. In a preferred embodiment, the distance-determining device is integrated with the communication device. For example, the distance between the mobile device and the household appliance can be determined based on information already obtained by a standard communication device. Such information can be generated or specifically determined during communication via Wi-Fi or Bluetooth.
[0066] The communication device can be configured to determine the distance based on the strength or lack of interference of a wireless signal received from the mobile device. The strength of the received signal is also called RSS (received signal strength) and, in conjunction with the strength of the transmitted signal, can allow for a distance determination. Lack of interference can be specified as the signal-to-noise ratio (SNR). An error rate in the transmission of information between the household appliance and the mobile device can also be considered to determine lack of interference.
[0067] In one embodiment, the distance between devices is determined using a technology known as beacon technology. One of the devices transmits wireless signals containing a message. This message can include information regarding the strength of the transmitted signal, the transmitter's position, the transmitter's identification, or other details. This allows the distance to be determined within a range of up to approximately 20 meters. The shorter the distance, the more accurate the determination. A receiver can thus determine its position relative to a beacon with improved accuracy. The accuracy of the determined position can be less than approximately one meter.
[0068] The output device can include a display unit, whereby the size, level of detail, or color of the output is controlled depending on the distance. The output provided can be adapted to the capabilities of the display unit, for example, regarding display size, orientation, or arrangement of individual pieces of information. If a display unit is too small to fully display predetermined information at a desired size, the information can be provided sequentially, either as a scrolling text or in a predetermined order.
[0069] The output device can include a controllable sound source, whereby the output volume is adjusted depending on the distance. For example, an audio data stream can be output in such a way that it is always perceived as having the same volume by the user, even if they change their position in a room containing the appliance.
[0070] According to yet another aspect of the present invention, a mobile device comprises a communication device for wireless coupling with a household appliance, wherein the mobile device is configured to transmit an output to be provided to the household appliance.
[0071] The mobile device can be configured to pair with a household appliance according to a predefined policy. This policy can, for example, control which function or application running on the mobile device should be assigned to a specific household appliance or a function performed by that appliance. This facilitates communication between predefined communication partners on the part of the household appliance and the mobile device. For instance, a function assigned to a household appliance can be automatically started on the mobile device when the appliance moves within a predetermined distance.
[0072] The policy can also control which household appliance the mobile device pairs with. In particular, the policy can control whether the mobile device pairs with only one predetermined selection of several household appliances. For example, pairing can be limited to the nearest appliance, i.e., the one closest to the mobile device. This can be determined based on a predetermined group of household appliances, such as those assigned to a specific household.
[0073] The mobile device can be configured to receive the policy from a central authority. This can be done using a wired or wireless communication device. The central authority can control or manage aspects of household appliances assigned to a user or household.
[0074] The mobile device can be configured to receive wireless signals from the household appliance, determine its distance to the appliance based on the received signals, and transmit this distance to the appliance. Determining the distance from the mobile device allows for easy use of existing appliance technology. In particular, the household appliance or control device can be designed as a beacon, enabling the mobile device to easily determine its distance.
[0075] According to yet another aspect of the present invention, a system comprises a household appliance and a mobile device as described herein. If the mobile device is configured to apply a policy, the system may further comprise a central entity for providing a policy to the mobile device.
[0076] It is preferred that the mobile device is configured to determine its position based on received wireless signals and transmit this information to the household appliance; and that the household appliance is configured to determine the distance based on its own position and the position of the mobile device. The mobile device may determine its position based on one or more sensors, for example, by means of a satellite-based radio navigation system or an inertial platform. Alternatively or additionally, the position may be determined by measuring the distance to one or more beacons, one of which may encompass the household appliance.
[0077] According to yet another aspect of the present invention, a sixth method comprises steps of determining a distance between a household appliance and a mobile device; wirelessly pairing the household appliance with the mobile device; transmitting an output from the mobile device to the household appliance; and making the output available at the household appliance depending on the determined distance.
[0078] The distance can be determined based on a wireless communication signal transmitted between the household appliance and the mobile device. This communication signal can include, in particular, Wi-Fi or Bluetooth (BT or BTLE). Information transmitted via this communication signal can assist in determining the distance.
[0079] The methods described herein can generally be combined or integrated. A part of one method can be merged with a part of another method to form a single method. A combination of several methods, in whole or in part, is also possible. A method according to the invention can be in the form of a computer program product with program code means and can be executed by means of a processing device, which in particular comprises or is configured as a programmable microcomputer or microcontroller. The processing device can in particular be comprised of a household appliance or a mobile device described herein. In some cases, distributed processing of the method on different processing devices is possible, which can be arranged in different devices, in particular in a household appliance and a mobile device.
[0080] The household appliances or systems described herein can also be combined or integrated with one another. The methods, devices, household appliances, mobile devices, or systems described herein can implement the present invention in various ways or in different aspects. Advantages or features can be transferred between the items or combined with one another.
[0081] The invention has been explained with reference to several claim categories (method, device, household appliance, mobile device, system, computer program product, etc.). Unless otherwise specified, all features of one claim category can be applied analogously to all other claim categories. In particular, the devices have appropriate means to carry out the described method steps. Even within a claim category, the features can be freely combined to provide further embodiments not explicitly described here.
[0082] Advantageous embodiments of the invention are now described in more detail with reference to the accompanying figures, in which: Figure 1 represents a system with a household appliance and a mobile device; Figure 2 represents an exemplary representation of an output on a household appliance; Figure 3 represents an exemplary communication between a mobile device and a household appliance; Figure 4 represents a first method for controlling a household appliance; Figure 5 represents a second method for controlling a household appliance; Figure 6 represents a third method for controlling a household appliance; Figure 7 represents a fourth method for controlling a household appliance; Figure 8 represents a fifth method for controlling a household appliance; and Figure 9 represents a sixth method for controlling a household appliance.
[0083] Figure 1Figure 100 shows a system 100 comprising at least one household appliance 105, a mobile device 110, and an optional central location 112. A first exemplary household appliance 105 is shown as an oven, and a second as a refrigerator; however, other appliances can also be used, such as a stove, a range hood, or a mixer. The household appliance 105 can, in particular, include a kitchen appliance designed for operation in a household kitchen. The household appliances 105 are preferably located close to one another, for example, in a shared household or a shared room such as a kitchen.
[0084] The mobile device 110 preferably comprises a smartphone, tablet computer, or fitness watch and is typically assigned to a predetermined user 115 who can carry the mobile device 110. The mobile device may also include a smart speaker, such as an Amazon Echo Dot or Show. A predetermined function can be provided on the mobile device 110, which can be performed in particular by an assigned program or application. Examples of such functions include managing a collection of recipes, acoustic or textual communication with another, remote user, or playing music. For this purpose, the function can provide output to the user 115 via a local output device on the mobile device 110, in particular in visual, acoustic, or haptic form.Furthermore, the function can evaluate input from user 115 at a local input device on the mobile device 110, which the user may provide manually, for example. Appropriate input and / or output devices may be provided on the mobile device 110 for this purpose. The mobile device 110 may also be configured to evaluate other inputs or environmental parameters that can be indirectly controlled by user 115, such as position, acceleration, or ambient brightness.
[0085] The mobile device 110 is typically configured to connect to a wireless network, in particular a wide area network such as the internet. The mobile device 110 can also communicate with the central unit 112 via this connection. For this purpose, the mobile device 110 can use, for example, Wi-Fi or mobile networks, e.g., 4G or 5G. Furthermore, the mobile device 110 preferably includes a wireless communication device 120, which is configured to establish a wireless data connection with a local device, for example, the household appliance 105.
[0086] The household appliance 105 comprises a control device 125, which is preferably configured to control a function of the household appliance 105. In one embodiment, the control device 125 is configured to control several household appliances 105. A control device 125 can also be a standalone unit and not part of a household appliance 105. In this case, communication between the control device 125 and an associated household appliance 105 preferably takes place wirelessly, for example, using a technology known as Home Connect. Several control devices 125 can also be provided in a household, each configured to control at least one household appliance 105. The control devices 125 can also be interconnected via data transmission.
[0087] The control device 125 comprises a processing unit 130, an input device 135, an output device 140, and a wireless communication device 145. The input device 135 and the output device 140 are shown here as an example integrated touch-sensitive screen. User input 115 can be provided by touching an area of the input device 135, whereby a visual indication of the input can be displayed in that area on the output device 140. This allows for context-sensitive input.
[0088] In another embodiment, the control device 125 comprises a sensor 142, which is typically configured to scan the household appliance 105 or its environment. Exemplary sensors 135 include a temperature sensor, a humidity sensor, a switch, a current or voltage sensor, a light sensor, a camera, or a barcode reader. A sensor value acquired by the sensor 142 can be used to control the household appliance 105. For example, the sensor value can include an operating state, an internal state, an internal or external parameter, or an input value for the household appliance 105. The sensor 142 can be designed as a sensor module that allows control of a scanning process. For example, a measurement frequency or measurement accuracy can be adjustable, or a measurement can be performed under a predetermined condition specified on the sensor module.The sensor module can provide a sampled value in its raw or processed form. Such processing can include, for example, averaging over time, linearizing a characteristic curve, or mapping multiple parameters to a single parameter.
[0089] It is proposed to establish a wireless connection between the mobile device 110 and the household appliance 105. Input from user 115 on the input device 135 of the household appliance 105 can then be transmitted to the mobile device 110 and used there to control the function. Similarly, output from a function running on the mobile device 110 can be transmitted to the household appliance 105 and made available to user 115 there via the output device 140. The input device 135 or the sensor 142, or a corresponding sensor module, can be provided as a local input device for the mobile device 110. The output device 140 can be provided as a local output device for the mobile device 110. Several simple or combined devices 135, 140, 142 of the household appliance 105 can also be provided as a combined input / output device on the mobile device 110.
[0090] In one embodiment, inputs and outputs can be transmitted via a single data connection. In another embodiment, a first data connection 150 can be established for transmitting the input and a second data connection 155 for transmitting the output. The data connections 150 and 155 can be independent of each other and use different protocols or technologies, or they can be implemented as a single bidirectional connection.
[0091] The first data connection 150 allows the control device 125 to present itself as a user interface (UI) configured to capture and provide input from the user 115. For example, WLAN or Bluetooth can be used as the underlying protocol for the data connection 150.
[0092] Via the second data connection 155, the control device 125 can present itself to the mobile device 110 as a UI streaming server, i.e., as a device that accepts a stream of output data that can be directed to a user 115. The underlying protocol can be, for example, Miracast or AirPlay, which in turn can be based on Wi-Fi or Bluetooth.
[0093] The distance between the household appliance 105 and the mobile device 110 can be determined based on one of the data connections 150, 155. In particular, the communication device 145 can be configured to estimate the distance and, optionally, the direction of the mobile device 110 based on transmission parameters. Specifically, signal strength, signal-to-noise ratio, or error rate can be used for distance determination. If multiple antennas are available, corresponding parameters can be used together to determine the distance. The distance can be determined by the control device 120 or by the mobile device 110. A distance determined by the mobile device 110 can be transmitted to the household appliance 105.
[0094] The mobile device 110 can also determine its geographical position, for example, based on information from a receiver of a satellite-based navigation system, an inertial system, and / or its distance to one of the household appliances 105. For this purpose, a household appliance 105 can implement a beacon that transmits its own position via wireless signals. This technology can be easily used, in particular, based on Bluetooth Low Energy (BTLE). The position of the mobile device 110 can then be determined based on the transmitted position and its distance to the household appliance 105, which can be determined based on the transmission parameters of the wireless signal. The determined position of the mobile device 110 can be transmitted to the household appliance 115, which can then determine its distance to the mobile device 110 based on its own position.
[0095] Preferably, the processing unit 130 is configured to adapt the properties of the output device 140 to the requirements of the received output from the mobile device 110. For example, an orientation (portrait or landscape), color capability, graphic resolution, or the size of an available display area of the output device 140 can be provided to the mobile device 110 as a property. If the mobile device 110 provides output that does not comply with these specifications, the processing unit 130 can perform a corresponding transformation of the output. This can involve, for example, converting display sizes or resolutions into one another, or reducing or reassigning a color palette.
[0096] In some embodiments, a display area on the output device 140 can be dynamically provided for a function of the mobile device 110. In this case, the conversion can be transparent, or changed properties of the output device 140 can be reported to the mobile device 110.
[0097] In one embodiment, a storage device 160 is provided, which is connected to the processing device 130 of the control device 125. The storage device 160 is preferably configured to function as a cache and to temporarily store information that cannot be transmitted to the mobile device 110 due to a disruption in the data connection 150. In particular, an input detected at the input device 135 can be temporarily stored until the data connection 150 is restored. A corresponding storage device can be provided on the mobile device 110 to temporarily store an output that cannot be transmitted to the household appliance 105 due to an interrupted data connection 155.A corresponding buffer may be provided by the mobile device 110 to store a potentially undeliverable output until the data connection 155 is restored.
[0098] It is preferred that the household appliance 105 comprises a first software component and the mobile device 110 a second software component, which exchange inputs and / or outputs. The components can each build upon an underlying functionality of the household appliance 105 or the mobile device 110, respectively, which provides transmission via the data connections 150, 155. Should one of the data connections 150, 155 be temporarily interrupted, for example, because the devices 105, 110 are outside a maximum bridgeable range, because antennas are unfavorably aligned with each other, or because an object, such as a person 115, is located in a Fresnel zone of the antennas, the information to be transmitted can be stored by the household appliance 105 in the storage device 160 and / or by the mobile device 110 in a corresponding storage device.Should the data connection 150, 155 become available again within a predetermined time, for example, approximately 10, 5, or 2 seconds, the stored content can be transmitted and the storage devices emptied. The software components do not need to be notified of the interrupted or disrupted data connection 150, 155. This ensures, for example, that the household appliance 105 can continue to output acoustic information provided by the mobile device. If a data connection 150, 155 is interrupted or disrupted for longer than the predetermined time, both data connections 150, 155, or only the affected data connection 150, 155, can be terminated. Re-establishing a data connection 150, 155 may require re-authentication of one of the devices 105, 110.
[0099] Output on the output device 140 of the household appliance 105 preferably occurs depending on a certain distance from the mobile device. For example, an audio data stream can be output at an increased volume when the user 115 moves away from the output household appliance 105 with the mobile device 110. A visual display can be enlarged with increasing distance.
[0100] The central unit 112 is preferably configured to provide a policy to a household appliance 105 that can control two functions. A first possible function is the assignment of a household appliance 105, or a function running on it, to a function running on the mobile device 110. In other words, an assigned application ("app") can be started on the mobile device 110 as soon as communication with a predetermined household appliance 105 has occurred. Which application this is can be determined based on the policy and, if necessary, a boundary condition. The boundary condition can, for example, relate to a functional state or capability of the household appliance 105. A personal preference of the user 115 of the mobile device 110 can also be taken into account.The policy can be updated by the central authority 112 as needed, for example, because a new household appliance 105 has been added to the same household, because a new user 115 has joined the household, or because the control device 125 has been updated. The control device 125 can, for example, be replaced or updated via a software update.
[0101] A second possible function of the directive is to select which of several household appliances 105 the mobile device 110 connects to. For example, it can be specified that a first application communicates only with the household appliance 105 that is closest to the mobile device 110. A second application can be restricted to communication with household appliances 110 that include an acoustic output device 140. Other specifications or combinations are also possible.
[0102] The policy can also determine which output takes precedence over which other output. For example, if several functions are active on a paired mobile device 110, it can be predetermined which output takes precedence over which other. Individual messages or information can also be prioritized differently. For example, a notification about the end of a cooking time can take precedence over the output of a video data stream. Such a distinction can also be made if several mobile devices 110 are paired with or can communicate with a household appliance 105. Furthermore, priorities between individual mobile devices 110 or their respective assigned users 115 can also be taken into account.
[0103] Figure 2Figure 1 shows an exemplary representation of an output on an output device 140 of a control device 125 for a household appliance 105. A first display area 205 and a second display area 210 are shown, the first display area 205 being assigned to the control of the household appliance 105 and the second display area 210 to the control of an exemplary function of a connected mobile device 110. The function is assumed to be, purely by way of example, the display of a cooking recipe. The household appliance 105 is also assumed to be, by way of example, an oven. In further embodiments, more than two display areas 205, 210 can be supported.
[0104] Figure 2aFigure 1 shows a first embodiment in which the display areas 205 and 210 are arranged side by side on the output device 140. The first display area 205 shows, by way of example, a temperature (200 °C), a symbol for an operating mode (convection), and the current time (12:02). Control elements 215 are also shown, which, in the present state, can be used to adjust the temperature up or down. The second display area 210 shows a graphic representation 220 of a dish to be prepared using the recipe and several text areas 225, which may contain instructions or a list of ingredients.
[0105] Figure 2bFigure 1 shows a second embodiment in which the second display area 210 initially occupies the entire area of the output device 140, but is partially superimposed on the first display area 205. This results in different space conditions that can be dynamically utilized. The outputs of the function are different from the embodiment of [Figure 1]. Figure 2a enlarged and rearranged. Additional space can be used for further text areas 225 or an additional control element 215 for the function, for example for scrolling right or left. Outputs of the control of the household appliance 105 are different compared to the embodiment of Figure 2a Reduced and smaller. The controls 215 and the time are no longer available here, and the temperature and operating mode are displayed in a smaller size.
[0106] In another embodiment, several mobile devices 110 – or users 115 assigned to them – can each be assigned a display area 205, 210. In one embodiment, display areas 205, 210 can be represented in the manner of index card tabs. Only one of the display areas 205, 210 can be displayed at any given time, and the existence of further display areas 205, 210 can be indicated by the displayed index card tabs. To display one of the further display areas 205, 210, the corresponding index card tab can be selected so that its assigned content is displayed on the output device 140.
[0107] Under what circumstances a function is output on a display area 205, 210 on the output device 140, how large or positioned a display area 205, 210 is, or how several display areas 205, 210 are arranged on the output device 140, can be determined by means of rules, which can also be called policies.
[0108] For example, priorities can be set for users (115), functions, mobile devices (110), or display areas (205, 210). These parameters can also be prioritized based on rules, so that, for instance, it can be determined whether a first function, whose priority is higher than that of a second function, but whose associated mobile device (110) has a lower priority than the mobile device associated with the second function (110), is allowed to access the output device (140) before the second function. Priorities can also be determined or changed based on events. For example, the priority of a function whose output changes can be higher than that of a function whose output does not change. The priority of a function can be temporarily increased when its output changes.Preferably, the priorities and rules are designed in such a way that the controllability of the household appliance 105 is always guaranteed and, in case of doubt, takes precedence over the controllability of a function of a mobile device 110.
[0109] Figure 3 Figure 1 schematically shows communication between a mobile device 110 and a household appliance 105. The communication depicted involves the transmission of an output from the mobile device 110 to the household appliance 105. Similarly, an input on the household appliance 105 can also be processed and transmitted to the mobile device 110.
[0110] The mobile device 110 includes a first software component 305 that generates an output. This output can include, for example, text or graphics. The software component 305 utilizes a layered abstraction of communication, as proposed, for example, in the ISO-OSI model. The first software component 305 provides the output to a second software component 310, which is provided by the mobile device 110 and can display the output on the output device 140.
[0111] However, the output is not transmitted directly between components 305 and 310. Instead, the first software component 305 passes the output to a lower first transmission layer 315, which then transmits the output to a second transmission layer 320 on the side of the household appliance 105. Transmission layers 315 and 320 can be configured, for example, to control flow control, acknowledgment, or retransmission in case of an error.
[0112] However, direct communication between transmission layers 315 and 320 only occurs in an abstract sense. In reality, the first transmission layer 315 passes the data to be transmitted to a first physical layer 325, which wirelessly transmits the data via the data connection 155 to a second physical layer 330 on the side of the household appliance 105. Physical layers 325 and 330 can, for example, convert bits into physical signals such as electricity or frequencies.
[0113] Although three layers 305, 315, 325 and 310, 320 and 330 are described here as examples, any number of layers can be provided.
[0114] It is proposed that the household appliance 105 be provided with a rule set 335, which is used, for example, like a firewall's control list, to determine whether output received via the data connection 155 should be output to the output device 140 or not. By way of example, the rule set 335 is applied at the transmission layer 320. At this layer, metadata about the mobile device 110, the first software component 305, a user connected to the mobile device 110, or transmission parameters may be present, which can be analyzed with respect to the rule set 335.
[0115] Figure 4 Figure 400 shows a flowchart of a first procedure 400 for controlling a household appliance 105. The procedure 400 can be executed distributed between the household appliance 105 and a mobile device 110.
[0116] In step 405, a policy can be determined, for example by providing a predefined policy, capturing input from a user 115, or downloading a policy from a central location 112.
[0117] In step 410, the mobile device 110 and the household appliance 105 can be communicatively linked, for example by establishing data connections 150 and 155. In step 415, it can be determined which sensors 142 on the household appliance 105 are available for release. This determination can be made according to the policy, so that not every sensor 142 can be released arbitrarily.
[0118] In step 420, the mobile device 110 can create a virtual device configured to provide sensor values from a sensor 142 shared on the household appliance 105. A virtual device can behave like a physical device physically present on the mobile device 110 for a function or app running on the mobile device 110. In step 425, the virtual device can be made available to one or more functions of the mobile device 110. The policy can also be observed to ensure that not every function receives all access rights or information about the sensor 142.
[0119] In step 430, the function can be executed. For this purpose, in step 435, sensor 142 can be configured, and sensor values from sensor 142 can be received via data connection 150, possibly converted, filtered, or cleaned with regard to the policy, and made available to the function.
[0120] Figure 5 Figure 500 shows a flowchart of a second method 500 for controlling a household appliance 105. In the exemplary embodiment chosen, steps associated with the mobile device 110 are shown in a left-hand area, and steps associated with a household appliance 105 are shown in a right-hand area. It is assumed that at the beginning of method 500, a data connection 155 already exists between the mobile device 110 and the household appliance 105, and that the two devices are, in particular, coupled with each other. The coupling can be established at any point in method 500 if necessary. The second method 500 can, in particular, be combined wholly or partially with method 400.
[0121] In step 505, the mobile device 110 can receive a message. In one embodiment, only a notification of a message available at an external location 112 is received. In step 510, a note or notification of the message can be generated and transmitted to the household appliance 105. The household appliance 105 can receive the note in step 515 and make it available to a user 115, for example, by means of the output device 140. Optionally, the output or display of the note by the household appliance 105 can be controlled according to a predetermined policy, which may be predefined, downloaded from an external location 112, or customized by a user 115.
[0122] In a continuation of procedure 500, in step 520, input from a user 115 can be captured, indicating that the user wishes to receive the message to which they were notified on the household appliance 105. Subsequently, in step 525, the household appliance 105 can request the message from the mobile device 110. The mobile device 110 can receive the request in step 530 and transmit the message to the household appliance 105 in step 535. The mobile device 110 can subject the message to a policy check. A message can be discarded, adapted, or modified based on the policy.
[0123] In step 540, the message can be provided by the household appliance 105 to the user 115, for example by means of the output device 140. Beforehand, the household appliance 105 can also subject the message to a check with regard to a predetermined policy.
[0124] Figure 6 Figure 60 shows a flowchart of a third method 600 for controlling a household appliance 105. In step 605, a mobile device 105 can be detected within a predetermined area around a household appliance 105, or vice versa. The area can be defined by the range of a communication technology used. This step can be performed by either the household appliance 105 or the mobile device 110.
[0125] In step 610, a connection for input to a function of the mobile device 110 can be established, for example by pairing the household appliance 105 or the control device 125 as an input device via a Bluetooth connection 150. In step 615, a connection for output of the function of the mobile device 110 can be established, for example by connecting the control device 125 as a UI streaming server to the mobile device 110 via a WLAN connection 155.
[0126] The data connections 150, 155 preferably follow established standards for remote output and input, respectively. Preferably, an openly documented standard is used, which is further preferably not expected to be significantly modified or extended in an incompatible manner for an extended period. This period can cover the expected lifespan of the household appliance, for example, approximately 10–30 years. Furthermore preferably, a test exists to determine that the household appliance 105 implements the selected standard flawlessly in a predetermined version. Compliance with the test can be certified. The wireless data connections 150, 155 can be separate and independent of each other, or a single data connection 150, 155 can be used for both input and output.
[0127] In step 620, the distance between the household appliance 105 and the mobile device 110 can be determined, specifically based on a transmission parameter of one of the data connections 150, 155. In step 625, it can be determined whether an input and / or output should be made for the function on the household appliance 105. For this purpose, user confirmation can be requested, for example. It can be determined whether the specified distance lies within a predetermined range in which the redirection should occur. It can also be determined that an input or output from another user 115 currently has a higher priority, so the redirection may not be available for the current user 115.The diversion may also be unavailable if a device condition of the household appliance 105 requires direct and exclusive operation of the household appliance using the devices 135, 140, for example, because overheating or other imminent danger has been detected. If the diversion is to be carried out, procedure 600 can be used.
[0128] In step 630, an input can be captured on the household appliance 105. In step 635, a mobile device 110 associated with the input can be determined, if multiple mobile devices 110 can be paired with the household appliance 105. In step 640, a function associated with the mobile device 110 can be determined, if multiple functions of the mobile device 110 can accept inputs from the household appliance 105. In step 645, the specified input can be provided to the function.
[0129] In parallel, in step 650, an output from a function of the mobile device 110 can be recorded. In step 655, an output area of the output device 140 can be determined, which is assigned to the function. If no output area is currently assigned to the function, existing output areas can be reassigned or a new output area can be created for the function. In step 660, the output of the function can be made available on the assigned output area.
[0130] Figure 7 A fourth method 700 for controlling a household appliance 105 is shown. It is assumed that the household appliance 105 is coupled to the mobile device 110 via a wireless data connection 155.
[0131] In step 705, an output from the mobile device 110 can be received. The output can generally include user-directed information that the mobile device 110 can provide if no pairing is in place. With the pairing, the household appliance 105, or a control device 125 it incorporates, can be used as a remote output device.
[0132] If a connection between the household appliance 105 and the mobile device 110 does not yet exist, it can be established so that the data connections 150, 155 can be used. The connection can be terminated, for example, if a predetermined distance between the household appliance 105 and the mobile device 110 is exceeded. In one embodiment, a connection is established only if the distance falls below a second threshold. The second threshold can be lower than the first, so that the establishment and termination can occur with a predetermined hysteresis. This prevents erratic connection establishment and termination. In another embodiment, hysteresis can also be provided for the transfer of a connection from one household appliance 105 to another household appliance 105.In yet another embodiment, a checkpoint can be specified that the mobile device 110 must pass before pairing with a household appliance 105 is established. Upon passing a further checkpoint, an existing pairing with an associated household appliance 105 can be terminated.
[0133] In step 710, rule set 335 can be applied to the received output. In particular, it can be checked whether the content of the output, its format, or meta-information generated during transmission permits the output to be made available on the output device 140.
[0134] If it is determined that the output must not be displayed, it can be discarded in step 715. Additionally, the data connection 155 can be terminated or closed. A corresponding input can also be discarded.
[0135] Otherwise, if it was determined in step 710 that the output may be provided on the output device 140, it may be output in step 720.
[0136] Figure 8 A fifth method 800 is shown, which can also run on a household appliance 105 that is coupled to a mobile device 110. In particular, the fifth method 800 can be executed in parallel or concurrently with one of the other described methods.
[0137] In step 805, an input can be captured at the input device 135 of the household appliance 105. In step 810, the rule set 335 can be applied to the captured input. In particular, the content and context of the input can be checked. The input can relate to a mobile device 110, a software component 205, or a user connected to the mobile device 110.
[0138] If it is determined that the input is not permissible due to one of its aspects based on rule set 335, it can be discarded in step 815. Furthermore, a corresponding output, as described above in connection with one of the other procedures, can also be discarded. A data connection 155 to the mobile device 110 can be disconnected or terminated. Otherwise, if it was determined in step 810 that the input is permissible, it can be transmitted to the mobile device 110 in step 820.
[0139] Figure 9 Figure 1 shows a flowchart of a sixth procedure 900. The procedure 900 can be executed across different components, in particular a household appliance 105 and a mobile device 110. By way of example, steps typically assigned to the mobile device 110 are shown in a left area, and steps typically assigned to the household appliance 105 are shown in a right area.
[0140] In step 905, the household appliance 105 can transmit wireless signals, in particular electromagnetic signals, which can be received by the household appliance 910 in step 910. The steps can also be performed in reverse, so that the household appliance 105 transmits signals which the mobile device 110 receives. The transmitting device 105, 110 can transmit the signals like a beacon, so that the receiving device 105, 110 can more accurately determine its distance from the transmitter. The distance can also be determined based on parameters of a physical transmission or a bit transmission between the mobile device 110 and the household appliance 105.
[0141] In step 915, the mobile device 110 can identify the household appliance 105 and, based on a policy, decide whether to communicate with it. The policy can be predefined or downloaded from an external source 112. If communication is to take place, the policy determines which function or app is intended for communication with the household appliance 105. The specified function or app can then be started, or the device can be notified of received information.
[0142] In step 920, the mobile device 110 pairs with the household appliance 105, which performs the pairing in a corresponding step 925. Pairing can include an exchange of transmission parameters, authentication, or verification of the communication partner. Following pairing, information can be easily exchanged, preferably in both directions.
[0143] In step 930, the mobile device 110 can determine its distance to the household appliance 105. This determination can be based, in particular, on parameters underlying the communication, such as an RSS or an SNR. In a further embodiment, the mobile device 110 can also determine its geographic position, optionally using communication parameters. In step 935, the determined distance and / or the determined position can be transmitted to the household appliance 105.
[0144] In step 940, the household appliance 105 determines its distance to the mobile device 110. It can base this determination on a previously received distance specified by the mobile device 110. In one embodiment, the household appliance 105 can determine the distance relative to its own position and to a position of the mobile device 110 that it may have previously received from the mobile device 110. Alternatively, the household appliance 105 can determine the distance based on parameters underlying the communication, as described above, such as an RSS or SNR. In another embodiment, a dedicated sensor is provided for determining the distance. Multiple information sources can also be combined to determine the distance.
[0145] In step 945, the mobile device 105 can transmit an output to the household appliance 105 via the established data connection 150, 155. The household appliance 105 can receive the output in step 950 and process it depending on the specified distance. For example, the size, frequency, color, or orientation of a visual output can be determined based on the distance. The greater the distance, the clearer or more noticeable the output can be. Similarly, the volume or frequency spectrum of an acoustic output can be adjusted based on the distance. The processed output can then be displayed using the output device 140.
[0146] The explanations given with reference to the figures are purely illustrative and not to be understood as limiting. Many modifications can be made to the embodiments shown in the figures without departing from the scope of protection of the invention described herein. In particular, the features of the embodiments can be freely combined with one another to provide further embodiments optimized for the intended application. Reference sign
[0147] 100 System 105 Household appliance 110 Mobile device 112 Central point 115 User 120 Communication device 125 Control device 130 Processing device 135 Input device 140 Output device 142 Sensor 145 Wireless communication device 150 First data connection (input) 155 Second data connection (output) 160 Storage device 205 first display area 210 second display area 215 control element 220 graphical representation 225 text area 305 First software component 310 Second software component 315 First transmission layer 320 Second transmission layer 325 First physical layer 330 Second physical layer 335 Rule set 400 Procedure 405 Determine guideline 410 Pair mobile device with household appliance 415 Determine available sensors 420 Create virtual device 425 Provide virtual device 430 Execute function 435 Configure sensor, provide sensor values 500 Procedure 505 Receive push notification 510 Generate, transmit notification 515 Receive, display notification 520 Determine user input 525 Request content 530 Receive request 535 Transmit message 540 Provide content 600 Procedure 605 Detect mobile device 610 Establish connection for input 615 Establish connection for output 620 Determine distance 625 Input / output local? 630 Detect input 635 Determine assigned mobile device 640 Determine assigned function 645 Provide input 650 Detect output 655 Determine assigned output area 660 Provide output 700 Procedure 705 Receive output 710 Apply rule set 715 Discard output 720 Output 800 Procedure 805 Capture input 810 Apply rule set 815 Reject input 820 Submit input 900 Procedure 905 Send / Receive wireless signals 910 Send / Receive wireless signals 915 Check policy, start app 920 Pair 925 Pair 930 Determine position / distance 935 Transmit position / distance 940 Determine distance 945 Transmit output 950 Deploy output
Claims
1. Method (400; 500), wherein the method (400) comprises the following steps: - wirelessly coupling (410) a household appliance (105) with a mobile device (110); and - providing (425) a sensor (142) of the household appliance (105) as a local appliance of the mobile device (110) for a function that is running on the mobile device (110); in particular an app so that the sensor of the household appliance can be used by the function essentially as if the mobile device comprised the sensor; - wherein the sensor samples an area of the household appliance and provides a sensor value which is transmitted to the mobile device and provided to the function; characterised in that - the function that is running on the mobile device (10) comprises a presentation of a cooking recipe and an output to be provided is transmitted from the mobile device to the household appliance; and - the function that is running on the mobile device (110) is made accessible to a user in parallel with a function of the household appliance on the household appliance.
2. Method (400; 500) according to claim 1, wherein the sensor (142) is provided in dependence upon a predetermined guideline.
3. Method (400; 500) according to claim 2, wherein the provision of the sensor (142) to the function can be controlled by a user (115) of the mobile device (110).
4. Method (400; 500) according to claim 2 or 3, wherein the guideline is obtained from a central point (112).
5. Method (400; 500) according to one of the preceding claims, moreover comprising controlling (435) a sampling criterion of the sensor (142) by the function.
6. Method (400; 500) according to one of the preceding claims, wherein the mobile device (110) receives (505) a message; an indication of the received message is transmitted (510) from the mobile device (110) to the household appliance (105); and the household appliance (105) provides (515) the indication to a user (115).
7. Method (400; 500) according to claim 6, wherein the transmission (510) is performed in dependence upon a predetermined guideline.
8. Method (400; 500) according to claim 6 or 7, wherein a content that is transmitted is adapted (510, 515) in dependence upon a predetermined guideline.
9. Method (400; 500) according to one of claims 6 to 8, wherein the coupling is performed automatically if an indication is to be transmitted.
10. Household appliance (105), comprising: - a sensor (142); - an output apparatus (140); - a communication facility (145) for wireless communication; and - a processing facility (130) that is configured so as to wirelessly couple a mobile device (110) to the household appliance (105) - and to provide a sensor value that is acquired by means of the sensor (142) to the mobile device (110) so that the sensor of the household appliance can be used by a function that is running on the mobile device (110), in particular an app, essentially as if the mobile device comprised the sensor; characterised in that - the communication facility (145) is configured to receive an output to be provided from the mobile device (110); - the output apparatus (140) is divided into areas so that the function that is running on the mobile device (110) is made accessible to a user (115) in parallel with a function of the household appliance on the household appliance, wherein the function that is running on the mobile device (110) comprises a presentation of a cooking recipe; and - the sensor (142) is configured to sample an area of the household appliance and to provide a sensor value which is transmitted to the mobile device (110) and provided to the function.
11. Mobile device (110), comprising: - a communication facility (120) for wireless communication; and - a processing facility that is configured so as to wirelessly couple the mobile device (110) to the household appliance (105) having a sensor (142) - and to provide the sensor (142) as a local appliance to a function that is running on the mobile device (110) so that the sensor of the household appliance can be used by the function, in particular an app, essentially as if the mobile device comprised the sensor, wherein the function that is running on the mobile device (110) comprises a presentation of a cooking recipe; characterised in that - the communication facility (120) is configured to transmit an output to be provided from the mobile device to the household appliance, so that the function that is running on the mobile device (110) can be made accessible to a user in parallel with a function of the household appliance on the household appliance; and - the communication facility (120) is configured to receive a sensor value and to provide the function, wherein the sensor value is sampled by the sensor in an area of the household appliance and is provided.
12. System (100) comprising a household appliance (105) according to claim 10 and a mobile device (110) according to claim 11.