Managing an inventory of a domestic appliance

Abstract

A household appliance (110) comprises a wireless communication device (205) configured to transmit and receive a radio signal; a processing device (220) for controlling the communication device (205) to transmit a radio signal to a predetermined area of ​​the household appliance (110) and to receive a radio signal reflected by an object (125) in that area. A detection device (225) is also provided to detect a predetermined object (125) based on the transmitted and received signals.

Description

[0001] The present invention relates to the management of a household inventory. In particular, the invention relates to the recognition of an object in the household.

[0002] A household may keep a number of items in stock that are necessary to provide for the needs of the people living there. For example, these items may include food, especially ingredients for meals and beverages. Typically, an attempt is made to maintain a predetermined basic stock of such items. When an item is used up, it can be replaced with a new one. For special occasions, such as when a particular dish is to be cooked, special items required for that purpose can be brought into the household.

[0003] For example, if a dish is to be prepared according to a predetermined recipe, it is important to ensure that all the necessary items are present in the household. It is often difficult for a user to keep track of which items are actually in the household and which are not. If a required item is missing, the dish cannot be prepared. If the item is brought into the household on suspicion, this can lead to overstocking, which can cause the item to spoil.

[0004] It has been proposed to automatically maintain a household food inventory. This could involve tracking items brought into the household, those removed from it, or those consumed there. However, it has been shown that tracking items within the household can be difficult. If an item is not properly tracked, an inventory list may not match the actual inventory.

[0005] The present invention is based on the object of providing an improved technique for determining whether a particular object is present in a household or not. The invention achieves this object by means of the subject matter of the independent claims. Subclaims specify preferred embodiments.

[0006] According to a first aspect of the present invention, a household appliance comprises a wireless communication device configured to transmit a radio signal and receive a radio signal; further comprising a processing device for controlling the communication device to transmit a radio signal into a predetermined area of ​​the household appliance and to receive a radio signal reflected by an object in the area. Furthermore, a detection device is provided to detect a predetermined object based on the transmitted and received signals.

[0007] The communication device can use a radio signal with a frequency that can partially penetrate the object or a surrounding object. A frequency of the radio signal can be in a radar band. Thus, a radar imaging method can be used to detect the object. An image of the object can be generated. The communication device can thus be provided with an additional benefit. The communication capability of the communication device may not be impaired by the described radiometric imaging of the object. It is preferred that the communication device be alternatively controlled to scan the object or to conduct a communication.

[0008] The household appliance may further comprise a modulator for modulating data into a transmitted radio signal and a demodulator for demodulating data from a received radio signal. Data can be modulated onto the radio signal in any desired manner, for example, using channel coding or non-orthogonal waves. High-bandwidth data transmission can be achieved in a frequency range that allows detection of the object.

[0009] It is particularly preferred that the processing device is configured to transmit an indication of a detected object to an external device. In a first phase, the processing device can control the scanning or detection of the object; in a second phase, a result of the processing can be transmitted to the external device. Thus, the household appliance can report the presence of the detected object to an external location. Similarly, the household appliance can report if the object has been removed.

[0010] In a further embodiment, several of the described communication devices are provided at different locations on the household appliance. In other words, a transmitting device and a receiving device can use different antennas, which can be provided at different locations on the household appliance. This allows for improved analysis of the object's transmissive properties with respect to the radio signal. More than two communication devices can also be provided, so that different configurations of transmitter and receiver can be controlled to scan the object. Figuratively speaking, the object can be scanned from different perspectives in this way.

[0011] Preferably, the communication device is configured to operate with radio signals with a frequency of more than approximately 60 GHz. The bandwidth of the radio signal may exceed approximately 500 MHz. Such sampling can be referred to as broadband or ultra-broadband sampling. The frequencies used are relatively high and can enable both high-resolution sampling and good data transmission.

[0012] In a particularly preferred embodiment, the communication device is configured to operate according to the 6G mobile communications standard. Communication can, for example, take place directly with another 6G-compatible communication device. Alternatively, data can be transmitted to a base station. The base station can be part of the household or located outside the household. It is particularly preferred that millimeter wave frequency range 2, which can be in a range from approximately 24 GHz to approximately 71 GHz, is used to scan the object. This range is also called FR2. In addition, scanning can be carried out using THz frequencies or frequencies in a range from approximately 7 to approximately 24 GHz, which are often referred to as FR3. Communication with an external location can take place on any 6G-compatible frequency.

[0013] It is particularly preferred that the object comprises a food item. The food item can be unpackaged and comprise, for example, a fruit or a vegetable. The object can also be packaged, for example, in a cup, a bottle, or sealed in plastic. The object can behave reflectively (reflecting), transmissively (transmitting), absorptively (absorbing), or dispersively (scattering) with respect to the radio signal. Combinations are also possible. Different parts of the radio signal can overlap. The communication device can be configured to detect and analyze superimposed radio signals (multipath). In one embodiment, the communication device is configured to specifically exploit multipath to improve data communication. Associated technical capabilities can be utilized to evaluate the received radio signal.Certain objects can be partially penetrated by the radio signal, allowing an indication of the contents of a package to be determined. For example, a carton of milk can be partially penetrated by the radio signal, allowing the liquid level of the milk in the package to be determined.

[0014] The household appliance further preferably comprises an interior space for accommodating objects. The household appliance may, in particular, comprise a storage cabinet or a drying cabinet. In one embodiment, a piece of storage furniture with an interior space can become a household appliance described herein by being equipped with a communication device described herein, a processing device described herein, and a detection device described herein.

[0015] In a particularly preferred embodiment, the household appliance comprises a refrigeration appliance. The refrigeration appliance can, for example, comprise a refrigerator, a freezer, a freezer chest, or a freezer compartment. These household appliances are particularly designed for medium- or long-term food storage. A significant portion of the food inventory to be kept in a household can be located in such an appliance.

[0016] The household appliance can be configured to detect an object placed in the interior and to control a cooling unit depending on the object. The cooling unit can, in particular, comprise a cooling compressor, the operation of which removes heat from the interior of the cooling device. An object placed in the interior can thus be cooled promptly. The shelf life of the object can be increased. Cooling can occur depending on the detected object. For example, fish or ice cream can be cooled particularly quickly, while soup, vegetables, or fruit can be cooled less quickly. The cooling unit can be controlled depending on a parameter detected on the object. The parameter can, for example, include a temperature, a mass, a fill level, a thermal capacity, or a perishability.

[0017] A further aspect of the present invention relates to the use of a wireless communication device according to the 6G standard for detecting an object in a predetermined area of ​​a household appliance. The communication device can be embodied, for example, as a radio module that can be intended for stationary installation on a device or facility. The communication device is preferably configured to transmit data to an external location; data relating to a detected object can be transmitted via the communication device.

[0018] According to yet another aspect of the present invention, a system comprises a household appliance described herein and a further communication device. The further communication device is preferably constructed in the same way as the communication device comprised by the household appliance. The communication devices can be controlled to cooperatively determine the object. In another embodiment, the further communication device can be equipped with a further processing device and a further recognition device. The object can be individually recognized multiple times in the system. Individual recognitions of the object can be communicated so that, for example, a path of the object through a household in which the household appliance is installed can be traced. The further communication device can be standalone or installed in another household appliance.In another variant, the system comprises several household appliances described herein.

[0019] The system can be configured to maintain an inventory of identifiable objects in a household. A number of identifiable objects can be predetermined and preferably relate to foodstuffs. The addition, movement, consumption, or removal of an object into the household can be monitored. Information regarding recognized objects can be processed centrally or decentrally. This allows the inventory to be maintained with improved speed and accuracy. In this way, it can be determined very quickly whether, for example, a predetermined foodstuff is present in the household in the desired quantity or not. This information can be useful, for example, when a predetermined dish is to be prepared which requires the processing of various foods. A stock of food in the household can be maintained more effectively.This can prevent spoilage of an item that is stored in excessive quantities, and it can also prevent the household from having less of the item than necessary.

[0020] According to yet another aspect of the present invention, a method for detecting an object in a predetermined area of ​​a household appliance comprises the steps of transmitting a radio signal into the predetermined area; receiving a radio signal reflected by an object in the area; and detecting the object based on the transmitted and received signals.

[0021] It is further preferred that the radio signal be modulated to transmit an indication of a detected object. This allows for a two-phase operation, in which the object is first scanned and detected using radio signals, and the result of the detection can be transmitted to an external location.

[0022] A method described herein can run partially or completely on a processing device that may be included in a household appliance described herein. For this purpose, the processing device can be implemented electronically and, for example, comprise a programmable microcomputer or microcontroller. The method can be in the form of a computer program product with program code means. The computer program product can also be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device, and vice versa.

[0023] Non-limiting embodiments of the invention will now be described in more detail with reference to the accompanying figures, in which: Figure 1 shows a system in a household; Figure 2 shows a radio unit with an object; and Figure 3 shows a flowchart of a method represent.

[0024] Figure 1 shows a system 100 in a household 105. A household appliance 110, exemplified as a refrigerator, is provided in the household 105. At least one radio unit 115 is provided on the household appliance 110. The household 105 may also include several such household appliances 110. Furthermore, one or more additional radio units 115 may be installed at different locations in the household 105.

[0025] Furthermore, an external location 120 may be provided, which may be located inside or outside the household 105. A radio unit 115 may communicate with the external location 120. The external location 120 may be configured to maintain an inventory of items located in the household 105.

[0026] A radio unit 115 is configured for wireless communication. Each radio unit 115 can communicate with another radio unit 115 and / or the external location 120. High-frequency radio signals, whose wavelengths can be in the millimeter range or even lower, can be used for communication. It is proposed to control a radio unit 115 to detect, by means of transmitted or received radio signals, an object 125 that may be located in the household 105 and, in particular, in a predetermined area of ​​the household appliance 110. The object 125 preferably comprises a food item, which may be packaged or unpackaged.

[0027] In one embodiment, an object 125 that has been added to a cooling device 110 can be detected. A cooling unit 130 of the cooling device 110, which is configured to dissipate heat from an interior of the cooling device 110, can be controlled depending on a detected object 125. In particular, the cooling unit 130 can be controlled to cool the interior more intensively after a still relatively warm object 125 has been inserted.

[0028] Multiple items 125 in the interior of the refrigerator 110 can be detected by one or more radio units 115. An inventory of items 125 located in the household 105 can include a number of predetermined items 125 that can be detected by a radio unit 115. For an item 125, a predetermined quantity can be specified which should preferably be present in the household 105. The actual quantity of an item 125 present in the household 105 can be determined based on scans of one or more items 125. For example, a shopping or order list can be automatically created to supplement missing items 125 in the household 105.

[0029] Figure 2shows a schematic of a radio unit 115 and an object 125. The radio unit 115 includes a wireless communication device 205, which includes a transmitter 210 and a receiver 215, a processing device 220, and a detection device 225. A modulator 230 and a demodulator 235 may also be provided. The modulator 230 and the demodulator 235 may also be included in the communication device 205.

[0030] The processing device 220 is configured to control the communication device 205. If, for example, data is to be transmitted to an external location 120, the data can be modulated by the modulator 230 and transmitted by the transmitter 210. If data is to be received, it can be captured by the receiver 215 and demodulated by the demodulator 235.

[0031] The processing device 220 can control certain aspects of the transmission and / or reception of radio signals. For example, the transmitter 210 or the receiver 215 can comprise multiple MIMO antennas. By appropriate control, a transmission or reception direction of the antennas can be adjusted. A transmission power, a transmission frequency, a modulation, or a demodulation can also be controlled, for example.

[0032] It is proposed that the processing device 220 control the communication device 205 such that the object 125 is scanned using radio signals. For this purpose, a radio signal can be transmitted from the transmitter 210 in the direction of the object 125, the object 125 can reflect part of the radio signal, and a reflected portion can be received by the receiver 215. The radio signal can have a relatively large bandwidth, so that it includes components of very different frequencies. The different frequencies can be influenced differently by the object 125. Based on the transmitted and received signals, the object 125 can be detected by the detection device 225. The detection device 225 can operate according to any desired technology.Preferably, the recognition device 225 comprises a machine learning technique, in particular an artificial neural network (ANN) that is trained to recognize one or more predetermined objects 125.

[0033] The scanning may be imaging, and the transmitter 210 and receiver 215 may be controlled to determine an image of the object 125 based on the received frequencies of the radio signal. Such an image is not provided as a visual representation of the object 125, but rather as a two-dimensional representation of its behavior with respect to a radio signal of a predetermined frequency. The provided image may therefore include information other than visual.

[0034] The object 125 can not only reflect or absorb a radio signal, but also transmit it. The object 125 can then be transmissive with respect to the radio signal. Furthermore, the object 125 can scatter a radio signal. Typically, the object 125 combines reflective, absorptive, transmissive, and dispersive properties. The object 125 can also be examined using multiple radio units 115. In the illustration of Figure 2 Another radio unit 115 is arranged opposite the transmitter 210 with respect to the object 125. This allows for an improved determination of the transmissive or absorptive behavior of the object 125. If the transmitter 210 and the receiver 215 are located essentially on the same side of the object 125, its reflective or dispersive properties with respect to the radio signal can be examined.

[0035] To detect the object 125, received radio signals from different radio units 115 can be collected at one location and provided as input to a single detection device 225. Alternatively, multiple detection devices 225 can be operated, and their results can be compared with each other.

[0036] Figure 3 shows an exemplary flowchart of a method 300 for detecting an object 125 according to a technique proposed herein.

[0037] In step 305, a predetermined event can be detected. For example, if the invention is implemented on a refrigerator 110 with an interior in which an object 125 can be located, the event can include the opening of an appliance door or lid. The event can generally indicate that the location or presence of an object 125 in the household 105 has changed.

[0038] In a step 310, a radio signal can be transmitted into a predetermined area. Using the example of the refrigerator 110, the radio signal can be transmitted from a predetermined direction into the interior of the refrigerator 110. In the case of a freestanding radio unit 115, for example, the signal can be transmitted into an environment.

[0039] In a step 315, a radio signal that has been reflected by the object 125 can be detected. This means that a radio signal that is generated when the transmitted radio signal hits the object 125 is evaluated. The received radio signal can also include an indication of an absorbed, scattered, or transmitted portion of a radio signal.

[0040] In a step 320, the object 125 can be recognized based on the received radio signal. If multiple receivers 215 are provided that can receive a previously transmitted radio signal, the received signals can be jointly evaluated to recognize the object 125. For this purpose, it may be necessary to transmit measured values ​​relating to a received radio signal between different radio units 115. The transmission can be carried out using a similar radio signal from a transmitter 210 of a first radio unit 115 to a receiver 215 of a second radio unit 115. In another embodiment, different radio units 115 can each individually perform a recognition of the object 125, wherein processing results can optionally be exchanged between the radio units 115 by transmitting corresponding data in the same manner.

[0041] In a step 325, a change regarding the item 125 may be determined on a radio unit 115. The change may include moving, adding, or removing the item 125. In another embodiment, the addition or removal of a portion of the contents of the item 125 may also be detected.

[0042] In a step 330, an inventory that records how many or what quantities of each item 125 are present in the household 105 for a number of predetermined items 125 can be updated or adjusted with respect to the determined change. The inventory can then reflect the stock levels of the predetermined items 125 in an improved manner.

[0043] In a further embodiment relating to a cooling device 110, the cooling unit 130 can be controlled depending on the specific object 125. If it has been determined that an object 125 or a part thereof has been newly added to the interior of the cooling device 110, the cooling unit 130 can be controlled to increase its cooling capacity to improve cooling of the interior. A temperature increase on other objects 125 already located in the cooling device 110 can thereby be reduced or prevented. Reference symbol

[0044] 100System 105Household 110Household appliance 115Radio unit 120External location 125Object 130Cooling unit 205 wireless communication device 210 transmitter 215 receiver 220 processing device 225 detection device 230 modulator 235 demodulator 300Procedure 305Detect event 310Send signal 315Detect reflection 320Detect object 325Determine change 330Reconcile inventory 335Control cooling unit

Claims

1. A household appliance (110), comprising: - a wireless communication device (205) configured to transmit a radio signal; and to receive a radio signal; - a processing device (220) for controlling the communication device (205) to transmit a radio signal into a predetermined area of ​​the household appliance (110); and to receive a radio signal reflected by an object (125) in the area; and - a recognition device (225) for recognizing a predetermined object (125) based on the transmitted and received signals.

2. The household appliance (110) of claim 1, further comprising a modulator (230) for modulating data into a transmitted radio signal; and a demodulator (235) for demodulating data from a received radio signal.

3. Household appliance (110) according to claim 2, wherein the processing device (220) is configured to transmit an indication of a recognized object (125) to an external device.

4. Household appliance (110) according to one of the preceding claims, wherein a plurality of communication devices (205) are provided at different locations on the household appliance (110).

5. Household appliance (110) according to one of the preceding claims, wherein the communication device (205) is configured to operate with radio signals having a frequency of more than approximately 60 GHz.

6. Household appliance (110) according to one of the preceding claims, wherein the communication device (205) is configured to operate according to the 6G mobile radio standard.

7. Household appliance (110) according to one of the preceding claims, wherein the object (125) comprises a food item.

8. Household appliance (110) according to one of the preceding claims, wherein the household appliance (110) comprises an interior space for receiving objects (125).

9. Household appliance (110) according to claim 8, wherein the household appliance (110) comprises a refrigerator.

10. The household appliance (110) according to claim 9, wherein the household appliance (110) is configured to determine an object (125) added to the interior; and to control a cooling unit (130) depending on the object (125).

11. Use of a wireless communication device (205) according to the 6G standard for detecting an object (125) in a predetermined area of ​​a household appliance (110).

12. System (100) comprising a household appliance (110) according to one of the preceding claims and a further communication device (205).

13. The system (100) of claim 12, wherein the system (100) is configured to maintain an inventory of identifiable objects (125) in a household (105).

14. A method (300) for detecting an object (125) in a predetermined area of ​​a household appliance (110), the method (300) comprising the following steps: - transmitting (310) a radio signal into the predetermined area; - receiving (315) a radio signal reflected by an object (125) in the area; and - detecting (320) the object (125) based on the transmitted and received signals.

15. The method (300) of claim 14, wherein the radio signal is modulated to transmit an indication of the detected object (125).

Images