Domestic appliance and method for processing image in domestic appliance
By installing a camera device with dead time on the storage room wall of the household appliance, and generating additional image segments when another trigger signal is received during the dead time, the problem of loss of trigger signal in the dead time in the prior art is solved, and the complete capture and processing of the information of the charge opening area is realized.
Patent Information
- Application Number
- CN202380061014.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-08-22
- Filing Date
- 2023-07-06
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2043-07-06
AI Technical Summary
When existing household appliances generate additional trigger signals during dead time, they cannot effectively capture and process related image clips, resulting in the loss of information in some areas.
A household appliance is designed, equipped with a camera device on the storage room wall, which has a dead time after receiving the trigger signal. If another trigger signal is received within the dead time, additional image segments are generated from the captured image, and only the area showing that the charge opening can be covered by another door.
When another trigger signal is triggered during dead time, an image segment can be generated for the area of the charge opening belonging to the two doors to ensure the integrity and accuracy of the information.
Smart Images

Figure CN119744339A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a household appliance, comprising a storage chamber bounded by a wall having a charging opening, a double door assembly, and a camera device arranged on the wall of the storage chamber, the double door assembly comprising a first door and a second door for closing the charging opening, wherein the household appliance is configured to output a first trigger signal to a data processing device when the first door is closed and to output a second trigger signal to the data processing device when the second door is closed, wherein the camera device is configured to capture an image of the charging opening upon receiving the trigger signal and transmit the image to the data processing device, wherein the camera device has a dead time after receiving the trigger signal, within which the camera device cannot capture another image upon receiving at least one other trigger signal, and wherein the data processing device is configured to generate an image segment from the captured image upon receiving the trigger signal and the image generated in accordance with the triggering of the trigger signal, the image segment only showing the area of the charging opening that can be covered by the door that triggers the trigger signal. The invention also relates to a method for processing images of a charging opening of a storage chamber captured by a camera device of a household appliance with a double door assembly, wherein the camera device has a dead time after receiving a trigger signal, during which the camera device cannot capture further images when receiving at least one further trigger signal, wherein in the method, after triggering the trigger signal, an image segment is generated from the captured image, which image segment only shows the area of the charging opening that can be covered by the door whose movement triggered the trigger signal. The invention can be applied particularly advantageously to household appliances, in particular refrigerators with a double door assembly with "French doors". Background Art
[0002] A household appliance of the type in question has the disadvantage that if a further trigger signal is generated within the dead time, this further trigger signal does not trigger a further image recording and therefore also does not generate a corresponding image segment. For example, if the situation occurs—although rarely—that both doors of a double door arrangement are closed almost simultaneously and triggers trigger signals that occur successively within the dead time, an image segment is only generated for the door whose trigger signal was triggered first. Summary of the invention
[0003] The object of the present invention is to at least partially overcome the disadvantages of the prior art.
[0004] This object is achieved according to the features of the independent claim. Preferred embodiments can be derived in particular from the dependent claims.
[0005] This object is achieved by a domestic appliance, which has:
[0006] - a storage chamber delimited by a wall having a charging opening,
[0007] a double door arrangement having a first door and a second door for closing a charging opening, wherein the household appliance is designed to output a corresponding trigger signal to a data processing device when the doors are closed,
[0008] a camera device arranged on a wall of the storage chamber, which is designed to record an image of the charging opening upon receipt of a trigger signal and transmit it to a data processing device,
[0009] in,
[0010] the camera device has a dead time after receiving the trigger signal, during which the camera device cannot record further images when receiving at least one further trigger signal,
[0011] the data processing device is configured to, upon receiving a trigger signal and an image generated in accordance with the triggering of the trigger signal:
[0012] if no further trigger signal is received within the dead time, an image segment is generated from the recorded image, which image segment shows only that region of the charging opening which can be covered by the door which triggered the trigger signal,
[0013] If a further trigger signal is received within the dead time, a further image segment is additionally generated from the recorded image, which further image segment shows only that region of the charging opening which can be covered or closed by another door.
[0014] This domestic appliance has the advantage that when a further trigger signal is triggered within the dead time, an image segment can be generated for the region of the charging opening that belongs to both doors, even though only one image is recorded, namely when the first trigger signal in time is triggered.
[0015] It is particularly advantageous if the data processing device is designed, for example programmed, to generate an image segment for each image generated based on a trigger signal triggered by a movement of one of the doors. This embodiment can be advantageous, for example, in order to be able to display the inside of the corresponding door particularly large on a display device with a limited display surface. It is thus also possible to always use the same image format here.
[0016] The data processing device can be a control device for the domestic appliance and, in one embodiment, can be used to control the camera device. In one embodiment, the data processing device is designed exclusively as a camera control device.
[0017] The household appliance may be a refrigerator, a freezer or a combination thereof. The storage compartment is used to store items, especially items that need to be refrigerated. In addition, the household appliance may be an oven, a cooking stove or a dishwasher. The storage compartment of the oven is used to heat items, the storage compartment of the cooking stove is used to cook items, and the storage compartment of the dishwasher is used to rinse or wash dishes.
[0018] The wall of the storage compartment can also be referred to as an "inner liner". The storage compartment can have one or more shelf compartments and possibly also one or more drawer compartments, which are used, for example, to accommodate drawers, which are used, for example, for special climate zones. In particular, the loading opening is a front loading opening.
[0019] One development is that the double door assembly is a so-called "French door" assembly in which the two doors are pivotable about a vertical axis and, in a front view of the household appliance, the left door is attached to the body of the household appliance by its left side and the right door is attached to the body by its right side. One development is that the two doors have the same width so that they meet in the center of the storage compartment in the closed state.
[0020] As is common in many refrigeration appliances, in particular refrigerators, the inner side of the door, which faces the storage compartment when the door is closed, is provided for storing storage items, for example by means of storage shelves for bottles, butter, eggs or the like.
[0021] Outputting a corresponding trigger signal to the data processing device when closing the door particularly includes triggering the trigger signal during the closing process of the door, particularly when a predefined opening angle is reached or falls below. An opening angle of zero can correspond to a closed door.
[0022] The camera device comprises at least one image acquisition sensor, in particular a digital image acquisition sensor, and possibly also evaluation electronics and / or image processing electronics. The camera device can be part of a camera module. In one embodiment, the camera module also has further functional units, such as an optical flash.
[0023] Arranging the camera device on the wall of the storage room can include arranging the camera device on the ceiling, side wall or bottom of the storage room. With this arrangement, a field of view is generated for the camera device, which is directed outward through the loading opening. In other words, the camera device captures images through the loading opening in an outward direction. As a result, the camera device can capture images of the inside of the door and is also specially designed for this purpose. That is, the camera device is particularly located in the area inside the storage room and is directed outward from the storage room.
[0024] The camera device is arranged (i.e. set up and disposed) for recording an image of the charging opening, in particular, that the field of view of the camera device is so large that the charging opening is at least largely, in particular completely, located within the field of view, so that the image images or shows the charging opening largely, in particular completely. The charging opening is at least largely located within the field of view, in particular, that the image recorded by the camera device shows a region of the charging opening that is free of an upper edge and / or a lower edge of no more than 5% of the height of the charging opening and / or a left edge and / or a right edge of no more than 5% of the width of the charging opening. In one embodiment, the camera device has a wide-angle lens or a fisheye lens connected upstream of the image sensor.
[0025] The camera device has a dead time after receiving the trigger signal, during which the camera device cannot capture a further image when receiving at least one further trigger signal, including, if the camera device performs image capture upon receipt of a first trigger signal, a dead time (duration) during which the camera device does not perform a further image capture when receiving a further trigger signal. This can be caused, for example, by the camera device requiring a certain duration for image capture and possible image storage, image processing and / or image transmission, which duration must expire before the camera device is ready to capture a further image.
[0026] A kind of expansion scheme is that the trigger signal is transmitted to the camera device and the data processing device simultaneously.In this case, typically, the data processing device first receives the trigger signal and thereafter receives the image produced when the trigger signal is triggered very soon.
[0027] A kind of expansion scheme is that the data processing device can distinguish the received trigger signal, that is, can identify which door is triggered by closing the trigger signal. For example, this can be achieved in the following way: the trigger signal for the two doors is input on different ports or attachment ends of the data processing device.
[0028] One extension is that the data processing device can assign the received image to a certain trigger signal. This can be achieved, for example, by assuming that the image was taken based on the trigger signal if the image is received within a certain delay time relative to the trigger signal. It is thus also known based on which door movement the image was taken. Another possibility is that the transmitted image includes the information based on which trigger signal the image was taken (i.e., by which door the trigger signal was triggered).
[0029] If no further trigger signal is received within the dead time, only an image detail is generated from the recorded image, which shows only that region of the charging opening which can be covered by the door which triggered the trigger signal.
[0030] The captured image shows both doors. The inner side of the door that triggered the trigger signal (usually still slightly tilted and not yet closed) and the stored items placed therein can be seen almost completely. For example, the other door that did not trigger a trigger signal within the dead time can be closed (wherein the image capture of the culinary items placed in this door is not relevant), can still be open, or, although also closed, is still significantly more open than the door that triggered the trigger signal (wherein the stored items can only be seen less clearly or not at all in the captured image). The user is usually only interested in the image of the inner side of this door, so the following image segment is generated: this image segment only shows the inner side of this door, and does not also show the other door.
[0031] If, however, another trigger signal is received within the dead time, this can reflect the situation where both doors or door leaves are closed at approximately the same time. Advantageously, the image sections of both doors are then available, for example, for automatic object analysis and possible subsequent inventory management and / or for viewing by a user.
[0032] In this case, a further image segment is generated from the recorded image generated only by the first trigger signal in time, which shows only that region of the charging opening which can be covered by the other door which has generated the trigger signal later in time and therefore shows the inner side of the other door. In this case, use is made of the fact that although only the inner side of the door which has generated the first trigger signal in time is shown in the image in the optimal or "ideal" position, due to the usually short temporal interval between the two trigger signals, the inner side of the door which has generated the second subsequent trigger signal is also shown in the image in a position which is sufficiently suitable, for example for evaluation and / or observation purposes.
[0033] In one embodiment, the data processing device is designed to copy the recorded image and to generate an image segment from the copied image, which image segment only shows that region of the loading opening which can be covered by the other door, if a further trigger signal is received within the dead time. This achieves the advantage that the data processing device can be programmed particularly easily, since practically the same operating routine can be used, for example, with regard to the generation of the first image segment, which is identical to the case without a further trigger signal within the dead time, and with regard to the generation of the second image segment, the difference is only due to a previous simple copying process and the information that the trigger signal generated by the other door is assigned to the copied image.
[0034] In one embodiment, the data processing device is designed to buffer the recorded images until the dead time has expired and only then to generate the at least one image segment. This achieves the advantage of a particularly simple implementation. In this case, use is made of the fact that for the purposes of image evaluation and image observation, a delay in the generation of the at least one image segment in the order of magnitude of the dead time is practically insignificant.
[0035] In one embodiment, if a trigger signal is received by the data processing device that is triggered by one of the doors and a trigger signal is received by the other of the doors within a dead time, the data processing device is configured to generate a further image segment from the recorded image, which further image segment only shows the region of the charging opening that can be covered by the other door. In other words, in this embodiment, the further image segment is only generated if the further (second) trigger signal received within the dead time is triggered by a different door movement than the previous (first) trigger signal. In this way, it is advantageously avoided that the image segment is generated by two trigger signals being triggered by the same door (movement).
[0036] One embodiment is that the further trigger signal is a trigger signal generated by the first gate or the second gate. Advantageously, this can be implemented particularly easily. In this case, in the case of a further trigger signal, it is not determined by which gate the further trigger signal was triggered. It is assumed that it is extremely unlikely that multiple trigger signals are triggered consecutively by the same gate (movement) within the dead time.
[0037] In one embodiment, the data processing device is set up to transmit at least one image segment to at least one display device. The following advantages are achieved in this way: the user can observe the stored items placed on the inner side of the door. In particular, the image segment can also be stored, in particular, at least the image segment is stored until a new image segment belonging to the door is generated. An extension scheme is that at least one display device includes a display device integrated into the household appliance, such as a screen, in particular a touch-sensitive screen ("touch screen (English: Touchscreen)"). An extension scheme is that at least one display device is a display device of an external entity of the appliance. Advantageously, this enables the user to observe the stored items imaged in the image segment when away from the household appliance, for example, when purchasing. In this case, the household appliance can be equipped with a communication device (such as a Bluetooth module, a WLAN module, and / or an Ethernet module, etc.), and the household appliance can exchange data with an external entity via the communication device. The external entity of the appliance is, for example, a user terminal, in particular a mobile user terminal, such as a smart phone or a tablet computer.
[0038] One embodiment is that at least one image segment is stored, for example, for retrieval by a user when required. Another embodiment is that at least one image segment is stored until it is replaced by a newer image segment for the same door.
[0039] One configuration is to arrange the camera device on the ceiling of the storage chamber wall. Advantageously, this enables a particularly clear view of the charging opening and therefore of the inner side of the door.
[0040] In one embodiment, the doors have the same width (in the closed state in the front view), in which case the camera device is arranged centrally on the ceiling of the storage compartment wall. Advantageously, this enables the camera device to see both doors or both halves of the loading opening equally clearly. In particular, in the case of doors of equal width, one image segment can correspond to one of the halves of the loading opening, and in the case of doors of uneven width, an image segment can correspond to a correspondingly unevenly wide side section of the loading opening.
[0041] In one embodiment, the dead time is no longer than 40 ms, in particular no longer than 20 ms. This achieves the advantage that for analysis and / or observation purposes, the inner side of the door whose movement triggered the trigger signal received during the dead time is always shown in the image in a very well-suited position.
[0042] In one embodiment, the trigger signal is triggered if a predetermined opening angle of the door is reached or falls below during the closing process of the door. This achieves the following advantage: the inside of the door can be recorded in a defined, particularly suitable position, more precisely in the following important relevant situation: the door has been previously opened and storage items stored on the inside of the door may have been removed and / or added.
[0043] One embodiment is that the predefined opening angle is in the range between 3° and 10°. This results in a good compromise between advantageous, largely frontal image recording and sufficient illumination.
[0044] One extension is that the trigger signal is generated by means of a trigger device, which is configured to trigger the trigger signal if a predetermined opening angle of the door is reached or less than during the closing process of the door. Another extension is that the trigger device generates the trigger signal if at least one condition is additionally met, for example, in addition to reaching or less than a predetermined opening angle, the closing speed of the door is greater than a predetermined threshold value.
[0045] One embodiment is that the triggering device monitors the movement of the two doors. This can be advantageous in order to keep the number of triggering devices small. For example, such a triggering device can be a camera-assisted monitoring device, an ultrasonic monitoring device, a radar monitoring device or a lidar monitoring device, etc.
[0046] One extension is to assign a corresponding trigger device to each of the two doors. This achieves the advantage that the occurrence of the following conditions can be determined particularly accurately and with a low evaluation workload: under which the trigger signal is triggered. One extension is to install the trigger device in the corresponding door.
[0047] In one embodiment, the triggering device is a gyroscopic sensor, in particular, the triggering signal can be triggered by means of a gyroscopic sensor arranged on the corresponding door. Gyroscopic sensors have the advantage that they can be compactly and particularly easily assembled and calibrated and can also detect angular changes and angular velocities of the door with high precision.
[0048] In one embodiment, the household appliance has at least one further camera device, which is configured to capture images in the storage room and / or in an open storage room drawer and transmit them to a data processing device. For example, the at least one further camera device may be a camera device arranged on at least one door, which is configured to capture at least one image in the storage room. Additionally or alternatively, the at least one further camera device may include a camera device that is configured to capture at least one image in an open storage room drawer. For example, the camera device may be arranged on the ceiling of a storage room wall, in particular in a common module together with a camera device that is configured to perform the above method.
[0049] The object is also achieved by a method for processing images of a charging opening of a storage compartment recorded by a camera device of a household appliance with a double door arrangement, wherein the camera device has a dead time after receiving a trigger signal, during which the camera device cannot record further images when receiving at least one further trigger signal, wherein in the method
[0050] - if after a trigger signal has been triggered by one of the doors of the double door arrangement, no further trigger signal has been triggered within the associated dead time, an image segment is generated from the recorded image, which image segment shows only that region of the charging opening which can be covered by the door whose movement triggered the trigger signal,
[0051] If a further trigger signal is received within the dead time, a further image segment is additionally generated from the recorded image, which shows only that region of the charging opening which can be covered by another door.
[0052] The method can be constructed similarly to a domestic appliance, or vice versa, and has the same advantages. BRIEF DESCRIPTION OF THE DRAWINGS
[0053] The above-mentioned properties, features and advantages of the present invention and the manner in which these properties, features and advantages are achieved will become clearer and more clearly understood with reference to the following exemplary description of the embodiments explained in more detail with reference to the accompanying drawings.
[0054] Figure 1 A schematic diagram of a household appliance with a double door assembly is shown in an oblique front view;
[0055] FIG. 2A to FIG. 2C Roughly shows the process for Figure 1 A possible flow of the method of capturing an image of a household appliance by a camera device; and
[0056] FIG. 3A to FIG. 3F Roughly shows the process for Figure 1 Another possible procedure for the method is to capture an image of a household appliance by a camera device. DETAILED DESCRIPTION
[0057] Figure 1 A schematic diagram of a household appliance is shown from an oblique frontal perspective in the form of a refrigerator 1 with a French door double door assembly 2, 3, which has a first (here on the left) door 2 and a second (here on the right) door 3 in the front view F, both of which are drawn in an open position. In addition, the refrigerator 1 has a storage chamber 5 or a cold storage chamber, which is bounded by a wall 4 and has a front loading opening 6. In the cold storage chamber 5, there are storage shelves 7 and drawers 8 for accommodating stored items. There is also a storage compartment 10 on the inner side 9 of the doors 2, 3. In the front view F, a camera device 12 is arranged centrally on the ceiling 11 of the storage chamber wall 4, which is set up to capture an image of the loading opening 6.
[0058] A triggering device in the form of a gyro sensor 13 is arranged in each of the doors 2, 3. The gyro sensor 13 can detect at least the angular change, the direction of rotation and possibly the angular velocity of the relevant door 2, 3, thereby being able to determine the opening angle of the door 2, 3. In the present case, if the door 2, 3 is closed and reaches or falls below a certain opening angle, for example 3°, a triggering signal is triggered by the gyro sensor 13. The triggering signal is forwarded to the camera device 12 and the data processing device 14. Upon receiving the triggering signal, the camera device 12 is triggered to record an image of the charging opening 6 and transmit it to the data processing device 14.
[0059] The refrigerator 1 can also have further camera devices, for example a camera device 15 present in the doors 2 , 3 , which is provided to record images of the refrigerating chamber 5 and transmit them to the data processing device 14 .
[0060] The data processing device 14 is configured to, upon receiving a trigger signal and triggering the generation of an image B (see Figure 2B ), an image segment BA is generated from the captured image B (see Figure 2C ), which shows the area of the charging opening 6 that can be covered by the door 2, 3 that triggered the trigger signal. That is, if the trigger signal is generated by the left door 2, the image segment BA shows the left half of the charging opening in the front view F or the right half of the charging opening 6 from the perspective of the camera device 12 and thus also the inner side 9 of the door 2. This applies analogously to the right door 3.
[0061] Furthermore, the data processing device 14 is configured to transmit the image segment BA to at least one display device, for example to a screen (not shown) of the refrigerator, or output it to a mobile user terminal, for example a smartphone S, on whose screen T the image segment can be displayed, for example by means of a corresponding application (“App”). To this end, the refrigerator 1 can be equipped with a communication module 16, for example a WLAN module, a Bluetooth module or an Ethernet module.
[0062] FIG. 2A to FIG. 2C A possible sequence of a method for processing images captured by camera device 12 is shown for the case where data processing device 14 receives a trigger signal from gyroscopic sensor 13 of one of doors 2, 3 (here, door 3 by way of example) and receives no further trigger signal within a dead time (e.g. 20 ms) of camera device 12, in particular no further trigger signal from gyroscopic sensor 13 of the other door 3, 2 (here, door 2 by way of example). The dead time corresponds to a time period during which camera device 12 cannot capture further images when receiving at least one further trigger signal.
[0063] Figure 2A Here, loading opening 6 and doors 2 , 3 are shown from the direction of camera device 12 , with left door 2 being more open and right door 3 having reached an opening angle (“triggering angle”) for triggering the trigger signal during the closing movement indicated by the arrow.
[0064] The camera device 12 then records the loading opening 6 at Figure 2B The image B shown in FIG. 1 is obtained and transmitted to the data processing device 14 .
[0065] The data processing device buffers the image B for a duration of at least the dead time ("delay time"). Figure 2C As shown in , if the delay time has expired and no further trigger signal has been received from one of the doors 2, 3, in particular door 2, during the delay time, then in a subsequent step the recorded image B is cropped to an image segment BA which shows only the right half (in the front view) of the charging opening 6 which can be covered by the door 3. This occurs when it is known that the trigger signal has been triggered by the gyro sensor 13 of the right door 3, for example because the image B is received within a certain time period after the trigger signal of the right door 3 is obtained.
[0066] FIG. 3A to FIG. 3F A possible sequence of steps of the method for processing images recorded by the camera device 12 is shown for the case where both doors 2, 3 are closed and reach their respective triggering angles within the dead time, such as Figure 3AAssume, by way of example, that the right door 3 reaches the trigger angle first, and then the left door 2 reaches the trigger angle within a dead time of, for example, 20 ms.
[0067] and Figure 2B Similarly, when the right door 3 reaches the trigger angle, the image B of the loading opening 6 is captured ( Figure 3B ) and transmits it to the data processing device 14. Since the trigger signal generated by the closing movement of the left door 2 is received by the camera device 12 within the dead time, no image is generated by the second trigger signal.
[0068] The data processing device also buffers this image B for the duration of the delay time and monitors whether the second trigger signal is received within the dead time, which is the case here. Figure 3C The captured image B shown in FIG. 1 is copied and cached Figure 3D The reproduced image K shown in .
[0069] and Figure 2C Similarly, the data processing device 14 now generates from the image B Figure 3E The image segment BA shown in FIG. 1 shows the right half (in the front view) of the charging opening 6 and is generated from the copied image K. Figure 3F The image segment BA-K shown in FIG. 1 shows the left half (in the front view) of the loading opening 6 which can be covered or closed by the right door 2. The two image segments BA and BA-K can be transmitted to at least one display device T and / or can be stored for retrieval, for example by a user.
[0070] Of course, the invention is not limited to the exemplary embodiments shown.
[0071] Generally speaking, “a”, “an” etc. can be understood as singular or plural, especially in the sense of “at least one” or “one or more” etc. can be understood as singular or plural, as long as this is not explicitly excluded, for example by the expression “exactly one”.
[0072] Numerical specifications may also include exactly the specified number and also the customary tolerance ranges, unless this is explicitly excluded.
[0073] Reference numerals list
[0074] 1 Refrigerator
[0075] 2Left door
[0076] 3Right door
[0077] 4Wall
[0078] 5Storage Room
[0079] 6 Loading opening
[0080] 7 Storage racks
[0081] 8 drawers
[0082] 9Inside of the door
[0083] 10 Storage compartments
[0084] 11Wall Ceiling
[0085] 12 Camera Device
[0086] 13 Gyroscope sensor
[0087] 14 Data processing device
[0088] 15 Camera Device
[0089] 16 Communication Module
[0090] B-picture
[0091] BA image fragment
[0092] BA-K image clip
[0093] FFront view
[0094] K Copied image
[0095] S smartphone
[0096] T-Screen
Claims
1. A household appliance (1), comprising: a storage chamber (5) delimited by a wall (4) having a charging opening (6), - a double door assembly (2, 3) comprising a first door (2) and a second door (3) for closing the charging opening (6), wherein: The household appliance (1) is configured to output a corresponding trigger signal to a data processing device (14) when the doors (2, 3) are closed. a camera device (12) arranged on the wall (4) of the storage chamber (5), which is designed to record an image (B) of the charging opening (6) upon receipt of a trigger signal and to transmit the image to a data processing device (14), in, the camera device (12) has a dead time after receiving the trigger signal, during which the camera device cannot record a further image (B) when receiving at least one further trigger signal, The data processing device (14) is configured to, upon receiving a trigger signal and the image (B) generated in response to the trigger signal: - if no further trigger signal is received within the dead time, an image segment (BA) is generated from the recorded image (B), which image segment shows only that region of the charging opening (6) which can be covered by the door (2, 3) which triggered the trigger signal, If a further trigger signal is received within the dead time, a further image segment (BA-K) is additionally generated from the recorded image (B), which shows only that region of the loading opening (6) which can be covered by another door (3, 2).
2. The household appliance (1) according to claim 1, wherein: The data processing device (14) is designed to copy the recorded image (B) and to generate an image segment (BA-K) from the copied image (K), which shows only that area of the loading opening (6) which can be covered by another door (3, 2), if the further trigger signal is received within the dead time.
3. The household appliance (1) according to claim 2, wherein: The data processing device (14) is designed to buffer the recorded image (B) until the dead time has expired and only then to generate at least one image segment (BA, BA-K).
4. The household appliance (1) according to any one of the preceding claims, wherein: The data processing device (14) is configured to generate a further image segment (BA-K) from the recorded image (B), if a trigger signal is received by the data processing device which is triggered by one of the doors (2, 3) and a trigger signal is received by the other of the doors (3, 2) within the dead time, the further image segment only showing that area of the charging opening (6) which can be covered by the other of the doors (3, 2).
5. The household appliance (1) according to any one of claims 1 to 3, wherein: The other trigger signal is a trigger signal generated by the first gate (2) or the second gate (3).
6. The household appliance (1) according to any one of the preceding claims, wherein: The data processing device (14) is designed to transmit the at least one image segment (BA, BA-K) to at least one display device (S, T).
7. The household appliance (1) according to any one of the preceding claims, wherein: The camera device (12) is arranged on the ceiling (11) of the storage room wall (4).
8. The household appliance (1) according to claim 7, wherein: The doors (2, 3) have the same width and in the front view (F) the camera device (12) is arranged centrally on the ceiling (11) of the storage compartment wall (4).
9. The household appliance (1) according to any one of the preceding claims, wherein: The dead time is not longer than 40 ms, in particular not longer than 20 ms.
10. The household appliance (1) according to any one of the preceding claims, wherein: If a predetermined opening angle of the doors (2, 3) is reached or falls below during the closing process of the doors (2, 3), the trigger signal can be triggered by means of a gyroscopic sensor (13) arranged on the respective door (2, 3).
11. The household appliance (1) according to any one of the preceding claims, wherein: The household appliance (1) has a further camera device (15) which is designed to record images in the storage compartment (5) and / or in an open storage compartment drawer and to transmit the images to the data processing device (14).
12. Method for processing an image (B) of a charging opening (6) of a storage chamber (5) recorded by a camera device (12) of a household appliance (1) with a double door assembly (2, 3), wherein: The camera device (12) has a dead time after receiving a trigger signal, during which the camera device cannot capture a further image (B) when receiving at least one further trigger signal, wherein in the method - if after a trigger signal has been triggered by one of the doors (2, 3) of the double door arrangement (2, 3) no further trigger signal has been triggered within the associated dead time, an image segment (BA) is generated from the recorded image (B) which shows only that region of the charging opening (6) which can be covered by the door (2, 3) whose movement triggered the trigger signal, If a further trigger signal is received within the dead time, a further image segment (BA-K) is additionally generated from the recorded image (B), which shows only that region of the loading opening (6) which can be covered by another door (3, 2).
Citation Information
Patent Citations
Refrigerator and control method for the same
CN105008833A
Refrigeration appliance comprising a camera module
CN105358924A
Side by side refrigerator with camera device
CN105972908A
Refrigerator and method for judging change of objects in object storage area of refrigerator
CN106052294A
Refrigerator, control method for photographing device of refrigerator and food recognition method and system
CN106989562A