Household appliance and method for processing an image in a household appliance

By incorporating a dead-time mechanism between a camera and a data processing unit in a household appliance, the problem of inaccurate image segments within the dead time is solved, enabling clear visualization of the inner side of each door in a dual-door assembly, supporting automatic analysis and user observation.

CN119744339BActive Publication Date: 2026-03-17BSH HAUSGERATE GMBH
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-06
Publication Date
2026-03-17

AI Technical Summary

Technical Problem

The trigger signal generated by existing household appliances during the dead time cannot trigger image capture, resulting in inaccurate image fragments, especially when the doors of a double-door assembly are closed simultaneously, only an image fragment of one door is generated.

Method used

The camera device installed in the household appliance has a dead time after receiving a trigger signal. During the dead time, the data processing device generates an image segment based on the trigger signal, ensuring that the image segment only shows the area covered by the triggered door. When another trigger signal is received, an additional image segment is generated, showing the area covered by another door.

Benefits of technology

It enables the accurate generation of multiple image segments of the loading opening within the dead time, ensuring that the inside of each door can be clearly shown, and supports automatic object analysis and user observation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119744339B_ABST
    Figure CN119744339B_ABST
Patent Text Reader

Abstract

A household appliance (1) comprising a storage compartment (5) defined by a wall (4) having a filling opening (6), a double-door assembly (2, 3), and a camera device (12) disposed on the wall (4), the double-door assembly having two doors (3), wherein a corresponding trigger signal is output to a data processing device (14) when the doors (2, 3) are closed, the camera device being configured to capture an image (B) of the filling opening (6) upon receiving the trigger signal and transmit it to the data processing device (14), wherein the camera device has a dead time. During the dead time, the camera device is unable to capture another image when it receives at least one additional trigger signal. When the trigger signal and the resulting image (B) are received, if no additional trigger signal is received during the dead time, the data processing device generates an image segment (BA) from the captured image, the image segment showing the gate that triggered the trigger signal. If an additional trigger signal is received during the dead time, the data processing device additionally generates another image segment (BA-K) from the captured image, the other image segment showing another gate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a household appliance comprising a storage compartment defined by a wall having a filling opening, a double-door assembly, and a camera device disposed on the wall of the storage compartment. The double-door assembly has a first door and a second door for closing the filling opening. The household appliance is configured to output a first trigger signal to a data processing device when the first door is closed and a second trigger signal to the data processing device when the second door is closed. The camera device is configured to capture an image of the filling opening upon receiving a trigger signal and transmit it to the data processing device. The camera device has a dead time after receiving the trigger signal, during which the camera device is unable to capture another image upon receiving at least one other trigger signal. The data processing device is configured to generate an image segment from the captured image upon receiving the trigger signal and an image generated according to the trigger signal. The image segment shows only the area of ​​the filling opening that can be covered by the door that triggered the trigger signal. The present invention also relates to a method for processing images captured by a camera device of a household appliance with a double-door assembly of a storage compartment opening, wherein the camera device has a dead time after receiving a trigger signal, during which the camera device is unable to capture additional images upon receiving at least one other trigger signal, wherein, in the method, after triggering the trigger signal, an image fragment is generated from the captured image, the image fragment showing only an area of ​​the storage compartment opening that can be covered by a door whose movement has triggered the trigger signal. Particularly advantageously, the present invention can be applied to household appliances, particularly refrigerators with a "French door" double-door assembly. Background Technology

[0002] The type of household appliance in question has the following drawback: if an additional trigger signal is generated during the dead time, this additional trigger signal does not trigger additional image capture and therefore does not produce any related image footage. For example, if—although rare—the two doors of a double-door assembly are closed almost simultaneously and trigger consecutive trigger signals during the dead time, then image footage will only be produced for the door whose trigger signal was triggered first. Summary of the Invention

[0003] The objective of this invention is to overcome, at least in part, the shortcomings of the prior art.

[0004] This task is solved according to the solution of this application. Preferred embodiments can be particularly derived from the examples.

[0005] This task is solved using a household appliance that has the following features:

[0006] - Storage chambers with wall-bound boundaries and loading openings.

[0007] - A double-door assembly having a first door and a second door for closing the filling opening, wherein the household appliance is configured to output a corresponding trigger signal to a data processing device when the doors are closed.

[0008] - A camera device disposed on the wall of the storage chamber, the camera device being configured to capture an image of the loading opening upon receiving a trigger signal and transmit the image to a data processing device.

[0009] in,

[0010] - The camera device has a dead time after receiving a trigger signal, during which the camera device cannot capture additional images when it receives at least one other trigger signal.

[0011] - The data processing device is configured to, upon receiving a trigger signal and an image generated based on the trigger signal:

[0012] - If no further trigger signal is received within the dead time, an image fragment is generated from the captured image, the image fragment showing only the area of ​​the loading opening that can be covered by the gate that triggered the trigger signal.

[0013] - If an additional trigger signal is received during the dead time, additional image segments are generated from the captured image, the additional image segments showing only the area of ​​the loading opening that can be covered or closed by another door.

[0014] This household appliance has the following advantages: when another trigger signal is triggered during the dead time, although only one image is captured, or more precisely, when the first trigger signal is triggered in time, it is able to generate an image fragment of the area of ​​the loading opening belonging to both doors.

[0015] This is particularly advantageous if the data processing device is configured, for example, programmed, to generate image segments for each image generated based on a trigger signal triggered by movement through one of the doors. For example, this extension can be advantageous so that the inner side of the corresponding door can be displayed particularly large on a display device with a limited display surface. Therefore, it is also possible to always use the same image format here.

[0016] The data processing device can be a control device for household appliances, and in one extended embodiment, it can be used to control a camera device. One extended embodiment is that the data processing device is specifically configured as a camera controller.

[0017] Household appliances can be refrigerators, freezers, or combinations thereof. Storage compartments are used to store items, especially those requiring refrigeration. Additionally, household appliances can be ovens, cooking stoves, or dishwashers. An oven's storage compartment is used to heat items, a cooking stove's storage compartment is used to cook items, and a dishwasher's storage compartment is used to rinse or wash dishes.

[0018] The walls of the storage compartment can also be referred to as the "innerliner". The storage compartment may have one or more shelf compartments and may also have one or more drawer shelves, for example for accommodating drawers, which may be for example for special climate zones. In particular, the filling opening is a front filling opening.

[0019] One extension is that the double-door assembly is a so-called "French door" assembly, in which the two doors are pivotable about a vertical axis, and in the front view of the appliance, the left door is attached to the body of the appliance by its left side, while the right door is attached to the body by its right side. Another extension is that the two doors have the same width, such that the two doors meet at the center of the storage compartment when closed.

[0020] As is common in many refrigeration appliances, especially refrigerators, the door, when closed, faces inwards and is designed for storing items, such as shelves for bottles, butter, eggs, etc.

[0021] Outputting a corresponding trigger signal to the data processing device when the door is closed includes, in particular, triggering the trigger signal during the closing process of the door, especially when a predetermined opening angle is reached or less than a given angle. A zero opening angle can be considered equivalent to a closed door.

[0022] The camera device includes at least one image capture sensor, particularly a digital image capture sensor, and may also include analysis and processing electronics and / or image processing electronics. The camera device may be part of a camera module. In an extended embodiment, the camera module may also have additional functional units, such as an optical flash.

[0023] The camera device can be mounted on the walls of the storage room, including the ceiling, side walls, or floor. This arrangement creates a field of view for the camera device, pointing outwards through the loading opening. In other words, the camera device captures images in an outward direction through the loading opening. Thus, the camera device can capture images of the inside of the door, and is specifically designed for this purpose. That is, the camera device is particularly located in an area within the storage room and points outwards from the storage room.

[0024] The camera device is configured (i.e., set up and arranged) for capturing images of the loading opening, particularly including a field of view such that the loading opening is at least substantially, and especially entirely, located within this field of view, so that the image will image or show the loading opening substantially, and especially entirely. The loading opening being at least substantially within this field of view particularly includes an image captured by the camera device showing an area of ​​the loading opening that is unmarked by an upper and / or lower edge no more than 5% of the height of the loading opening and / or a left and / or right edge no more than 5% of the width of the loading opening. An extension is that the camera device has a wide-angle lens or fisheye lens connected upstream of the image sensor.

[0025] The camera device has a dead time after receiving a trigger signal. During this dead time, the camera device cannot capture additional images upon receiving at least one other trigger signal. This includes the dead time (duration) existing if the camera device performs image capture based on the reception of the first trigger signal, during which the camera device does not perform additional image capture upon receiving another trigger signal. The reason for this could be, for example, that the camera device requires a certain duration for image capture and possible image storage, image processing, and / or image transmission, and that duration must end before the camera device is ready to capture another image.

[0026] One extended approach is to transmit the trigger signal simultaneously to both the camera device and the data processing device. In this case, typically, the data processing device receives the trigger signal first, followed shortly by the image generated upon triggering the signal.

[0027] One extension is that the data processing device can identify the received trigger signal, that is, it can identify which door triggered the trigger signal by closing it. For example, this can be achieved by having the trigger signals for the two doors input at different ports or attachments of the data processing device.

[0028] One extended approach is that the data processing device can assign the received image to a specific trigger signal. For example, this could be achieved by assuming that if an image is received within a defined delay time relative to the trigger signal, the image is considered to have been captured based on that trigger signal. Therefore, it is also known which door's movement triggered the image. Another possibility is that the transmitted image includes information about which trigger signal (i.e., the trigger signal triggered by which door) the image was captured on.

[0029] If no additional trigger signal is received within the dead time, an image fragment is generated only from the captured image, the image fragment showing only the area of ​​the loading opening that can be covered by the gate that triggered the trigger signal.

[0030] The captured images show two doors. The inside of the door that triggered the signal (typically still slightly tilted and not closed) and the stored items placed inside are almost fully visible. For example, another door that did not trigger a signal during the dead time may be closed (where capturing an image of the cooking items placed inside that door is not critically relevant), may still be open, or, although also closed, may still be significantly opener than the door that triggered the signal (wherein, the stored items may be less clearly visible or not visible at all in the captured image). Users are typically only interested in the image of the inside of that door; therefore, image clips are generated that show only the inside of that door and not the other door.

[0031] If another trigger signal is received within the dead time, this can be mapped to a situation where two doors or door leaves are closed approximately simultaneously. Advantageously, image fragments from both doors can then be used, for example, for automated object analysis and possible subsequent inventory management and / or for user observation.

[0032] In this case, an additional image segment is generated from the image captured solely by the first temporal trigger signal. This additional image segment shows only the area of ​​the loading opening that can be covered by another door that has been subsequently triggered, and thus shows the inside of that other door. This is taken full advantage of the fact that although only the inside of the door that has been triggered by the first temporal trigger signal is shown in the image in the optimal or "ideal" position, the inside of the door that has been triggered by the second temporal trigger signal is also shown in the image in a sufficiently suitable position—for example, for analysis and / or observation purposes—due to the typically short temporal interval between the two trigger signals.

[0033] One configuration involves a data processing device configured to, if an additional trigger signal is received within the dead time, copy the captured image and generate an image segment from the copied image, the image segment showing only the area of ​​the loading opening that can be covered by another door. This achieves the advantage that the data processing device is particularly easy to program because the same operating routine can be used, for example, for generating the first image segment in the case where no additional trigger signal is received within the dead time, and for generating the second image segment, the distinction lies only in the prior simple copying process and the information regarding the allocation of the trigger signal generated by the other door to the copied image.

[0034] One configuration involves a data processing device configured to buffer captured images until the dead time has expired before generating at least one image segment. This approach offers the advantage of particularly simple implementation. It takes full advantage of the fact that, for the purposes of image analysis and image observation, the delay in generating at least one image segment within the order of the dead time is practically negligible.

[0035] One configuration involves the data processing device receiving a trigger signal triggered by one of the doors, and within a dead time period receiving a trigger signal triggered by another door. The data processing device is then configured to generate an additional image segment from the captured image, the additional image segment showing only the area of ​​the loading opening that can be covered by the other door. That is, in this configuration, the additional image segment is generated only if the other (second) trigger signal received within the dead time period is triggered by the movement of a door different from the previous (first) trigger signal. This advantageously avoids generating image segments by triggering two trigger signals from the same door (movement).

[0036] One configuration is that the additional trigger signal is generated through either the first or second gate. Advantageously, this can be implemented particularly easily. Here, in the case of the additional trigger signal, it is not determined which gate triggered it. It is assumed here that it is highly unlikely that multiple trigger signals would be triggered consecutively through the same gate (movement) within the dead time.

[0037] One configuration involves a data processing device configured to transmit at least one image fragment to at least one display device. This provides the advantage that a user can observe stored items placed inside the door. In particular, the image fragment can be stored, and stored continuously until a new image fragment belonging to the door is generated. An extension is that the at least one display device includes a display device integrated into the household appliance, such as a screen, particularly a touch-sensitive screen. Another extension is that the at least one display device is a display device for an external entity of the appliance. Advantageously, this allows the user to observe the stored items imaged in the image fragment even when away from the household appliance, for example, during shopping. In this case, the household appliance can be equipped with a communication device (e.g., a Bluetooth module, a WLAN module, and / or an Ethernet module, etc.) via which it can exchange data with an external entity. The external entity is, for example, a user terminal, particularly a mobile user terminal, such as a smartphone or tablet.

[0038] One extension is to store at least one image fragment, for example, for use by a user when needed. Another extension is to store at least one image fragment until it is replaced by a newer image fragment used for the same gate.

[0039] One configuration involves mounting the camera device on the ceiling of the storage room wall. Advantageously, this allows for a particularly clear view of the loading opening and therefore a particularly clear view of the inside of the door.

[0040] One configuration is that the doors have the same width (in the front view when closed), and in the front view, the camera device is centrally positioned on the ceiling of the storage compartment wall. Advantageously, this allows the camera device to see both doors or the two halves of the loading opening equally clearly. In particular, in the case of doors of the same width, an image segment can correspond to one half of the loading opening; in the case of doors of uneven width, an image segment can correspond to a corresponding side segment of the loading opening of uneven width.

[0041] One configuration is that the dead time is no longer than 40 ms, and especially no longer than 20 ms. This achieves the following advantage: for analysis and / or observation purposes, as shown in the image below, the inside of the door is in a position that remains very well-fitted: the movement of the door has triggered the trigger signal received during the dead time.

[0042] One configuration is that the trigger signal is activated if a predetermined opening angle of the door is reached or less than the door's opening angle during the closing process. This achieves the advantage of being able to photograph the inside of the door in a defined, particularly suitable position, more specifically in the important relevant case where the door has been previously opened and stored items stored on the inside of the door may have been removed and / or added.

[0043] One extended approach is to pre-determine the opening angle to be between 3° and 10°. This produces a good trade-off between favorable, largely frontal image capture and adequate lighting.

[0044] One extension involves generating a trigger signal using a triggering device configured to activate if a predetermined opening angle of the door is reached or less than the predetermined opening angle during the door's closing process. Another extension involves generating the trigger signal if at least one additional condition is met, for example, in addition to reaching or less than the predetermined opening angle, the door's closing speed exceeds a predetermined threshold.

[0045] One extension is to use triggering devices to monitor the movement of both doors. This can be advantageous in keeping the number of triggering devices small. For example, such triggering devices could be camera-supported monitoring devices, ultrasonic monitoring devices, radar monitoring devices, or lidar monitoring devices, etc.

[0046] One extension is to assign a corresponding triggering device to each of the two doors. This has the advantage of allowing for the determination with particularly high accuracy and minimal analysis workload of the occurrence of a condition that triggers the trigger signal. Another extension is to install the triggering device in the respective door.

[0047] One configuration uses a gyroscope sensor as the triggering device, specifically, the trigger signal can be triggered by a gyroscope sensor arranged on the corresponding door. The gyroscope sensor has the advantages of being compact, particularly easy to assemble and calibrate, and furthermore, it can detect changes in the door's angle and angular velocity with high precision.

[0048] One configuration is that the household appliance has at least one additional camera device configured to capture images of the storage room and / or open storage drawers and transmit them to a data processing device. For example, the at least one additional camera device could be a camera device mounted on at least one door, configured to capture at least one image of the storage room. Additionally or alternatively, the at least one additional camera device could include a camera device configured to capture at least one image of an open storage drawer. For example, this camera device could be mounted on the ceiling of the storage room wall, particularly in a common module together with a camera device configured to perform the above-described method.

[0049] This task is also solved by a method for processing images captured by a camera device of a household appliance with a double-door assembly through the loading opening of a storage room, wherein the camera device has a dead time after receiving a trigger signal, during which the camera device is unable to capture additional images upon receiving at least one additional trigger signal, wherein, in the method

[0050] - If a trigger signal is triggered by one of the doors of the dual-door assembly and no further trigger signal is triggered within the relevant dead time, an image fragment is generated from the captured image, showing only the area of ​​the loading opening that can be covered by a door whose movement has triggered the trigger signal.

[0051] - If an additional trigger signal is received during the dead time, additional image segments are generated from the captured image, the additional image segments showing only the area of ​​the loading opening that can be covered by another door.

[0052] This method can be constructed similarly to household appliances, or vice versa, and has the same advantages. Attached Figure Description

[0053] The above-described properties, features, and advantages of the invention, as well as the ways of achieving these properties, features, and advantages, become clearer and more readily understood in conjunction with the illustrative description of the embodiments set forth in more detail below with reference to the accompanying drawings.

[0054] Figure 1 A simplified diagram of a household appliance with a double-door assembly is shown in a front-view perspective.

[0055] Figures 2A to 2C Roughly illustrated for processing via Figure 1 One possible procedure for capturing images using a camera device in a household appliance; and

[0056] Figures 3A to 3F Roughly illustrated for processing via Figure 1 Another possible process for capturing images using a camera device in a household appliance. Detailed Implementation

[0057] Figure 1 A simplified diagram of a household appliance is shown from a frontal angle. This appliance is a refrigerator 1 with French door assemblies 2 and 3, which have a first (left) door 2 and a second (right) door 3, both shown in an open position in front view F. The refrigerator 1 also has a storage compartment 5 or refrigerator compartment, defined by a wall 4, and a front-mounted filling opening 6. Storage shelves 7 and drawers 8 are present in the refrigerator compartment 5 for storing items. Storage compartments 10 are also present on the inner sides 9 of the doors 2 and 3. In front view F, a camera device 12 is centrally positioned on the ceiling 11 of the storage compartment wall 4, configured to capture images of the filling opening 6.

[0058] Triggering devices in the form of gyroscope sensors 13 are arranged in doors 2 and 3 respectively. The gyroscope sensors 13 can detect at least the angular changes and rotation directions of the relevant doors 2 and 3, and may detect angular velocities, thereby determining the opening angle of doors 2 and 3. In the current situation, if doors 2 and 3 are closed and reach or fall below a determined opening angle, for example, 3°, a trigger signal is triggered by the gyroscope sensors 13. This trigger signal is forwarded to the camera device 12 and the data processing device 14. Upon receiving the trigger signal, the camera device 12 is triggered to capture an image of the loading opening 6 and transmit it to the data processing device 14.

[0059] Refrigerator 1 may also have an additional camera device, such as camera device 15 located in doors 2 and 3, which is configured to capture images of the refrigerator compartment 5 and transmit them to data processing device 14.

[0060] Data processing device 14 is configured to process an image B (see [reference]) generated upon receiving a trigger signal and triggering according to the trigger signal. Figure 2B When the image is captured (B), an image segment BA is generated from the captured image B (see [link to image segment B]). Figure 2C The image fragment BA shows the area of ​​the loading opening 6 that can be covered by doors 2 and 3 that trigger the trigger signal. That is, if the trigger signal is generated through the left door 2, the image fragment BA shows the left half of the loading opening in the front view F or the right half of the loading opening 6 from the perspective of the camera device 12, and therefore also shows the inner side 9 of door 2. Similarly, this applies to the right door 3.

[0061] Furthermore, the data processing device 14 is configured to transmit the image segment BA to at least one display device, such as the screen of the refrigerator (not shown), or output it to a mobile user terminal, such as a smartphone S, on which the image segment can be displayed, for example, by means of a corresponding application (“App”). For this purpose, the refrigerator 1 may be equipped with a communication module 16, such as a WLAN module, a Bluetooth module, or an Ethernet module.

[0062] Figures 2A to 2C A possible flow is shown for processing images captured by camera device 12 in the following situation: data processing device 14 receives a trigger signal from the gyroscope sensor 13 of one of doors 2 and 3 (exemplarily door 3 in this case) and does not receive any further trigger signals within the dead time (e.g., 20 ms) of camera device 12, particularly not from the gyroscope sensor 13 of the other door 3 or 2 (exemplarily door 2 in this case). The dead time corresponds to a duration during which camera device 12 is unable to capture any further images when at least one further trigger signal is received.

[0063] Figure 2A Therefore, the loading opening 6 and doors 2 and 3 are shown from the direction of the camera device 12, wherein the left door 2 is opened more fully, and the right door 3 has reached the opening angle (“trigger angle”) used to trigger the trigger signal during the closing movement indicated by the arrow.

[0064] Then, camera device 12 captures images of the loading opening 6. Figure 2B Image B is shown in the figure, and the image is transmitted to the data processing device 14.

[0065] The data processing device buffers image B for at least the duration of the dead time (“delay time”). For example... Figure 2C As shown, if the delay time has expired and no further trigger signal is received from one of doors 2 or 3, particularly door 2, during the delay time, the captured image B is cropped into image fragment BA in a subsequent step. This image fragment shows only the right half of the loading opening 6 (in the front view), which can be covered by door 3. This occurs when it is known that the trigger signal has been triggered by the gyroscope sensor 13 of the right door 3, for example, because image B is received within a defined duration after the trigger signal of the right door 3 is received.

[0066] Figures 3A to 3F This illustrates one possible flow for processing images captured by camera device 12 in the following situation: both doors 2 and 3 are closed, and their respective trigger angles are reached within the dead time, such as... Figure 3AAs shown in the diagram. For example, it is assumed that the right door 3 reaches the trigger angle first, and then the left door 2 reaches the trigger angle within a dead time of, for example, 20ms.

[0067] and Figure 2B Similarly, when the right door 3 reaches the trigger angle, image B of the loading opening 6 is captured. Figure 3B And transmit it to the data processing device 14. Since the trigger signal generated by the closing movement of the left door 2 is received by the camera device 12 within the dead time, no image is generated by the second trigger signal.

[0068] The data processing device also buffers image B for the duration of the delay time and monitors whether a second trigger signal is received within the dead time, which is the case in this case. Then, from Figure 3C The image B shown is copied and cached. Figure 3D The image K shown is a copy.

[0069] and Figure 2C Similarly, data processing device 14 now generates from image B Figure 3E The image fragment BA shown illustrates the right half of the loading opening 6 (in the front view) and was generated from a copied image K. Figure 3F The image fragments BA-K shown illustrate the left half (in the front view) of the loading opening 6, which can be covered or closed by the right-side door 2. Both image fragments BA and BA-K can be transmitted to at least one display device T and / or stored for recall, for example, by a user.

[0070] Of course, the present invention is not limited to the embodiments shown.

[0071] Generally speaking, "one" or "one" can be understood as singular or plural, especially in the sense of "at least one" or "one or more", as long as this is not explicitly excluded, for example, by expressing "exactly one".

[0072] The numerical specification may also include exactly the number being specified and the common tolerance range, provided that this is not explicitly excluded.

[0073] List of reference numerals

[0074] 1. Refrigerator

[0075] 2. Left side door

[0076] 3. Right side door

[0077] 4. Wall

[0078] 5. Storage room

[0079] 6. Loading opening

[0080] 7 Storage racks

[0081] 8 drawers

[0082] The inside of the 9 doors

[0083] 10 Storage compartments

[0084] 11. Ceiling of the wall section

[0085] 12 Camera devices

[0086] 13 Gyroscope Sensor

[0087] 14 Data processing device

[0088] 15. Camera equipment

[0089] 16 Communication Module

[0090] Image B

[0091] BA image fragment

[0092] BA-K image fragments

[0093] F Front View

[0094] K Reproduced Image

[0095] S smartphone

[0096] T screen

Claims

1. Household appliance (1) having - a storage compartment (5) delimited by a wall (4) having a charging opening (6), - a double door assembly having a first door (2) and a second door (3) for closing the charging opening (6), wherein the household appliance (1) being set up for outputting a corresponding trigger signal to a data processing device (14) when the door is closed, - a camera device (12) arranged on the wall (4) of the storage compartment (5), the camera device being set up for taking an image (B) of the charging opening (6) upon receipt of a trigger signal and for transmitting the image to the data processing device (14), wherein - the camera device (12) has a dead time after receipt of a trigger signal, in which dead time the camera device is not able to take a further image (B) upon receipt of at least one further trigger signal, - the data processing device (14) is set up for, upon receipt of a trigger signal and of an image (B) triggered in accordance with the trigger signal: - if no further trigger signal is received in the dead time, generating an image section (BA) from the taken image (B), which image section shows only a region of the charging opening (6) which can be covered by the door which triggered the trigger signal, - if a further trigger signal is received in the dead time, additionally generating a further image section (BA-K) from the taken image (B), which further image section shows only a region of the charging opening (6) which can be covered by the other door.

2. The household appliance (1) according to claim 1, wherein the data processing device (14) is set up for, if the further trigger signal is received in the dead time, copying the taken image (B) and generating an image section from the copied image (K), which image section shows only a region of the charging opening (6) which can be covered by the other door.

3. The household appliance (1) according to claim 2, wherein the data processing device (14) is set up for caching the taken image (B) until the dead time has expired and then generating at least one image section.

4. The household appliance (1) according to any one of the preceding claims, wherein the data processing device (14) is set up for, if a trigger signal triggered by one of the doors is received by the data processing device and a trigger signal triggered by the other of the doors is received in the dead time, generating a further image section (BA-K) from the taken image (B), which further image section shows only a region of the charging opening (6) which can be covered by the other of the doors.

5. The household appliance (1) according to any one of claims 1 to 3, wherein, the further trigger signal is a trigger signal generated by the first door (2) or by the second door (3).

6. The household appliance (1) according to any one of claims 1-3, wherein, the data processing device (14) is set up for transmitting the at least one image section to at least one display device.

7. The household appliance (1) according to any one of claims 1-3, wherein, the camera device (12) is arranged on a ceiling (11) of the wall (4) of the storage compartment.

8. The household appliance (1) according to claim 7, wherein the doors have the same width, in a front view (F) the camera device (12) being arranged centrally on a ceiling (11) of the wall (4) of the storage compartment.

9. The household appliance (1) according to any one of claims 1-3, 8, wherein, the dead time is not longer than 40 ms.

10. The household appliance (1) according to any one of claims 1-3, 8, wherein, The dead time is not longer than 20 ms.

11. The household appliance (1) according to any one of claims 1-3, 8, wherein, The trigger signal can be triggered by means of a gyrosensor (13) arranged on the respective door if a predefined opening angle of the door is reached or undershot during the closing of the door.

12. The household appliance (1) according to any one of claims 1-3, 8, wherein, The domestic appliance (1) has a further camera device (15) which is provided for recording images in the storage compartment (5) and / or in an open storage compartment drawer and for transmitting the images to the data processing device (14).

13. Method for processing an image (B) taken by a camera device (12) of a domestic appliance (1) having a double door assembly through a charging opening (6) of a storage compartment (5), wherein The camera device (12) has a dead time after receiving a trigger signal, during which dead time the camera device cannot record a further image (B) upon receiving at least one further trigger signal, wherein in the method - if no further trigger signal is triggered within the associated dead time after a trigger signal is triggered by one of the doors of the double-door assembly, an image section (BA) is generated from the recorded image (B), which image section shows only a region of the filling opening (6) which can be covered by the door whose movement has triggered the trigger signal, - if a further trigger signal is received within the dead time, a further image section (BA-K) is additionally generated from the recorded image (B), which further image section shows only a region of the filling opening (6) which can be covered by the other door.

Citation Information

Patent Citations

  • Refrigerator and control method for the same

    CN105008833A

  • Refrigeration appliance comprising a camera module

    CN105358924A