Refrigeration system with imaging

Abstract

In an example, a refrigeration system includes one or more cameras positioned to capture images of items before the items are placed in a cabinet. The refrigeration system can include one or more movable racks on which items can be placed. When the racks are moved outside, items can be placed on the racks and a set of cameras can image the racks to determine information about the items placed on the racks.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 264,720, filed December 1, 2021, the aforementioned priority application being incorporated herein by reference in its entirety. [Background technology]

[0002] Refrigeration units are common in homes. In recent years, specialized refrigeration units have been developed for certain types of perishable foods and consumables. For example, freezers exist to store frozen goods (e.g., meat). Beverage coolers allow beverages to be maintained at colder temperatures. A wine cooler refers to a general type of refrigeration assembly designed specifically to hold wine bottles and other beverages. Typically, wine coolers include a rack that can be pulled outward to allow the bottles to be positioned. This allows wine coolers to (customarily) hold the bottles sideways. [Brief description of the drawings]

[0003] [Figure 1A] FIG. 2 illustrates a front view of a refrigeration system in a closed orientation according to one or more embodiments. [Figure 1B] FIG. 1B is a front view of the refrigeration system of FIG. 1A in an open orientation according to one or more embodiments. [Figure 1C] FIG. 1B is a cross-sectional side view of a refrigeration system in a closed orientation taken along line AA of FIG. 1A in accordance with one or more embodiments. [Figure 1D] FIG. 1C is a cross-sectional side view of the refrigeration system in an open orientation taken along line BB of FIG. 1B in accordance with one or more embodiments. [Figure 1E] FIG. 1C is a simplified diagram of the viewing angles used by the camera array of the refrigeration system illustrated by FIGS. 1A-1D, according to one or more embodiments. [Figure 1F]FIG. 1 illustrates a variation in which an exemplary refrigeration system is implemented to include a camera module as a retrofit, in accordance with one or more embodiments. [Figure 1G] FIG. 13 illustrates another variation in which an exemplary refrigeration system is implemented in conjunction with a camera module 180 to house the camera array 160. [Figure 2A] FIG. 1 illustrates a hardware diagram of an exemplary refrigeration system according to one or more embodiments. [Figure 2B] FIG. 1 illustrates a network communication system for providing information regarding items stored in a refrigeration system, according to one or more embodiments. [Figure 3A] FIG. 1 illustrates an exemplary method for operating a refrigeration system according to one or more embodiments. [Figure 3B] FIG. 1 illustrates an exemplary method for operating a refrigeration system according to one or more embodiments. [Figure 3C] FIG. 1 illustrates an exemplary method for operating a refrigeration system according to one or more embodiments. [Figure 4] FIG. 1 illustrates a computer system in which one or more embodiments may be implemented. [Diagram 5] FIG. 1 is a block diagram illustrating a user device for use with the described embodiments. [Figure 6A] FIG. 1 illustrates an exemplary beverage cooler according to one or more embodiments. [Figure 6B] FIG. 1 illustrates an exemplary beverage cooler according to one or more embodiments. [Figure 6C] FIG. 1 illustrates an exemplary beverage cooler according to one or more embodiments. [Figure 6D] FIG. 1 illustrates an exemplary beverage cooler with a ribbed light diffusing door according to one or more embodiments. [Figure 7A] FIG. 1 illustrates a reversible rack for a refrigeration system according to one or more embodiments. [Figure 7B]FIG. 1 illustrates a reversible rack for a refrigeration system according to one or more embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0004] Embodiments include a refrigeration assembly or system (herein referred to for convenience as a "refrigeration system") that utilizes a set of cameras to image items as they are placed on a rack that is withdrawn from an interior space of the refrigeration system. For example, one or more cameras of the refrigeration system can image items on the rack, such as when the rack is being withdrawn or pushed into a stowed position. The refrigeration system can initiate image processing and analysis to determine information about the items on the rack. The information may then be transmitted to a user device and / or displayed on a display.

[0005] Among other advantages, by way of example, a user may learn information about items held within a refrigeration system or refrigerated appliance. Furthermore, the processing and imaging performed requires minimal or no separate action from the user to procure. For example, a user need not handle the item in any special way other than placing the item on a rack (preferably label-side up, if applicable) and pushing the rack in, actions that the user would perform anyway. Thus, the user may avoid tedious tasks such as holding the item in front of a camera.

[0006] Additionally, the examples generate content that allows users to learn about items stored using a refrigeration system or appliance. In some examples, the refrigeration system or appliance is implemented as a beverage cooler for holding wine, liquor, canned drinks, and the like. For example, for wine, users often need to know inventory by type and category (e.g., number of red wines, vintage, wine attributes, etc.). Additionally, users may also want to know which wines are open (e.g., for first drinking) and the fill level of the bottles. Various embodiments allow users to determine such information without having to open the device, thereby saving user convenience and energy.

[0007] In some examples, the refrigeration system is operated by (i) detecting that a given rack of a plurality of racks of the refrigeration system is moved from a withdrawn position to a stowed position within the refrigeration system, (ii) capturing one or more images of the rack, and (iii) initiating performance of an image analysis of the one or more images or performing an image analysis of the one or more images to determine information regarding one or more items placed on the rack.

[0008] Further, in the example, the refrigeration system implements operations for performing a first image scan of a first rack using a first set of cameras, the first image scan being performed when the first rack is outside of the interior space of the refrigeration system, a portion of the first rack being a first distance from the first set of cameras. The operations further comprise performing a second image scan of a second rack using a second set of cameras, the second image scan being performed when the second rack is outside of the interior space of the refrigeration system, the second rack being a second distance from the second set of cameras, the second distance being greater than the first distance.

[0009] In an example, a camera module is provided for a refrigeration system, the camera module including a set of one or more cameras and a housing that can be attached to a cabinet or structure of the refrigeration system. In an example, the housing can be structured to secure to the refrigeration system and to position the camera array such that a corresponding viewing angle of one or more cameras of the camera array is positioned in a vertical space that matches a thickness that occupies a door of the refrigeration system when the door is in a closed position. The refrigeration system also can include one or more processors that carry out instructions to perform operations including: (i) capturing one or more images of a rack of the refrigeration system when the rack is pulled out of the interior cabinet, and initiating performance of image analysis of the one or more images to determine information regarding one or more items placed on the rack.

[0010] One or more embodiments described herein provide that the methods, techniques, and actions performed by a computing device are performed programmatically or as computer-implemented methods. As used herein, "programmatically" means through the use of code or computer-executable instructions. These instructions may be stored in one or more memory resources of the computing device. Programmatically performed steps may or may not be automatic.

[0011] One or more embodiments described herein may be implemented using program modules, engines, or components. A programmatic module, engine, or component may include a program, a subroutine, a portion of a program, or a software or hardware component that can perform one or more specified tasks or functions. As used herein, a module or component may exist on a hardware component independent of other modules or components. Alternatively, a module or component may be a shared element or process of other modules, programs, or machines.

[0012] Some embodiments described herein may generally require the use of computing devices that include processing and memory resources. For example, one or more embodiments described herein may be implemented in whole or in part on computing devices such as servers, desktop computers, cellular or smartphones, tablets, wearable electronic devices, laptop computers, printers, digital picture frames, network equipment (e.g., routers), and tablet devices. Memory, processing, and network resources may all be used in connection with establishing, using, or executing any embodiment described herein (including executing any method or implementing any system).

[0013] Furthermore, one or more embodiments described herein may be implemented through the use of instructions executable by one or more processors. These instructions may be carried in a computer-readable medium. The machines illustrated or described with the following figures provide examples of processing resources and computer-readable media that may carry and / or execute instructions for implementing embodiments of the present invention. In particular, many machines illustrated with embodiments of the present invention include processors and various forms of memory for holding data and instructions. Examples of computer-readable media include permanent memory storage devices such as hard drives of personal computers or servers. Other examples of computer storage media include portable storage units such as CD or DVD units, flash memory (such as those found in smartphones, multifunction devices, or tablets), and magnetic memory. Computers, terminals, and network-enabled devices (e.g., mobile devices such as cellular phones) are all examples of machines and devices that utilize processors, memories, and instructions stored on computer-readable media. Furthermore, the embodiments may be implemented in the form of a computer program, or a computer-usable carrier medium that may carry such a program.

[0014] Refrigeration system FIG. 1A is a front view of a refrigeration system (or assembly) in a closed orientation, according to one or more embodiments. FIG. 1B is a front view of the refrigeration system of FIG. 1A in an open orientation, according to one or more embodiments. FIG. 1C is a side cross-sectional view of the refrigeration system 100 in a closed orientation, along line AA of FIG. 1A, according to one or more embodiments. FIG. 1D is a side cross-sectional view of the refrigeration system 100 in an open orientation, along line BB of FIG. 1B, according to one or more embodiments. The refrigeration system 100 shown and described by way of example in FIGS. 1A-1D can correspond to a beverage cooler with structural and functional features optimized to maintain wine bottles and beverages in a suitable environment. In variations, the embodiments can be used with other types of refrigeration systems. As will be described in more detail, the refrigeration system 100 is configured to perform image processing and analysis to determine information regarding the items and contents stored within the refrigeration system 100.

[0015] 1A, refrigeration system 100 includes a cabinet 110, a door 120, and a cooling subsystem 130. When refrigeration system 100 is closed, door 120 is in a closed position and the interior space of the cabinet is sealed off by door 120. In an example, door 120 includes an exterior facade and an optional handle 112. To open door 120, a user can pull handle 112 and the door will rotate outward to allow the user access to the interior space of cabinet 110.

[0016] To accommodate wine bottles, and more generally beverage containers, the interior space 114 of the refrigeration system 100 includes racks 118 that are movable laterally outward (Z direction) when the cabinet 110 is in an open position. The interior space 114 is maintained at a desired temperature to cool the items on the racks 118. As a beverage cooler, the interior space 114 may be maintained at a temperature ranging from, for example, 33°F to 70°F. As a wine cooler, the interior space 114 may be maintained at a temperature ranging from 44°F to 65°F. Thus, a particular temperature may be selected depending on a user's preferences and / or the type of items being stored. Additionally, in other examples, the temperature setting may be automatically set based at least in part on one or more items placed on the racks. For example, as described by way of example, the cameras 122, 124, 126 may be operable to determine information about the item, such as the type or item (e.g., type of beverage or wine, the manufacturer or origin of the wine, the fill status of the beverage, etc.). The refrigeration system 100 may include one or more processors 220 (see FIG. 2A ) that are capable of processing images of items to determine information and automatically implementing actions to control operation of the refrigeration system 100 based on the determined information.

[0017] The cabinet 110 includes an upper segment 111 that integrates or otherwise provides a camera array, the camera rate including cameras 122, 124, 126. In the illustrated example, the camera rate includes three cameras, although in variations, more or fewer cameras may be used. Each camera may include an optical sensor and a lens, or combination of lenses, combined with processing resources for generating image data using light captured by the optical sensor. As further described, the camera 122 is proximate (i.e., closest to) the left side 101 of the cabinet 110, and the camera 126 is proximate to the right side 103 of the cabinet 110. The cameras 122, 126 may be the same type of camera, and the camera 124 may be a different type of camera. For example, the cameras 122, 126 may incorporate a wide-angle lens, such as a fisheye lens, while the camera 124 includes a high-resolution lens. The cameras 122, 126 may be selected to determine information about the items and contents stored in the rack 118 that is closest to the lens of the camera array.

[0018] 1B, the door 120 is shown in an open position to provide access to the interior space 114 of the cabinet 110. A rack subassembly 140 is mounted inside the cabinet and maintains a number of racks 118 that can move laterally (e.g., in the Z direction) in and out of the cabinet (or between a stowed position and an extended position) while the door 120 is in the open position. As will be described in further detail, the rack assembly 140 allows individual racks 118 to slide outward. When a given one of the racks 118 is slid outward, a user can place a bottle on the rack 118, remove a bottle from the rack 118 (e.g., for consumption), rearrange a bottle on the rack 118, add a bottle to the rack, and / or remove a bottle for partial consumption and then return it to the rack 118. The user can then slide the rack back into the interior space 114 of the cabinet 110. As will be explained in more detail, the array of cameras 122, 124, 126 operates to capture images of items on any one of the racks that are returned to a stowed position.

[0019] Referring to the cross-sectional view shown in FIG. 1C (with the door in the closed position), cameras 122, 124 (not visible in FIG. 1C) and camera 126 (not visible in FIG. 1C) are provided in the upper segment of cabinet 110. Each camera 122, 124, 126 is oriented downwards such that the field of view of the respective lens is obstructed by the thickness of door 120. In the illustrated example, cameras 122, 124, 126 are not located within an interior space, e.g., upper rack 118 blocks other racks. Rather, the cameras are located above door 120, allowing cameras 122, 124, 126 to capture images of the racks for processing as the door opens and the racks slide in and out.

[0020] Referring to the cross-sectional view shown in Figure 1D (with the door in the open position), each rack 118 is movable laterally (in the Z direction) to allow a user to access the items held in that rack. Cameras 122, 124 (not visible in Figure 2D), camera 126 (not visible in Figure 2D) are pointed downwards such that their downward viewing angle coincides with or overlaps with the space occupied by the thickness of door 120 when the door is in the closed position.

[0021] In an example, each camera 122, 124, 126 of the camera array is mounted in the front and top segment 128 of the cabinet 110. The top segment 128 can be a unitary or single housing segment cabinet 110. In another example, the top segment 128 can be a cavity in which the cameras 122, 124, 126 can be mounted and accessed. Each camera 122, 124, 126 of the camera array is mounted in the top segment 128 with the lenses facing downwards. In an example, the cameras are aligned such that the vertical field of view (Y direction) of each camera includes or otherwise coincides with the space 125 that occupies the thickness of the door 120 when the door is in the closed position. In an example, the cameras 122, 124, 126 can be mounted to be flush or to be recessed outward from the surface of 121. For example, 121 can be in the form of a surface with openings to accommodate the lenses of the individual cameras 122, 124, 126. Alternatively, some or all of the lenses may protrude from their respective openings. Additionally, the cameras 122, 124, 126 are mounted on swing arms that allow them to swing in and out of position.

[0022] 1D , a user places a bottle 12 on top of the upper rack 118 as the rack is slid outward to an extended position 119. As the rack 118 slides inward, the bottle crosses the field of view of the cameras 122, 124, 126, which capture images (e.g., video frames) of the bottle 12 before the rack returns to a stowed position 117. Additionally, the cameras 122, 124, 126 can be configured to capture images of the rack 118 when it is stationary or when it is moving outward from the cabinet 110.

[0023] 1D , embodiments enable image capture and processing of bottles 12 with minimal or no additional user interaction beyond the user placing the bottle 12 on the desired rack 118. Additionally, the configuration of the camera array allows the camera array to capture recognizable images of the bottle even as it passes within a relatively short distance of the cameras 122, 124, 126. Additionally, as each rack can be individually slid into the interior space 114 of the cabinet 110, the camera array can capture recognizable images of items placed on other racks as well.

[0024] While the described example shows rack 118 supporting items (e.g., bottles) in a first orientation (e.g., lengthwise along the Z axis), in variations rack 118 may alternatively or additionally be configured to support items in an alternate orientation (e.g., widthwise along the Z axis).

[0025] FIG. 1E is a simplified diagram of the viewing angles used by the camera array of the refrigeration system 100, according to one or more embodiments. In the illustrated example, the camera array 160 includes three lenses, but in variations, more or fewer cameras may be utilized. In some examples, the camera array 160 includes multiple cameras 122, 124, 126, each having a lens exposed at the bottom 121 or opening of the cabinet 110. The individual cameras of the camera array 160 may operate in one or more camera sets, with each set being a preferred or primary source for acquiring recognizable images of items placed on the corresponding rack 118 or its area. Based on the implementation, one camera of the camera array 160 may be used in multiple sets. In some variations, the individual cameras of each camera set are preconfigured or dynamically controlled to operate in a coordinated manner, such as acquiring images simultaneously.

[0026] Thus, in an example, camera array 160 includes or otherwise provides an alternative set of cameras for imaging a particular rack 118 based on the vertical distance between the respective rack and the camera lens (assumed to be coplanar with 121 for purposes of explanation herein). In an example, the distance between 121 and the top rack may range from 40-75 mm. Similarly, the distance between 121 and the second rack (from the top) may range from 120-180 mm, and the distance between the third rack from the top may range from 200-250 mm. Additionally, in other variations, the operation of the camera sets, including the selection, operation and / or configuration of the cameras, may be based on a switching element triggered by the movement of rack 118.

[0027] The embodiments recognize that when racks are used, different sets of cameras may enable and facilitate the operation of acquiring recognizable image data from each rack 118. For items placed on the top rack 118, the proximity of the top rack 121 combined with the standard field of view of the camera lenses limits the camera's coverage in the X direction. Additionally, the camera's ability to focus on such nearby items may be limited. Similarly, items placed on a second rack may have similar challenges with respect to imaging by the camera array, where the field of view from a single camera does not span the entire width of the rack (X direction) and items placed on the second rack may be too close to the respective cameras to be adequately focused on.

[0028] For the middle or bottom racks 118, the field of view of the camera may present lower requirements compared to the field of view required for the imaging camera, however, the vertical distance between each camera and the rack may create additional challenges with regard to obtaining images with adequate definition of text that can later be recognized using optical character recognition (OCR).

[0029] Furthermore, the camera array 160 can be configured to accommodate additional optimizations. Specifically, the camera array 160 can include a minimum number of cameras to image the entire span of each rack with sufficient resolution to allow subsequent image recognition (e.g., OCR) and other image processing to be performed. With respect to spacing as described, one optimal configuration of the camera array 160 provides for placing the ultra-wide lens cameras 122, 126 toward the left and right sides of each of the cabinets 110 to capture images of items placed on the top two racks 118. Furthermore, a camera (e.g., an HD camera) can be placed in the center of the camera array to capture images of items placed on other racks. In other variations, the HD cameras can be placed toward the side ends of the camera array 160 (e.g., as cameras 122, 126).

[0030] In one implementation, the cameras 122, 126 have a field of view of greater than 180 degrees (e.g., fisheye camera lenses) with video recording capability, while the mid camera 124 can be selected to have a field of view of between 70 degrees and 100 degrees with high-resolution video capture capability.

[0031] While many of the examples show cameras 122, 124, 126 positioned in an upper segment or region of refrigeration system 100 and having a downward viewing angle, in variations cameras 122, 124, 126 may be positioned in a bottom segment or region and configured to have an upward viewing angle.

[0032] Retrofit replacement FIG. 1F illustrates a variation in which an exemplary refrigeration system 100 is implemented to include a camera module 180, in which the camera array 160 is housed, according to one or more embodiments. In the example, the refrigeration system 100 includes a camera module 180 having a housing 182 separate from the structure of the refrigeration system 100. For example, the camera module 180 can be mounted on the top surface of the refrigeration system such that the lens surface 185 of the camera array is located in front of / or above the door 120. As with other examples, the camera module 180 can include an alternative set of cameras 122, 124, 126 distributed lengthwise (along the X direction) of the cabinet 110. Thus, the lens surface 185 positions the cameras 122, 124, 126 such that the field of view of each camera includes the vertical thickness in front of the door (see, for example, FIG. 1E). Additionally, based on the camera orientation and lens configuration, the field of view of each camera can also overlap the vertical thickness occupied by the door 120. Thus, when door 120 is opened and a rack is moved in front of the camera (under lens plane 185), the cameras in the camera array can image each rack.

[0033] FIGURE 1G illustrates another variation in which an exemplary implementation of refrigeration system 100 includes a camera module 180 in which camera array 160 is housed. In the example of FIGURE 1G, door 120 of refrigeration system 100 spans the height of refrigeration system 100. In such an example, housing 192 of camera module 180 can be structured to position the camera array such that lens surface 185 is substantially aligned with or located in front of the vertical thickness occupied by door 120.

[0034] Additionally, in other variations, the camera module 180 may be located partially within the cabinet 110 with an extension to accommodate a camera array that extends outside the cabinet, such as in the orientation shown.

[0035] Although a number of examples have been described using Figures 1A-1G that allow the cameras of the camera array to capture images as the corresponding rack is pulled out of the cabinet 110, in variations, an item can be placed in the rack 118 without moving the rack out of the cabinet 110. For example, a user can place a bottle in the rack while the rack remains housed. In such an example, the camera can detect the item and capture the item placed on the rack 118. Furthermore, in some variations, the camera module 180 can be manufactured as an accessory to a suitably configured refrigeration system.

[0036] Refrigeration System Hardware FIG 2A is a hardware diagram of an exemplary refrigeration system according to one or more embodiments. Refrigeration system 200 of FIG 2A may be configured according to examples such as those described with reference to FIGS. 1A-1E. Thus, refrigeration system 200 provides an example of refrigeration system 100, as described with reference to other examples herein, and references to elements of FIGS. 1A-1E in the context of refrigeration system 200 indicate appropriate or similar elements of refrigeration system 100.

[0037] 2A , the refrigeration system 200 includes a cooling subassembly 210, one or more processors 220, a camera interface 227, and / or a camera array 230. Additionally, the refrigeration system 200 can include one or more communication ports 240, 242. The communication ports can include wireless ports. For example, one of the communication ports 240 can enable local device-to-device communication, for example, using a Bluetooth protocol, and another of the communication ports 242 can enable network / internet communication through Wi-Fi (e.g., wireless communication promulgated under 802.11(g), 802.11(n), 802.11(ac), etc.), cellular communication, or other wireless communication protocols, etc.

[0038] The cooling subassembly 210 includes a compressor unit, refrigerant handling mechanisms, and other components for cooling the interior space 114 (see FIGS. 1A-1E) of the cabinet 110 (see FIGS. 1A-1E). In an example, the cooling subassembly 210 may include a compressor, an evaporator, refrigerant lines, and temperature / power controls to enable cooling of the interior space 114 of the refrigeration system 100.

[0039] In examples, one or more processors ("processor 220") control the operation of refrigeration system 200, including control of cooling subassembly 210, while providing image control and / or processing functions. Processor 220 receives image data captured through individual cameras of camera array 230 via camera interface 227. In some examples, camera array 230 is an integral component set of refrigeration system 200, meaning that camera array 230 is provided with refrigeration system 200 at the time of manufacture or assembly. In variations such as those described with the examples of Figures 1F and 1G, camera array 230 may be provided as a separate module or component that is attached to the housing of refrigeration system 200 after manufacture. In such examples, processor 220 may also be distributed or located with camera module 180 (see Figures 1F and 1G).

[0040] In some examples, the refrigeration system 200 includes or is connected to a camera interface 227 to enable the use of subsequent cameras, as described with various examples. For example, the refrigeration system 200 can be manufactured to include ports for connecting the camera array 230 or individual cameras. The camera array 230 can then be added as an option during distribution, at the point of sale, or by the user (e.g., after sale). If manufactured separately, the camera array 230 can be modularized to include each camera of the camera array 230. In a variation, the individual cameras of the camera array 230 can be separately connected or attached and operated independently by the processor 220.

[0041] In examples, refrigeration system 200 may also include various types of sensors, such as (i) door sensors 211 (to detect when a door is open, closed, during, etc.), (ii) one or more rack sensors 212 positioned to detect the position and / or movement by each of one or more corresponding racks, and (iii) a temperature sensor 213 for detecting the temperature of the interior space within interior space 114 of cabinet 110. In some examples, processor 220 receives temperature input from temperature sensor 213 and implements temperature control operations 224 to cause cooling subassembly 210 to maintain, increase, or decrease the temperature of interior space 114. In examples, refrigeration system 200 includes a temperature control interface (not shown) that allows a user to adjust a desired temperature of interior space 114. In response to the temperature input, processor 220 may control cooling subassembly 210 to increase or decrease cooling of the interior space, and temperature sensor 213 may generate an output that allows processor 220 to implement temperature control operations 224 to reach a target temperature.

[0042] Additionally, as described with various examples, the processor 220 implements image processing logic 222 to perform various types of image processing operations on the racks when they are withdrawn from the cabinet 110 (e.g., when in the withdrawn position). For example, as described with other examples, the image processing operations may include operations performed in connection with functions including (i) presence detection (e.g., detecting whether a particular type of item is present in one of the racks 118), (ii) object detection to determine the type of item detected (e.g., whether the item placed on the rack is a can, bottle, or other type of beverage), (iii) analysis of hue, color contrast, and / or opacity (e.g., to determine the fill level or type of liquid in a container), (iv) label detection to detect labels on bottles, and / or (v) character and / or image recognition, for example, to scan label lettering and images.

[0043] In some examples, the processor 220 performs operations to implement the aforementioned functions. In a variant, the processor 220 initiates an image processing operation, for example, by performing a preliminary image processing step. As a result of initiating the image processing operation, a normalized image of the item's label, or alternatively, the item itself, is transmitted to another computing device, a remote system, or a network service. For example, the processor 220 can implement operations to correct distortions in an image captured by a wide-angle (or ultra-wide-angle) lens camera. A distortion correction operation can also be performed to normalize roundness in the image caused by the shape of the bottle. If the rack requires multiple cameras to image the items on the rack, the processor 220 can implement operations to normalize and combine images from different cameras. The images can be combined, for example, by (i) correcting distortions in images captured by multiple cameras, (ii) identifying overlapping areas between two or more cameras imaging the rack, (iii) removing the overlapping areas, and (iv) blending the remaining portions of the images. As a result of the process, an image of the item's label can be extracted and transmitted for further recognition and analysis.

[0044] Additionally or alternatively, the processor 220 performs selected image processing operations to enable or optimize performance of image processing functions, as described with some examples. The processor 220 also initiates image processing and analysis by transmitting processed image data to a remote computer system or service via one of the communication ports 240, 242 to allow additional image processing to be performed by the remote system or service. For example, the processor 220 can capture and transmit image data to a remote service, computer, or computing device, where additional operations for presence detection, item detection, color / hue analysis, label detection, and / or image / character recognition are performed.

[0045] In another variation, the processor 220 may implement the image processing logic 222 to receive image data from the camera array 230 and initiate image processing and analysis by retransmitting the image data to another computer system for image processing. Thus, in a variation, some or all of the operations to implement the image processing functions may be performed by one or more other computer systems, such as a network service, a remote server, and / or a user mobile device.

[0046] In some examples, the processor 220 receives and processes images from the camera array 230. Furthermore, the processor 220 performs different image processing operations for different sets of cameras of the camera array 230. For example, for a first set of cameras using ultra-wide-angle lens cameras, the processor 220 implements an operation to normalize the image. Furthermore, the processor 220 can normalize the image based on the distance between the rack from which the image is captured and the respective lens of the corresponding camera. Furthermore, the processor 220 can detect occupied racks (e.g., using the rack sensor 212 or through image processing) and perform a set of image processing operations based on the detected occupied racks. Furthermore, the set of selected operations can also be based on the position of the captured item.

[0047] Additionally, in some examples, the processor 220 implements image processing logic 222 to combine images from multiple cameras to form a single image of items placed on a given rack 118. For example, the processor 220 can select images captured by a particular combination of the camera array 230 based on the rack 118 in use. For the top rack or top set of racks 118, the camera array 230 can perform an image combining operation to combine images of the rack captured by the different cameras of the camera array 230 into a single image. The processor 220 can selectively implement the image combining operation based on the proximity of the camera array 230 to the particular rack and / or rack 118 in use. In the illustrated example, the camera array 230 can utilize an ultra-wide lens camera focused on the top rack 118 or top set of racks. The processor 220 implements image processing logic 222 to combine images from a pair of ultra-wide lens cameras, for example, positioned laterally.

[0048] In some examples, the processor 220 responds to use of the rack (e.g., the rack is pulled out, pushed in, or left in the pulled position) by capturing multiple images of the rack 118 using individual cameras of the camera array 230. The processor 220 can implement the camera array 230 to select which image processing operation to perform based on the rack detected as being in use. For example, in response to detecting the top rack 118 in use, the processor 220 can select to use images from a camera (e.g., an ultra-wide lens camera) that is optimized for close-up of the top rack. In such an implementation, the processor 220 can implement image combining to capture the full width (X direction) of the rack 118.

[0049] In variations, refrigeration system 200 includes a display 228 that displays output corresponding to or based on rack information 225. In examples, display 228 may be touch-sensitive and / or include an interactive interface. In some variations, rack information 225 may be displayed as content to provide information to a user about the contents of the refrigeration system.

[0050] In an example, the rack information 225 includes information about, for example, the contents of the interior space 114. In an example, the rack information 225 identifies the presence of items (e.g., bottles, beverage containers, etc.), one or more categories of items (e.g., type of beverage or container (e.g., bottles vs. cans)), a subcategory of the items (e.g., bottles of red wine vs. bottles of white wine), a state of the items (e.g., partially consumed, unopened, opened, etc.), an orientation of the items, and / or label information for individual items. Additionally, the rack information 225 can identify information about the orientation of the items, such as the relative orientation of the labels on the bottles. In such a case, the orientation can reflect a determination of whether the labels are, for example, (i) facing up (e.g., so that they are visible to the camera array when the rack is extended), (ii) turned sideways so that a portion of the label is distorted or not visible to the camera array, and / or (iii) rotated to omit most of the front panel and expose the back label or front of the item. Additionally, for detected items, rack information 225 can identify where individual items are located on a given rack (e.g., visually, by coordinates, by slot, etc.) Additional examples of rack information 225, as well as other content that can be displayed using display 228, are provided with the example of FIG.

[0051] 2B illustrates a network communication system for providing information about items stored in a refrigeration system, according to one or more embodiments. In an example, the network communication system 300 includes a refrigeration system 200 and one or more user devices 272, 274 that communicate with the refrigeration system 200 using either a local wireless connection 242 (e.g., Bluetooth) or a network connection (e.g., Wi-Fi Direct). In an alternative embodiment, the refrigeration system 200 can communicate with the user devices 272, 274 indirectly via a network service, server, or remote computer.

[0052] Thus, in some examples, network communication system 300 includes one or more servers 280 or other remote computer systems. In an variation, server 280 implements or provides network services 282 that utilize the rack information transmitted over network 292 by refrigeration system 200.

[0053] 2B, refrigeration system 200 transmits rack information 225 over one or more networks to server 280 (or other remote computer system) or network service 282. Rack information 225 may include information obtained from performing image processing of images captured by camera array 230, the captured images depicting items placed on individual racks 118. Rack information 225 may be determined locally on refrigeration system 200 by processor 220. Alternatively, some or all of rack information 225 may be determined by a remote computer, server, or service. Thus, as described with the example of FIG. 2A , the rack information 225 includes (i) information identifying the presence of items (e.g., bottles, beverage containers, etc.) on the respective racks, (ii) information regarding one or more categories (e.g., type of beverage or container) or subcategories of the respective items (e.g., type of wine (red, wine, rosé, etc.)), (iii) information regarding the status of the respective items (e.g., opened or uncorked, corked, previously opened, partially consumed, filled, etc.), and / or (iv) label information of the respective items (e.g., information regarding brand, vintage, product name, country of origin, etc.). End users can access content based on the rack information 225 using, for example, a mobile device that communicates with or otherwise utilizes the network service 282. For example, the mobile device can run an application ("app") dedicated to the network service 282 to browse content based at least in part on the rack information 225. Alternatively, the user can operate a computer having a browsing component installed thereon to browse such content.

[0054] In an alternative embodiment, the refrigeration system 200 transmits the rack information 225 to the user device 272, for example through a local wireless connection. The user device 272 can run an application (e.g., a dedicated application, a browsing component, etc.) to view content based at least in part on the rack information 225.

[0055] In an example, the user devices 272, 274 generate rack content 235 that incorporates or is based on the rack information 225. Thus, the user devices 272, 274 can display content similar or the same as that provided on the display 228 of the refrigeration system 200. In a variation, the rack content 235 includes an item / rack map showing each detected item and the corresponding rack in which the item is located. Additionally, the item / rack map can identify the location along the span of the rack (along the X, Z directions) in which the item is detected to be located. Additionally, the rack content 235 can include more information about each item, including information determined by performing image processing of the respective item, as well as supplemental information. The supplemental information can include information that is not determined from the label or item itself, but is determined from an information source based on information obtained from the label or item. For example, in the case of wine, the maker and vintage may be cross-referenced with an information repository about a particular wine maker and vintage year to obtain supplemental information including, for example, how the wine is made and descriptive information about particular aspects or attributes of the wine, such as, for example, awards the wine may have won, and taste characteristics of the wine that are determined by experts and not necessarily listed on the wine's label. As another example, rack content 235 may recommend types of food that would go well with a particular wine by referencing an identifier (e.g., vintage, maker, product label, origin, etc.), category (e.g., "Burgundy", "Pinot", etc.), or other aspect determined about the wine through image processing (e.g., image recognition of label information) against an information repository in which food recommendations are maintained.

[0056] In an example, rack content 235 is provided as an interactive interface. For example, a user may interact with a graphical representation of items identified as residing in a particular rack to view supplemental information about the individual items. Additionally or alternatively, a user may view a list of items residing in refrigeration system 200 and, through interaction with a given entry in the list, receive an output indicating the rack (or rack location) on which the item is stored.

[0057] Where information about an item is provided (e.g., through the selection of a graphical representation of the item), examples may provide additional information about the item provided. The additional information may include, for example, information about the status of the item (e.g., opened or uncorked, corked, previously opened, partially consumed, filled), recommendations and supplemental information about how to consume the item (e.g., type of food, etc.).

[0058] Further, in examples, rack content 235 may include a list of recommendations. The list of recommendations may identify other items that may be of interest to the user based, for example, on the user's affinity for a particular item. For example, historical information about items over a period of time may be maintained, and information about user preferences (e.g., winemaker, wine type, vintage, aspects of a particular item, etc.) may be maintained and analyzed to determine user preferences. Rack content 235 may provide recommendations regarding additional items the user may purchase based on the user's preferences and / or items the user may have stored in refrigeration system 200.

[0059] As another example, the rack content 235 may include an ordering interface that allows a user to purchase items from a third party source. A user may utilize the ordering interface to purchase refills for consumed items, such as replacement wine bottles. In an example, the refrigeration system 200 may monitor consumption levels of items based on image processing of returning racks to their proper position with text as items are removed, as well as indications that items have been consumed or partially consumed. In response to detecting that an item has been consumed, the rack content 235 may provide an ordering interface to allow a user to reorder the consumed item. Additionally or as a variation, the ordering interface may allow a user to purchase recommended items, or items that the user has searched for, or has been otherwise informed about.

[0060] methodology 3A-3C illustrate an exemplary method for operating a refrigeration system according to one or more embodiments. In describing the exemplary method, reference may be made to elements of FIGS. 1A-1G, 2A, and / or 2B to indicate appropriate components for performing the steps or sub-steps being described.

[0061] 3A, in step 310, a first scan or image process is performed on a first rack 118 of the refrigeration system 100, 200 when the rack 118 is located outside the cabinet 110 of the refrigeration system. In step 312, a second scan or image process is performed on a second rack 118 of the refrigeration system 100, 200 when the second rack is located outside the cabinet 110, the second rack being different from the first rack. For example, the first rack may correspond to a top rack 118 of the refrigeration system 100, and the second rack may correspond to a middle or bottom rack 118. Each of the first and second image processes includes an operation in which image data captured by a corresponding camera is processed to enable recognition and other analysis. Thus, for example, each image process may result in a normalized image of the item's label or the item itself. Additionally, the normalized image may include optimizations to enhance recognition and subsequent analysis.

[0062] In some variations, the first and second image processes are performed on images captured of the first rack 118 and the second rack 118, respectively. As described with other examples, the first and second image processes can be performed when the racks are moved inside or outside the cabinet 110, or when statically positioned outside the cabinet 110.

[0063] Further, in the example, the operation of the first image processing process is different from the operation of the second image processing process. The first image processing may be performed using a first set of cameras of a first type, and the second image processing is performed using a second set of cameras of a second type. The first and second sets of cameras may be different to accommodate different distances between the individual racks and the respective cameras. Furthermore, the type of image processing performed may also be different. To perform image analysis on racks that may be relatively close to the camera lenses, the image processing used (or preferred) may be configured specifically for wide-angle lens cameras, including ultra-wide-angle lens (or fisheye lens) cameras. Furthermore, the image processing may use multiple cameras, and the captured images are combined into a single view.

[0064] To perform image processing on racks with greater spacing, the image processing can accommodate higher resolution and alternative lighting conditions. Thus, the number and type of cameras used to image different racks 118 may vary based on the proximity of each rack to its corresponding camera. Additionally, the image processing may also vary based on the proximity of the cameras to the racks and / or the type of camera being used.

[0065] 3B, at step 320, it is detected that a rack of the refrigeration system 100, 200 is being moved from a withdrawn position to a stowed position within the interior space 114 of the cabinet 110. At step 322, the camera array 230 captures images of the contents of the rack 118 as the rack 118 is moved into the interior space 114. In some implementations, the images correspond to a series of frames, such as may be captured by a video.

[0066] In step 324, image analysis is initiated by the processor 220 of the refrigeration system 100, 200. The processor 220 may implement operations for selecting images to analyze, for example, for item detection, item recognition, label detection and recognition, etc. The operations may include selecting a set of images to analyze, more specifically, selecting a set of cameras of the camera array 230 to utilize for processing. In a variation, the processor 220 may normalize the images, such as by performing image merging as necessary, before transmitting the images to a remote computer or service for further processing. Additionally, in other variations, the processor 220 may implement operations for performing object detection and image / character recognition.

[0067] In some examples, the processor 220 determines or obtains results of the image analysis and records the results in memory and / or generates content based on the results for display. Additionally or alternatively, the results are generated or provided to a user device.

[0068] Results of the image analysis include a determination of the type of item in step 325. For example, the item may be determined by container type (e.g., bottle, can, box, etc.) and / or beverage type (e.g., soda vs. hard alcohol).

[0069] In step 326, the results of the analysis identify the location of the item. The location may relate the item to a particular rack 118 as well as the item's location on the rack. For example, the coordinates of the item along the horizontal axis (X or Z direction) may be determined. Additionally, when an item is removed from a rack and relocated, the item's new location may be determined and recorded.

[0070] In step 327, information about the item is determined using recognition analysis. In some examples, the processor 220 captures an image and performs label detection and normalization. Subsequent OCR and image analysis can be used to determine additional information about the beverage. In an example, label detection can be used to generate a normalized image of the item's label, and subsequent analysis is performed to determine information about the item. The additional information can identify the type of beverage (e.g., wine, champagne, soda, etc.), one or more subcategories of the item (e.g., wine color), and the manufacturer or brand. For wines, liqueurs, and other specialty beverages, this information can identify the maker, year, place of origin (e.g., country or region), and descriptive terms (e.g., alcohol content) that may be listed on the label.

[0071] Referring to the example of FIG. 3C, in step 330, the processor 220 initiates and performs image processing using images captured by a rack-dedicated or rack-prioritized camera set for the rack in use. The rack in use may correspond to a rack in motion (e.g., being moved from an extended position to a stowed position). In performing image processing, in step 332, images are selected from a camera set optimized or configured for the particular rack. The configuration may include camera / lens type, focus attributes, and subsequent image processing. For example, the top rack 118 may be imaged using (i) multiple cameras, (ii) an ultra-wide-angle lens camera, and / or (iii) image merging, where images from multiple cameras may be formed into a single image for processing. In one implementation, images are selected and then processed, but in variations, images from multiple camera sets are processed and prioritized by weighting. Thus, the processor 220 and subsequent image processing / analysis may utilize multiple camera sets, with non-prioritized camera sets providing information for specific purposes (e.g., hue analysis), edge analysis, and / or confidence value and rating determination.

[0072] Thus, in step 340, image analysis is performed to determine information about the items placed on the rack 118. In some examples, the processor 220 of the refrigeration system 100, 200 performs the image analysis by locally implementing the recognition algorithm. In variations, a remote computer system or device performs the image analysis operations. Additionally, in variations, the processor 220 of the refrigeration system 100, 200 and / or the remote computer system or device performs the image analysis by sending image data to a remote system or service, including a third party service, which returns the recognition results.

[0073] In step 342, information regarding the type of item is determined. For example, the presence of a new item on the rack is determined. Additionally, the type of item may be detected by type based on or corresponding to the type of container (e.g., can, box, bottle, etc.) or the shape of the item. In step 343, the location of the item on the rack 118 may be determined, the location based on, for example, the rack coordinates and / or the location of a particular slot.

[0074] In step 344, additional information about each item is determined from a recognition operation. The recognition operation may include character image recognition, logo recognition, and / or pattern analysis of the label imaged for each item. In step 345, label detection and analysis may be performed. The analysis may implement, for example, label detection, logo detection, image analysis (of the image on the label), optical character recognition (OCR), and / or other operations to determine information such as the wine's vintage, maker, origin, variety, and other categories.

[0075] Additionally or as a variation, in step 346, an opacity and / or hue analysis is performed. The opacity information can be used to determine the state of the item. For example, a change in the opacity / hue of the item can reflect the fill level of the item. Further, in step 347, cork or lid recognition can be performed, for example, to determine whether the item has been opened. For example, in the case of a cork, the height of the cork from the top of the bottle can reflect whether the bottle has been uncorked. Similarly, if the bottom of the lid is missing, the lid can be considered to have been previously opened.

[0076] In some variations, the image analysis performed results in an identifier for the item, and the processed image of the item is stored. For example, the identifier for the item may be based in part on the label analysis. When the item is first detected, an image of the item may be stored in association with the identifier, along with a determination regarding the hue, opacity, and / or lid characteristics. In subsequent instances when the rack 118 is used, the hue, opacity, and / or lid characteristics of the same item may be compared to the stored image to determine changes that indicate the item has been opened (e.g., uncorked) and / or partially consumed.

[0077] According to an example, the image analysis decision is transmitted and / or rendered in step 350. In some examples, the decision may be transmitted by refrigeration system 100, 200 to another device using a local wireless port (step 352). In variations, the decision may be transmitted by refrigeration system 100, 200 to a user's computing device (step 354), e.g., using one of wireless communication ports 240, 242. Additionally, a remote computer system or service may make the decision in whole or in part and transmit the decision to another device using a network connection.

[0078] Network Computer System 4 illustrates a computer system on which one or more embodiments may be implemented. Computer system 400 may be implemented, for example, on a server or combination of servers. For example, computer system 400 may be implemented as part of network communication system 300 as described with the example of FIG. 2B. Similarly, computer system 400 may implement operations as described with the example of FIG. 2A and steps or sub-steps of the exemplary method as described with the example of FIGS. 3A-3C.

[0079] In one implementation, computer system 400 includes a processor 410, a memory resource 420 (e.g., read-only memory (ROM) or random access memory (RAM)), a storage device 440, and a communication interface 450. Computer system 400 includes at least one processor 410 for processing information stored in memory resource 420, such as provided by random access memory (RAM) or other dynamic storage device for storing information and instructions executable by processor 410. Memory resource 420 may also be used to store temporary variables or other intermediate information during execution of instructions to be executed by processor 410. Computer system 400 may also include memory resource 420 or other static storage device for storing static information and instructions of processor 410. A storage device 440, such as a magnetic disk or optical disk, is provided for storing information and instructions.

[0080] The communication interface 450 allows the computer system 400 to communicate with one or more networks (e.g., cellular networks) through the use of a network link 480 (wireless or wired). Using the network link 480, the computer system 400 can communicate with a refrigeration system, a user device, or other computing systems to implement one or more embodiments described. The executable instructions 442 stored in the memory resource 420 can include instructions 442 for implementing a remote computer system, a network service, and / or a network communication system (see, e.g., FIG. 2B) as described with one or more embodiments. The executable instructions stored in the memory resource 420 can also implement operations for implementing steps as described with the examples of FIGS. 3A-3C.

[0081] Thus, examples described herein relate to the use of computer system 400 to implement the techniques described herein. According to an aspect, the techniques are executed by computer system 400 in response to processor 410 executing one or more sequences of one or more instructions contained in memory resource 420. Such instructions may be read into memory resource 420 from another machine-readable medium, such as storage device 440. Execution of the sequences of instructions contained in memory resource 420 causes processor 410 to perform the processing steps described herein. In alternative implementations, hardwired circuitry may be used in place of or in combination with software instructions to implement examples described herein. Thus, examples described herein are not limited to any particular combination of hardware circuitry and software.

[0082] User Device FIG. 5 is a block diagram illustrating a user device for use with the described example. In one example, the user device 500 may perform a designated service application that utilizes rack information 525 to provide rack content 535 and other information. In some examples, the user device 500 operates to communicate with a network service through one or more networks. In many implementations, the user device 500 includes a mobile computing device, such as a smartphone, a tablet computer, a laptop computer, a VR or AR headset device, etc. The user device 500 includes wireless communication interfaces 510, 512 for communicating with external entities using any number of wireless communication protocols. The user device 500 can receive rack information 525 from the network system 502 (or other remote computer system or device), for example, through a wireless network interface (e.g., cellular radio, Wi-Fi, etc.). Additionally or as a variation, the user device 500 can receive rack information 525 from the refrigeration system 100, 200 using a local wireless communication protocol (e.g., Bluetooth).

[0083] In certain aspects, the user device 500 stores a specified application (e.g., a service app 532) in local memory 530. In variations, the local memory 530 can store additional applications executable by the one or more processors 520 of the user device 500, enabling it to access and interact with one or more host servers via one or more networks 580.

[0084] As described with various examples, the service application 532 executes on the user device 500 and generates rack information 525 on the display screen 540 of the user device 500. The rack information 525 can be displayed as part of a user interface 545 that includes interactive features (e.g., menus, selectable features, search features, etc.) that allow the consumer to view the inventory of beverages, purchase additional beverages, view recommendations and other information about the items in the inventory. Additionally, in some examples, the user interface 545 can present a rack map where items are displayed by rack and, in some variations, by their location on their respective racks.

[0085] Enhanced beverage cooler 6A-6C illustrate an example beverage cooler, according to one or more examples. In the illustrated example, the beverage cooler 600 may include configurations that enhance or optimize use of the beverage cooler 600. Additionally, in some variations, the beverage cooler may be structured with a camera array, a processor, and resources to determine rack information, as described with various examples.

[0086] 6A-6C, beverage cooler 600 includes a housing 610 with a door 620 and a door handle 612. The door inset can be mounted flush with a contoured upper segment 615 of the housing 610. The door 620 can be contoured and shaped to match the cabinet 610 so that the door 620 is fully recessed and flush with the facade of the upper housing segment 629.

[0087] Top tray table In the examples, the housing 610 of the beverage cooler 600 includes an integral tray 612 disposed on a top surface 611. From the examples, it is recognized that the beverage cooler 600 can be up to waist height. The integral tray 612 can be integrated into the top surface to allow the housing 610 to function as a flat top surface for receiving items without affecting the design or functionality of the beverage cooler 600. Additionally, the tray 612 can include a lip or other protrusion to accommodate items to be contained thereon. Additionally, in the examples, the top surface 611 of the housing 610 can be shaped or structured to hold a structure (e.g., the exterior of the tray 612). The top surface 611 can be contoured or provided with a lip or upward protrusion on the inside, for example, separate from the tray 612. In some examples, the integral tray 612 is integrally formed (e.g., through a common manufacturing process with the rest of the housing, such as injection molding or metal pressing). In other examples, the tray 612 is integral, meaning that the tray can be connected (e.g., using fasteners). In such an example, the integrated tray 612 may be attached to and detached from the housing 610 .

[0088] Compressor housing segment In the example, the beverage cooler 600 includes a compressor housing segment 630 that is positioned to extend from the bottom surface 613 of the housing 610. The compressor housing segment 630 may include a sloped front façade 632 that tapers inwardly from 630. The housing 610 may be further elevated off the ground by legs 636. Optionally, the legs 636 may be retractable to allow the vertical height of the housing 610 to be adjustable. When the housing 610 is elevated by the legs 636, the sloped front façade 632 creates a cavity in the front area below the housing 610. This cavity allows for scaffolding and sweeping without adding to the overall height of the housing. Additionally, the front façade 632 may create a cavity below the compressor housing segment 630 as well as on the sides of the compressor housing segment 630. Providing such a cavity improves airflow from the underside and sides of the housing.

[0089] Additionally, the compressor housing segment 630 can house a fan that blows the warmed air outward, away from the compressor assembly. By structuring the front facade 632 to be angled, the air can be blown downward toward the ground, rather than toward a person's feet, or other directions where the warmed air may be trapped. Because the air is blown forward (at an angle toward the ground), the beverage cooler 600 can be pressed with the rear 609 against a wall without having to provide a gap for the blown air. Additionally, the cabinet 610 can be installed in a tight space or mounted flush under a counter or inside a cabinet as a result of the blown air being directed directly forward and underneath the cabinet 610.

[0090] 6C, the rear surface 609 of the housing 610 is mounted approximately flush with the wall or cabinet and is flat on the rear surface 609. The compressor housing segment 630 may also have a flat rear facade to eliminate or reduce separation between the back wall and the unit.

[0091] Ribbed translucent exterior FIG. 6D illustrates a variation in which the beverage cooler 600 includes a ribbed door 628 to promote light diffusion. In some examples, the ribbed door 628 or facade can be formed from ribbed or wavy glass, or other translucent material. For example, the door 628 can be constructed partially from ridged glass (or a translucent material), such as bottle glass. As an addition or variation, the door can be formed partially from opaque glass or a translucent material. The use of light diffusing materials can protect certain types of items, such as vintage wines, from degradation due to light.

[0092] Reversible Rack 7A and 7B illustrate a reversible rack for a refrigeration system, according to one or more examples. The rack 700 can be integrated with a refrigeration system, as described with various examples, including in FIGS. 1A-1G and 6A-6D. The rack 700 includes a reversible bottom tray 720 carried by a rack structure 710. The tray 720 can include a first layer 712 and a second layer 714, each including an arrangement of spaced apart corresponding support structures, where the spaced apart support structures can correspond to wires, rods, or similar types of structures. In some examples, the spacing between the support structures of the first layer 712 can be greater than the spacing between the support structures of the second layer 714. The change in spacing can be implemented, for example, by varying the thickness of the support structures of the first layer 712 compared to the second layer 714.

[0093] As described, the trays 720 may be reversible when placed under the area formed by the rack structure 710. In FIG. 7A, the first layer 712 is placed on top (relative to the second layer 714). In FIG. 7B, the second layer 714 is placed on top. The trays 720 may be retained within the rack structure 710 by a combination of retaining structures 716 (e.g., clips, shelf support pins and bolts, etc.). For example, a user may manipulate the retaining structures 716 on the inner surface of the rack structure 710 to allow the trays 720 to be separated, inverted, and reinserted into the rack structure 710.

[0094] In the example of FIG. 7A, the first layer 712 of the tray structure 720 is the top surface. The first layer 712 can include spacing between support structures dimensioned to hold wine bottles. The second layer 714 can form a base structure for holding smaller bottles or items. In the example shown, the arrangement of the first layer 712 can hold wine bottles width-wise, meaning that wine can be presented on the tray 720 laterally relative to the direction of movement of the rack 700 (which can move in and out of the cabinet in the Z direction).

[0095] Referring to the example of FIG. 7B, a user can invert the tray 720 so that the second layer 714 is on top. The second layer can support items of various sizes, including cans or small bottles that would pass through a conventional tray designed to hold wine bottles. Additionally, the second layer can also hold wine bottles or other similarly shaped items. However, the positioning of the second layer 714 also allows for wine bottles to be held vertically (i.e., along the Z direction) relative to the movement of the rack.

[0096] In examples, a user may select which side of tray 720 faces up based on preferences regarding the orientation of wine bottles and / or the size or dimensions of items tray 720 may hold. In some examples, rack 700 may be provided as an accessory to a refrigeration system as illustrated by the various examples. Additionally, a refrigeration system as illustrated by the various examples may include one or more racks 700.

[0097] conclusion Although examples are described in detail herein with reference to the accompanying drawings, it should be understood that the concept is not limited to those exact examples. Therefore, it is intended that the scope of the concept be defined by the following claims and their equivalents. Furthermore, it is contemplated that a particular feature described individually or as part of an example can be combined with other features described individually or as part of other examples, even if the other features and examples do not mention the particular feature. Thus, the failure to describe a combination does not preclude the right to such combination. [Explanation of symbols]

[0098] 12 Bottles 100 Refrigeration System 101 Left side 103 Right Side 110 Cabinet 111 Upper Segment 112 Handle 114 Interior Space 117 Contained Location 118 Luck 119 Pulled out position 120 Doors 121 Bottom 122 Camera 124 Camera 125 Space 126 Cameras 128 Upper Segment 130 Cooling Subsystem 140 Rack Sub-Assembly 160 Camera Array 180 Camera Module 182 Case 185 Lens Surface 192 Case 200 Refrigeration System 210 Cooling Subassembly 211 Door sensor 212 Rack Sensor 213 Temperature Sensor 220 Processor 222 Image Processing Logic 224 Temperature Control Operation 225 Rack Information 227 Camera Interface 228 Display 230 Camera Array 235 Rack Content 240 communication port, wireless communication port 242 communication port, local wireless connection, wireless communication port 272 User Devices 274 User Devices 280 Server 282 Network Services 292 Network 300 Network Communication System 400 Computer Systems 410 Processing Resources 410 Processor 420 Memory Resources 440 Storage Devices 442 Executable command 450 Communication Interface 480 Network Link 500 user devices 502 Network System 510 Wireless Communication Interface 512 Wireless Communication Interface 520 Processor 525 Rack Information 530 Local Memory 532 Service Apps 535 Rack Content 540 Display Screen 545 User Interface 580 Network 600 Beverage Cooler 609 Back 610 Case 610 Cabinet 611 Top surface 612 Door handle, integrated tray 613 Bottom 615 Upper Segment 620 Door 628 Ribbed Door 629 Upper housing segment 630 Compressor Housing Segment 632 Front Facade 700 Racks 710 Rack Structure 712 First Layer 714 Second Layer 716 Retention structure 720 Reversible bottom tray, tray, tray structure

Claims

1. a cabinet having an interior space; a cooling subassembly for cooling the interior space; a door connected to a front side of the refrigeration cabinet for enclosing the interior space in a closed position and for providing access to the interior space in an open position; a rack subassembly mounted within the cabinet, the rack subassembly including a set of racks, each rack movable from a stowed position contained entirely within the interior space to an extended position in which at least a portion of the rack extends outside the interior space to receive one or more items; and a camera array including one or more cameras, each of the one or more cameras oriented such that a corresponding viewing angle includes a vertical space in front of the interior space; A refrigeration system comprising:

2. 2. The refrigeration system of claim 1, wherein the camera array comprises a plurality of cameras positioned outside the interior space of the cabinet.

3. 3. The refrigeration system of claim 2, wherein the cameras of the camera array are positioned facing downward and the vertical space of the field of view includes an overlap with a space occupied by a thickness of the door when the door is in the closed position.

4. The refrigeration system of claim 3 , wherein the cameras of the camera array are integrated into the structure of the cabinet.

5. 4. The refrigeration system of claim 3, wherein the cameras are retrofitted to the cabinet.

6. The refrigeration system of claim 1 , wherein the camera array includes one or more wide-angle lenses.

7. 7. The refrigeration system of claim 6, wherein the camera array includes at least one first wide-angle lens positioned proximate to at least a first side of the interior space and a second wide-angle lens positioned proximate to at least a second side of the interior space.

8. 8. The refrigeration system of claim 7, wherein the camera array includes at least a third lens disposed between the first wide-angle lens and the second wide-angle lens.

9. the set of racks includes a first rack disposed adjacent an upper side of the interior space and a second rack disposed below the first rack; 9. The refrigeration system of claim 8, wherein the camera array is operable to capture a recognizable image of an object placed on the first rack using either or both of the first wide-angle lens and / or the second wide-angle lens.

10. 10. The refrigeration system of claim 9, wherein the camera array is operable to capture recognizable images of objects disposed on the second rack using the third lens.

11. The refrigeration system of claim 1 , wherein the camera array is movement triggerable to capture and process images.

12. 1. A method for operating a refrigeration system, comprising: performing a first image scan of a first rack using a first set of cameras, the first image scan being performed when the first rack is outside an interior volume of the refrigeration system and a portion of the first rack is a first distance from the first set of cameras; performing a second image scan of a second rack using a second set of cameras, the second image scan being performed when the second rack is outside of the interior volume of the refrigeration system, a portion of the second rack being a second distance from the second set of cameras, the second distance being greater than the first distance; A method comprising:

13. 13. The method of claim 12, wherein the first set of cameras have a first type of lens each having a first field of view angle, and the second set of cameras have a second type of lens each having a second field of view angle, the second field of view angle being smaller than the first field of view angle.

14. 14. The method of claim 13, wherein the first set of cameras includes a first wide-angle camera and a second wide-angle camera, and performing the image scan includes combining an image captured by the first wide-angle camera and an image captured by the second wide-angle camera.

15. The method of claim 14 , wherein the second set of cameras includes a single camera that captures an image of a majority of the second rack.

16. 1. A method for operating a refrigeration system, comprising: detecting when a given rack of a plurality of racks of the refrigeration system is moved from a withdrawn position to a stowed position within the refrigeration system; capturing one or more images of the rack and initiating performance of image analysis of the one or more images to determine information regarding one or more items placed on the rack; A method comprising:

17. The method of claim 16 , wherein initiating performance of the image analysis includes determining, for each of the one or more items, information that identifies a type of the item.

18. The method of claim 17 , wherein determining the type of the item includes determining whether the item is a bottle or a can.

19. The method of claim 16 , wherein initiating performance of the image analysis comprises determining a position of each of one or more items relative to the rack.

20. 17. The method of claim 16, wherein initiating the performance of the image analysis includes detecting a label on each of the one or more items and performing image recognition on the label to determine information regarding the contents of the bottle.

21. 21. The method of claim 20, wherein the determined information regarding the contents of an item includes at least one of a brewing year, a manufacturer, or a type of the contents.

22. The method of claim 21 , wherein the item is a wine bottle.

23. 17. The method of claim 16, further comprising performing the image analysis on the refrigeration system.

24. 17. The method of claim 16, further comprising selecting one of a plurality of sets of cameras of the camera array for capturing the one or more images based on a vertical distance or position of the moving rack relative to a camera array.

25. 25. The method of claim 24, wherein selecting one of a plurality of sets of cameras comprises selecting a first set of cameras including one or more wide angle lenses in response to detecting that the vertical distance is less than a first threshold.

26. 25. The method of claim 24, wherein the first set of cameras includes at least a first wide angle lens positioned proximate to at least a first side of the interior space and a second wide angle lens positioned proximate to at least a second side of the interior space.

27. 27. The method of claim 26, wherein initiating performance of the image analysis includes combining an image captured using the first wide angle lens and an image captured using the second wide angle lens.

28. The method of claim 16 , further comprising the step of transmitting information about the item to another device.

29. 30. The method of claim 28, wherein transmitting information about the item comprises transmitting the information to a network service using one or more networks.

30. 30. The method of claim 28, wherein transmitting information about the item includes transmitting the information to a user's mobile device using a local wireless connection.

31. The method of claim 16 , wherein initiating performance of the image analysis includes determining information regarding the type of the item, the location of the item relative to the rack, and the contents of the item.

32. The method of claim 16 , wherein determining the type of information comprises estimating a relative amount of the content or a volume of the item.

33. a cabinet having an interior space; a cooling subassembly for cooling the interior space; a door connected to a front side of the refrigeration cabinet for enclosing the interior space in a closed position and for providing access to the interior space in an open position; a rack subassembly mounted within the cabinet, the rack subassembly including a set of racks, each rack movable from a stowed position contained entirely within the interior space to an extended position in which at least a portion of the rack extends outside the interior space to receive one or more items; and a camera array including one or more cameras, each of the one or more cameras oriented such that a corresponding viewing angle includes a vertical space in front of the interior space; one or more processors, detecting that a rack of the rack subassembly is in the extended position; capturing one or more images of the rack; commencing performing an image analysis of the one or more images to determine information regarding one or more items placed on the rack; the one or more processors executing instructions for performing operations including A refrigeration system comprising:

34. 34. The refrigeration system of claim 33, wherein the one or more processors execute instructions to perform the image analysis.

35. A camera module for a refrigeration system, comprising: a camera array including one or more cameras; It is a housing the housing being structured for fastening to a refrigeration system and for positioning the camera array such that a corresponding viewing angle of one or more cameras of the camera array is disposed in a vertical space consistent with a thickness occupying a door of the refrigeration system when the door is in a closed position; one or more processors, capturing one or more images of the rack of the refrigeration system as the rack is extended from an interior cabinet; commencing performing an image analysis of the one or more images to determine information regarding one or more items placed on the rack; the one or more processors executing instructions for performing operations including A camera module comprising:

Images