Multi-camera vision system facilitating detection of door position using audio data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera systems in refrigerator appliances are resource-intensive, complex, and costly, requiring significant data processing, storage, and communication resources, and are difficult to integrate into the appliance's design and manufacturing, with high energy consumption and maintenance costs.
Innovation Solution
A multi-camera vision system that uses audio data to determine the position of the refrigerator door and operates the camera only when the door is open, capturing data using audio data recognition models that are more resource-efficient than image-based models, reducing the need for complex components and lowering operational costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a camera system is used to monitor food items in the refrigerator appliance, then inventory monitoring capability is improved, but device complexity and resource consumption increase significantly
Solution Approach 1:
The patent extracts the door position detection function from the camera system by using a separate audio sensor to capture door opening/closing sounds. This allows the camera to operate independently based on audio-triggered events, reducing the complexity burden on the camera system while maintaining inventory monitoring capability.
Solution Approach 2:
The audio sensor serves multiple functions: it detects door position (open/closed state), triggers camera operation, and enables event-based inventory monitoring. This multi-functionality reduces the need for separate sensors and control mechanisms, thereby reducing overall system complexity.
2Productivity
If a camera system continuously monitors the chilled chamber, then inventory tracking is improved, but energy consumption increases
Solution Approach 1:
Instead of continuous monitoring, the camera operates periodically based on audio-triggered events. The audio sensor detects door opening/closing sounds and triggers the camera to capture images only at these relevant moments, significantly reducing energy consumption while maintaining effective inventory tracking.
Solution Approach 2:
The system uses the natural acoustic environment (door opening/closing sounds) to automatically trigger camera operation without requiring continuous power or manual control. The audio-based event detection enables the system to serve itself by utilizing ambient sounds for intelligent operation scheduling.
3Loss of energy
If audio data recognition models are used to determine door position, then operational costs are reduced, but measurement precision requirements increase
Solution Approach 1:
The audio sensor acts as an intermediary that converts physical door position information (open/closed state) into audible sound signals. The audio recognition model then processes these sound signals to determine door position, providing a cost-effective indirect measurement method that achieves sufficient precision for inventory management purposes.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces energy and operational costs, simplifies the design and assembly of the inventory management system, and improves efficiency by concentrating data processing and capture efforts only when the door is open, while maintaining effective inventory management.
Implementation Method 1
The camera module can be configured to capture audio data associated with the chilled chamber
Data Source
AI summary
In one embodiment, a refrigerator appliance is provided. The refrigerator appliance can include a cabinet defining a chilled chamber, a door to provide selective access to the chilled chamber, and a camera assembly operable to monitor the chilled chamber. The camera assembly can include a camera module having a camera that is operable to capture data associated with the chilled chamber. The camera module can be configured to capture audio data associated with the chilled chamber. The camera module can be further configured to determine a position of the door based at least in part on the audio data associated with the chilled chamber. The camera module can be further configured to operate the camera to capture the data associated with the chilled chamber based at least in part on a determination that the door is in an open position.