Appliance Object Tracking via Body Part Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image-based recognition systems for appliances lack the ability to effectively track and manage the status of objects within their operating volumes, particularly in terms of inventory, usage, and processing states, leading to inefficiencies in automation and user interaction.

Innovation Solution

An object tracking system comprising an imager and a controller that captures image data to detect parts of a person's body and objects, identifies object characteristics, and initiates actions based on these characteristics, such as updating inventory or selecting processing methods, providing feedback to users through advanced interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If an image-based recognition system is implemented to track objects in an appliance, then object status tracking capability is improved, but device complexity increases

Engineering Contradiction:
Improveobject status trackingVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system divides object tracking into distinct functional modules: image capture by the imager, body part detection by the controller, object identification, and action determination. This segmentation allows each component to specialize in a specific task, improving overall tracking capability while managing system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller serves as an intermediary between the imager and the appliance's control systems. It processes image data to detect body parts, identifies objects, determines actions, and initiates appropriate responses. This intermediary role centralizes the complexity in a dedicated processing unit while simplifying the interfaces with other components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the system detects body parts and identifies objects to provide user feedback, then user interaction quality is improved, but processing time increases

Engineering Contradiction:
Improveuser interactionVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary detection of body parts and identification of objects as the user approaches or interacts with the appliance. By preparing this information in advance, the system can quickly determine appropriate actions and provide immediate feedback, reducing perceived processing time while maintaining high interaction quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system initiates actions based on detected body parts and identified objects to provide feedback to the user. This feedback loop allows the appliance to respond appropriately to user intentions, improving ease of operation by making the system more intuitive and responsive to user needs.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10762641B2Interaction recognition and analysis system
Publication Date: 2020.09.01 WHIRLPOOL CORP
  • US10762641B2 patent drawing
  • US10762641B2 patent drawing
  • US10762641B2 patent drawing

AI summary

An object tracking system is disclosed. The system comprises an appliance comprising at least one operating volume and an access region through which the operating volume is accessed. The system further comprises at least one imager and a controller. The controller is operable to detect at least one part of a person's body in the access region based on the image data and identify the object in connection with the part of the person's body. Based on the detection of the object in connection with the person's body, the controller is configured to identify the object. An action is determined for the object based on one or more characteristics of the physical object indicated in the image data.