Depth Image Background Removal for Intuitive User Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing applications face challenges in user interaction due to complex and non-intuitive control systems, which can create a barrier between users and game or multimedia experiences, as controls often do not correspond to actual actions.
Innovation Solution
A target recognition, analysis, and tracking system that uses depth imaging to isolate human targets, process gestures, and interpret movements to control applications or animate avatars, allowing users to interact with games and applications using natural motions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional controls (keyboards, mice, controllers) are used to manipulate game characters or application aspects, then the application can be operated, but the controls become difficult to learn and do not correspond to actual actions, creating a barrier between user and application
Solution Approach 1:
The patent replaces traditional mechanical control systems (keyboards, mice, controllers) with a computer vision-based system that captures and processes images of the user's actual body movements. The system substitutes physical control devices with optical sensing and image processing, allowing natural motions to directly control application elements without requiring learning of arbitrary control mappings
Solution Approach 2:
The patent creates a digital representation or model of the user's physical body and movements through image processing. By capturing the user's actual motions and creating a corresponding digital model, the system allows the user's real-world actions to be copied and translated into application controls, eliminating the disconnect between control input and intended action
2Adaptability or versatility
If controls are designed to correspond to actual actions, then user intuition is improved, but the system requires complex image processing and movement analysis capabilities
Solution Approach 1:
The patent divides the image processing task into distinct segments: capturing images of user movements, processing images to identify specific body parts and their positions, determining movements of those body parts, and translating movements into application controls. This segmentation allows each processing stage to be handled separately, making the overall complex system more manageable and implementable
Solution Approach 2:
The patent introduces an intermediary processing system that acts as a mediator between the user's physical movements and the application controls. This intermediary layer captures images, processes them to extract movement information, and translates the movements into appropriate control signals, bridging the gap between natural human motion and digital application interaction
Data Source
AI summary
An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may then be discarded to isolate one or more voxels associated with a foreground object such as a human target and the isolated voxels associated with the foreground object may be processed.