Depth image processing

Abstract

Embodiments described herein can be used to detect holes in a subset of pixels of a depth image that has been specified as corresponding to a user, and to fill such detected holes. Additionally, embodiments described herein can be used to produce a low resolution version of a subset of pixels that has been specified as corresponding to a user, so that when an image including a representation of the user is displayed, the image respects the shape of the user, yet is not a mirror image of the user. Further, embodiments described herein can be used to identify pixels, of a subset of pixels specified as corresponding to the user, that likely correspond to a floor supporting the user. This enables the removal of the pixels, identified as likely corresponding to the floor, from the subset of pixels specified as corresponding to the user.

Description

Background technique [0001] Many computing applications, such as computer games, multimedia applications, etc., use controls to let users manipulate game characters or other aspects of the application. Traditionally, such controls have been input using, for example, controllers, remotes, keyboards, mice, and the like. Unfortunately, such controls can be difficult to learn, creating a barrier between the user and such games and applications. Additionally, such controls may differ from actual game operation or operation of other applications that use the controls. For example, game controls that cause a game character to swing a baseball bat may not correspond to the actual motion of swinging a baseball bat. More recently, cameras have been used to allow users to manipulate game characters or other aspects of applications without the need for traditional handheld game controllers. Additionally, such a camera enables the user's representation to be displayed in games or other ...

AI Technical Summary

Problems solved by technology

However, while useful for detecting and displaying user representations in some situations, ST techniques have been shown to be unable to reliably detect and display user representations in other situations.

For example, ST technology often cannot reliably detect and display user representations while the user is lying or sitting on or near the ground

Images