UI Object Positioning via Camera Depth to Resolve Screen Crowding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface (UI) systems that use camera images to receive user input face usability issues due to crowding when a large number of selectable objects are displayed, leading to a decrease in usability.
Innovation Solution
An information processing system that includes processing circuitry to control the movement of UI objects on a display screen from a pre-recognition position to a post-recognition position in response to user input, where the post-recognition position is spatially related to a camera-captured image-derived feature, allowing for efficient arrangement of UI objects to avoid crowding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a large number of selectable objects are displayed in the screen region near the user's head or hands, then the UI provides more options, but the screen becomes crowded and usability drops
Solution Approach 1:
The patent transitions UI object placement from a two-dimensional screen plane to a three-dimensional space by utilizing depth information from camera-captured images. UI objects are positioned at spatial locations corresponding to the user's head and hand positions in 3D space, allowing multiple objects to be arranged without crowding the limited screen region near the user.
Solution Approach 2:
The patent implements dynamic positioning of UI objects based on real-time recognition of the user's head and hand positions. The UI objects move and reposition themselves in response to user gestures, creating an interactive system that adapts to user actions rather than maintaining fixed positions, thereby preventing crowding while providing multiple selectable options.
2Ease of operation
If UI objects are positioned near the user's head or hands in camera-captured images, then user interaction is enhanced, but screen region limitations cause crowding when many objects are provided
Solution Approach 1:
The patent extends the limited two-dimensional screen region into three-dimensional space by using depth information from camera images. UI objects are placed at different depths and spatial positions corresponding to the user's anatomy (head, hands, torso), effectively increasing the available area for UI objects without requiring more screen real estate.
Solution Approach 2:
The patent nests multiple UI objects within the spatial volume defined by the user's body in the camera image. By positioning UI objects at different spatial locations (head region, hand regions, torso region) and using depth layering, multiple objects can be contained within the limited screen area without overlapping or crowding.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An information processing system includes processing circuitry configured to control a movement of a UI object on a display screen from a pre-recognition position toward a post-recognition position in response to recognition of an operation object initiated by a user, wherein the post-recognition position is spatially related to a displayed position of a predetermined displayed feature, and the predetermined displayed feature is an image derived from a camera captured image.