Dynamic GUI Positioning for Gesture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems for remote operation of consumer electronics using gestures fail to account for variations in user size within the image due to changes in camera distance, leading to inconsistent GUI element reachability and usability.
Innovation Solution
An image processing apparatus that detects and calculates the size and position of a person or their parts in an image, adjusts the GUI elements' placement based on these calculations, and optionally enlarges specific image regions to maintain consistent usability across varying distances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the camera distance to the user is changed, then the user size in the image changes, but the GUI element reachability becomes inconsistent
Solution Approach 1:
The system dynamically adjusts the GUI element placement and image region based on the detected user size in the image. The control unit calculates the user size from the image data and modifies the display parameters in real-time, transforming the static GUI layout into a dynamic one that adapts to varying user distances from the camera.
Solution Approach 2:
The system changes the display parameters (GUI element positions and image region size) based on the calculated user size parameter. When the user size in the image changes due to distance variation, the control unit adjusts the parameters of the displayed image and GUI elements to maintain consistent operability.
2Shape
If the user moves closer to the camera, then the user appears larger in the image, but the hand movement range in the image increases
Solution Approach 1:
The control unit adjusts the display parameters based on the calculated user size. When the user appears larger in the image (closer to camera), the system modifies the GUI element placement and may adjust the image region to maintain appropriate hand movement range for interaction.
3Shape
If the user moves farther from the camera, then the user appears smaller in the image, but the hand movement range in the image decreases
Solution Approach 1:
The control unit adjusts the display parameters based on the calculated user size. When the user appears smaller in the image (farther from camera), the system modifies the GUI element placement and may adjust the image region to ensure sufficient hand movement range for interaction.
4Device complexity
If GUI elements are disposed at fixed positions, then the layout is simple, but the user must adjust position to reach elements when user size varies
Solution Approach 1:
The system transforms the static GUI layout into a dynamic one where element positions are adjusted based on the detected user size. The control unit calculates appropriate GUI element positions according to the user's apparent size in the image, ensuring elements remain within reachable hand movement range without requiring users to physically reposition themselves.
Solution Approach 2:
The system changes the GUI element position parameters based on the calculated user size parameter. This dynamic parameter adjustment allows the GUI layout to adapt to varying user distances while maintaining operational ease.
Data Source
AI summary
There is provided an image processing apparatus including: a detecting unit detecting one of an entire person and a part of a person in an image produced by image data acquired by image pickup by an imaging unit; a position/size calculating unit calculating a size and a position of the detected one of the entire person and the part of the person in the image; and a GUI disposing unit disposing graphical user interface (GUI) elements, which are to be displayed by being superimposed on the image produced by the image data, on the image based on the calculated size and position.