Image Processing UI with Perimeter Icons for Fast Object Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing user interfaces for cameras require inefficient and suboptimal interaction methods, such as pinching or touching the entire display, which are cumbersome and difficult when objects overlap or move, violating Fitts' Law and leading to poor usability.
Innovation Solution
An apparatus and method that detects objects in an image, calculates region of interest (ROI) scores, and displays user interface elements like icons for these objects on the display perimeter, allowing one-handed selection and control of image processing functions like zoom, focus, and exposure based on these scores.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the entire display is used as the interaction area for selecting objects, then all shooting areas can be considered as potential input areas, but the time needed to move the selector to the target area increases significantly according to Fitts' Law
Solution Approach 1:
The patent segments the interaction area by displaying separate icons for each detected object along the display perimeter. Instead of requiring the user to navigate across the entire display to select an object, each object is represented by its own icon that can be independently selected. This segmentation reduces the effective interaction distance and applies Fitts' Law more efficiently to each individual icon rather than the entire display area.
Solution Approach 2:
The patent introduces icons as intermediary elements between the detected objects in the image and the user interface selection mechanism. These icons serve as mediators that represent objects and enable selection without requiring direct interaction with the object locations in the image. The icons are positioned along the display perimeter, creating an intermediate selection layer that reduces the time and effort required to select objects.
2Adaptability or versatility
If conventional touch interaction is used across the entire display, then users can select any object, but usability becomes inefficient when objects overlap or move continuously during video shooting
Solution Approach 1:
The patent segments overlapping or closely positioned objects into distinct icons along the display perimeter. Each detected object, even if overlapping in the image, receives its own icon representation. This segmentation allows users to clearly distinguish and select individual objects without confusion from overlapping visual elements, significantly improving ease of operation when dealing with multiple or overlapping objects.
Solution Approach 2:
The patent implements a dynamic icon generation system that automatically updates as objects are detected, tracked, or added during video shooting. The icons along the display perimeter dynamically reflect the current state of detected objects, allowing users to select objects even when they move or appear/disappear in the frame. This dynamic adaptation maintains usability without requiring manual reconfiguration of the interface.
3Adaptability or versatility
If user interface elements are displayed across the entire display area, then all objects can be accessed, but one-handed operation becomes difficult and the interaction complexity increases
Solution Approach 1:
The patent moves the interaction interface from the two-dimensional image space to a one-dimensional arrangement along the display perimeter. By positioning all icons along the edge of the display, the patent creates a compact interaction zone that can be easily accessed with one hand. This dimensional reorganization maintains access to all detected objects while significantly reducing the physical distance and complexity of interaction, making the interface suitable for one-handed operation.
Data Source
AI summary
An apparatus and method for processing an image are provided. The apparatus includes: one or more processors; memory storing instructions configured to, when executed by the one or more processors, cause the one or more processors to: detect objects in the image; determine region of interest (ROI) scores of the respective detected objects; determine whether to display icons for the respective objects based on the respective ROI scores; display an image processing user interface including at least a portion of the image and the icons; and receive an input selecting an icon from among the icons displayed with the user interface, and in response perform image processing based on the selected icon.