Dynamic Overlay Graphic Placement Around Important Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for placing overlay graphics in image sequences are either static and risk occluding important information or manual, which is time-consuming and introduces delays in live broadcasts.
Innovation Solution
A computer-implemented method for selecting overlay graphic placement locations based on overlay graphic and object data, using placement scores determined by convolving matrix representations of the graphic and image sequence, with early stopping and prediction techniques to optimize resource usage and viewer experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If overlay graphics are placed in fixed locations, then placement is simple and consistent, but important information in the image sequence may be occluded
Solution Approach 1:
The patent implements dynamic overlay graphic placement by analyzing each frame of the image sequence to identify important objects and automatically adjusting the placement location of overlay graphics in real-time. This transforms the static fixed-location approach into a dynamic system that adapts to the content of each frame, preventing occlusion of important information while maintaining ease of operation through automated decision-making algorithms.
2Loss of information
If overlay graphic placement is performed manually by a graphics director, then placement can avoid occluding important information, but the process is time-consuming and introduces delays in live broadcasts
Solution Approach 1:
The patent replaces the manual mechanical process of a graphics director visually assessing each frame and manually positioning overlay graphics with an automated computer-based system. The system uses image processing algorithms to automatically detect important objects, calculate optimal placement locations, and render overlay graphics without human intervention. This substitution eliminates the time-consuming manual operations while maintaining or improving the quality of placement decisions, enabling real-time processing for live broadcasts.
3Measurement precision
If all candidate graphic locations are evaluated to find the optimal placement, then the best placement location is found, but computational resources and time are excessively consumed
Solution Approach 1:
The patent implements a two-stage evaluation process where candidate graphic locations are first filtered using a rough assessment criterion that quickly eliminates obviously poor placements. Then, only the remaining promising candidates undergo detailed placement score evaluation. This partial action approach ensures that computational resources are concentrated on evaluating only the most viable options, achieving high placement accuracy while significantly reducing the total computational effort and energy consumption compared to evaluating all possible locations.
Data Source
Figure 1~3
Figure 4~5B
Figure 6
AI summary
A computer-implemented method of selecting an overlay graphic placement location for display on a display device, the method comprising: obtaining overlay graphic data; obtaining object data indicating the location of any objects in an image sequence of one or more images to which the overlay graphic is to be applied; initiating a process to determine a placement score, based on the overlay graphic data and the object data, for each of a plurality of candidate graphic locations, wherein the process is terminated when a placement score above a predetermined stopping threshold value is found; and selecting the overlay graphic placement location in dependence on the placement scores such that, when a placement score above the predetermined stopping threshold value is found, the current candidate graphic location is selected to be the overlay graphic placement location.