Screen Capture Enlargement in Video Playback via Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video recording playback systems fail to efficiently enlarge and display multiple screen captures from customer service agent monitors during call recordings, leading to unclear or distorted views and computational inefficiencies when trying to zoom in on specific screens.

Innovation Solution

A video player application that receives metadata with coordinates for each screen capture, allowing users to select and enlarge specific screen captures within a mask container using HTML elements and JavaScript, without re-rendering the video, thus maintaining high-resolution playback efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If screen captures from multiple monitors are recorded into a single video recording as a matrix of smaller images, then the video recording can capture all screens simultaneously, but the images become smaller in size and harder to view clearly

Engineering Contradiction:
Improvedisplay area of each screen captureVSAvoiddetail visibility of screen captures
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The video player divides the video recording into multiple separate video elements corresponding to each original monitor screen. Each video element can be independently selected and enlarged, allowing viewers to see detailed content from any individual screen without being constrained by the matrix layout.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a two-dimensional matrix layout to a multi-dimensional viewing structure where video elements can be selected and displayed in full size. This dimensional transformation allows the same video content to be viewed both as a comprehensive matrix and as individual full-resolution elements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the video recording is enlarged to show individual screen captures in detail, then the image quality improves, but the computational overhead increases due to re-rendering requirements

Engineering Contradiction:
Improveimage resolution of screen capturesVSAvoidcomputational overhead for video processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The video recording is pre-processed during encoding to create multiple video elements with embedded metadata containing position and size information for each original screen. This preliminary segmentation allows for efficient runtime selection and display without requiring computationally intensive re-rendering operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates lightweight references (copies) to the original video data through metadata-based positioning rather than duplicating the actual video content. Each video element is a reference to the underlying video stream with transformation parameters, avoiding redundant data storage and processing.

Inventive Principle:
Principle #26Copying

3Ease of operation

If multiple screen captures are displayed as a matrix in the video recording, then all screens are captured simultaneously, but the user cannot easily focus on or enlarge specific individual screens

Engineering Contradiction:
Improveuser ability to select and view individual screensVSAvoidaccessibility of specific screen content
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The video player provides dynamic switching between matrix view and individual video element views. Users can interactively select which video element to view, and the system dynamically adjusts the display to show the selected element in full size, enabling flexible focus on any specific screen content.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system introduces an intermediary layer of video elements with metadata that acts as a bridge between the raw video stream and the user interface. This intermediary structure enables efficient selection, filtering, and display of individual screens without directly manipulating the underlying video data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10645458B2Enlargement of screen-capture recorded into a video recording during playback thereof
Publication Date: 2020.05.05 NICE LTD
  • US10645458B2 patent drawing
  • US10645458B2 patent drawing
  • US10645458B2 patent drawing

AI summary

A method for enlarging a screen-capture concatenated into a matrix of multiple different screen-captures during playback of a video recording in a video player application, executed by a processor of a computerized system, may include receiving a video recording of a plurality of screen-captures. The video recording may include metadata with coordinates defining a position or a size of each screen-capture from the plurality of screen-captures in the video recording. A selection may be received from a user using an input device coupled to the computerized system of a screen-capture from the plurality of screen-captures in the video recording to view on a display. The coordinates of the selected screen-capture may be transformed by applying an algorithm based on HTML elements, so as to enlarge the selected screen-capture within a mask container. The enlarged screen-capture in the mask container selected by the user may be displayed on the display.