Smart TV Screenshot Object Recognition Layering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart TV systems lack an efficient method to visually and interactively display recognized objects in screenshots, providing users with real-time feedback and reducing computational load and memory consumption.

Innovation Solution

A method and device for displaying screenshots on smart TVs, where recognized objects are identified and framed within a layered interface, allowing users to select and interact with these objects using a remote controller, with object recognition frames and a focus frame displayed on separate layers to minimize computational workload and memory usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If object recognition frames and focus frames are displayed on the same layer, then user interaction is simplified, but computational load and memory consumption increase

Engineering Contradiction:
Improveuser interactionVSAvoidcomputational load
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The display interface is divided into multiple layers: a first layer for displaying the screenshot and a second layer for displaying object recognition frames and focus frames. This segmentation allows independent rendering and management of different display elements, reducing computational overhead while maintaining interaction capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a vertical dimension by stacking display elements across multiple layers (first layer for screenshot, second layer for frames). This dimensional organization separates the base image from overlay elements, enabling efficient memory management and reduced rendering complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If object recognition frames are displayed for all recognized objects, then information completeness is improved, but visual clutter and complexity increase

Engineering Contradiction:
Improveinformation completenessVSAvoidvisual complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Different visual qualities are applied to different objects: selected objects receive prominent focus frames with enhanced visibility, while unselected objects have simpler recognition frames. This differential treatment maintains information completeness while reducing visual complexity through hierarchical emphasis.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses color differentiation to distinguish between selected and unselected objects. Focus frames use distinctive colors or brightness levels to highlight the selected object, while recognition frames use subtler visual properties. This color coding system conveys multiple layers of information without increasing structural complexity.

Inventive Principle:
Principle #32Color changes

3Quantity of substance

If multiple layers are used for displaying screenshot and recognition frames, then memory management is improved, but system complexity increases

Engineering Contradiction:
Improvememory managementVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The display system is segmented into functional layers: first layer for the screenshot image data and second layer for the recognition frame data. This segmentation enables independent memory allocation and management for each layer, optimizing memory usage while keeping the multi-layer architecture manageable through clear functional separation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11812188B2Method and device for displaying a screen shot
Publication Date: 2023.11.07 HISENSE VISUAL TECH CO LTD
  • US11812188B2 patent drawing
  • US11812188B2 patent drawing
  • US11812188B2 patent drawing

AI summary

A method for displaying a screen shot, and a display device are provided. The method includes receiving a first input instruction from a remote controller for obtaining a screen shot of a display screen of the display device while a display content is being displayed on the display screen; in response to the first input instruction, capturing a screen shot of the display screen; automatically determining one or more recognized objects in the screen shot; receiving a second input instruction from the remote controller; and in response to the second input instruction: displaying the screen shot on the display screen in a first display layer; displaying one or more object recognition frames for identifying the one or more recognized objects of the screen shot in a second display layer; and displaying, in the second display layer over the first display layer, a focus frame over a first object recognition frame among the one or more object recognition frames corresponding to a first recognized object among the one or more recognized objects based on a user selection requested from the remote controller.