Composite Image Data Processing for Remote Display Frame Rate Stability

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing systems face challenges in reducing the data amount to be transmitted from a first terminal to a second terminal when displaying image data for both main and sub-screens, especially when the data amount of one kind of image data becomes large, making it difficult to maintain a designated frame rate.

Innovation Solution

The system processes image data by generating composite image data at the first terminal, which combines main and sub-image data based on layout data from the second terminal, and then transmits this composite data. This includes object recognition to adjust the positioning and size of the sub-image data to avoid data loss and enhance visibility of dynamic objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If main image data and sub image data are transmitted separately without compositing, then the second terminal can perform flexible picture-in-picture processing, but the data amount to be transmitted increases making it difficult to maintain designated frame rate

Engineering Contradiction:

Improvepicture-in-picture processing flexibilityVSAvoidframe rate maintenance

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The first terminal performs preliminary compositing of main image data and sub image data before transmission, creating a pre-processed composite image that reduces the data amount to be transmitted and ensures frame rate maintenance, while still allowing the second terminal to perform picture-in-picture processing

Inventive Principle:

Principle #10Preliminary action

2Quantity of substance

If image data is filled with single color in specific regions before transmission, then the data amount is reduced, but dynamic objects in those regions may be lost or obscured

Engineering Contradiction:

Improvedata amountVSAvoiddynamic object visibility

Core Design Contradiction:

Quantity of substanceVSLoss of information

Solution Approach 1:

The system dynamically determines whether to perform single-color filling in specific regions based on object recognition results. When a dynamic object is detected in a specific region, the filling is skipped or modified to preserve the object's visibility, while still reducing data amount in regions without dynamic objects

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system uses object recognition to provide feedback about the presence of dynamic objects in specific regions, which then informs the decision-making process for whether to apply single-color filling, creating a closed-loop system that balances data reduction with information preservation

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12279067B2Processing system and processing method of image data

Publication Date: 2025.04.15 WOVEN PLANET HLDG INC

AI summary

A processor of a first terminal generates composite image data, in which main and sub image data are composited together, based on the main image data, the sub image data, and data about layout of a screen of a second terminal. The main image data are image data which are obtained by a main camera and are to be displayed on a main screen of a display of the second terminal. The sub image data are image data which are obtained by a sub camera and are to be displayed on a sub-screen of the display. A processor of the first terminal transmits the composite image data from the first terminal to the second terminal. A processor of the second terminal displays the composite image data received from the first terminal on the display.