Stream Reprocessor SoC for Video Quality and Resource Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Limited resources in video processors, such as those in portable devices, lead to inefficient video data processing, resulting in insufficient storage space for compressed video streams and degraded image quality.

Innovation Solution

A stream reprocessing system on chip (SoC) that includes a central processing unit, memory controller, and stream reprocessor, which determines whether to reprocess video data using algorithms like compression, super-resolution, frame rate conversion, and denoising, improving both subjective and objective qualities of video data processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video data is compressed using limited resources in portable devices, then processing can be performed, but compression efficiency is insufficient and image quality is degraded

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The system divides video processing into two distinct stages: initial compression using limited portable device resources, and subsequent reprocessing using powerful server resources. This segmentation allows each stage to operate within its resource constraints while achieving overall high quality output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary reprocessing system that receives compressed video data from portable devices and performs additional processing using superior server resources. This intermediary stage bridges the gap between limited mobile resources and high-quality output requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If more resources are allocated for video processing in portable devices, then image quality improves, but device complexity and resource consumption increase

Engineering Contradiction:
Improvevideo processing qualityVSAvoidprocessor resources
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts the complex reprocessing operations from the portable device and relocates them to a server environment. This extraction allows portable devices to maintain simple, low-resource architectures while still achieving high-quality video processing through the distributed reprocessing system.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If video data is reprocessed to improve quality, then image quality and compression efficiency improve, but additional storage space is required

Engineering Contradiction:
Improvecompression efficiencyVSAvoidstorage space
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system performs preliminary compression at the portable device stage, creating a compact intermediate representation that requires minimal storage space. This preliminary action enables subsequent reprocessing without requiring excessive storage resources, as the intermediate compressed form is much smaller than the original uncompressed video data.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11726949B2System and method for selectively reprocessing video streams based on system resources and stream status
Publication Date: 2023.08.15 SAMSUNG ELECTRONICS CO LTD
  • US11726949B2 patent drawing
  • US11726949B2 patent drawing
  • US11726949B2 patent drawing

AI summary

Provided are a stream reprocessing system on chip (SoC) and a method for operating the same is provided. The stream reprocessing system includes a plurality of processors including a central processing unit (CPU); a memory controller configured to receive a stream; and a stream reprocessor configured to perform reprocessing the stream, wherein the stream reprocessor includes: a control unit configured to determine whether to perform the reprocessing on the stream; a reprocessing unit configured to reprocess the stream based on receiving a command to perform the reprocessing on the stream from the control unit; and an output unit configured to transmit the reprocessed stream to a memory.