Semiconductor Device for Smooth 360-Degree Display Movement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for displaying 360-degree moving images face delays when moving the display area, as they require decoding of non-I frame images, which can lead to time-consuming processes and delayed image rendering.

Innovation Solution

A semiconductor device with a reception unit, determination unit, and decoding unit that divides a whole image into small screen images and determines a new decoding area when an I frame appears, allowing for immediate decoding and smooth display area movement by pre-decoding frames based on recent I frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the display area is moved to an adjacent small screen image that is not an I frame, then the display area can be moved to show different content, but it takes time to decode the non-I frame image by referring to previous or future I frames, causing display delay

Engineering Contradiction:
Improvedisplay area movement capabilityVSAvoiddecoding time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-decoding small screen images that are adjacent to the current display area, even before the user requests to move to those areas. The determination unit identifies candidate small screen images near the current display area and pre-decodes them, so when the user moves the display area, the target image is already decoded and ready for immediate display, eliminating decoding delays.

Inventive Principle:
Principle #10Preliminary action

2Ease of manufacture

If the small screen image of the moving destination is decoded by referring to an I frame immediately before, then the image can be decoded using past reference data, but it requires decoding multiple frames which increases the time until display

Engineering Contradiction:
Improvedecoding process simplicityVSAvoiddisplay preparation time
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

Instead of waiting until the user requests to move the display area to decode the target image, the system performs preliminary decoding of adjacent small screen images in advance. The determination unit identifies which small screen images are near the current display area and pre-decodes them, so when movement is requested, the image is already ready for immediate display.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the small screen image of the moving destination is decoded by referring to an I frame immediately after, then the image can be decoded using future reference data, but the display of the small screen image must be delayed until the I frame is available

Engineering Contradiction:
Improvedecoding accuracyVSAvoiddisplay delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system proactively decodes small screen images in advance before the user actually requests to move the display area. By identifying candidate images adjacent to the current display area and decoding them beforehand, the system ensures that when movement is requested, the target image is already decoded and ready for immediate display without waiting for future I frames.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If all small screen images are decoded in advance, then smooth display area movement can be achieved, but the decoding load and memory requirements increase significantly

Engineering Contradiction:
Improvedisplay area movement smoothnessVSAvoiddecoding load
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

Instead of uniformly decoding all small screen images across the entire panoramic image, the patent applies local quality by selectively decoding only those small screen images that are adjacent to or near the current display area. This localized approach ensures smooth display area movement for relevant regions while avoiding the excessive decoding load and memory requirements that would result from decoding the entire image.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10419753B2Semiconductor device, moving image processing system, method of controlling semiconductor device
Publication Date: 2019.09.17 RENESAS ELECTRONICS CORP
  • US10419753B2 patent drawing
  • US10419753B2 patent drawing
  • US10419753B2 patent drawing

AI summary

A display area can be smoothly moved.A semiconductor device sequentially receives a plurality of whole images, each of which includes a plurality of small screen images and which are temporally continuous and form a moving image, and decodes a received whole image. Here, the semiconductor device includes a reception unit that receives the whole image including the small screen images, a determination unit that determines a decoding area which includes a small screen image to be decoded and which is included in the whole image, and a decoding unit that decodes the small screen image in the decoding area which is determined by the determination unit and which is included in the whole image. The determination unit determines a new decoding area when a small screen image of intra frame appears in the decoding area.