360-Degree Image Processing Using Valid Pixel Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The processing of 360-degree image views in virtual reality environments is time-consuming and resource-intensive, particularly due to the need to perform computations on pixels that are not necessary for rendering, leading to delays in real-time storage and rendering.

Innovation Solution

A method and apparatus for image processing that involves precomputing, where a computing device analyzes pixels in an image space for validity, stores and processes only valid pixel groups, and uses a mask to ignore invalid pixels, thereby optimizing resource utilization by avoiding unnecessary computations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all pixels in the image space are processed to create a 360 degree view, then the completeness of the virtual reality environment is improved, but the processing time and resource consumption increase significantly

Engineering Contradiction:
Improvecompleteness of virtual reality environmentVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts and processes only the valid pixel groups that are actually needed for rendering the 360-degree view, separating them from the invalid pixels. By identifying and isolating only the necessary pixels through validity analysis and masking, the system avoids wasting computational resources on pixels that will not contribute to the final rendered image, thus reducing processing time while maintaining completeness of the virtual reality environment.

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of manufacture

If computations are performed on all pixels including invalid ones, then the processing is simpler to implement, but the resource utilization decreases and unnecessary computations occur

Engineering Contradiction:
Improvesimplicity of processing implementationVSAvoidresource consumption
Core Design Contradiction:
Ease of manufactureVSLoss of energy

Solution Approach 1:

The patent applies preliminary action by performing validity analysis on pixels before the actual rendering computation. The system pre-identifies which pixels are valid and will be needed for the 360-degree view, creating a mask that guides subsequent processing. This preliminary step ensures that only necessary computations are performed, optimizing resource utilization while maintaining implementation feasibility through structured processing pipelines.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If real-time storage and rendering of 360 degree view is achieved, then the user experience is improved, but the processing delays occur due to time-consuming computations

Engineering Contradiction:
Improvereal-time rendering capabilityVSAvoidprocessing delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

To achieve real-time rendering, the patent extracts and processes only the valid pixel groups that contribute to the final 360-degree view. By separating valid pixels from invalid ones through validity analysis and using masks to guide processing, the system reduces the computational workload to only the necessary pixels, enabling real-time storage and rendering without significant processing delays.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by processing only the necessary portion of pixels (valid pixel groups) rather than all pixels in the image space. This selective processing approach reduces the total computational effort required while still achieving complete and accurate 360-degree view rendering in real-time, as only the partial set of valid pixels is needed for the final output.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10455211B2Method and apparatus of image processing
Publication Date: 2019.10.22 ADVANCED MICRO DEVICES INC
  • US10455211B2 patent drawing
  • US10455211B2 patent drawing
  • US10455211B2 patent drawing

AI summary

A method and apparatus of precomputing includes capturing a first image by a first image capturing device. An image space for the first image is defined and pixels in the image space are analyzed for validity. Valid pixels are stored as valid pixel groups and the valid pixel groups are processed.