Image Processing with Corrected Ray Tracing for Screen-Edge Reflections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques fail to accurately represent reflected appearances near the edges of a screen, leading to interruptions or unnatural distortions.

Innovation Solution

An image processing method that utilizes a first depth buffer for initial depth testing, followed by ray tracing to determine reflected colors, with corrections made to the reflection direction based on proximity to the screen edge to ensure accurate rendering of reflections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image processing is used for reflections, then processing speed is maintained, but reflection accuracy deteriorates near screen edges

Engineering Contradiction:
Improvereflection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the screen into different regions (center area and edge area) and applies different processing methods to each. The center area uses conventional reflection processing while the edge area uses ray tracing processing, allowing high accuracy where needed without overwhelming the entire system with complex computations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies ray tracing only to pixels located in the edge region of the screen where reflection accuracy is critical, while using simpler conventional processing for the center region. This local application of complex processing only where necessary resolves the contradiction between accuracy and complexity.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If ray tracing is applied to all pixels, then reflection accuracy improves, but processing time increases

Engineering Contradiction:
Improvereflection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies ray tracing only partially to edge pixels rather than all pixels. This partial action provides sufficient accuracy for the critical edge regions while avoiding the excessive computational cost of applying ray tracing to every pixel in the entire screen.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements local quality by applying the computationally intensive ray tracing method only to the edge region where reflection accuracy is most important, while using faster conventional processing methods for the center region, thus optimizing the balance between accuracy and processing time.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If reflection processing is performed without correction, then processing simplicity is maintained, but visual quality deteriorates near screen ends

Engineering Contradiction:
Improvevisual qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies correction processing only to the edge region where visual quality degradation occurs, while maintaining the simpler uncorrected processing for the center region. This localized correction approach improves visual quality at critical locations without unnecessarily complicating the entire processing pipeline.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20250245907A1Non-transitory computer-readable medium, image processing system, image processing method, and image processing apparatus
Publication Date: 2025.07.31 NINTENDO CO LTD
  • US20250245907A1 patent drawing
  • US20250245907A1 patent drawing
  • US20250245907A1 patent drawing

AI summary

An image processing system according to an exemplary embodiment renders objects in a virtual space in a frame buffer, and with a direction from a virtual camera to a position in the virtual space relating to a pixel of interest in a drawn image as an incidence direction, calculates a reflection direction based on the incidence direction and a normal direction. The image processing system calculates as a ray tracing direction a direction obtained by making a correction toward an inside of a screen in the calculated reflection direction, traces a ray along the ray tracing direction, and adds a color of a collision position of the ray to a color of the pixel of interest.