3D Image Rendering Viewpoint-Based Region Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional image processing systems face issues with unnatural borders between visible light image data when generating a single piece of three-dimensional model data from multiple image capture points with different illumination environments, leading to undesirable display quality.

Innovation Solution

A three-dimensional image processing apparatus that obtains range image data and visible light image data from multiple devices, generates three-dimensional model data, sets a point of view, and renders display image data by selecting appropriate visible light image data based on the view point, ensuring seamless integration and improved display quality by eliminating visible borders.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a single piece of three-dimensional model data is generated from a plurality of pieces of visible light image data captured from different image capture points, then three-dimensional model data can be created, but unnatural borders between pieces of visible light image data appear in the display image depending on the set point of view

Engineering Contradiction:
Improvedisplay qualityVSAvoidunnatural borders between image data
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent divides the display image into multiple regions based on the set point of view, and selects different visible light image data for each region. This segmentation approach allows the system to choose the most appropriate image data for each specific region, avoiding the appearance of unnatural borders that would occur if a single image data source was used for the entire display image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different visible light image data to different regions of the display image based on the set point of view. Each region is assigned the image data that best matches its local requirements, ensuring that the displayed image maintains high quality and natural appearance throughout, rather than using a uniform image data source for all regions.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If multiple pieces of visible light image data are used for rendering, then more comprehensive scene coverage is achieved, but borders between the image data become visible in the display image

Engineering Contradiction:
Improvescene coverageVSAvoiddisplay quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent segments the display image into multiple regions and assigns different visible light image data to each region based on the set point of view. This segmentation allows the system to utilize multiple image data sources to achieve comprehensive scene coverage while maintaining display quality by carefully selecting which image data to use for each specific region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the selection of visible light image data based on the parameter of set point of view. By dynamically selecting image data according to the viewing angle and position, the system can maintain high display quality across different viewing conditions while still utilizing multiple image data sources for comprehensive coverage.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9922451B2Three-dimensional image processing apparatus and three-dimensional image processing system
Publication Date: 2018.03.20 SEIKO EPSON CORP
  • US9922451B2 patent drawing
  • US9922451B2 patent drawing
  • US9922451B2 patent drawing

AI summary

A three-dimensional image processing apparatus includes: an obtainment unit that obtains range image data from each of a plurality of range image generation devices and obtains visible light image data from each of a plurality of visible light image generation devices; a model generation unit that generates three-dimensional model data expressing a target contained in a scene based on a plurality of pieces of the range image data; a setting unit that sets a point of view for the scene; and a rendering unit that selects one of the pieces of the visible light image data in accordance with the set point of view and renders a region corresponding to the surface of the target based on the selected visible light image data.