Viewpoint Movement Control via Depth-Direction Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing two-dimensional image sensors with short baselines between divided pixels limit the viewpoint movement effect in generated moving images, restricting the range of in-focus plane movement and leading to image quality issues like double contours when moving beyond the refocusable range.
Innovation Solution
An image processing apparatus that generates composite images by varying the compositing ratio of parallax images over time, allowing the rotational center of viewpoint movement to shift in the depth direction, thereby enabling a viewpoint movement effect from a position different from the in-focus plane.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the in-focus plane is moved within the refocusable range using refocus processing, then the viewpoint movement effect can be increased in distant objects, but the range of rotational center movement is restricted to the refocusable range and the viewpoint movement effect remains comparatively small when the number of divided pixels is small
Solution Approach 1:
The patent moves the rotational center in the depth direction (focus direction) independently from the in-focus plane position by introducing depth-direction positioning of composite images. This allows the rotational center to be positioned at any depth location, not just at the in-focus plane, thereby expanding the range of viewpoint movement beyond the refocusable range while maintaining image quality.
Solution Approach 2:
The patent changes the positioning parameters of composite images in the depth direction to control the rotational center position. By adjusting the depth-positioning parameter, the rotational center can be moved to any desired depth location, enabling viewpoint movement effects at various depths without being constrained by the refocusable range or the number of divided pixels.
2Adaptability or versatility
If the in-focus plane is moved beyond the refocusable range, then a larger viewpoint movement effect can be achieved, but double contours appear in the image leading to a drop in image quality
Solution Approach 1:
The patent introduces independent depth-direction positioning of composite images, separating the rotational center position from the in-focus plane position. This allows the rotational center to be positioned at any depth location without being constrained by the refocusable range, enabling viewpoint movement effects beyond the traditional range while avoiding double contours and maintaining image quality.
3Volume of moving object
If the baselines between divided pixels are kept short in two-dimensional image sensors, then the device structure remains compact, but the viewpoint movement effect in generated moving images becomes comparatively small
Solution Approach 1:
The patent changes the positioning parameters of composite images in the depth direction to amplify the viewpoint movement effect. By adjusting the depth-positioning parameter, the system can achieve significant viewpoint movement effects even with short baselines between divided pixels, without needing to increase device size or the number of pixels.
Data Source
AI summary
There is provided an image processing apparatus. A generating unit generates a plurality of composite images by repeatedly carrying out a compositing process that composites a plurality of parallax images according to a compositing ratio. The parallax images have parallax with respect to each other. A control unit carries out control so that the compositing ratio changes over time as the compositing process is repeated. A positioning unit positions the plurality of composite images so that a rotational center of viewpoint movement arising between the plurality of composite images due to the change over time in the compositing ratio moves in a depth direction.