Subframe Pattern Superimposition for Corresponding Point Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for corresponding point detection using Imperceptible Structured Light (ISL) schemes require doubling the frame rate, leading to increased development and manufacturing costs due to the need for specialized projector devices.
Innovation Solution
An image processing apparatus that superimposes a pattern image on subframe images corresponding to a frame, allowing for corresponding point detection during content viewing without the need for high-speed projector devices, by using a single-panel projector that transforms each frame into multiple subframes and projects them sequentially, thereby maintaining cost efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If ISL scheme is used with ordinary projector device, then corresponding point detection can be realized during content viewing, but frame rate must be doubled which increases device complexity and cost
Solution Approach 1:
The patent divides a single frame into multiple subframes, each containing a portion of the structured light pattern. By sequentially projecting these subframes and capturing them with the camera, the system achieves complete pattern coverage without requiring the camera to capture at doubled frame rates, thus avoiding the need for specialized high-speed projector devices
Solution Approach 2:
The patent employs periodic projection of patterned subframes interspersed with content subframes. The structured light pattern is projected in a periodic sequence across multiple subframes, allowing the camera to capture the pattern at appropriate intervals while maintaining normal content display, thereby avoiding the need for continuous high-speed projection
2Productivity
If frame rate is doubled for ISL scheme, then corresponding point detection is enabled, but development and manufacturing costs increase due to dedicated device requirements
Solution Approach 1:
The patent segments the structured light pattern across multiple subframes rather than requiring complete pattern projection in a single frame. This segmentation allows the use of ordinary projector devices operating at standard frame rates, eliminating the need for expensive dedicated high-speed projection hardware
Solution Approach 2:
The patent prepares multiple subframes in advance, each containing a portion of the structured light pattern. These pre-prepared subframes are then sequentially projected in a controlled manner, allowing the system to achieve complete pattern coverage without requiring real-time high-speed generation or projection capabilities
3Adaptability or versatility
If pattern image is superimposed on subframe images, then corresponding point detection is achieved during content viewing, but image processing complexity increases
Solution Approach 1:
The patent alternates between projecting content subframes and patterned subframes in a periodic sequence. This periodic structure simplifies the image processing requirements, as the system only needs to perform pattern extraction and corresponding point detection during patterned subframe intervals, rather than continuously processing all frames
Solution Approach 2:
The patent extracts the structured light pattern from the captured subframe images by comparing with reference patterns. This extraction process isolates the pattern information from the content, simplifying subsequent corresponding point detection by focusing only on the extracted pattern features rather than processing the entire image content
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3
AI summary
The present disclosure relates to an image processing apparatus and method that realize corresponding point detection during content viewing while at the same time keeping cost increase to a minimum. A pattern image including a given pattern is superimposed on any one of a plurality of subframes corresponding to a frame, each subframe is sequentially projected onto a projection section, a capture section is caused to capture the projected subframe image, projected by the projection section, on which the pattern image has been superimposed in synchronism with the projection control, and corresponding points between the projected image and a captured image are detected on the basis of the pattern image included in the captured image acquired as a result of capture by the capture section, in accordance with the capture control. The present disclosure is applicable, for example, to an image processing apparatus, a projection apparatus, a capture apparatus, a projection/capture apparatus, a control apparatus, a projection/capture system, and so on.