Virtual Viewpoint Image Display With Timed Specific Image Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle to effectively display specific images in virtual viewpoint images without relying on the original captured images, and lack flexibility in timing and viewpoint control.
Innovation Solution
An image processing apparatus and method that acquires a virtual viewpoint image based on captured images and outputs specific images at controlled timings and viewpoints, using processor and memory to generate and display these images independently of the original captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual viewpoint image is generated from captured images, then the image shows a specific viewpoint of the subject, but it is difficult to display specific images at controlled timings and viewpoints independently
Solution Approach 1:
The patent segments the image processing into independent modules: virtual viewpoint image generation from captured images, and separate specific image display control. The processor can independently generate virtual viewpoint images and control display timing of specific images, allowing flexible adaptation without increasing overall system complexity
Solution Approach 2:
The patent introduces viewpoint information as an intermediary that connects the virtual viewpoint image generation and specific image display. This intermediary parameter enables synchronized control of both image types based on the same viewpoint data, achieving coordination without direct coupling of complex processing paths
2Adaptability or versatility
If the virtual viewpoint image is generated based on captured images, then the image reflects the original subject, but it cannot show specific images created in different processes
Solution Approach 1:
The patent maintains clear segmentation between captured images used for virtual viewpoint generation and specific images created in separate processes. The processor handles these as distinct data streams with different purposes, preserving process differentiation while enabling both to be displayed through the unified virtual viewpoint interface
Solution Approach 2:
The patent adds a temporal dimension through viewpoint information that tracks the progression of virtual viewpoint images. This time parameter allows specific images from different processes to be displayed at appropriate moments in the virtual viewpoint sequence, enabling process differentiation without losing contextual information
3Ease of operation
If the specific image is displayed without timing control, then the display is simple, but the user interaction and image presentation are not enhanced
Solution Approach 1:
The patent implements self-service through automatic timing control based on viewpoint information. The processor autonomously determines when to display specific images according to the virtual viewpoint progression, eliminating manual timing control while enhancing presentation efficiency through automated synchronization with the virtual viewpoint sequence
Data Source
AI summary
An image processing apparatus includes a processor and a memory connected to or built in the processor. The processor acquires a virtual viewpoint image showing an aspect of a subject in a case in which the subject is observed from a viewpoint specified by viewpoint information based on a plurality of captured images and the viewpoint information, and outputs, based on the viewpoint information, data for displaying a specific image created in a process different from a process of the virtual viewpoint image, and the virtual viewpoint image on a display.