3D-Aligned Screen Generation for Wide-Field Image Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wide-field images, such as 360-degree images, are challenging to view due to curvature issues, making it difficult for users to recognize the captured areas and their locations, and existing image capturing devices fail to capture objects from all 360-degree directions, missing critical views like the back of objects.
Innovation Solution
An information processing apparatus and system that generates a screen with first and second captured image display areas and a three-dimensional image display area, allowing users to select and view specific captured areas and their corresponding positions, enhancing user convenience by complementing captured images with positional information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the entire wide-field image is displayed on a display terminal, then the complete captured area is visible, but the user has difficulty viewing the displayed wide-field image due to curvature
Solution Approach 1:
The patent divides the wide-field image into multiple predetermined-area images, each representing a specific captured area. Users can select and view individual areas rather than attempting to view the entire curved wide-field image at once, thereby improving viewing convenience while maintaining comprehensive coverage through the collection of segmented areas.
Solution Approach 2:
The patent introduces a three-dimensional image as an intermediary that aligns multiple predetermined-area images with their corresponding captured positions. This three-dimensional representation serves as a mediator between the user and the wide-field image, providing spatial context and making it easier for users to navigate and understand the captured areas without dealing directly with the curved wide-field image.
2Ease of operation
If a predetermined-area image is displayed to improve viewing convenience, then the curvature issue is mitigated, but the user can hardly recognize what is captured and where the image is captured
Solution Approach 1:
The three-dimensional image acts as an intermediary that preserves and communicates spatial information. It aligns predetermined-area images with their captured positions in three-dimensional space, enabling users to recognize both what is captured in each area and where it was captured, while still maintaining the viewing convenience of individual predetermined areas.
Solution Approach 2:
The patent replaces the traditional two-dimensional display approach with a three-dimensional representation system. This substitution allows the system to convey spatial and positional information that would be lost in conventional two-dimensional displays, enabling users to understand the relationship between captured areas and their locations without compromising viewing convenience.
3Area of stationary object
If the image capturing device captures a 360-degree view in a single imaging process, then the imaging range is maximized, but the back of objects cannot be captured
Solution Approach 1:
The patent segments the 360-degree view into multiple predetermined-area images, each capturing a specific portion of the environment. By analyzing these segmented areas and their corresponding three-dimensional positions, the system can identify and retrieve images that capture objects from different directions, including the back of objects, thereby overcoming the limitation of single-shot 360-degree imaging.
Solution Approach 2:
The patent performs preliminary actions by capturing images at multiple predetermined positions and orientations before the user needs to view the final result. These pre-captured images are stored and aligned in three-dimensional space, allowing the system to later present comprehensive object views including back views that would not be visible in a single 360-degree capture.
Data Source
Figure 1A~1C
Figure 2
Figure 3A~3C
AI summary
An information processing apparatus (5) includes a generation unit (53) to generate a screen including a first captured image display area displaying a first predetermined-area image, a second captured image display area displaying a second predetermined-area image, and a three-dimensional image display area. The first predetermined-area image is a first predetermined area of a first captured image, which is obtained by capturing an object with an image capturing device (10) at a first image capturing position. The three-dimensional image display area displays at least a part of a three-dimensional image aligned with the first captured image, the three-dimensional image including a position image indicating a second image capturing position of the image capturing device at a specific date and time of image capturing. The second predetermined-area image is a second predetermined area of a second captured image, which is obtained by capturing the object with the image capturing device (10) at the specific date and time of image capturing that is associated with the second image capturing position indicated by the position image.