3D-Linked Screen Generation for Curved Wide-Field Image Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wide-field images with a wide field of view, such as 360-degree images, are challenging to view due to curvature issues, and existing technologies fail to capture objects from all 360-degree directions, leading to incomplete image representation.
Innovation Solution
An information processing apparatus associates first position information from a captured image with second position information from a three-dimensional image to generate a screen with a first display area showing a predetermined area from the captured image and a second display area showing associated three-dimensional image portions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a wide-field image is displayed on a display terminal, then the entire surrounding area is captured, but the image becomes curved and users have difficulty viewing it
Solution Approach 1:
The patent divides the wide-field image into multiple predetermined areas and displays them as separate selectable regions on the terminal screen. Users can view different portions of the wide-field image by selecting different predetermined areas, converting a single difficult-to-view curved image into multiple manageable flat segments.
Solution Approach 2:
The patent adds an interactive dimension to the display by allowing users to select and navigate between different predetermined areas. This transforms the static curved wide-field image into an interactive multi-region display where users can explore different portions of the captured scene.
2Ease of operation
If only a predetermined-area image is displayed, then viewability is improved, but users cannot grasp what is captured in the predetermined area or where it is captured from
Solution Approach 1:
The patent merges the predetermined-area image display with additional context information including the captured image metadata and three-dimensional position data. By combining these elements into a unified display interface, users can simultaneously view the predetermined area, understand what is captured, and grasp the spatial context of the capture location.
Solution Approach 2:
The patent introduces an information processing apparatus as an intermediary that processes and correlates the predetermined-area image with three-dimensional image data and position information. This intermediary adds contextual layers that help users understand the captured content and its spatial relationship without overwhelming the primary view.
3Area of stationary object
If an image capturing device images objects at 360 degrees from a single position, then the field of view is maximized, but objects cannot be captured from all 360-degree directions relative to the object
Solution Approach 1:
The patent implements a nested structure where multiple captured images from different predetermined areas are organized hierarchically. Each predetermined area contains information about the captured scene from that specific viewpoint, and these nested regions collectively provide complete 360-degree coverage of the object from all directions.
Solution Approach 2:
The patent transforms the static single-position 360-degree capture into a dynamic multi-position capture system. By capturing images from multiple predetermined areas and allowing users to navigate between them, the system dynamically reconstructs complete object representation from multiple viewpoints, enabling users to see all sides of objects.
Data Source
Figure 1A~1C
Figure 2
Figure 3A~3C
AI summary
An information processing apparatus (5) includes a processing unit (501, 54) to associate first position information indicating a first position in a captured image with second position information indicating a second position in a three-dimensional image. The captured image is obtained by capturing an image of a target object. The three-dimensional image includes a three-dimensional area corresponding to the target object. The information processing apparatus (5) includes a generation unit (501, 53) to generate a screen including a first display area and a second display area. The first display area displays a predetermined-area image that is a predetermined area in the captured image. The second display area displays at least a part of the three-dimensional image in which the second position is associated with the first position in the captured image by the processing unit (501, 54).