Mixed Reality Image Capture via Observer-Positioned Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for capturing mixed reality space images suffer from poor image quality, inclusion of the display device, and difficulty in achieving desired viewpoints and interactions between observers and virtual objects.
Innovation Solution
An image processing apparatus that captures real space images, generates virtual space images based on the image sensing unit's viewpoint, superimposes and stores these images to form a mixed reality space image, and allows for printing instructions to be given, enabling selection and output of desired mixed reality space images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a screen shot of the display screen is taken using an image sensing device, then the mixed reality space image can be acquired, but the image quality becomes poor and the display device is included in the image
Solution Approach 1:
The patent extracts the image capture function from the display device by introducing a separate image sensing device (camera) positioned at the observer's eye position. This allows the system to capture the mixed reality space image without including the display device itself, while maintaining image quality through direct optical capture rather than screen recording.
Solution Approach 2:
The patent introduces an intermediary image sensing device that acts as a mediator between the mixed reality display and the observer. This device captures the visual information at the observer's eye position, serving as a bridge to obtain high-quality images without directly recording from the display screen.
2Reliability
If the image on the mixed reality space is sensed using a camera, then the image can be captured, but the desired viewpoint position and visual axis direction cannot be achieved
Solution Approach 1:
The patent implements dynamic viewpoint control by allowing the image sensing device to be positioned and oriented at arbitrary locations in three-dimensional space. The system can dynamically adjust the camera's position and viewing angle to match the observer's eye position and visual axis direction, enabling capture from any desired viewpoint rather than fixed positions.
Solution Approach 2:
The patent transitions from two-dimensional screen capture to three-dimensional spatial capture by positioning the image sensing device in 3D space at the observer's eye position. This adds the dimension of spatial freedom, allowing the system to capture images from any viewpoint and orientation, not just from fixed screen positions.
3Reliability
If the mixed reality space image is captured from fixed positions, then the image can be obtained, but the interaction between observer and virtual objects cannot be understood
Solution Approach 1:
The patent implements feedback by capturing images at the observer's actual eye position and visual axis direction, creating a closed loop where the capture position responds to the observer's viewing behavior. This feedback mechanism ensures that the captured images reflect the actual interaction between the observer and virtual objects, preserving the contextual information needed to understand interactions.
Solution Approach 2:
The patent changes the capture parameters by allowing the image sensing device to be positioned at variable locations and orientations corresponding to the observer's eye position and viewing direction. This parameter flexibility enables the system to capture images that reflect the dynamic interaction between observer and virtual objects, rather than static fixed-position views.
Data Source
AI summary
An image processing apparatus is connected to a print unit adapted to print an image, and can output an image to be printed to the print unit. The apparatus includes an image sensing unit adapted to capture a real space image, a generation unit adapted to generate a virtual space image according to a viewpoint position and orientation of the image sensing unit, and a composition unit adapted to obtain a mixed reality space image by combining the real space image captured by the image sensing unit and the virtual space image generated by the generation unit. In addition, a display unit is adapted to display a mixed reality space image obtained by the composition unit, and an output unit is adapted to output a mixed reality space image, which is obtained by the composition unit, to the print unit in response to an input of a print instruction. The generation unit generates a virtual space image to be displayed by the display unit according to a first procedure, and generates a virtual space image to be outputted by the output unit according to a second procedure which is different from the first procedure.