Spherical Image Editing in VR via Immersive Preview
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Editing of spherical images in VR environments is cumbersome due to the need to frequently remove and reattach head-mounted displays to verify editing details, making the process inconvenient and time-consuming.
Innovation Solution
An editing system that allows users to preview and edit spherical images in VR using an immersive presentation device, input device, and image processing apparatus, enabling real-time editing and verification without removing the headset, through the use of an immersive presentation device, display, input device, and image processing apparatus that includes a position-and-orientation detection unit, operation detection unit, retaining unit, editing reflection processing unit, renderer unit, and communication unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the editor uses a head mounted display to view spherical images in VR, then the viewing experience is immersive and realistic, but the editor must frequently remove and reattach the headset to verify editing details, making the editing process cumbersome and time-consuming
Solution Approach 1:
The patent merges the VR immersive viewing experience with the 2D editing interface by allowing the editing application to display both the spherical image in VR mode and the 2D equidistant cylindrical projection simultaneously or alternately. This enables the editor to perform editing operations on the 2D representation while viewing the immersive 3D result, eliminating the need to remove the headset for verification.
Solution Approach 2:
The patent utilizes dimensionality conversion by displaying the spherical image in two forms: the immersive 3D VR view and the 2D equidistant cylindrical projection. The editor can switch between or view both dimensions simultaneously, allowing editing operations to be performed on the 2D map while verifying results in the 3D immersive view, thus maintaining headset placement throughout the editing process.
2Ease of operation
If the editor removes the head mounted display to perform editing work on a 2D display, then editing operations are easier to perform, but the immersive viewing experience is lost and frequent removal/attachment is required
Solution Approach 1:
The patent combines the 2D editing interface with the VR immersive view, allowing the editor to perform editing operations while the spherical image is displayed in VR mode. The editing application receives operations via input devices and applies them to the spherical image without requiring headset removal, thus eliminating time loss while maintaining editing ease.
Solution Approach 2:
The patent enables continuous editing operations without interruption by maintaining the VR display throughout the editing process. The editor can perform all editing operations while wearing the headset, and the spherical image is continuously updated and displayed in VR mode, eliminating the repeated start-stop cycles of removing and reattaching the headset.
3Ease of operation
If the spherical image is displayed in equidistant cylindrical projection on a 2D display, then editing operations can be performed, but the immersive spherical viewing experience is not available during editing
Solution Approach 1:
The patent merges the 2D equidistant cylindrical projection interface with the immersive spherical VR view by allowing the editing application to display both representations. The editor can perform editing operations on the 2D projection while the spherical image is simultaneously or alternatively displayed in immersive VR mode, providing both editing capability and immersive viewing experience during the editing process.
Solution Approach 2:
The patent utilizes dimensionality conversion to display the spherical image in both 2D equidistant cylindrical projection and 3D immersive VR formats. This allows the editor to switch between dimensions or view both simultaneously, enabling editing operations on the 2D representation while maintaining access to the immersive spherical view for verification without removing the headset.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to an image processing apparatus and method, and a program that are capable of more facilitating editing. The image processing apparatus includes: an operation detection unit configured to detect an operation input by an operation unit; and a display control unit configured to output, to an immersive presentation device, part or entirety of a spherical image on which an image of the operation unit is superimposed, as a presentation image, to cause the immersive presentation device to display the presentation image, the display control unit being configured to control, in a case where the operation input has been detected, the display of the presentation image such that the operation input is reflected. The present technology is applicable to an editing system.