Virtual Camera Panorama Texture Mapping for Portable Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for displaying virtual spaces on portable devices fail to provide a high sense of reality, particularly when capturing and reproducing panorama images with wide angles, as they do not effectively simulate the user's motion and attitude changes.
Innovation Solution
An information processing system that includes a portable display device and a separate information processing device, utilizing sensors like gyrosensors and geomagnetic sensors to control the attitude of a virtual camera, allowing for the sequential pasting of panorama images on a model surface and displaying a moving image that simulates the user's motion, with features like wireless communication for image transmission and storage of image-capturing position and direction information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual space is displayed on a portable display according to movement or attitude, then the display adapts to user motion, but the sense of reality is insufficient
Solution Approach 1:
The patent applies the copying principle by capturing real-world panorama images and replicating them in a virtual environment. The virtual camera system copies the visual characteristics of real-world scenes, including wide-angle perspectives and spatial relationships, to create an immersive virtual space that mirrors reality while adapting to user movement.
Solution Approach 2:
The patent transitions from conventional two-dimensional displays to three-dimensional virtual space representation. By using panorama images with wide angles (180° or more) and rendering them in a virtual camera system that responds to six-degree-of-freedom movements, the system adds spatial dimensionality to the display, creating a more realistic immersive experience.
2Area of moving object
If panorama images with wide angles are captured and reproduced, then the field of view is expanded, but the simulation of user motion and attitude changes is insufficient
Solution Approach 1:
The patent implements feedback by continuously monitoring the portable display device's movement and attitude through sensors (gyroscopic, magnetic, or optical), and dynamically adjusting the virtual camera's position and orientation accordingly. This closed-loop system ensures that the virtual panorama reproduction accurately reflects the user's real-world movements, enhancing the sense of presence.
Solution Approach 2:
The system transitions from static panorama display to dynamic virtual camera movement. The virtual camera's position, orientation, and field of view are continuously adjusted in real-time based on the portable display device's movement, creating a dynamic reproduction that adapts to user actions and provides an immersive experience.
3Measurement precision
If a virtual camera is controlled to change attitude according to portable display device, then the simulation accuracy is improved, but the system complexity increases
Solution Approach 1:
The patent applies universality by using a multi-functional portable display device that serves multiple purposes: it acts as both the display output and the sensing input device. The same device that displays the virtual panorama also contains the sensors (gyroscopic, magnetic, or optical) that detect user movement and control the virtual camera, eliminating the need for separate sensing systems and reducing overall complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides a high sense of reality by accurately simulating the user's motion and attitude changes, enhancing the experience of viewing panorama images captured with wide angles, and allows for seamless image reproduction and display on portable devices.
Implementation Method 1
utilizing sensors like gyrosensors and geomagnetic sensors to control the attitude of a virtual camera
Implementation Method 2
utilizing sensors like gyrosensors and geomagnetic sensors to control the attitude of a virtual camera
Implementation Method 3
displaying a moving image that simulates the user's motion, with features like wireless communication for image transmission
Implementation Method 4
features like wireless communication for image transmission
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A panorama moving image including panorama images of a real world is pasted on a model in a virtual space as texture, and an image of the model is captured by a virtual camera. An image-capturing direction of the virtual camera is changed in accordance with an attitude of a portable display device, and the image captured by the virtual camera is displayed on the portable display device.