Virtual Classroom Desk Overlay for Immersive HMD Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In immersive virtual spaces, students wearing HMDs cannot use real objects like textbooks or personal computers without removing the HMD, which is inconvenient.
Innovation Solution
A viewing system that includes a server for distributing virtual space information and a viewing terminal with a display section to show the virtual space, and an input section to receive and process videos of the real space, allowing image composition to fit the real space video onto virtual space objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a student wears an HMD to participate in an immersive virtual class, then the student can concentrate more on the class by shutting out outside information, but the student cannot use real objects such as textbooks, notebooks, or personal computers on the desk without taking off the HMD
Solution Approach 1:
The patent introduces a camera as an intermediary device that captures images of real objects (textbooks, notebooks, personal computers) on the student's desk and transmits them to the virtual space. This allows the student to view and interact with real objects through the HMD display without physically removing the device, thus maintaining both immersion and access to real-world materials.
Solution Approach 2:
The patent creates visual copies of real objects by capturing images with a camera and displaying them within the virtual space through the HMD. These copied images represent the actual physical objects on the desk, allowing students to view textbook content, take notes, or operate personal computers while wearing the HMD, effectively replicating the functionality of physical objects in the virtual environment.
2Ease of operation
If a video of the real space is displayed below the virtual space to allow use of real objects, then the student can access real materials, but the sense of immersion is lost
Solution Approach 1:
The patent integrates real object images into the three-dimensional virtual space rather than displaying them in a separate two-dimensional area below the virtual space. The images are positioned and scaled to match the virtual environment's depth and perspective, creating a unified spatial experience that maintains immersion while providing access to real objects through the HMD display.
Data Source
AI summary
A student terminal is for viewing a class given in a virtual space that is immersive. The student terminal includes: a VR function section configured to display the virtual space according to virtual space information; and an input section for receiving a video capturing a desk of a student who views the class. The VR function section extracts, from the video, an area including a top plate of the desk corresponding to a desk object in the virtual space, and performs image composition for fitting a video capturing the area onto a top plate of the desk object.