HMD Controller with Touch Panel for VR Collaboration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality games do not allow users without head-mounted displays (HMDs) to effectively participate and contribute, as there is no mechanism for users wearing and not wearing HMDs to cooperate in the same virtual space.
Innovation Solution
An application control program and system that uses a controller to output virtual space images to both HMDs and touch panel displays, allowing users without HMDs to perform actions in virtual space through touch operations, which are reflected on the HMDs, enabling cooperation between users wearing and not wearing HMDs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If a virtual reality game is played with HMDs for multiple users, then the sense of immersion is increased, but there may not be enough HMDs for all users to play
Solution Approach 1:
The HMD serves multiple functions: it displays the virtual space image to the wearing user and simultaneously transmits the same image to a touch panel display for non-wearing users. This multi-functionality allows the single HMD to support both immersive VR experience and collaborative participation without requiring additional HMD devices.
Solution Approach 2:
A touch panel display acts as an intermediary device that receives and displays the virtual space image from the HMD. This intermediary allows non-wearing users to view and interact with the virtual space without needing to wear an HMD, thereby expanding participant capacity while maintaining immersion quality for wearing users.
2Illumination intensity
If all users wear HMDs to play virtual reality games, then the sense of immersion is maximized, but users who do not want to wear HMDs cannot participate
Solution Approach 1:
The system provides universal access to the virtual space through multiple interfaces: HMD for immersive viewing and touch panel display for non-immersive viewing. This multi-functionality enables both wearing and non-wearing users to participate in the same virtual space according to their preferences, maximizing both immersion and participation flexibility.
Solution Approach 2:
The system adds a new dimension of interaction by providing a second display interface (touch panel) that operates in a different modality from the HMD. This dimensional addition allows users to choose their preferred interaction mode, enabling participation flexibility without compromising the immersive experience for those who wear HMDs.
3Quantity of substance
If a single HMD is shared among multiple users, then device quantity is reduced, but the wearing user cannot see the image displayed on the touch panel display
Solution Approach 1:
The virtual space image is segmented and transmitted to multiple display devices simultaneously: the HMD receives the image for the wearing user, and the touch panel display receives the same image for non-wearing users. This segmentation ensures that each user receives the complete visual information appropriate to their interface, preventing any loss of image visibility.
Solution Approach 2:
The system implements bidirectional communication between the HMD and touch panel display. The touch panel display not only receives images from the HMD but also allows operations that are reflected back to the virtual space visible on the HMD. This feedback mechanism ensures both users have access to complete information and can cooperate effectively.
Data Source
AI summary
A controller outputs an image of the virtual space in correspondence with a posture of a first user wearing the mounted display, outputs an image of the virtual space to a touch panel display used by a second user, performs a first action in the virtual space in correspondence with a touch operation performed by the second user on the touch panel display, outputs an image of the virtual space reflecting the first action to the mounted display, and performs a second action in the virtual space reflecting the first action in correspondence with an operation performed by the first user on an operation unit.