HMD Image Generation for Camera Streaming Without Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users wearing head-mounted displays (HMDs) face inconvenience when streaming game videos as they need to remove the HMD to make settings for camera images, disrupting their gaming experience.
Innovation Solution
An information processing apparatus that estimates the attitude of the HMD using imaging and sensor data to generate a content image and a system image, allowing users to make settings for camera image streaming without removing the HMD.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user removes the HMD to make settings regarding the camera image, then the user can easily access the settings menu, but the user's immersion in the virtual reality experience is broken and convenience is reduced
Solution Approach 1:
The patent introduces a second display surface (such as a screen on the HMD itself or a paired device) that allows users to access settings menus without removing the HMD. This creates an additional dimensional space for interaction, separating the settings interface from the virtual reality content display, thereby enabling users to configure camera images while maintaining their VR immersion.
2Loss of time
If the user keeps the HMD on while making settings, then immersion is maintained, but the interface for making settings becomes difficult to access
Solution Approach 1:
The patent segments the display functionality into two separate surfaces: one for virtual reality content (the primary HMD display) and another for system settings and camera configuration (a secondary display surface). This segmentation allows users to access settings without switching between physical devices or removing the HMD, as the settings interface is available on a dedicated secondary surface that can be viewed simultaneously or alternately with the VR content.
3Ease of operation
If a separate device is used for settings, then settings can be accessed, but the system complexity increases
Solution Approach 1:
The patent implements multi-functionality by enabling the HMD system to serve dual purposes: displaying virtual reality content on the primary display surface and providing settings access through a secondary display surface. The same HMD hardware platform is utilized for both immersive gaming and configuration tasks, eliminating the need for separate dedicated setting devices and reducing overall system complexity while maintaining ease of operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to set up camera image streaming while wearing the HMD, enhancing user experience by maintaining immersion and convenience during gameplay.
Implementation Method 1
an imaging device 18 that captures an image around the head-mounted display 100
Implementation Method 2
an attitude sensor 124 that detects a value corresponding to an attitude of the head-mounted display 100
Data Source
AI summary
An estimation processing section derives attitude information indicative of the attitude of an HMD worn by a user on the head. A game image generation section generates a content image in a three-dimensional virtual reality space for display on the HMD based on the attitude information regarding the HMD. A system image generation section generates a system image allowing the user wearing the HMD on the head to make settings regarding a camera image for broadcast along with the content image.