Mixed Reality Content Overlay on 360-Degree VR Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree virtual reality (VR) technology is primarily limited to video-on-demand and real-time broadcasting, and lacks the capability to analyze real-time situations in industrial settings effectively.
Innovation Solution
A method and apparatus that utilize a plurality of cameras to capture and stitch 360-degree images, convert them into a selected projection format, recognize target objects of interest, and generate metadata, which is then mapped onto the 360-degree VR image to create mixed reality content for real-time analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 360-degree VR technology is used for video-on-demand or real-time broadcasting, then immersive viewing experience is improved, but real-time situation analysis capability deteriorates
Solution Approach 1:
The system performs multiple functions using the same 360-degree VR infrastructure: it provides immersive broadcasting experiences while simultaneously enabling real-time situation analysis through metadata overlay and object recognition, making the technology universally applicable to both entertainment and industrial monitoring
2Area of stationary object
If multiple cameras are used to capture 360-degree region, then image coverage is improved, but system complexity increases
Solution Approach 1:
The patent combines multiple camera feeds into a single stitched 360-degree equirectangular image, merging the functionality of multiple devices into one unified view that maintains comprehensive coverage while simplifying the output for processing and display
3Adaptability or versatility
If metadata is overlaid on 360-degree VR image, then real-time analysis capability is improved, but processing complexity increases
Solution Approach 1:
The system segments the complex processing task into distinct modules: image capture, stitching, object recognition, metadata generation, and overlay composition. This segmentation allows each component to be optimized independently while maintaining overall system functionality
Data Source
AI summary
A mixed reality content providing apparatus is disclosed. The mixed reality content providing apparatus may recognize an OOI included in a 360-degree VR image to generate metadata of the OOI and may provide a user with mixed reality content where the metadata is overlaid on the 360-degree VR image.