VR Comment Overlay via Semantic Point-of-Interest Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In virtual reality environments, users cannot effectively display and visualize comments made by others regarding points of interest in real-time, as existing systems lack efficient methods to associate comments with specific locations and viewing directions within the virtual space.

Innovation Solution

An apparatus and method that utilize semantic analysis to identify points of interest in virtual reality content based on user comments, allowing for the display of a subset of comments overlaid over the virtual reality view, positioned and filtered based on visibility, viewing direction, and virtual distance, using predetermined point of interest data and image recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all comments are displayed in the virtual reality view, then information completeness is improved, but visual clutter and user distraction increase

Engineering Contradiction:

Improvecomment information completenessVSAvoidvisual clutter and distraction

Core Design Contradiction:

Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies local quality by selectively displaying comments only in specific regions of the virtual reality view where they are most relevant to the user's current focus. Comments are positioned near their associated points of interest rather than uniformly distributed, creating localized information density that provides completeness without overwhelming the entire visual field.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system implements partial action by displaying only a subset of available comments rather than all comments. The selection criteria filter comments based on relevance to the current viewpoint, temporal recency, and user preferences, presenting enough information to be useful while avoiding the harm of complete information display.

Inventive Principle:

Principle #16Partial or excessive action

2Loss of information

If comments are positioned close to points of interest, then association clarity is improved, but occlusion of the point of interest may occur

Engineering Contradiction:

Improvecomment-point association clarityVSAvoidvisible area of point of interest

Core Design Contradiction:

Loss of informationVSArea of stationary object

Solution Approach 1:

The system resolves the occlusion problem by transitioning from a two-dimensional display plane to a three-dimensional virtual space. Comments are positioned in 3D space relative to points of interest, allowing them to appear above, below, or at angled positions that maintain visual association without blocking the actual point of interest from view.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system uses visual properties such as color, transparency, and size variations to differentiate comments from the underlying point of interest. Comments may be rendered with semi-transparent backgrounds or distinct color coding that allows the point of interest to remain visible through or alongside the comment text.

Inventive Principle:

Principle #32Color changes

3Loss of information

If semantic analysis is used to identify points of interest, then comment relevance is improved, but processing time and computational resources increase

Engineering Contradiction:

Improvecomment relevance accuracyVSAvoidcomment processing time

Core Design Contradiction:

Loss of informationVSLoss of time

Solution Approach 1:

The system applies preliminary action by pre-processing and indexing comment data during ingestion, including initial semantic analysis and categorization. This advance preparation allows for rapid retrieval and filtering during actual viewing, reducing real-time processing requirements while maintaining high relevance accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system replaces intensive real-time semantic analysis with pre-computed semantic features and metadata. Comments are analyzed offline for key topics, entities, and relevance scores, which are then used for quick filtering and selection during virtual reality viewing, substituting computational mechanics with pre-prepared data structures.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11321886B2Apparatus and associated methods

Publication Date: 2022.05.03 NOKIA TECHNOLOGIES OY

AI summary

An apparatus configured to, in respect of virtual reality content comprising video imagery configured to provide a virtual reality space wherein a virtual reality view presented to a user provides for viewing of the VR space; based on a comment made by and a virtual location of a commenting-user in the virtual reality space when the comment was made; provide for determination of a point of interest in the virtual reality space, the point of interest identified based on, at least, the virtual location of the commenting-user when the comment was made and semantic analysis of the comment to identify the point of interest surrounding the virtual location to which the comment refers, the point of interest associated with the comment thereby enabling the comment to be overlaid over the virtual reality view of the video imagery.