Selectable Interaction Elements in 360-Degree Video Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional 360-degree video systems restrict user experience for remote participants in video conferencing by limiting interaction to mere viewing or selecting between the 360-degree image and focused views of in-room participants, without providing efficient means to identify individuals, access information, or control content.

Innovation Solution

Incorporating selectable interaction elements into the 360-degree video stream, such as text, icons, or widgets, that allow users to select objects for information retrieval, message sending, and perspective changes, enabling enhanced interaction and control within the video conferencing environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional 360-degree video systems are used, then the system structure remains simple, but the user interaction capability is limited

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces selectable interaction elements as intermediary components between the 360-degree video stream and the user interface. These elements (icons, text labels, widgets) act as mediators that enable remote participants to interact with in-room participants and content without requiring complex direct interaction mechanisms. The interaction elements are overlaid on the video stream and can be selected to perform actions such as identifying participants, sending messages, or requesting focused views.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If selectable interaction elements are incorporated into the video stream, then user interaction efficiency is improved, but data transmission load increases

Engineering Contradiction:
Improvecommunication efficiencyVSAvoiddata transmission load
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts interaction functionality from the main video stream by using separate interaction elements that are overlaid on top of the video content. These elements are transmitted as additional data layers that can be selectively rendered. When interaction elements are selected, the system extracts and transmits only the relevant focused video content or participant information requested, rather than transmitting the entire 360-degree stream at full resolution continuously.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If interaction elements are added to enable participant identification and content control, then functional versatility is improved, but interface complexity increases

Engineering Contradiction:
Improvefunctional versatilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the interaction system into distinct, modular interaction elements that can be independently designed and implemented. Each element (such as participant identification icons, message sending buttons, content control widgets) performs a specific function. These segmented elements are distributed throughout the video stream at relevant locations, allowing users to access different functions without being presented with a single complex control interface. The segmentation enables selective rendering of interaction elements based on user needs and system state.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10444955B2Selectable interaction elements in a video stream
Publication Date: 2019.10.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10444955B2 patent drawing
  • US10444955B2 patent drawing
  • US10444955B2 patent drawing

AI summary

Techniques are described herein that are capable of providing selectable interaction elements in a 360-degree video stream. A selectable interaction element is an element (e.g., user interface element) for which selection of the element initiates the providing of information pertaining to an object with which the element is associated. For instance, the selectable interaction element may be positioned proximate the object in the 360-degree video stream (e.g., a portion of the 360-degree video stream or an entirety of the 360-degree video stream). Examples of a user interface element include but are not limited to text, an icon, and a widget.