Video Display Control for Split Screen and Priority Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video streaming technologies often result in a distracting viewing experience for remote viewers due to abrupt camera movements focusing on different individuals, and limited viewing angles on mobile devices, which can make conversations tiresome to follow.

Innovation Solution

A method and apparatus that utilize a 180-degree image-capture field of view to identify areas of interest, determine display priorities based on predefined rules, and adjust the video display to present multiple areas of interest either in a single view or split screen arrangement, ensuring optimal viewing without constant adjustments, using a processor and memory to manage the video stream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the camera automatically focuses on different speakers by detecting active objects, then the video content dynamically adapts to the conversation flow, but the viewing experience becomes distracting due to abrupt camera movements and viewpoint jumps

Engineering Contradiction:
Improvedynamic adaptation to conversation flowVSAvoiddistracting effect on viewer
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by enabling the display to smoothly transition between different areas of interest rather than abruptly jumping. The system dynamically adjusts the viewpoint composition based on detected active objects, but does so in a controlled manner that maintains viewer comfort. This resolves the contradiction by making the system adaptive while minimizing harmful distracting effects.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces an intermediary processing layer that mediates between the detected active objects and the final camera viewpoint. Instead of directly mapping speaker detection to camera movement, the system processes multiple areas of interest and determines optimal composition strategies, acting as a buffer that smooths transitions and prevents abrupt changes that would distract viewers.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the camera viewpoint is confined to a limited aspect ratio screen, then the video stream is compatible with standard mobile devices, but the viewer experience is restricted and requires constant viewpoint adjustments

Engineering Contradiction:
Improvedevice compatibilityVSAvoidviewing comfort
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent addresses this contradiction by utilizing another dimension in the composition space. Instead of being limited to a single fixed viewpoint, the system considers multiple areas of interest and compositions simultaneously, selecting and transitioning between them based on the conversation dynamics. This provides viewers with a more comprehensive view while maintaining device compatibility.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If multiple areas of interest are simultaneously displayed using split screen arrangement, then all participants are visible, but the display complexity increases and may reduce clarity

Engineering Contradiction:
Improvevisibility of all participantsVSAvoiddisplay arrangement complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the display into multiple areas of interest that can be independently composed and displayed. When multiple participants are active, the system segments the viewpoint into distinct regions, allowing each to be optimized separately. This can manifest as split-screen arrangements or other multi-region compositions that maintain clarity while showing all relevant participants.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9930270B2Methods and apparatuses for controlling video content displayed to a viewer
Publication Date: 2018.03.27 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9930270B2 patent drawing
  • US9930270B2 patent drawing
  • US9930270B2 patent drawing

AI summary

A method and an apparatus for controlling video content displayed to a viewer are presented. The method includes receiving video stream of a video. Two or more areas of interest are identified in a segment of the video stream and a display priority for each area of interest is determined. The method includes facilitating display of concurrently occurring portions of the segment if the display priority for the each area of interest is equal and the areas of interest can be simultaneously presented in a single view on a display screen. The concurrently occurring portions are displayed in a split screen arrangement if the areas of interest cannot be simultaneously presented in the single view. The portions of the segment related to one or more areas of interest are displayed based on an order of the display priority if the display priority for the each area of interest is unequal.