Composite Video Stream Switching for Remote Teaching Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video communication technologies for remote teaching often require multiple devices and increased bandwidth, limiting the ability to simultaneously display both the teacher and writing surfaces effectively, especially for remote participants with limited display capacity.

Innovation Solution

An electronic device with multiple image capturing devices automatically selects and transmits the most relevant image stream, focusing on either the teacher or the writing surface, reducing data requirements and ensuring legible presentation on various display sizes by resizing and prioritizing content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If two separate communication devices are used to capture both the teacher and writing surface, then both image streams can be captured, but data transmission requirements are doubled and device complexity increases

Engineering Contradiction:
Improveimage stream coverageVSAvoidnumber of devices
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple image capturing devices (laptop camera and smartphone camera) into a single communication device that can capture both the teacher and writing surface simultaneously. The device includes a camera module that can switch between different capture modes (first image stream for teacher, second image stream for writing surface) without requiring separate devices, thereby reducing system complexity while maintaining full image stream coverage.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If two separate communication devices are used to capture both the teacher and writing surface, then both image streams can be captured, but bandwidth requirements increase

Engineering Contradiction:
Improveimage stream coverageVSAvoiddata transmission volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent implements dynamic switching between different image streams based on the teaching scenario. The camera module can dynamically switch between capturing the teacher (first image stream) and the writing surface (second image stream), or capture both simultaneously in a composite view. This dynamic adaptation allows the system to transmit only the necessary image data at any given moment, reducing overall bandwidth requirements compared to continuously transmitting both separate streams.

Inventive Principle:
Principle #15Dynamics

3Loss of information

If both image streams are transmitted simultaneously, then both teacher and writing surface are visible, but remote participants with small displays cannot legibly view the written content

Engineering Contradiction:
Improvecontent visibilityVSAvoiddisplay legibility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the image capture and transmission into distinct modes. Instead of transmitting both full-resolution image streams simultaneously (which would be impossible on small displays), the system captures both views but transmits them in a segmented manner - either alternating between teacher view and writing surface view, or providing a composite view with the writing surface at an appropriate size for legibility on remote displays. This segmentation allows small display devices to clearly view written content while still providing access to both image streams.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11838677B2Composite presentation surface and presenter imaging for a multiple camera transmitting device in a video communication session
Publication Date: 2023.12.05 MOTOROLA MOBILITY LLC
  • US11838677B2 patent drawing
  • US11838677B2 patent drawing
  • US11838677B2 patent drawing

AI summary

An electronic device, computer program product, and method are provided that autonomously switch between first and second image streams of two image capturing devices during a video communication session, reducing data transmission and display size requirements for recipients. A controller of the electronic device identifies a person in the first image stream and identifies a writing surface in the second image stream. In response to determining that the person is not attending to the writing surface, the controller communicates, to at second electronic device(s) during the video communication session, at least a first portion of the first image stream that focusses on a face of the person. In response to determining that the person is attending to the writing surface, the controller communicates at least a second portion of the second image stream that focusses on the writing surface.