Programmable Video Layout for Dynamic Conference Composition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video conferencing systems lack the ability for organizers to customize the layout and transitions during a meeting based on specific events or parameters, limiting flexibility and engagement.

Innovation Solution

Implementing programmable instructions, such as JavaScript code or HTML, that allow organizers to specify custom or preset layouts and transition events, enabling dynamic changes in the video conference layout based on events like presentation sharing, participant actions, or network quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If preset layouts are used for video conferencing, then the system is simple to operate, but the layout cannot be customized according to different parameters or events

Engineering Contradiction:
Improvelayout customizationVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system transitions from static preset layouts to dynamic programmable layouts that can change based on events, participant actions, and conference parameters. Organizers can write code to automatically adjust layouts in response to dynamic conditions such as participant joining, screen sharing, or audio routing changes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

A layout service acts as an intermediary between the video conferencing system and participant devices. This service receives layout instructions from organizers, processes them through a layout engine, and distributes the resulting layout data to participants, thereby managing complexity centrally rather than at each device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If individual video feeds are sent to each participant according to preset layout, then the layout is fixed, but the system uses more network bandwidth and processing resources

Engineering Contradiction:
Improveresource efficiencyVSAvoidlayout flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system merges multiple individual video feed transmissions into a single composite video stream. The layout service combines video feeds according to the determined layout and sends one consolidated stream to each participant, reducing network bandwidth consumption and processing requirements while maintaining layout flexibility through programmable instructions.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If organizers want to control layout based on different parameters, then layout flexibility improves, but the system becomes more complex to implement and operate

Engineering Contradiction:
Improveparameter-based controlVSAvoidoperational simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The layout service serves as an intermediary that handles the complexity of parameter-based layout control. Organizers can specify layout parameters and event conditions without needing to understand the underlying implementation complexity, as the layout service processes these instructions and generates appropriate layout configurations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Organizers can prepare layout instructions and event conditions in advance before the conference begins. The system allows pre-configuring layout behaviors for various scenarios, so that during the conference, layouts automatically adjust based on predetermined rules without requiring real-time manual intervention.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11196963B1Programmable video composition layout
Publication Date: 2021.12.07 AMAZON TECH INC
  • US11196963B1 patent drawing
  • US11196963B1 patent drawing
  • US11196963B1 patent drawing

AI summary

Implementations for combining a plurality of content based on instructions for a layout of a video conference are described. A video conference is established between a plurality of devices of participants of the video conference. First content is received from a device of the plurality of devices in the established video conference. Second content is also received. Instructions for a layout of the first content and the second content during the video conference is received. Based on the instructions for the layout, the first content and the second content are combined into a composite video stream. The composite video stream is saved or transmitted.