Server Segments Video Streams for Multi-Display Array Sync

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in efficiently distributing audio/video (A/V) data to an array of client devices, particularly in maintaining synchronization and handling user interactions across multiple displays.

Innovation Solution

A server system that identifies collocated client devices, prompts a 'video grid' mode, breaks video streams into segments, and streams them to individual devices, with audio enabled on one central device and muted on others, using methods like eye tracking or voice interfaces to determine device configuration and coordinate user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single large TV is used to display A/V content, then the display area is large, but the cost is high

Engineering Contradiction:
Improvedisplay areaVSAvoidcost
Core Design Contradiction:
Area of stationary objectVSEase of manufacture

Solution Approach 1:

The patent divides the display system into multiple smaller client devices (e.g., multiple TVs or displays) arranged in an array, where each device displays a portion of the overall A/V content. This segmentation allows the system to achieve a large total display area while using multiple smaller, more cost-effective devices instead of one expensive large TV.

Inventive Principle:
Principle #1Segmentation

2Area of stationary object

If A/V data is distributed to multiple client devices, then the display area increases, but maintaining synchronization becomes complex

Engineering Contradiction:
Improvedisplay areaVSAvoidsynchronization complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary that receives the A/V data stream, processes it into multiple synchronized output streams, and distributes them to all client devices. The server acts as a central coordinator that handles the complexity of synchronization, timing, and data distribution, freeing the client devices from needing to manage synchronization themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If audio is transmitted to all client devices, then each device can play audio independently, but audio synchronization and noise control becomes problematic

Engineering Contradiction:
Improveaudio playback flexibilityVSAvoidaudio noise and synchronization issues
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different audio handling strategies to different client devices based on their positions and roles in the array. The server transmits audio data to specific devices designated as audio output devices, while other devices receive video data only or have audio muted. This local differentiation ensures that audio is played from optimal locations without causing noise or synchronization problems.

Inventive Principle:
Principle #3Local quality

4Productivity

If the server processes and separates video data into multiple streams, then each client device receives optimized data, but the server processing complexity increases

Engineering Contradiction:
Improvedata distribution efficiencyVSAvoidserver processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The server segments the incoming A/V data stream into multiple separate video streams, with each stream optimized for a specific client device or group of devices. This segmentation allows efficient distribution where each client receives only the data it needs, improving overall system productivity and reducing network bandwidth requirements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11496727B2Streaming to display array
Publication Date: 2022.11.08 ARRIS ENTERPRISES LLC
  • US11496727B2 patent drawing
  • US11496727B2 patent drawing
  • US11496727B2 patent drawing

AI summary

Aspects of the present invention are drawn to a server device for use with a stream of encoded A/V data and an n×m array of client devices. The server device includes a memory and a processor. The memory causes the server device to decode the A/V data to gain access to decoded video data and decoded audio data, as well as determining the configuration of the n×m array of client devices. The memory causes the server device to separate the decoded video data into n times m distinct video data payloads and encode n times m converted streams of encoded A/V data. The memory additionally causes the server device to transmit the n times m encoded subdivided streams to the n×m array of client devices, respectively, based on the determined configuration of the n×m array of client devices.