Gesture-Based Video Feed Customization for Smart TV Conferencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interactive and supplemental content delivery systems for viewers are decoupled from primary communication channels, lacking easy-to-deploy video conferencing capabilities, especially in smart TV connected devices, which misses the core use case of facilitating large-screen communications.

Innovation Solution

A networked communication session is established with parameter information from devices, enabling access to a composited interactive audio/video feed that can be customized and transmitted across devices, including TVs via Internet media extenders, using gesture-based interfaces and video applications to facilitate interactive video conferencing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate communication channels are used for supplemental content delivery, then content can be provided to viewers, but the communication channels become decoupled from primary broadcasting channels

Engineering Contradiction:
Improvecontent delivery capabilityVSAvoidcommunication channel structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines separate communication channels (broadcast channel and supplemental content channel) into a unified networked communication session. The server mediates between content providers and viewers, merging previously decoupled channels into an integrated system where both primary content and supplemental information flow through connected network pathways.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The communication system is designed to handle multiple functions through a single unified channel structure. The same network infrastructure supports both traditional broadcasting and supplemental content delivery, video conferencing, and interactive communication, eliminating the need for separate dedicated channels for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If video conferencing is added to smart TV connected devices, then large-screen communications are enabled, but device complexity and deployment difficulty increase

Engineering Contradiction:
Improvevideo conferencing capabilityVSAvoiddeployment ease
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The server acts as an intermediary that handles the complex video conferencing logic, session management, and participant coordination. Individual smart TV devices don't need to implement complex conferencing protocols themselves; instead, they connect to the server which manages the multi-party communication, simplifying device implementation while enabling full video conferencing functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates virtual representations of participants through video feeds and audio streams that are distributed by the server. Each participant receives copied versions of other participants' media streams, enabling conferencing functionality without requiring direct peer-to-peer connections between devices, thus simplifying deployment.

Inventive Principle:
Principle #26Copying

3Ease of operation

If customizable audio/video feed representations are provided to different devices, then user experience is enhanced, but system complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidfeed composition system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The server provides different customized representations of the composited audio/video feed to different devices based on their specific capabilities and user preferences. Each device receives a tailored version optimized for its display characteristics, interaction mode, and user needs, rather than a uniform feed to all participants.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the composited feed representation for each device based on real-time conditions such as which participant is speaking, device orientation, screen size, and user interactions. The feed composition is not static but adapts continuously to provide optimal viewing experience for each participant's context.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10033967B2System and method for interactive video conferencing
Publication Date: 2018.07.24 SALERNO MICHAEL
  • US10033967B2 patent drawing
  • US10033967B2 patent drawing
  • US10033967B2 patent drawing

AI summary

A networked communication session is defined vis-à-vis parameter information received from a first device, and access to the networked communication session is provided to the first device. Access to the networked communication session is further provided to each of additional device(s) in accordance with information associated with each of the additional device(s). A composited interactive audio/video feed is generated and transmitted that comprises audio/video input received during the networked communication session from each of the devices. Each of the devices is configured via a gesture-based user interface to enable user-based selection and respective manipulation of at least a portion of the composited audio/video feed that results in a customized representation of the composited audio-video feed at a particular one device that is not represented at a particular other of the device(s).