Segmented Video Preview Controls for Remote Participants

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video conferencing applications using smartphones tethered to larger displays face challenges in allowing users to control camera settings or adjust the camera without physically interacting with the smartphone, as the camera's display is not readily accessible, and the rear cameras capture the user's actions, limiting remote participants' visibility and control.

Innovation Solution

An electronic device with a video image segmentation and control module (VISCM) that segments the video image into a primary and secondary segment, allowing for a touchless action center with virtual interfaces, enabling air gestures for control and modification of the primary segment's content, which can be transmitted to remote participants for concurrent control during video communication sessions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the camera display is made accessible on the smartphone, then users can control camera settings, but the rear cameras capture the user's actions limiting remote participants' visibility

Engineering Contradiction:
Improvecamera control accessibilityVSAvoiduser action visibility to remote participants
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The video feed is segmented into a primary segment (user's face and upper body) and a secondary segment (user's hands and actions). The primary segment is transmitted to remote participants while the secondary segment is used for touchless control interfaces, allowing simultaneous visibility and control accessibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A touchless action center with virtual interfaces serves as an intermediary between the user and the camera controls. This intermediary allows users to control camera settings through air gestures without physically interacting with the smartphone, while the segmented video feed ensures remote participants can see the user's actions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the smartphone camera display is used for control, then users can adjust settings, but the display is not readily accessible during video communication

Engineering Contradiction:
Improvesettings adjustment accessibilityVSAvoidtime to access and adjust camera settings
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The control interface is moved from the traditional 2D smartphone display to a 3D spatial interface using air gestures. Users can control camera settings by making gestures in the air within a defined spatial zone, eliminating the need to physically access the smartphone display during video communication.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The mechanical interaction of physically touching the smartphone display is replaced with a touchless air gesture system. The touchless action center captures spatial gestures and translates them into control commands, eliminating the need for physical contact with the device.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If the video feed is segmented into primary and secondary segments, then remote participants can control settings, but the system complexity increases

Engineering Contradiction:
Improveremote control capabilityVSAvoidvideo processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The video feed is divided into a primary segment (user's face and upper body for communication) and a secondary segment (user's hands and actions for control). This segmentation enables remote participants to access control settings while maintaining clear visibility of the user during communication.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The segmented video system serves multiple functions: the primary segment enables communication with remote participants, the secondary segment provides the basis for touchless control interfaces, and together they enable remote settings adjustment without increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20230388451A1Segmented video preview controls by remote participants in a video communication session
Publication Date: 2023.11.30 MOTOROLA MOBILITY LLC
  • US20230388451A1 patent drawing
  • US20230388451A1 patent drawing
  • US20230388451A1 patent drawing

AI summary

A method allows a receiving device to control aspects of an image stream transmitting (IST) device. The method includes receiving a segmented video stream from the IST device during a video communication session. The segmented video stream includes a primary segment and a secondary segment presenting a virtual control interface. The method includes presenting, on a display device, a control enabling view of the segmented video stream and monitoring for movement, captured by at least one image capturing device, that is indicative of the input occurring within a spatial location proximate to the selectable feature. The method includes in response to detecting the input, identifying a function associated with the selectable feature and activating the function to affect one or more characteristics of a video image presented within the primary segment.