Persona Pixel Video Capture Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video-capture systems struggle to dynamically adjust settings based on the identified persona in video frames, leading to suboptimal extraction and merging of presenter images with content, affecting the quality of multimedia experiences in online meetings.

Innovation Solution

The system identifies persona pixels within video frames and adjusts video-capture settings such as exposure and gain based on the brightness values of these pixels, using a video-capture controller with modules for frame reception, persona identification, and adjustment command output, to enhance the dynamic range and quality of the extracted persona.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video-capture settings are adjusted based on all pixels in video frames, then the overall image quality improves, but the processing complexity and time increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the video frame into persona pixels (representing the presenter) and non-persona pixels (background). The system selectively processes only persona pixels for video-capture setting adjustments, thereby reducing processing complexity while maintaining image quality for the relevant subject.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing quality levels to different regions of the video frame. Persona pixels receive full processing attention for accurate setting adjustment, while non-persona pixels are excluded from processing. This local differentiation reduces overall processing complexity while preserving image quality where it matters most.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If video-capture settings are dynamically adjusted for each frame, then the quality of extracted persona improves, but the processing time increases

Engineering Contradiction:
Improvepersona extraction qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts only the relevant persona pixels from each video frame, excluding background pixels from processing. This extraction approach maintains high persona extraction quality while reducing the total number of pixels requiring dynamic processing, thereby decreasing processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by processing only a subset of pixels (persona pixels) rather than all pixels in each frame. This selective processing achieves sufficient persona extraction quality without the excessive processing time that would result from analyzing every pixel dynamically.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If the system processes only persona pixels for setting adjustment, then the processing efficiency improves, but the adaptability to background changes decreases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidadaptability to background changes
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic persona identification where the set of persona pixels is continuously updated based on current frame analysis. This dynamic approach allows the system to adapt to changes in presenter position, lighting, and appearance while maintaining processing efficiency by focusing only on relevant pixels.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from continuous persona identification to adjust the set of pixels processed in each frame. By feeding back the identified persona region information, the system maintains adaptability to background and lighting changes while preserving processing efficiency through selective pixel analysis.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9942481B2Systems and methods for iterative adjustment of video-capture settings based on identified persona
Publication Date: 2018.04.10 PERSONIFY INC
  • US9942481B2 patent drawing
  • US9942481B2 patent drawing
  • US9942481B2 patent drawing

AI summary

Disclosed herein are systems and methods for iterative adjustment of video-capture settings based on identified persona. In an embodiment, a method includes receiving video frames that are being captured by a video camera of an ongoing scene. The method also includes identifying a persona in one or more of the received frames at least in part by identifying, in each such frame, a set of pixels classified as being representative of the persona. The method also includes selecting, based collectively on the brightness values of the pixels in the identified set, a respective adjustment command for one or more adjustable video-capture settings of the camera, as well as outputting the selected commands to the camera for use in continuing to capture video data representative of the ongoing scene.