Orchestrator Firmware for Imaging Optimization in Heterogeneous Platforms

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In heterogeneous computing platforms, existing systems lack efficient methods for detecting and configuring imaging optimization settings during collaboration sessions, particularly in a manner that is independent of the host Operating System and adaptable to varying contextual conditions.

Innovation Solution

A heterogeneous computing platform with an orchestrator device that receives telemetry data and implements imaging optimization settings, such as background segmentation or video stabilization, based on policies that can be applied without host OS involvement, using firmware services and AI models to manage and configure devices like high-performance AI devices and VPUs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If imaging optimization settings are configured through host Operating System, then system compatibility is maintained, but OS dependency increases and flexibility is reduced

Engineering Contradiction:
Improveconfiguration flexibilityVSAvoidsystem dependency
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts imaging optimization configuration functionality from the host Operating System and implements it at the firmware level. The orchestrator device directly configures imaging parameters (background segmentation, background blur, virtual background, red-eye correction, noise reduction, face framing, auto-focus, auto-enhancement, auto-zoom, and video stabilization) without requiring OS involvement, thereby reducing OS dependency and increasing configuration flexibility.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a firmware-based intermediary layer between the collaboration session and imaging processing. The orchestrator device acts as this intermediary, receiving telemetry data and configuring imaging optimization settings directly at the firmware level, eliminating the need for direct OS mediation and enabling more flexible, adaptive configuration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If imaging optimization is implemented without host OS involvement, then configuration flexibility improves, but system complexity increases

Engineering Contradiction:
Improveautonomous configurationVSAvoidfirmware management
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent segments the computing system into distinct functional layers: a collaboration session manager that detects session parameters, an orchestrator device that manages firmware services and telemetry data, and imaging processing units that execute optimization algorithms. This segmentation enables autonomous configuration at the firmware level while distributing system complexity across specialized components rather than concentrating it in a single complex system.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12001561B2Detecting and configuring imaging optimization settings during a collaboration session in a heterogenous computing platform
Publication Date: 2024.06.04 DELL PROD LP
  • US12001561B2 patent drawing
  • US12001561B2 patent drawing
  • US12001561B2 patent drawing

AI summary

Systems and methods for detecting and configuring imaging optimization settings during a collaboration session in a heterogenous computing platform are described. In some embodiments, an Information Handling System (IHS) may include a heterogeneous computing platform having a plurality of devices and a memory coupled to the heterogeneous computing platform, where the memory includes a plurality of sets of firmware instructions, where each set of firmware instructions, upon execution by a respective device, enables the respective device to provide a corresponding firmware service, and where at least one of the plurality of devices operates as an orchestrator configured to receive telemetry data and change an imaging optimization setting during a collaboration session, at least in part, based upon the telemetry data.