Virtual Camera Hardware Abstraction Layer for Multi-Protocol Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems face inefficiencies in providing camera functionality across different devices, as they often require handling various physical layers and image/video formats, leading to cumbersome resource constraints and processing inefficiencies.

Innovation Solution

A common hardware abstraction layer is introduced to convert buffers and provide image post-processing mechanisms, enabling virtual cameras to stream video frames over multiple protocols (e.g., Bluetooth, Wi-Fi, UWB) and expose devices as standard cameras, allowing first-party or third-party applications to access these streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If different physical layers and services are used to stream image/video data from smart devices, then the portable device can play/render the data, but the smart device requires multiple services and third party applications to handle different interfaces and formats, increasing device complexity and consuming more processing resources

Engineering Contradiction:
Improvecapability to handle different physical layers and image/video formatsVSAvoidnumber of services and third party applications required
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A virtual camera service is introduced as an intermediary component between the camera hardware and different communication protocols. This virtual camera abstracts the physical camera interface and provides unified access points for various protocols (Wi-Fi, Bluetooth, UWB), eliminating the need for multiple third-party applications to handle different interfaces directly.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The virtual camera service provides universal functionality by serving multiple protocols and use cases through a single service instance. It can stream image and video data to different devices via different physical layers while maintaining a consistent interface, replacing the need for multiple specialized services.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple services and third party applications are invoked to handle different interfaces and formats, then various image/video formats can be supported, but processing resources, memory resources and bandwidth of the smart device are inefficiently constrained

Engineering Contradiction:
Improvesupport for various image/video formatsVSAvoidprocessing resource efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

Multiple image/video processing functions that were previously distributed across different services and third-party applications are merged into a single virtual camera service. This consolidation reduces the total processing overhead and memory consumption while maintaining support for various formats through standardized conversion within the virtual camera.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The virtual camera acts as an intermediary that handles format conversion and protocol adaptation centrally, rather than requiring each consuming application to independently handle format conversion. This reduces the cumulative processing burden on the smart device's resources.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If a common hardware abstraction layer is used to convert buffers and provide image post-processing mechanisms, then virtual cameras can stream video frames over multiple protocols efficiently, but the system requires integration of post-processing mechanisms within the abstraction layer

Engineering Contradiction:
Improvestreaming efficiency over multiple protocolsVSAvoidintegration of post-processing mechanisms within HAL
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Image post-processing mechanisms are merged with the hardware abstraction layer buffer conversion functions. This integration allows the HAL to perform both data conversion and post-processing operations within a unified processing pipeline, improving streaming efficiency by eliminating additional processing stages.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Image post-processing operations are performed preliminarily within the hardware abstraction layer before data is streamed to external devices. This preliminary processing reduces the data volume and complexity of data that needs to be transmitted over multiple protocols, improving streaming efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240220178A1Methods, apparatuses and computer program products for providing virtual cameras for hardware inputs
Publication Date: 2024.07.04 META PLATFORMS INC
  • US20240220178A1 patent drawing
  • US20240220178A1 patent drawing
  • US20240220178A1 patent drawing

AI summary

Systems and methods for providing a camera of a device as a virtual camera for one or more other communication devices are disclosed. The device may receive one or more requests from one or more communication devices to utilize a camera of the device as a virtual camera of the one or more communication devices. The device may allow access to the camera of the device to at least one of the one or more communication devices. The device may enable the at least one communication device to utilize the camera of the device to capture one or more images or videos. The device may enable provision of the captured one or more images or videos to the at least one communication device to enable display of the captured one or more images or videos by the at least one communication device.