USB Webcam Pseudo-Video Frame Sensor Data Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Devices using universal serial bus (USB) connectors are limited by the USB protocol and the number of pins available, restricting the types of data that can be communicated over a single connector, requiring additional connectors or custom protocols for more complex data transmission.

Innovation Solution

A system that includes a webcam with a processor and transceiver that generates pseudo-video frames to encode non-standard sensor data, allowing it to be transmitted over a single standard USB interface using standard video picture encoding protocols like MPEG-4 Part 2, YUY2, or H.264, thereby enabling the communication of multiple types of data without the need for custom protocols.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If standard USB protocol and connector are used, then device compatibility and cost are improved, but the ability to transmit non-standard sensor data is limited

Engineering Contradiction:
Improvedata transmission capabilityVSAvoidprotocol complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the standard USB protocol multi-functional by embedding sensor data within video frame structures. The video data stream serves dual purposes: conveying actual video information and carrying sensor data (ambient light, proximity, motion, audio) within the same transmission channel, eliminating the need for separate communication protocols or connectors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements a nested data structure where sensor data is embedded within video frames, which are in turn encoded within USB packets. Specifically, sensor data is placed in video frame headers or as overlay elements within the video stream, creating a hierarchical nesting that allows multiple data types to coexist in a single USB channel.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Adaptability or versatility

If additional connectors or custom protocols are used to transmit sensor data, then data transmission versatility is improved, but device complexity and cost increase

Engineering Contradiction:
Improvedata transmission capabilityVSAvoidmanufacturing cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The invention makes the standard USB protocol multi-functional by embedding sensor data within video frame structures. The video data stream serves dual purposes: conveying actual video information and carrying sensor data (ambient light, proximity, motion, audio) within the same transmission channel, eliminating the need for separate communication protocols or connectors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses standard video encoding formats (MPEG-4, H.264, YUY2) as a template or copying mechanism to encode sensor data. By representing sensor information in the same format and structure as video data, the system leverages existing, well-understood encoding standards rather than creating costly custom protocols, thereby reducing manufacturing complexity and cost.

Inventive Principle:
Principle #26Copying

3Device complexity

If sensor data is embedded in video frames, then single connector transmission is achieved, but data extraction complexity increases

Engineering Contradiction:
Improveconnector quantityVSAvoiddata extraction difficulty
Core Design Contradiction:
Device complexityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent segments video frames into distinct components: standard video data portions and sensor data portions. By dividing the frame structure into identifiable segments (such as headers, overlays, or dedicated data fields), the receiver can systematically extract sensor information without having to parse the entire video stream, reducing extraction complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces video frame structures as an intermediary container that holds both video and sensor data in a standardized format. This intermediary structure acts as a mediator between the diverse sensor data sources and the USB transmission protocol, providing a unified interface that simplifies data extraction at the receiving end.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11064247B1System and method for communicating non-standard video data via USB
Publication Date: 2021.07.13 ELO TOUCH SOLUTIONS INC(US)
  • US11064247B1 patent drawing
  • US11064247B1 patent drawing
  • US11064247B1 patent drawing

AI summary

Some embodiments include an apparatus, method, and computer program product for receiving non-standard video data via a single standard universal serial bus (USB) interface, where the non-standard video data includes sensor data from one or more sensors in addition to standard video frames from an image detector. Some embodiments include recovering a standard video picture encoding packet from a standard USB packet, and recovering non-standard video data. Some embodiments include detecting a pseudo-video frame within the non-standard video data, determining sensor data from one or more sensors from the pseudo-video frame, and transmitting the sensor data to a monitor scaler processor. Some embodiments include storing the standard USB packet, and in response to the detecting, discarding the pseudo-video frame.