Hybrid Feature Video Bitstream Decoding for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression technologies struggle to efficiently compress video content for both human and machine consumption, leading to high network bandwidth requirements and computational complexity, particularly in devices that process video.
Innovation Solution
A hybrid decoder and encoder system that separates video and feature components, allowing for adaptive decoding modes based on the bitstream attributes, and includes a demultiplexer to parse the hybrid bitstream into video and feature components, with a feature decoder providing feedback to the video decoder for enhanced compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video content is transmitted in uncompressed or standard compressed format for human viewing, then video quality is maintained, but network bandwidth requirements increase significantly
Solution Approach 1:
The patent segments the bitstream into distinct video components and feature components. The video components are compressed using traditional video coding techniques for human viewing, while feature components extract and transmit only the essential visual features needed for machine analysis. This segmentation allows the system to reduce overall bandwidth requirements by transmitting compressed video for quality and compact feature representations for machine processing, without requiring full-resolution uncompressed video transmission.
2Quantity of substance
If video processing is performed entirely on edge devices, then network bandwidth is reduced, but computational complexity and battery consumption increase
Solution Approach 1:
The patent extracts and separates feature components from the video stream at the edge device. Instead of performing complete video processing locally, the system extracts only the essential feature representations needed for machine analysis and transmits these compact features to the server. This extraction approach reduces the computational burden on edge devices compared to full video processing, while still achieving the goal of reduced network bandwidth by transmitting only feature data rather than full video frames.
3Adaptability or versatility
If a hybrid bitstream is created to serve both human and machine applications, then versatility is improved, but system complexity increases
Solution Approach 1:
The hybrid bitstream is segmented into clearly defined video components and feature components with distinct syntax structures. The video components follow standard video coding formats that can be decoded by conventional video decoders, while feature components contain machine-specific information. This segmentation allows different parts of the bitstream to be processed independently - video components for human viewing and feature components for machine analysis - thereby managing decoder complexity through modular processing while maintaining dual-purpose versatility.
Solution Approach 2:
The patent creates a universal bitstream format that can serve multiple functions simultaneously. The same bitstream can be decoded by standard video decoders for human viewing (using video components) and by specialized feature decoders for machine analysis (using feature components). This multi-functionality is achieved by incorporating both video and feature representations in a unified bitstream structure, allowing a single transmission to satisfy both human and machine application requirements without requiring separate encoding streams.
Data Source
AI summary
Methods and systems for hybrid feature video bitstream encoding and decoding are provided. Encoding can be performed in one of a plurality of modes. In one mode, the video components of the encoded bitstream include residual data generated encoding the difference between feature data and input video data. A compatible decoder can operate in a plurality of decoding modes. In one decoding mode, the video components are decoded using the encoded video and encoded feature data in the bitstream. The hybrid bitstream between the encoder and decoder is formed with a plurality of hybrid segments, each having a plurality of components specifying characteristics the feature and video content of the segment.