Edge-Assisted AR Video Frame Offloading with Consistent-Bitrate Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality (AR) devices face challenges in providing a seamless and immersive experience due to the substantial processing power required for tasks like object detection, which often results in delayed and inaccurate object detection results when offloading image frames to a server.
Innovation Solution
The implementation of efficient offloading of image frame processing tasks in edge-assisted AR, where image frames are compressed using a consistent bitrate and then wirelessly sent to a server for processing, allowing for the receipt of object detection results for immediate use in subsequent image frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If image frames are offloaded to a server for object detection in AR, then processing power requirements are reduced on the AR device, but the time required to receive object detection results increases causing delays
Solution Approach 1:
The patent applies preliminary action by compressing image frames using a consistent bitrate before offloading them to the server. This preprocessing step reduces the size of data to be transmitted, thereby decreasing the time required for network transmission while maintaining the benefit of server-side processing power. The consistent bitrate compression ensures that the compression process is efficient and predictable, further reducing processing time on the AR device before offloading.
2Loss of time
If image frames are compressed using consistent bitrate before offloading, then transmission time is reduced, but compression complexity increases on the AR device
Solution Approach 1:
The patent applies parameter changes by using a consistent bitrate as a fixed parameter for compression across all image frames. This approach simplifies the compression process by eliminating the need for complex adaptive bitrate adjustment algorithms, reducing the computational complexity on the AR device. The consistent bitrate parameter ensures predictable compression ratios and transmission times, making the overall system more efficient despite the simplicity of the compression approach.
Data Source
AI summary
An augmented reality (AR) device captures a first image frame of a first scene in a real world. The AR device compresses the first image frame using a same bitrate across an entirety of the first image frame to generate a first compressed image frame. The AR device wirelessly sends, to a server, the first compressed image frame. The AR device receives, from the server, object detection results that identify locations of objects depicted in the first image frame.