Alternating Frame DSP Processing with Lockstep Prediction Checks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing complexity of automotive electronics, particularly in safety and autonomous systems, places significant burdens on System on a Chip (SoC) devices due to the need for reliability and redundancy in processing sensor data, leading to inefficiencies and increased silicon area requirements.
Innovation Solution
Implementing digital signal processors (DSPs) that operate independently on alternating frames, with lockstep microprocessors performing frame checks and predictions, allowing for efficient frame processing and releasing DSP bandwidth for other tasks while maintaining safety integrity levels (ASIL D) without doubling silicon area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion compensation is performed using only previously decoded frames, then decoding complexity is reduced, but prediction accuracy deteriorates due to inability to utilize future frame information
Solution Approach 1:
The patent applies preliminary action by performing motion compensation prediction on future frames before they are actually decoded. The decoder predicts future frame blocks using motion vectors from already decoded frames, allowing the system to prepare prediction data in advance. This enables the use of future frame information for prediction while maintaining manageable decoding complexity through the predicted frame comparison process.
2Measurement precision
If all decoded blocks are processed with full motion compensation, then prediction accuracy is improved, but processing time increases due to extensive block-by-block comparison
Solution Approach 1:
The patent applies partial action by selectively processing only those block pairs that require motion compensation comparison. Instead of processing all decoded blocks uniformly, the system identifies and processes only the subset of blocks where motion compensation is needed, based on the predicted motion vectors and frame differences. This reduces processing time while maintaining prediction accuracy for the critical blocks.
Solution Approach 2:
The patent applies local quality by treating different block pairs differently based on their specific characteristics. The system evaluates motion vectors and frame differences locally for each block pair, applying motion compensation only where necessary and using appropriate comparison methods for each local region. This localized approach optimizes processing efficiency while maintaining overall prediction accuracy.
3Measurement precision
If motion vectors are derived from accurate motion compensation, then prediction quality improves, but decoding delay increases due to the need to wait for future frames
Solution Approach 1:
The patent applies preliminary action by performing motion compensation predictions for future frames in advance, before actual decoding occurs. The system predicts future frame blocks using available motion vector information, allowing motion vectors to be derived from accurate predictions rather than requiring waiting for future frame decoding. This eliminates decoding delay while maintaining prediction quality.
Data Source
Figure 1~2
Figure 3A~3B
Figure 4A~4B
AI summary
Frames from an image stream or streams are processed by independently operating digital signal processors (DSPs) (404A, 404B), with only frame checking microprocessors (402A, 402B) operating in a lockstep mode. In one example, two DSP (404A, 404B) are operating on alternate frames. Each DSP (404A, 404B) processes the frames and produces prediction values for the next frame. The lockstep microprocessors (402A, 402B) develop their own next frame prediction. The lockstep processors (402A, 402B) compare issued frames and previously developed predicted frames for consistency. If the predictions are close enough, the issued frame passes the test. The lockstep processors (402A, 402B) then compare the issued frame to the preceding two frames for a similar consistency check. If the prior frames are also close enough, the issued frame is acceptable.