Object Detection Scheduling for Shared Hardware Throughput
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing object detection systems face delays in processing due to the differing processing times and resource sharing between high-accuracy and high-throughput detection units, leading to inefficiencies in frame processing.
Innovation Solution
An object detection device with an arbitration unit that controls the start prohibition flag for a first detection unit based on the frame input period, processing times of both units, and shared hardware resources to synchronize their operations, ensuring timely completion of processing by the second detection unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the first detection unit processes frames with high accuracy, then detection precision is improved, but processing time increases causing delays in frame output
Solution Approach 1:
The detection system is segmented into two distinct detection units: a first detection unit for high-accuracy detection and a second detection unit for rapid detection. Each unit processes different portions of the frame or operates on different priorities, allowing the system to balance accuracy and speed by segmenting the detection workload rather than using a single unified detection approach
Solution Approach 2:
The system dynamically adjusts detection resources and processing priorities based on frame characteristics and timing requirements. The arbitration unit dynamically determines whether to prioritize the first detection unit for accuracy or allow the second detection unit to expedite processing, creating a dynamic balance between detection precision and processing speed
2Device complexity
If the first detection unit and second detection unit share hardware resources, then device complexity is reduced, but processing delays occur due to resource contention
Solution Approach 1:
An arbitration unit is introduced as an intermediary component that manages resource allocation and processing timing between the first detection unit and second detection unit. This mediator coordinates their operations, controls access to shared hardware resources, and ensures that critical detections are prioritized, thereby reducing processing delays while maintaining a relatively simple shared hardware architecture
Solution Approach 2:
The system implements periodic detection cycles where the first detection unit and second detection unit operate in coordinated time intervals. The arbitration unit enforces periodic processing schedules that allow each detection unit to access shared resources in turn, preventing continuous resource contention and ensuring predictable processing timing
Data Source
AI summary
A first detection unit that identifies a label of an object reflected in an input frame and a location of a bounding box of the object, and predicts an area of the bounding box in a frame input later than the frame based on history of the location of the bounding box of the same object. A second detection unit that identifies the label of the reflected object and the location of the bounding box of the object, in the predicted area of the bounding box in the frame input later. The first detection unit and the second detection unit share a hardware resource. The arbitration unit controls turning on and off of a start prohibition flag which is to prohibit start of a processing of the first detection unit.