Object Detection Device Using Direction-Aware 2D Bounding Box Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current object detection systems for automated driving face challenges in accurately estimating the position of objects from 2D bounding boxes due to changes in object center position with direction, and require high-cost annotation data for 3D bounding box calculations.
Innovation Solution
An object detection device that includes an object extraction unit, a direction calculation unit, and a bottom area calculation unit to estimate object positions with high accuracy by transforming 2D bounding boxes into real-world coordinates using a homography matrix and considering object direction, allowing for precise calculation of bottom areas and object sizes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the center position of a 2D bounding box is used to represent object position, then the calculation is simple, but the position estimation accuracy deteriorates because the center position changes with object direction
Solution Approach 1:
The patent transitions from using only 2D bounding box center positions to incorporating 3D direction information (orientation angle) to accurately represent object position. By adding the dimension of directional information, the system can distinguish between objects at different orientations even when their 2D projections overlap, thereby improving position estimation accuracy without excessive complexity increase.
Solution Approach 2:
The patent segments the object representation into distinct components: 2D bounding box position, object direction (orientation angle), and 3D size information. This segmentation allows each component to be processed and transformed independently, maintaining computational efficiency while improving overall position estimation accuracy through the combination of these segmented information elements.
2Measurement precision
If a neural network model is used to output 3D bounding boxes, then object size and direction can be estimated, but large amounts of costly annotation data are required for training
Solution Approach 1:
The patent uses 2D bounding box information as a copy or proxy for the more complex 3D bounding box representation. Instead of training a neural network to directly output 3D bounding boxes requiring expensive 3D annotation data, the system uses the simpler 2D bounding box annotations to infer object position and direction, thereby reducing the quantity and cost of required annotation data while maintaining estimation accuracy.
Solution Approach 2:
The patent employs inexpensive 2D bounding box annotations as a substitute for expensive 3D bounding box annotations. The 2D bounding box, which can be annotated at low cost, serves as a disposable intermediate representation that suffices for the detection task, eliminating the need for costly 3D annotation data while still enabling accurate object position and size estimation.
3Measurement precision
If 2D bounding box coordinates are transformed to real world coordinates using homography matrix, then position can be calculated, but the transformed position does not reflect the actual object center position when object direction varies
Solution Approach 1:
The patent incorporates feedback from object direction information into the position transformation process. By using the orientation angle as feedback, the system adjusts the transformation to account for the object's actual direction, ensuring that the calculated real world position accurately reflects the object center position rather than relying solely on the 2D bounding box center transformation.
Data Source
AI summary
Provided is an object detection device that can estimate an object position from a 2D-BBOX, with high accuracy. The object detection device includes: an object extraction unit which extracts an object from an image and outputs a rectangle enclosing the object in a circumscribing manner; a direction calculation unit which calculates a direction of the extracted object on the image; and a bottom area calculation unit which calculates bottom areas of the object on the image and in a real world coordinate system, using a width of the rectangle outputted from the object extraction unit and the direction of the object on the image calculated by the direction calculation unit.


