Bounding Box Geometry Training for Accurate Object Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing autonomous vehicle systems face challenges in accurately generating bounding boxes for object detection using sensor data, particularly in determining the geometry and orientation of objects, which affects navigation and safety.

Innovation Solution

The system employs a machine-learned model to process sensor data, calculating yaw error and intersection over union losses between candidate and ground truth bounding boxes, and uses these losses to train the model, allowing for more robust confidence in geometric evaluations and reducing computational complexity by aligning candidate boxes with ground truth boxes before calculating IoU.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the system calculates detailed geometric losses (yaw error, IoU) between candidate and ground truth bounding boxes, then the accuracy of object detection improves, but the computational complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by first calculating simple confidence values and basic losses, then progressively computing more complex geometric losses (yaw error, IoU) only for candidate boxes that pass initial filtering thresholds. This staged approach allows accurate geometric evaluation while reducing overall computational complexity by avoiding unnecessary calculations for low-probability candidates.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The loss calculation process is segmented into multiple independent components: confidence loss, yaw error loss, and IoU loss. Each component can be computed separately and combined, allowing the system to selectively enable/disable specific loss types based on computational resources available while maintaining detection accuracy when full computation is performed.

Inventive Principle:
Principle #1Segmentation

2Loss of time

If the system aligns candidate boxes with ground truth boxes before calculating IoU, then the processing time is reduced, but the complexity of the alignment process increases

Engineering Contradiction:
Improveprocessing timeVSAvoidalignment complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary alignment of candidate bounding boxes with ground truth boxes before computing IoU metrics. By pre-aligning the boxes to a common coordinate system or orientation, the system simplifies the subsequent IoU calculation process, reducing processing time while the alignment itself remains a straightforward geometric transformation.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the system uses multiple loss functions (confidence loss, yaw loss, IoU loss) to train the model, then the reliability of object detection improves, but the device complexity increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system merges multiple loss functions (confidence loss, yaw error loss, and IoU loss) into a unified multi-objective training framework. These losses are combined with appropriate weighting factors to form a composite loss function that guides the model training process, improving detection reliability by simultaneously optimizing multiple geometric and confidence-related metrics.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The training system is designed with multi-functionality to handle different types of loss functions and optimization objectives. The framework can accommodate various loss types (classification loss, regression loss, geometric loss) and selectively apply them based on training requirements, making the system adaptable to different detection scenarios while maintaining robust performance.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250014203A1Geometric confidence for tracking objects
Publication Date: 2025.01.09 ZOOX INC
  • US20250014203A1 patent drawing
  • US20250014203A1 patent drawing
  • US20250014203A1 patent drawing

AI summary

Techniques for training a model for detecting objects in an environment are discussed herein. For example, techniques can include determining losses associated with spatial features of candidate bounding boxes output by a machine-learned (ML) model and utilizing the losses to train the ML model. Techniques may include determining candidate bounding box(es) associated with an object detected in an environment using the ML model and receiving a ground truth bounding box associated with the detected object. A yaw error loss may be determined by comparing yaw features of the candidate bounding box to the ground truth bounding box. The candidate bounding box may be axis aligned with respect to the ground truth bounding box and an intersection over union (IoU) loss may be determined based on an IoU between the axis aligned candidate bounding box and the ground truth bounding box. The ML model may be trained based on the losses.