Autonomous Vehicle Tracking Camera for Long-Range Object Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional LiDAR systems in autonomous vehicles face limitations in accurately identifying and tracking objects beyond a certain threshold distance, leading to reduced reaction time and potentially unsafe vehicle operations.

Innovation Solution

A tracking camera system is implemented onboard autonomous vehicles, which receives object coordinate data to adjust its position and focus, capturing image data to identify objects using object recognition algorithms, thereby augmenting LiDAR capabilities when objects are beyond its accurate detection range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If LiDAR is used to detect objects, then detection speed is improved, but detection accuracy diminishes beyond threshold distance

Engineering Contradiction:
Improvedetection speedVSAvoidobject identification accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent combines LiDAR and camera systems into an integrated tracking camera system. The LiDAR provides rapid detection and coordinate data, while the camera captures detailed images for accurate identification. This merging allows the system to maintain both fast detection speed and high accuracy even at distances beyond LiDAR's reliable identification range.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The tracking camera acts as an intermediary between LiDAR detection and final object identification. When LiDAR detects an object beyond its accurate identification range, the camera system uses the LiDAR coordinates to target and capture images of the distant object, serving as a mediator that extends the effective identification range while maintaining accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If tracking camera system adjusts position to follow object, then object tracking capability is improved, but system complexity increases

Engineering Contradiction:
Improveobject tracking capabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses feedback from LiDAR coordinate data to continuously adjust the camera's azimuth and elevation positions. The LiDAR provides real-time coordinate feedback about object location, and this feedback drives the motorized adjustments of the tracking camera system, enabling reliable automatic tracking without complex manual control systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The tracking camera system integrates multiple functions into a single platform: object detection, coordinate reception, motorized positioning (azimuth and elevation adjustment), focus control, and image capture. This multi-functionality reduces overall system complexity compared to having separate systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If camera focuses on distant object, then image quality is improved, but adjustment time increases

Engineering Contradiction:
Improveimage qualityVSAvoidfocus adjustment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by using LiDAR to pre-determine object coordinates and calculate required camera adjustments before actual image capture. The azimuth and elevation motors are pre-positioned based on LiDAR data, and focus adjustment is pre-calculated based on object distance, minimizing delays during actual tracking and capture.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The tracking camera system maintains continuous useful action by seamlessly integrating LiDAR detection, coordinate processing, camera positioning, and focus adjustment into a continuous operational flow. Rather than discrete sequential steps with idle transitions, the system continuously receives LiDAR updates and continuously adjusts camera parameters, eliminating unnecessary delays in the tracking process.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12135377B2Systems and methods for implementing a tracking camera system onboard an autonomous vehicle
Publication Date: 2024.11.05 PONY AI INC
  • US12135377B2 patent drawing
  • US12135377B2 patent drawing
  • US12135377B2 patent drawing

AI summary

Systems, methods, and non-transitory computer-readable media are provided for implementing a tracking camera system onboard an autonomous vehicle. Coordinate data of an object can be received. The tracking camera system actuates, based on the coordinate data, to a position such that the object is in view of the tracking camera system. Vehicle operation data of the autonomous vehicle can be received. The position of the tracking camera system can be adjusted, based on the vehicle operation data, such that the object remains in view of the tracking camera system while the autonomous vehicle is in motion. A focus of the tracking camera system can be adjusted to bring the object in focus. The tracking camera system captures image data corresponding to the object.