Vehicle Vision System Pedestrian Detection Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle vision systems using fish-eye cameras face challenges in accurately detecting pedestrians due to variations in size and orientation across the image, leading to performance issues and the need for extensive training data and resources.

Innovation Solution

The system subdivides the fish-eye image into regions based on camera optics and orientation, applying different processing methods to each sub-region to enhance pedestrian detection using dedicated classifiers, reducing the requirement for extensive training data and resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single processing method is applied to the entire fish-eye image, then the system complexity is low, but the pedestrian detection accuracy deteriorates due to size and orientation variations across different regions

Engineering Contradiction:
Improvepedestrian detection accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The fish-eye image is divided into multiple regions (e.g., central region and peripheral regions) based on camera optics and orientation. Each region is processed using dedicated classifiers trained on region-specific characteristics, allowing the system to account for variations in pedestrian size and orientation across different parts of the image while maintaining manageable processing complexity through localized processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing methods and classifiers are applied to different regions of the image. The central region uses one type of classifier while peripheral regions use different classifiers optimized for their specific viewing angles and distortion characteristics. This local optimization improves detection accuracy without requiring a complete redesign of the entire processing system.

Inventive Principle:
Principle #3Local quality

2Reliability

If extensive training data is used to train classifiers for all regions, then the detection robustness improves, but the training resources and time increase significantly

Engineering Contradiction:
Improvedetection robustnessVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The training process is segmented by region, with each classifier trained only on data relevant to its specific region. This reduces the amount of training data required for each individual classifier compared to training a single universal classifier on all possible pedestrian orientations and sizes, thereby reducing overall training time while maintaining robust detection through region-specific optimization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Region-specific classifiers are pre-trained offline on representative data for each region. This preliminary training action allows the system to achieve robust detection performance without requiring extensive real-time processing or continuous training, as the region-specific characteristics are already captured in the pre-trained models.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If region-specific classifiers are implemented, then the processing resources per region are optimized, but the overall system complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The image processing system is segmented into multiple independent processing streams, each handling a specific region with its own optimized classifier. This segmentation allows each stream to process images more efficiently using region-appropriate parameters, improving overall productivity while keeping each individual processing module relatively simple and manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses a universal framework that can accommodate multiple region-specific classifiers. The overall architecture remains consistent and reusable across different regions, with each region simply plugging into the same processing pipeline with its own trained model. This maintains system manageability while allowing region-specific optimization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10095935B2Vehicle vision system with enhanced pedestrian detection
Publication Date: 2018.10.09 MAGNA ELECTRONICS INC
  • US10095935B2 patent drawing
  • US10095935B2 patent drawing
  • US10095935B2 patent drawing

AI summary

A vision system of a vehicle includes a camera disposed at a vehicle and having a field of view that encompasses first and second regions exterior of the vehicle. The camera captures image data that includes a first set of image data representative of the first region of the field of view and a second set of image data representative of the second region of the field of view. An image processor processes the first set of image data to detect a pedestrian present in the first region based on a first predetermined orientation of a pedestrian. The image processor processes the second set of image data to detect a pedestrian present in the second region based on a second predetermined orientation of a pedestrian.