Onboard Camera Viewpoint Conversion for Vehicle Surroundings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems that use onboard cameras to generate synthesized images for vehicle surroundings often suffer from image resolution deterioration during viewpoint conversion, and cannot simultaneously display both original and converted images effectively.

Innovation Solution

The system increases the pixel count of onboard cameras to perform viewpoint conversion internally, allowing both original and converted images to be displayed with high resolution by alternately switching and processing normal-view and top-view images, and synthesizing them to generate panoramic images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If viewpoint conversion is performed using existing onboard cameras, then the system can generate converted images showing vehicle surroundings from different perspectives, but the image resolution deteriorates during the conversion process

Engineering Contradiction:
Improveviewpoint conversion capabilityVSAvoidimage resolution
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing viewpoint conversion at the camera level before image transmission and processing. Each onboard camera performs viewpoint conversion on captured images locally, generating converted images that are then transmitted to the server. This preliminary conversion at the source prevents resolution deterioration during subsequent processing and transmission, as the conversion is done when the image data is still at its highest quality state.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If the pixel count of onboard cameras is increased to maintain high resolution during viewpoint conversion, then image quality is preserved, but the system complexity and cost increase

Engineering Contradiction:
Improveimage resolutionVSAvoidcamera system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling each onboard camera to perform viewpoint conversion independently using its own processing capabilities. Instead of requiring a centralized high-performance system to handle all conversion operations, each camera unit autonomously performs the conversion on its captured images, reducing the overall system complexity and distributing the processing load across multiple independent units.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If both original and converted images are displayed simultaneously on the monitor, then the driver can access multiple views for enhanced situational awareness, but the processing load and data transmission requirements increase

Engineering Contradiction:
Improvedisplay flexibilityVSAvoidprocessing load
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The patent applies segmentation by dividing the image processing and transmission tasks across multiple independent camera units, each handling its own viewpoint conversion separately. Instead of one system processing all conversions centrally, each camera segment handles its own image data independently, reducing the processing load on any single system component and enabling efficient simultaneous display of multiple views.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8134595B2Image processing system and method with high resolution view-point conversion images
Publication Date: 2012.03.13 NISSAN MOTOR CO LTD
  • US8134595B2 patent drawing
  • US8134595B2 patent drawing
  • US8134595B2 patent drawing

AI summary

An image processing system so disclosed has respective image pickup parts and respective viewpoint conversion parts configured to perform viewpoint conversion of original images captured by the respective image pickup parts to generate converted images. The image processing system also includes a display device controllable to display the converted images.