Vehicle Image Processing Apparatus for Curved Backing Distortion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for vehicles struggle to accurately display surrounding conditions, particularly when backing up in curved spaces, as overhead images generated from wide-angle cameras distort objects' shapes and heights, making it difficult for drivers to judge distances and avoid obstacles.

Innovation Solution

An image processing apparatus that generates and displays a vehicle travel direction image and a vehicle lateral side image, in addition to an overhead image, using images from cameras mounted on the vehicle, to provide a clearer view of the surroundings, including the integration of a vehicle movement direction display line to help drivers avoid obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If wide-angle cameras are used to photograph images of a wide viewing-angle region from a close distance, then the area of visible surroundings is improved, but image distortion increases making it difficult to accurately judge distances and object heights

Engineering Contradiction:
Improveviewing-angle regionVSAvoiddistance and height judgment
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent introduces a vehicle movement direction display line that extends from the vehicle in the travel direction, adding a dimensional reference (directional indicator) to the overhead image. This allows drivers to understand the relationship between the vehicle's movement and surrounding objects, compensating for the distortion caused by wide-angle lenses.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the display parameters by adding a movement direction indicator with specific visual characteristics (line extending from vehicle, arrowhead at end). This parameter change provides additional spatial reference information that helps drivers judge distances and directions despite the wide-angle distortion.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If only overhead image and rear direction image are displayed, then the device complexity is reduced, but the ability to detect obstacles on left or right sides during curved backing is insufficient

Engineering Contradiction:
Improveimage display configurationVSAvoidobstacle detection capability
Core Design Contradiction:
Device complexityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent segments the surrounding space into different directional views by adding a vehicle movement direction display line that indicates the travel direction within the overhead image. This segmentation allows drivers to mentally divide the space into sectors relative to the movement direction, improving obstacle detection in curved backing scenarios.

Inventive Principle:
Principle #1Segmentation

3Ease of manufacture

If overhead image is generated assuming captured surrounding space extends on a plane, then the ease of manufacture is improved, but the distortion of stereoscopic objects not present on the road surface increases

Engineering Contradiction:
Improveimage processing methodVSAvoidobject shape accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The vehicle movement direction display line acts as an intermediary element between the distorted overhead image and the driver's spatial understanding. It provides a reference that helps drivers interpret the positions and orientations of objects, compensating for the planar assumption distortion without requiring complex 3D reconstruction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11528413B2Image processing apparatus and image processing method to generate and display an image based on a vehicle movement
Publication Date: 2022.12.13 SONY GROUP CORP
  • US11528413B2 patent drawing
  • US11528413B2 patent drawing
  • US11528413B2 patent drawing

AI summary

An image processing apparatus is provided. An image photographed by a camera that photographs the surroundings of the vehicle is received. An overhead image, a vehicle travel direction image, and a vehicle lateral side image corresponding to a vehicle movement direction which is either left or right of the vehicle is generated based on the image. The generated image is displayed on a display unit. For example, a display image is generated or updated in accordance with a travel direction of the vehicle and direction-of-rotation information of a steering wheel. In a case where the vehicle is backed counter-clockwise, the overhead image, the vehicle rear image, and a vehicle left side image are generated and displayed. In a case where the vehicle is backed clockwise, the overhead image, the vehicle rear image, and a vehicle right side image are generated and displayed.