Birds-eye-view Image Joint Setting for Obstacle Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing birds-eye-view image generation systems face challenges in accurately displaying the position and shape of subjects around joints in combined images, leading to misrecognition of obstacles due to unnatural reflections and discontinuities, which can disrupt driving safety.

Innovation Solution

A birds-eye-view image generation device that includes a captured image acquisition unit, an image conversion unit, a birds-eye-view image combining unit, and a joint setting unit, which sets the joint position based on the vehicle's rim and radial directions to maintain the positional relationship between the vehicle and images, ensuring accurate representation of subjects without disconnection over joints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If two birds-eye-view images are displayed to overlap each other around the joint, then the visibility of solid obstacles around the joint is improved, but a single solid obstacle may be seen as a double image

Engineering Contradiction:
Improvevisibility of solid obstaclesVSAvoidimage accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent divides the birds-eye-view image into multiple regions corresponding to different imaging devices, and processes each region separately with appropriate transparency settings. The joint region is specifically segmented to apply non-overlapping display, preventing double images while maintaining obstacle visibility through proper segmentation of the display areas.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If two birds-eye-view images are displayed not to overlap each other around the joint, then double imaging is avoided, but the solid obstacle may be seen to be disconnected over the joint and to be discontinuous

Engineering Contradiction:
Improveimage accuracyVSAvoidvisibility of solid obstacles
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent applies different display qualities to different regions of the image. In non-joint regions, images are displayed with normal opacity, while in joint regions, the display parameters are locally adjusted to prevent discontinuity. This allows the obstacle to appear continuous across joints while avoiding double imaging in non-joint areas.

Inventive Principle:
Principle #3Local quality

3Reliability

If a display region cutting process is performed at different reference heights to detect obstacles around joints, then obstacle detection capability is improved, but the positional relationship between the subject and the vehicle's own image changes for each switching display

Engineering Contradiction:
Improveobstacle detection capabilityVSAvoidpositional relationship accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

Instead of switching between different reference heights (vertical dimension switching), the patent resolves the positional relationship issue by adjusting transparency and blending in the horizontal display dimension. This allows obstacle detection across multiple heights while maintaining consistent positional relationships in the displayed image, as the same reference height is used throughout without switching.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Reliability

If the position of joint portion of combined birds-eye-view image is varied to detect obstacles, then obstacle detection around joints is improved, but the complexity of image processing increases

Engineering Contradiction:
Improveobstacle detection around jointsVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary detection of joints and obstacles before final image composition. By identifying joint positions and obstacle locations in advance, the system can apply appropriate transparency and blending parameters during composition without requiring complex real-time adjustments. This preliminary action simplifies the overall processing complexity while maintaining reliable obstacle detection.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9715631B2Birds-eye-view image generation device, and birds-eye-view image generation method
Publication Date: 2017.07.25 PANASONIC AUTOMOTIVE SYST CO LTD
  • US9715631B2 patent drawing
  • US9715631B2 patent drawing
  • US9715631B2 patent drawing

AI summary

A birds-eye-view image generation device includes a captured image acquisition unit, an image conversion unit, a birds-eye-view image combining unit, and a joint setting unit. The joint setting unit sets any position of a rim of a vehicle image corresponding to a vehicle included in the birds-eye-view image as an end point in an overlapping imaging range in two birds-eye-view images corresponding to two imaging devices of which imaging ranges overlap each other, and sets a line which extends in any direction on an opposite side to the vehicle image from the end point between two radial directions directed to the end point from the two imaging devices, as a joint which joins two birds-eye-view images which are combined.