Bird's-Eye Vehicle Display With Sonar-Camera Blind-Zone Coverage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing drive assistance apparatuses fail to prevent three-dimensional objects from disappearing in the close proximity of a vehicle in bird's-eye view images, despite being detected by sensors like sonar units.

Innovation Solution

A drive assistance apparatus that includes a sensor with a detection range within the angle of view of a second imaging section, which creates a bird's-eye view image by combining images from the second imaging section and a first imaging section, and sets the detection range of the sensor within a region of the bird's-eye view image based on the image captured by the second imaging section.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the junction boundary between camera images is set in the vicinity of four corners of a vehicle, then the camera installation position and angle of view restrictions are satisfied, but three-dimensional objects disappear at the junction boundary creating blind zones

Engineering Contradiction:
Improvecamera installation feasibilityVSAvoidvisibility of three-dimensional objects
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

A sonar unit is introduced as an intermediary detection device to detect three-dimensional objects in the blind zone near the vehicle corners. The sonar detection results are then integrated with the camera images to supplement the missing visual information, allowing objects that disappear at junction boundaries to be detected and displayed through multiple sensing modalities

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent combines multiple sensing systems (cameras and sonar units) into an integrated drive assistance system. The image processing section merges camera images with sonar detection data, creating a composite view that compensates for the limitations of individual sensors and eliminates blind zones by combining the strengths of different detection technologies

Inventive Principle:
Principle #5Merging (Combining)

2Area of stationary object

If the bird's-eye view image is created by combining camera images projected onto road surface position, then the all-around view is achieved, but three-dimensional objects disappear in the close proximity of the vehicle

Engineering Contradiction:
Improvecoverage area of bird's-eye viewVSAvoiddetection accuracy near vehicle
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent applies different detection qualities to different spatial zones: camera-based visual detection is used for distant areas where optical detection is effective, while sonar-based detection is applied to close-proximity areas near the vehicle where optical detection fails. This local differentiation of detection methods ensures high measurement precision in each zone according to its specific requirements

Inventive Principle:
Principle #3Local quality

3Loss of information

If the position or angle of the junction boundary is changed in association with sonar unit, then the blind spot is reduced, but the system complexity increases

Engineering Contradiction:
Improveblind spot coverageVSAvoidsystem configuration complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The junction boundary position is made dynamic rather than fixed, adjusting its location based on sonar detection results. When sonar detects a three-dimensional object in the blind zone, the system dynamically repositions the junction boundary to ensure the object remains visible in the composite image, adapting the display configuration in real-time to maintain optimal detection coverage

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12220825B2Display apparatus
Publication Date: 2025.02.11 PANASONIC AUTOMOTIVE SYST CO LTD
  • US12220825B2 patent drawing
  • US12220825B2 patent drawing
  • US12220825B2 patent drawing

AI summary

A driving assistance apparatus is provided in which the detection range of a left-front-corner sonar (12a) located at the vehicle's left front corner is included in the field of view of a second imaging means (14) located at the vehicle's left front corner. When the left-front-corner sonar (12a) detects a three-dimensional object at the vehicle's left front corner, an image processing means (3) synthesizes an image of the image created using a second imaging means (14) and the images created with four cameras (7a-7d) for imaging the complete periphery of the vehicle, and creates a bird's-eye-view image (40b). The detection range of the left-front-corner sonar (12a) is included within a region of the bird's-eye image (40b) on the basis of the image created with the second imaging means (14).