Fish-Eye Camera Dynamic Cropping for Steering-Accurate Trajectory Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing parking assistance systems using fish-eye cameras for 360° vision in vehicles face challenges in displaying the front view trajectory accurately, especially at high steering wheel angles, due to image cropping and distortion, which can obscure important details for the driver.

Innovation Solution

A method employing a front wheel angle sensor, fish-eye camera, and display screen to determine the trajectory of the front wheels, adjust the image cropping based on wheel angles and camera dimensions, and superimpose the trajectory on the display, ensuring accurate and detailed image representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If fish-eye cameras with 180° horizontal field of view are used to achieve 360° vision, then the coverage area is improved, but the objects in the image appear smaller and require cropping which loses important details

Engineering Contradiction:
Improvefield of view coverageVSAvoidimage detail loss due to cropping
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent applies dynamic cropping that adapts to steering wheel angle. The cropping region is not fixed but changes dynamically based on the current steering position, allowing the system to maintain optimal image composition across different driving scenarios while preserving important visual information

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the cropping parameters (horizontal and vertical crop values) based on the steering wheel angle parameter. As the steering angle changes, the crop region is adjusted to maintain the trajectory within the display area while preserving maximum relevant image detail

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the front and rear camera images are cropped to combine with side cameras for 360° view, then the 360° coverage is improved, but the interior template cannot be displayed for high steering wheel angles

Engineering Contradiction:
Improve360° view coverageVSAvoidtrajectory display visibility
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The cropping region is made dynamic and adaptive to the steering wheel angle. Instead of a fixed crop that fails at high angles, the system continuously adjusts the crop boundaries to ensure the trajectory remains visible while maintaining 360° view capability

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from the steering wheel angle sensor to adjust the cropping parameters. The current steering position provides feedback that determines the optimal crop region, ensuring the trajectory is always properly positioned for display

Inventive Principle:
Principle #23Feedback

3Device complexity

If static cropping is used to combine fish-eye camera images with side cameras, then the 360° view assembly is simplified, but the trajectory cannot be accurately displayed at varying steering angles

Engineering Contradiction:
Improveimage processing complexityVSAvoidtrajectory position accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system transitions from static to dynamic cropping, where the crop region adapts in real-time to steering wheel angle changes. This dynamic approach maintains trajectory accuracy across all steering positions while keeping the overall system relatively simple through algorithmic adaptation

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3420529B1Driving assistance method in a forward gear of a motor vehicle, provided with a camera having a fish-eye lens
Publication Date: 2020.01.22 RENAULT SA
  • EP3420529B1 patent drawing
  • EP3420529B1 patent drawing
  • EP3420529B1 patent drawing

AI summary

Driving assistance method in a forward gear of a motor vehicle, provided with a front wheels angle sensor, a display screen and a camera having a fish-eye lens arranged at the front of the vehicle and directed in a colinear manner in the longitudinal direction of the vehicle so as to acquire images at the front of the vehicle. The method comprises the following steps: the trajectory of the front wheels of the vehicle is determined as a function of the angle of the front wheels and the characteristics of the vehicle, a cropping value of the image acquired by the camera is determined as a function of the trajectories of the front wheels, the angle of the steering wheel, the dimensions of the sensor of the camera and the dimensions of the display screen, the cropped image acquired by the camera to be displayed on the display screen is determined as a function of the trajectories of the front wheels and the cropping value, and the trajectory of the front wheels of the vehicle is displayed superimposed on the cropped image on the display screen.