Camera Mirror HMI Overlay Adjustment for Skewed Trailer Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Camera monitor systems in commercial vehicles face issues with human machine interface (HMI) elements being overlaid in incorrect locations and orientations due to angled or skewed camera images, leading to inaccurate display of supplemental information.
Innovation Solution
A method and system for adjusting the HMI element location in response to changes in the reference location of the trailer in the camera images, using a CMS controller to detect shifts and adjust the HMI position to minimize overlap and maintain accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If HMI elements are overlaid on camera images at fixed positions, then the display structure is simple, but the HMI elements appear in incorrect locations when the camera image is angled or skewed
Solution Approach 1:
The system dynamically adjusts the position and orientation of HMI elements based on detected camera image skew angles. The HMI element location is no longer fixed but adapts in real-time to compensate for camera angulation, resolving the contradiction between simple display structure and accurate HMI placement.
Solution Approach 2:
The system changes the positional parameters of HMI elements based on detected camera skew angles. By calculating offset values from the skew angle and applying transformations to HMI element coordinates, the system maintains accurate overlay positioning despite camera angulation, balancing structural simplicity with positioning precision.
2Speed
If the camera arm extends quickly, then the system response time is reduced, but the rotational speed varies and causes inaccurate HMI placement
Solution Approach 1:
The system uses feedback from rotational speed sensors to detect deviations in camera arm extension. By monitoring the actual rotational speed during extension and comparing it to expected values, the system can identify when the camera has not reached the correct extended position and adjust HMI element locations accordingly, maintaining reliability despite speed variations.
Solution Approach 2:
The system replaces reliance on precise mechanical positioning with a software-based compensation approach. Instead of ensuring the camera arm extends to an exact mechanical position, the system uses image analysis and skew angle detection to dynamically adjust HMI element positions, substituting mechanical precision requirements with computational correction.
3Adaptability or versatility
If the camera image is angled to cover a larger field of view, then the visibility is improved, but the HMI elements are displayed in incorrect orientations
Solution Approach 1:
The system addresses the orientation problem by adding rotational transformation to the HMI element positioning. Instead of only adjusting horizontal and vertical positions, the system applies rotational offsets based on the detected skew angle, effectively adding an angular dimension to the coordinate transformation to maintain proper HMI element orientation despite camera angulation.
Data Source
AI summary
A method for adjusting a human machine interface (HMI) element location in a commercial vehicle display includes displaying, on an electronic display of a commercial vehicle, images from a camera secured to the commercial vehicle that depict a trailer of the commercial vehicle and its surrounding environment; determining a reference location of a reference point of the trailer in the images; superimposing an HMI element in the images on the electronic display at an HMI location determined relative to the reference location; and detecting that the reference location has changed in the images, and adjusting the HMI location in response thereto. A camera monitoring system (CMS) for a vehicle and a method for a camera mirror system are also disclosed.