Digital Panning of Panoramic Video for Worktool Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wide-angle cameras on mobile equipment with articulated front portions create distorted panoramic images that reduce the visible field of view when corrected, making it difficult for operators to see the worktool's area of operation effectively.
Innovation Solution
A method and system that digitally re-project image frames onto a projection surface aligned with the articulated front portion's movement, incorporating distortion correction to maintain a clear view of the worktool and its workspace.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If wide-angle fisheye cameras are used to capture video, then the field of view is increased, but the images become distorted making it difficult for operators to view the worktool area effectively
Solution Approach 1:
The patent applies local quality by selectively correcting distortion only in the regions of the image where the worktool and its workspace are located, rather than applying uniform correction across the entire image. This allows the operator to see the worktool area clearly while maintaining the wide field of view benefits of fisheye cameras in other portions of the image.
Solution Approach 2:
The patent transforms the distorted fisheye image from its original curved projection into a rectilinear projection that aligns with the worktool's coordinate system. This dimensional transformation corrects the distortion by remapping pixels according to a different projection model, making the worktool area visible and interpretable while preserving the expanded field of view.
2Ease of operation
If rectilinear projection is used to correct fisheye distortion, then the distortion is reduced, but the field of view appears unnatural and is cropped, reducing the visible area
Solution Approach 1:
The patent applies distortion correction selectively only to the worktool region and its immediate workspace, rather than to the entire image. This localized approach corrects distortion where needed while preserving the natural wide-angle perspective in other areas, maintaining both operational clarity and wide field of view.
Solution Approach 2:
The patent dynamically adjusts the projection parameters based on the detected position and orientation of the worktool. As the worktool moves or changes orientation, the correction region and projection parameters are updated in real-time, allowing the system to adaptively balance distortion correction with field of view preservation.
3Reliability
If the camera is mounted on the rear portion to provide a safe vantage point, then the camera is protected from damage, but the field of view does not follow the articulated front portion movement, reducing visibility of the worktool
Solution Approach 1:
The patent replaces the mechanical solution of mounting the camera on the moving front portion with a digital/image processing solution. By using software-based projection transformation that follows the worktool's position and orientation, the system achieves the benefit of a moving viewpoint without the mechanical complexity and vulnerability of mounting the camera on the articulated portion.
Solution Approach 2:
The patent creates a virtual copy of the worktool's perspective by transforming the fixed camera's wide-angle view to align with the worktool's coordinate system. This digital copy allows the operator to see the worktool area as if viewing from the worktool's perspective, while the physical camera remains protected in its fixed mounting position.
Data Source
AI summary
In a mobile equipment with an articulated front portion having a worktool, a fisheye camera with a wide field of view, containing the front portion, is often mounted in a fixed direction on a rear portion of the mobile equipment. Thus, when the front portion moves (e.g., rotates) relative to the rear portion, a view around the front portion may be compromised due to inherent cropping in fisheye-distortion correction. Digital panning of panoramic video is disclosed that rotates a projection surface, in accordance with movement of the front portion, and generates a projected video on the projection surface, utilizing information that may have otherwise been cropped, to expand the visible area around the worktool. The digital panning in the projected video may mimic an operator turning their head to look down the longitudinal axis of the front portion while using the worktool.