Multi-faceted Image Projection onto Convex Polyhedron

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current sensor systems in vehicles, particularly in autonomous driving, face challenges in projecting and processing wide-angle images from fisheye cameras, which result in distorted images due to convex non-rectilinear appearances, limiting effective 360-degree coverage and accurate target classification.

Innovation Solution

A system and method that project a multi-faceted image onto a convex polyhedron by determining a mapping between pixels in a wide-angle image and a multi-faceted image using intrinsic camera parameters and pixel unit vectors, transforming fisheye camera images into a piece-wise projective image with fewer distortion, comprising at least three facets, to achieve a narrower field of view representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If a wide-angle fisheye camera is used to achieve 360-degree coverage, then the field of view is improved, but image distortion increases due to convex non-rectilinear appearance

Engineering Contradiction:
Improvefield of viewVSAvoidimage distortion
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The patent divides the distorted wide-angle image into multiple regions or facets, each corresponding to a specific viewing angle range. By segmenting the image processing task, the system applies different correction transformations to different regions, effectively reducing overall distortion while maintaining 360-degree coverage capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the image from a conventional 2D plane to a multi-faceted 3D representation projected onto a convex polyhedron. This dimensional transformation allows the system to represent wide-angle views with reduced distortion by mapping pixels to faceted surfaces rather than flat planes

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If a mapping transformation is applied to reduce image distortion, then image quality is improved, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent pre-calculates and stores mapping tables that define the transformation relationships between wide-angle image coordinates and multi-faceted projected coordinates. During actual processing, the system simply looks up pre-computed values rather than performing complex real-time calculations, significantly reducing processing complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transforms the image coordinate system by changing parameters such as projection angle, facet orientation, and pixel mapping relationships. By adjusting these parameters, the system optimizes the balance between distortion reduction and processing efficiency for different application scenarios

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11683458B2Projecting multi-faceted image onto convex polyhedron based on wide-angle image
Publication Date: 2023.06.20 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US11683458B2 patent drawing
  • US11683458B2 patent drawing
  • US11683458B2 patent drawing

AI summary

Systems and methods for projecting a multi-faceted image onto a convex polyhedron based on an input image are described. A system can include a controller configured to determine a mapping between pixels within a wide-angle image and a multi-faceted image, and generate the multi-faceted image based on the mapping.