Fisheye Camera Dewarping with Nested Mini Map

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Surveillance systems using fisheye cameras face challenges in monitoring moving objects due to limited angle of view, leading to potential misses, and the original images captured by these cameras are not optimized for human vision, making it inconvenient for users to perform effective monitoring.

Innovation Solution

A monitoring apparatus and system that includes a communication interface, storage, and display to receive and display original images from omnidirectional cameras, with the ability to dewarp images for a calibrated view and provide a mini map of the original image within the calibrated view, allowing users to intuitively compare and focus on specific regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If an original fisheye image is displayed to maintain wide angle of view, then the monitoring coverage is improved, but the image is not optimized for human vision making it inconvenient for users to perform monitoring

Engineering Contradiction:
Improvemonitoring coverageVSAvoiduser convenience
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The display screen is segmented into multiple regions: a main display area showing the calibrated image optimized for human vision, and a smaller inset area displaying the original fisheye image. This segmentation allows users to simultaneously view both the comfortable-to-watch calibrated view and the wide-coverage original view without having to switch between different displays or modes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The original fisheye image is nested within the calibrated image display area as a smaller inset or overlay. This nesting approach allows the original image to be displayed within the context of the calibrated image, enabling users to see both views concurrently with the original image positioned at a specific location within the calibrated view framework.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Ease of operation

If a calibrated image is displayed to optimize for human vision, then user convenience is improved, but the display size is reduced making it harder to observe events in detail

Engineering Contradiction:
Improveuser convenienceVSAvoiddisplay size
Core Design Contradiction:
Ease of operationVSArea of moving object

Solution Approach 1:

The display is segmented into a large main area for the calibrated image and a smaller inset area for the original image. This segmentation allows the calibrated image to occupy the maximum available display real estate for comfortable viewing, while the original image is placed in a smaller, non-intrusive inset that provides reference information without competing for primary viewing attention.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of competing for the same two-dimensional display space in a way that forces a trade-off between size and optimization, the solution uses a layered or inset approach that effectively adds a third dimension to the display arrangement. The original image is positioned within the calibrated image space, allowing both to be viewed simultaneously with appropriate size differentiation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If only a calibrated image is displayed to focus on specific regions, then monitoring effectiveness is improved, but the relationship between original and calibrated images becomes less intuitive

Engineering Contradiction:
Improvemonitoring effectivenessVSAvoidspatial relationship information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The display is segmented to show both the calibrated image in the main area and the original image in an inset area. This segmentation ensures that users can focus on the calibrated image for detailed event observation while simultaneously having access to the original image for spatial context, preventing loss of spatial relationship information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The inset display of the original image provides continuous visual feedback about the spatial relationships and positions of objects within the calibrated image view. This feedback mechanism allows users to understand where objects are located in the overall scene while monitoring specific regions in detail, maintaining intuitive spatial awareness throughout the monitoring process.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10924652B2Monitoring apparatus and monitoring system
Publication Date: 2021.02.16 HANWHA VISION CO LTD
  • US10924652B2 patent drawing
  • US10924652B2 patent drawing
  • US10924652B2 patent drawing

AI summary

A monitoring apparatus includes: a communication interface configured to receive an original image acquired by a camera; a storage configured to store the original image; a display configured to display the original image and a calibrated image obtained by dewarping the original image; and a controller configured to control operations of the communication interface, the storage, and the display, wherein, in a view mode in which only the calibrated image among the original image and the calibrated image is displayed, in response to the calibrated image being selected, the display is configured to display a mini map which shows the original image in a portion of the selected calibrated image.