360-Degree Camera Fisheye Correction and Orientation Saving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 360-degree camera technologies face challenges in presenting a clear and focused view of events, as users struggle to follow points of interest due to manual orientation changes and the fisheye effect caused by wide-angle lenses, leading to distorted views and blurred edges.

Innovation Solution

A user interface and processing system that allows simultaneous display of multiple camera angles, enabling users to set and save orientations, and employs fisheye mapping functions to correct distortion, ensuring smooth transitions and natural views without blurred areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual orientation changes are used to follow points of interest, then users can change the view orientation, but users have to manually change the view every time and cannot save orientations

Engineering Contradiction:
Improveease of following points of interestVSAvoidtime to manually change view
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary action by automatically capturing and storing multiple orientation positions during video recording. When playback occurs, these pre-captured orientations are automatically presented to the user, eliminating the need for manual orientation changes during viewing. The processor saves the orientation information in memory during recording, making it readily available during playback without requiring user intervention.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If fisheye correction is applied to wide-angle lens views, then the fisheye effect is reduced, but distorted views with blurred lines appear at the edges of the field of view

Engineering Contradiction:
Improveimage distortion correctionVSAvoidimage quality at edges
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The system applies local quality by using different processing approaches for different regions of the image. The processor applies fisheye correction algorithms that preserve image quality by selectively correcting distortion while maintaining edge clarity. The stitching process blends images from multiple lenses with adjusted blending parameters in different regions, ensuring that edge areas maintain their sharpness while the overall fisheye effect is corrected.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If multiple camera lenses are used to capture surround view, then a 360-degree view is achieved, but fisheye effect and distorted views are introduced

Engineering Contradiction:
Improvesurround view coverageVSAvoidview distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system segments the 360-degree view into multiple overlapping fields of view captured by separate wide-angle lenses. The processor then stitches these segmented images together, applying distortion correction to each segment before combining them. This segmentation approach allows the system to maintain the advantages of multiple lenses for comprehensive coverage while correcting the distortion introduced by each individual lens through targeted processing of each segment.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10805530B2Image processing for 360-degree camera
Publication Date: 2020.10.13 VISUAL SUPPLY CO
  • US10805530B2 patent drawing
  • US10805530B2 patent drawing
  • US10805530B2 patent drawing

AI summary

In some implementations, a 360-degree camera includes two wide-angle lenses that provide a spherical view of a scene. The 360-degree camera is configured to be connected to a computing device for rendering the captured images. The user interface provides for the ability to present several camera views simultaneously, where each camera view is operated independently from the other camera views, such that the view may be changed during display by the user by changing the orientation. A plurality of rendering processes is executed in parallel to provide the data for each of the views and the output from each process is combined for presentation on the display. Additionally, a plurality of different combinations of multiple view layouts are provided, such as a circular view inside a rectangular view, a view that splits the display into equal separate views, and three or four independent camera views displayed simultaneously.