360° Image Orientation Without Remapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Images taken using full-perimeter cameras or fisheye lenses suffer from distortion, leading to challenges in utilizing 360° views effectively without remapping, as existing technologies primarily focus on distortion correction or coordinate computation rather than providing usable 360° images as-is.

Innovation Solution

An image processing device and method that acquires and processes 360° images by computing a rotational angle to position a reference point, such as a point of origin or point of convergence, in a designated orientation with respect to the image center, allowing for more intuitive direction perception in 360° views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If 360° images are used as-is without remapping, then the image structure is preserved and processing is simplified, but the distortion makes it difficult to perceive directions such as up and down

Engineering Contradiction:
Improveimage processing complexityVSAvoiddirection perception
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent applies preliminary action by computing the rotational angle in advance before the image is used. The rotational angle is calculated based on the position of a reference point (such as the point where the optical axis intersects the image plane) relative to the image center. This pre-computed rotational angle is then used to rotate the 360° image, establishing the correct orientation before the user needs to perceive directions. This resolves the contradiction by preparing the orientation information ahead of time, avoiding the need for complex real-time processing while ensuring proper direction perception.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies parameter changes by modifying the orientation parameter of the 360° image through rotation. Specifically, the image is rotated by a computed rotational angle to reposition the reference point to a designated orientation (such as the top center of the image). This parameter change (rotation angle) transforms the distorted 360° view into a properly oriented image that maintains its full-perimeter structure while enabling intuitive direction perception. This resolves the contradiction by changing the orientation parameter to achieve both structural preservation and ease of direction perception.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If the 360° image is rotated to position the reference point in a designated orientation, then direction perception is improved, but additional processing is required to compute the rotational angle

Engineering Contradiction:
Improvedirection perceptionVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies the taking out principle by extracting the essential information needed for orientation from the 360° image itself. Specifically, the reference point (where the optical axis intersects the image plane) is identified within the image data, and the rotational angle is computed based solely on the positional relationship between this extracted reference point and the image center. This extraction approach resolves the contradiction by obtaining the necessary orientation information directly from the image content without requiring external sensors or complex processing systems, thus improving direction perception while keeping processing complexity manageable.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies self-service by enabling the 360° image to provide its own orientation information through internal analysis. The image itself contains the reference point that defines its orientation, and the system uses this self-contained information to compute the rotational angle and correct the direction perception. This self-service mechanism resolves the contradiction by eliminating the need for external orientation sensors or complex processing systems, as the image data itself suffices to determine and correct its orientation.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If remapping is performed to remove distortion, then the image can be used effectively, but the original 360° view structure is lost

Engineering Contradiction:
Improveimage usabilityVSAvoid360° view structure
Core Design Contradiction:
Adaptability or versatilityVSShape

Solution Approach 1:

The patent applies the inversion principle by reversing the conventional approach. Instead of remapping the 360° image to a conventional perspective view (which loses the full-perimeter structure), the patent inverts the problem by keeping the 360° cylindrical structure intact and instead rotating the entire image to achieve proper orientation. This inversion resolves the contradiction by maintaining the original 360° view structure while still making the image usable through proper rotational orientation, thus preserving both the structural integrity and adaptability of the image.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent applies preliminary action by pre-computing the rotational angle based on the reference point position before any orientation correction is applied. This pre-computed angle is then used to rotate the 360° image, establishing the correct orientation while preserving the original cylindrical structure. This resolves the contradiction by preparing the orientation information in advance, allowing the 360° view structure to be maintained while achieving effective usability through proper orientation, thereby avoiding the need for distortion-removing remapping.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10713525B2Image processing device and method to obtain a 360° image without remapping
Publication Date: 2020.07.14 SONY GROUP CORP
  • US10713525B2 patent drawing
  • US10713525B2 patent drawing
  • US10713525B2 patent drawing

AI summary

[Object] To obtain a more useful image when an image including a 360° view around the camera is used without being remapped.[Solution] Provided is an image processing device including: an image acquisition unit that acquires a 360° image; and a rotational angle computation unit that computes a rotational angle of the 360° image in a manner that a reference point included in the 360° image is positioned in a designated orientation with respect to a center of the 360° image.