Fisheye Image Expansion Using Offset Reference Points for Body Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Fisheye images generated by fisheye lens cameras suffer from distortion, leading to varying gravity directions and unnatural body orientations in the image, which affects the accuracy of estimation models trained on standard lens images.
Innovation Solution
A technique for panoramically expanding fisheye images by generating a complementary circular image with a reference point different from the image center, followed by panoramic expansion to create a more accurate panoramic image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fisheye image is panoramically expanded using the center of the image circle as the reference point, then the panoramic image can be generated, but unnatural distortions remain where body directions vary for each position
Solution Approach 1:
The patent applies asymmetry by deliberately choosing a reference point that is offset from the center of the image circle. This asymmetric positioning of the reference point relative to the image center allows the panoramic expansion to compensate for the fisheye distortion, making gravity directions consistent across the panoramic image while maintaining ease of operation.
2Device complexity
If the reference point is set at the center of the image circle, then the panoramic expansion is simple, but the captured object position changes with camera orientation causing inappropriate reference point setting
Solution Approach 1:
The patent applies preliminary action by pre-determining an appropriate reference point based on the captured object's position and the camera's orientation before performing panoramic expansion. This advance preparation ensures that the reference point is appropriately positioned to maintain object consistency, rather than simply using the image center regardless of conditions.
Data Source
AI summary
The present invention provides an image processing apparatus (10) including a detection unit (12) that detects a plurality of predetermined points of a body of each of a plurality of persons from an image in an image circle of a fisheye image, a gravity direction determination unit (13) that determines a gravity direction in a position of each of the plurality of persons from the plurality of predetermined points, a reference point decision unit (14) that decides a reference point, based on the gravity direction in the position of each of the plurality of persons, a complementary circular image generation unit (16) that generates a complementary circular image that is a circular image acquired by adding a complementary image to the image in the image circle of the fisheye image, and that has, as a center, the reference point different from a center of the image in the image circle, and an expansion unit (17) that panoramically expands the complementary circular image, based on the reference point, and generates a panoramic image.