Panorama Stabilization via Single Sensor and OIS

Solution Overview

Problem

When photographing a panorama using multiple cameras, existing methods face challenges in accurately correcting camera shake due to the varying movements of each camera, requiring multiple sensors and increasing computational complexity and costs.

Innovation Solution

An electronic apparatus that uses a single sensor, including a 3-axis acceleration sensor and a 3-axis angle sensor, to calculate individual movement information of multiple cameras, compensating for camera movements through an Optical Image Stabilization (OIS) unit to generate a stable panorama image, and further analyzes feature points on a 3D virtual sphere for shake correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors are used to sense each movement of multiple cameras, then measurement precision of camera movement is improved, but device complexity and cost increase

Engineering Contradiction:

Improvecamera movement measurementVSAvoidsensor quantity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

A single sensor unit is designed to perform multiple functions: it senses the movement of the electronic apparatus and, through calculation, determines the individual movement of each camera. This multi-functional approach replaces the need for multiple dedicated sensors, reducing device complexity while maintaining measurement precision.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The processor acts as an intermediary that receives movement information from a single sensor and calculates the individual movement of each camera based on predefined locations. This computational mediation allows one sensor to provide accurate movement data for multiple cameras without requiring direct sensing for each camera.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If multiple sensors are used to sense each movement of multiple cameras, then measurement precision of camera movement is improved, but manufacturing cost increases

Engineering Contradiction:

Improvecamera movement measurementVSAvoidmanufacturing cost

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

A single sensor unit is designed to perform multiple functions: it senses the movement of the electronic apparatus and, through calculation, determines the individual movement of each camera. This multi-functional approach replaces the need for multiple dedicated sensors, reducing device complexity while maintaining measurement precision.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The processor acts as an intermediary that receives movement information from a single sensor and calculates the individual movement of each camera based on predefined locations. This computational mediation allows one sensor to provide accurate movement data for multiple cameras without requiring direct sensing for each camera.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If multiple sensors are used to sense each movement of multiple cameras, then measurement precision of camera movement is improved, but computational complexity increases

Engineering Contradiction:

Improvecamera movement measurementVSAvoidcalculation complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system pre-stores the locations of multiple cameras relative to the sensor unit before operation. During operation, the processor directly uses these predefined locations to calculate camera movements from sensor data, avoiding the need for complex real-time calculations or multiple sensors, thus reducing computational complexity while maintaining precision.

Inventive Principle:

Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively corrects camera shake across multiple cameras using a single sensor, reducing computational complexity and costs while generating high-quality panorama images by accurately compensating for individual camera movements and minimizing feature point movement.

Implementation Method 1

a sensor configured to acquire movement information; The sensor may include a 3-axis acceleration sensor and a 3-axis angle sensor

Methodology Applied

Scientific EffectAcceleration sensing: Accelerometer

Implementation Method 2

The sensor may include a 3-axis acceleration sensor and a 3-axis angle sensor

Methodology Applied

Scientific EffectAngular sensing: Gyroscope

Implementation Method 3

compensating for camera movements through an Optical Image Stabilization (OIS) unit

Methodology Applied

Scientific EffectOptical stabilization:

Data Source

PatentUS10992862B2Electronic apparatus and method for controlling electronic apparatus thereof

Publication Date: 2021.04.27 SAMSUNG ELECTRONICS CO LTD

AI summary

An electronic apparatus for acquiring a panorama image using a plurality of cameras and a method for controlling the electronic apparatus thereof are provided. The electronic apparatus includes a plurality of cameras for capturing an image, a sensor for acquiring movement information, and a processor for determining individual movement information of the plurality of cameras with reference to a predefined location using movement information acquired through the sensor, acquiring a plurality of images through the plurality of cameras based on the individual movement information and generating a panorama image using the plurality of photographed images.