Smartphone Celestial Image Composition Using Sensor Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for capturing clear images of celestial bodies in the night sky face challenges such as afterimages due to Earth's rotation and mismatched star locations when composing multiple images, which are computationally intensive and require expensive equipment like equatorial telescopes or star trackers.

Innovation Solution

A method and apparatus using sensor information from GPS, magnetometer, accelerometer, and gyroscope to calculate the moving direction of celestial bodies, allowing for the composition of images taken with short exposure times without excessive computing power, enabling accurate alignment and removal of afterimages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a long exposure time is applied to shoot stars, then the brightness of the photograph is improved, but afterimages of stars remain on the photograph due to Earth's rotation

Engineering Contradiction:
ImprovebrightnessVSAvoidimage clarity
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent divides a single long exposure into multiple short exposure shots. Instead of taking one photograph with a long exposure time that causes star trails, the system captures multiple images with shorter exposure times and combines them through image stacking. This segmentation allows each individual shot to freeze star positions while the composite image achieves the desired brightness through accumulation of multiple frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements continuous shooting mode where multiple photographs are taken in rapid succession without interruption. The camera continuously captures images at a high frame rate, ensuring that the celestial objects remain in nearly the same position throughout the shooting sequence. This continuous action allows for capturing enough frames to create a bright composite image while maintaining sharp star positions.

Inventive Principle:
Principle #20Continuity of useful action

2Illumination intensity

If multiple photographs are taken and composed to acquire sufficient brightness, then the brightness is improved, but the locations of stars become mismatched due to celestial sphere rotation

Engineering Contradiction:
ImprovebrightnessVSAvoidstar location accuracy
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The patent employs feedback mechanisms through sensor data (GPS, accelerometer, gyroscope, magnetometer) that continuously monitor the camera's position and orientation during the shooting sequence. This feedback information is used to calculate and compensate for Earth's rotation effects, allowing the system to realign stars across multiple photographs accurately. The feedback loop ensures that even as the Earth rotates during the multi-shot sequence, the composite image maintains precise star alignment.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary calculations of Earth's rotation effects based on the shooting time, location, and duration before composing the final image. By pre-calculating the expected stellar movement based on astronomical algorithms and sensor data, the system can apply appropriate transformation matrices to each frame beforehand, ensuring that stars align perfectly in the composite image without requiring complex post-processing realignment.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If conventional methods are used to match specific points on pixels, then the star locations can be matched, but a long processing time and large memory capacity are required

Engineering Contradiction:
Improvestar location matchingVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and utilizes readily available sensor data (GPS coordinates, accelerometer, gyroscope, magnetometer readings) that are already captured during normal mobile device operation. Instead of performing complex image processing to identify and match star positions pixel-by-pixel, the system extracts the necessary positional and orientational information from these pre-existing sensor streams, significantly reducing processing time and computational requirements while maintaining accurate star alignment.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical/computational approach of visual feature matching (comparing pixel patterns to identify stars) with a sensor-based computational model. Instead of using image processing algorithms to detect and match stellar features, the system substitutes this with mathematical calculations based on sensor data and astronomical algorithms, which are computationally more efficient and can be performed rapidly on mobile devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Manufacturing precision

If equatorial telescope or star tracker is used to rotate camera in response to celestial body movement, then afterimages are eliminated, but the cost of equipment becomes very high

Engineering Contradiction:
Improveimage clarityVSAvoidequipment cost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent creates a virtual equatorial mount by using software algorithms that simulate the effect of physical tracking equipment. Instead of requiring an actual equatorial telescope or star tracker to physically rotate the camera, the system captures multiple stationary shots and uses computational methods to compensate for Earth's rotation. This virtual copying of the tracking function through software achieves the same result as expensive physical equipment without the need for specialized hardware.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent utilizes standard mobile device sensors (GPS, accelerometer, gyroscope, magnetometer) that are already present in consumer smartphones and tablets, replacing the need for expensive specialized astronomical equipment. These inexpensive, mass-produced sensors provide sufficient data for calculating and compensating for stellar movement, making astrophotography accessible to ordinary users without requiring investment in costly equatorial mounts or star trackers.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11172141B2Method and apparatus for composing images of celestial bodies
Publication Date: 2021.11.09 HAECHITECH CORP
  • US11172141B2 patent drawing
  • US11172141B2 patent drawing
  • US11172141B2 patent drawing

AI summary

Disclosed are a method and apparatus for composing a plurality of images of the celestial bodies. The method and apparatus can compose a plurality of images using various pieces of information associated with the plurality of images and a time interval during the plurality of images are taken, such that objects are accurately matched with no afterimage.