Trail Simulation Image Generation Noise Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup apparatuses face challenges in generating high-quality trail simulation images of star movements with minimal noise, especially during long-time exposure, which degrades image quality and increases product size and cost due to the need for GPS and elevation angle sensors, and the usability is affected by the time required for noise reduction processes.

Innovation Solution

An image pickup apparatus that shoots a first image, a black image, and a second image in sequence, using a noise reduction unit to process the black image for noise reduction, a trail generation unit to predict object movement, and a synthesis unit to generate a trail simulation image, displayed on a display unit, thereby reducing noise and enhancing usability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If noise reduction process is executed by shooting black image before and after actual shooting, then image quality is improved with little fixed pattern noise, but generation time of trail simulation image increases and usability degrades

Engineering Contradiction:
Improveimage qualityVSAvoidgeneration time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by shooting the black image before the actual star trail shooting session. This allows the noise reduction process to be prepared in advance, so that when the actual shooting occurs, the black image data is already available for immediate noise reduction processing, thereby reducing the overall generation time while maintaining image quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuity of useful action by integrating the noise reduction process into the existing shooting workflow. The black image is shot as part of the normal shooting sequence, and the noise reduction is performed continuously on the captured images without requiring separate dedicated time slots, thus maintaining efficient use of time while ensuring high image quality.

Inventive Principle:
Principle #20Continuity of useful action

2Measurement precision

If GPS sensor and elevation angle sensor are used to predict positions of heavenly bodies, then prediction accuracy is improved, but device complexity and product cost increase

Engineering Contradiction:
Improveprediction accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by using the image pickup apparatus's own captured images to determine the positions and movements of heavenly bodies. The system analyzes the actual star positions in the captured images to calculate movement trajectories, eliminating the need for external GPS and elevation angle sensors. This self-contained approach maintains prediction accuracy while significantly reducing device complexity and cost.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent uses copying by creating a digital model of the night sky based on captured images. Instead of using physical sensors to measure positions, the system creates a computational representation of star positions and movements from the image data, allowing for accurate prediction without requiring additional hardware sensors.

Inventive Principle:
Principle #26Copying

3Loss of information

If long-time exposure is used to shoot diurnal motions of stars, then trail visibility is improved, but fixed pattern noise increases and image quality degrades

Engineering Contradiction:
Improvetrail visibilityVSAvoidfixed pattern noise
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent converts the harmful fixed pattern noise generated during long-time exposure into a beneficial element for noise reduction. By capturing a black image under the same long-time exposure conditions, the system obtains data that represents the noise pattern, which is then used to subtract and remove the noise from the actual star trail images, thereby converting the noise problem into a solution.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The patent introduces an intermediary approach by using the black image as a mediator between the captured star trail images and the final processed output. The black image serves as a reference model that mediates the noise reduction process, allowing the system to separate the desired star trail information from the unwanted fixed pattern noise through computational processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10359498B2Image pickup apparatus having function of generating simulation image,control method therefor, and storage medium
Publication Date: 2019.07.23 CANON KK
  • US10359498B2 patent drawing
  • US10359498B2 patent drawing
  • US10359498B2 patent drawing

AI summary

An image pickup apparatus capable of generating a high-quality trail simulation image with little noise, without degrading usability. An image pickup unit shoots a first image, a black image, and a second image in this order. A noise reduction unit executes a process for reducing noise in at least one image of the first image and the second image using the black image. A trail generation unit generates a predicted trail of an object on the basis of a movement of the object between the first image and the second image. A synthesis unit synthesizes the first image or the second image in which the noise has been reduced and the generated trail and generates a trail simulation image of the object. A display unit displays the synthesized trail simulation image.