Image Pickup Apparatus Motion Detection HDR Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image synthesis technologies face challenges in accurately detecting motion between images of different exposure times, particularly when generating high dynamic range images, as they often require synchronized exposure periods to ensure accurate positioning and block matching, which can be difficult when dealing with camera shake or moving objects.
Innovation Solution
An image pickup apparatus and method that perform exposure in multiple time periods to acquire both short-exposure and long-exposure image data, using frequency analysis and block matching to detect motion regions and adjust the synthesis process accordingly, ensuring accurate motion detection and artifact-free image generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If block matching is performed on images of different exposure times to detect motion, then motion detection can be achieved in HDR image synthesis, but measurement precision deteriorates due to exposure time differences causing inaccurate positioning
Solution Approach 1:
The image data is segmented into multiple regions based on exposure time characteristics. Short-exposure images are used for motion detection in regions where motion is present, while long-exposure images are used in static regions. This segmentation allows the system to handle different exposure times appropriately for different spatial regions, resolving the contradiction between adaptability and precision.
Solution Approach 2:
The system dynamically changes the exposure time parameter based on the detected motion characteristics. When motion is detected in a region, the system adjusts to use short-exposure images for that region's motion detection. This parameter adaptation enables accurate motion detection even when dealing with images of different exposure times.
2Adaptability or versatility
If multiple exposure time periods are used to acquire both short-exposure and long-exposure image data, then adaptability improves for different motion conditions, but device complexity increases due to multiple exposure control requirements
Solution Approach 1:
The image pickup device is designed with multi-functionality to perform both short-exposure and long-exposure acquisitions using the same hardware components. The exposure control unit universally manages different exposure time periods without requiring separate dedicated systems, thereby achieving adaptability while controlling device complexity.
Solution Approach 2:
The exposure time is made dynamic and adjustable based on the shooting conditions and motion characteristics. The system can switch between short and long exposure periods as needed, providing adaptability to different motion conditions while using a single flexible exposure control mechanism rather than multiple fixed systems.
3Measurement precision
If frequency analysis is performed on image data to detect motion regions, then measurement precision improves for motion detection, but loss of time increases due to additional processing requirements
Solution Approach 1:
Frequency analysis is performed as a preliminary step before full block matching to identify motion regions. This preliminary action allows the system to focus subsequent detailed motion detection only on regions where motion is likely present, thereby maintaining high measurement precision while reducing overall processing time by avoiding exhaustive analysis of static regions.
Data Source
AI summary
An image pickup apparatus includes a lens, an image pickup device, and a processor. The processor acquires a plurality of pieces of first image data and second image data with an exposure time period longer than an exposure time period of the first image data from the image pickup device, detects a motion region by using the first image data and the second image data, and acquires motion detection information by using the plurality of pieces of first image data. The processor changes a synthesis method in accordance with whether the motion region is detected and generates one piece of synthesized image data.