Rolling-Shutter Microscopy for Rapid Extended Depth of Field
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for producing microscopic images with an extended depth of field are time-consuming and require significant effort.
Innovation Solution
A method involving a digital microscope that acquires a plurality of microscopic frames from different focus positions using a rolling shutter and a movable mirror system or deformable lens, followed by selecting and composing sharp image parts to form an image with an extended depth of field.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple microscopic frames are acquired from different focus positions using a rolling shutter, then the production speed of extended depth of field images is improved, but image distortion occurs due to the rolling shutter effect
Solution Approach 1:
The patent converts the harmful rolling shutter distortion into a useful tool by using the temporal information from different scan lines to capture focus variations across the image. The distortion that would normally require correction is instead exploited to achieve extended depth of field through focus stacking, transforming a defect into a functional advantage
Solution Approach 2:
The patent changes the focus position parameter dynamically during image acquisition by moving mirrors or deformable lenses, while simultaneously utilizing the rolling shutter's temporal scanning to capture multiple focus planes. This parameter change approach enables rapid acquisition of extended depth of field images without requiring mechanical movement of the entire microscope system
2Manufacturing precision
If a global shutter is used to avoid rolling shutter distortion, then image geometric accuracy is improved, but the acquisition time and complexity increase
Solution Approach 1:
Instead of using a global shutter to avoid distortion, the patent embraces the rolling shutter's sequential scanning and converts it into a focus-stacking mechanism. Each scan line captures a slightly different focus plane, and this temporal focus variation is used to synthesize an extended depth of field image, eliminating the need for global shutter hardware
Solution Approach 2:
The patent replaces the mechanical global shutter mechanism with a computational approach that processes rolling shutter data. By using image processing algorithms to combine information from different scan lines at different focus positions, the system achieves extended depth of field without the time penalty and complexity of global shutter hardware
3Manufacturing precision
If traditional focus stacking methods are used to produce extended depth of field images, then image quality is improved, but the processing time and effort increase significantly
Solution Approach 1:
The patent introduces dynamic focus adjustment during the image acquisition process by using movable mirrors or deformable lenses that change focus position in real-time during the rolling shutter scan. This dynamic approach captures multiple focus planes in a single continuous operation, eliminating the need for multiple static acquisitions and subsequent heavy processing
Solution Approach 2:
The patent maintains continuous useful action by performing focus stacking during the natural rolling shutter scan process rather than as a separate post-processing step. The focus position is continuously adjusted during acquisition, and the extended depth of field image is formed by continuously combining information from different scan lines, making the entire process more efficient
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables rapid production of microscopic images with an extended depth of field with high sensitivity and reduced effort, utilizing a rolling shutter and movable mirrors or deformable lenses to capture and process frames efficiently.
Implementation Method 1
The image distortion caused by the rolling shutter is a side effect of the fast readout feature of CMOS sensors
Implementation Method 2
a deformable objective lens or a movable mirror system for changing a focal length of the objective
Implementation Method 3
a microscope with an objective lens for optically imaging a specimen
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present invention concerns a method for producing a microscopic image with an extended depth of field by means of a microscope. The microscope comprises an images sensor that comprises pixels that are arranged as a matrix that is formed by lines. In a step of the method, a plurality of microscopic frames of a specimen is acquired while a focus position (z) is changed. The microscopic frames are acquired line by line. The focus position (z) is changed over a course of acquiring individuals of the microscopic frames. In a further step, parts of individuals of the acquired lines are identified. These parts sharply image the specimen. The identified parts of the lines are composed in order to form a microscopic image of the specimen with an extended depth of field. Furthermore, the present invention concerns a microscope.