Rolling Shutter Imager Steering Mirror Object Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Global shutter imagers used for object detection and tracking in environments like retail stores face challenges with high cost, noise, and the need for expensive active illumination due to their larger pixel size and inability to capture sharp images of moving objects under ambient light, especially when a large area needs to be covered.
Innovation Solution
Implementing a system with a rolling shutter imager and a steering mirror to track objects, allowing the use of ambient light and reducing the need for active illumination, while also employing a combination of wide and narrow field-of-view imagers to optimize coverage and resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a global shutter imager is used to capture sharp images of moving objects, then image sharpness is improved, but cost and noise increase
Solution Approach 1:
The system dynamically switches between global shutter and rolling shutter modes based on object motion detection. When motion is detected, the system uses rolling shutter with extended exposure time and image processing to achieve sharp images, eliminating the need for expensive global shutter imagers in all conditions.
Solution Approach 2:
The patent changes the exposure time parameter and shutter type based on lighting conditions and object motion. By extending exposure time in rolling shutter mode and using image processing techniques, the system achieves global shutter-like image quality without the associated cost and noise penalties.
2Measurement precision
If a global shutter imager with short exposure time is used for moving objects, then motion blur is reduced, but illumination requirements increase
Solution Approach 1:
The system dynamically adjusts exposure time and shutter type based on object motion and lighting conditions. For slowly moving or stationary objects, rolling shutter with extended exposure time is used, allowing ambient light to suffice and eliminating the need for expensive active illumination systems.
Solution Approach 2:
The patent uses periodic scanning of the rolling shutter across the image sensor, allowing extended exposure time for each scan line. This periodic action enables accumulation of light over time, achieving sufficient illumination without requiring additional active lighting.
3Measurement precision
If a high-resolution imager is used to cover a large area, then object identification capability is improved, but the imager size and cost increase
Solution Approach 1:
The system segments the imaging task into multiple passes using rolling shutter scanning. Instead of requiring a single high-resolution image of the entire area, the rolling shutter captures sequential lines that are processed to reconstruct high-resolution images of specific objects of interest, effectively dividing the imaging function across time and space.
Solution Approach 2:
The patent creates multiple images of the same object from different temporal snapshots during the rolling shutter scan. By processing these sequential captures, the system reconstructs high-resolution images without requiring a physically large high-resolution sensor array.
4Measurement precision
If active illumination is used to enable sharp image capture of moving objects, then image quality is improved, but interference with opto-electronic components and annoyance to operators increases
Solution Approach 1:
The system extracts and eliminates the active illumination component from the imaging system. By using rolling shutter with extended exposure time and ambient light, the patent removes the harmful active illumination sources that cause interference with opto-electronic components and annoyance to human operators.
Solution Approach 2:
The patent converts the limitation of rolling shutter (potential for motion blur) into a benefit by using extended exposure time with ambient light. This approach eliminates the need for harmful active illumination while still achieving sharp images through careful exposure management and image processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach results in a smaller, less expensive, and more efficient camera system that can effectively track objects with lower noise and reduced illumination requirements, enabling better image capture and object identification in retail environments.
Implementation Method 1
a steering mirror selectively operable to steer at least a portion of the first imager field-of-view relative to one or more objects in the environment
Data Source
AI summary
A first imager has a relatively high resolution and a relatively narrow first field-of-view. Information about objects in an environment is detected or captured, and used to steer the first field-of-view of the first imager. The sensor(s) may take the form of a second imager with a relatively lower resolution and relatively wider second field-of-view. Alternatively, other types of sensors, for instance presence/absence sensors may be employed. The first field-of-view may be directed toward an object that satisfies one or more conditions, for instance matching a particular SKU. The first field-of-view may track a moving object, for instance via a tracking mirror and actuator. This approach may be employed in retail locations, for example in grocery or convenience stores, for instance to reduce various forms of theft or in industrial environments.