Virtual Camera Array for Insect Wing Deformation Measurement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for measuring the flapping motion of insect wings, particularly bilateral wings with high flapping-frequency and large stroke-amplitude, face challenges such as blind observation regions and difficulty in simultaneous image capture, limiting the accuracy of deformation measurement and requiring active features like laser-sheet sources for detailed reconstruction.
Innovation Solution
A computer vision system using multiple virtual stereo and structured-light sensors, combined with an optoelectronic guiding equipment, to capture high-speed image sequences of insect flight, reconstructing three-dimensional wing deformation by imaging a high-speed CMOS camera to multiple virtual cameras and projecting laser-sheet sources with gratings, while an optoelectronic guiding system leads the insect through the observation region to avoid blind spots and ensure synchronized image capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single-camera system with structured-light sources is used to measure wing deformation, then detailed reconstruction information can be obtained, but blind observation regions occur when the wing surface becomes parallel to the projective direction
Solution Approach 1:
The patent combines multiple camera systems (first camera system and second camera system) with different projection directions to observe the same wing. This merging of multiple observation viewpoints eliminates blind regions where a single camera would fail to capture wing surface information, while maintaining detailed reconstruction capability through structured-light sources.
Solution Approach 2:
The patent introduces a new dimension of observation by placing cameras at different spatial locations and angles. The first camera system observes from one viewpoint while the second camera system observes from another viewpoint, creating multi-dimensional coverage that eliminates the blind observation regions inherent in single-viewpoint systems.
2Loss of information
If multiple real cameras are used to observe bilateral wings from different viewpoints, then blind observation regions can be avoided, but it becomes very difficult to simultaneously capture images of insect flight
Solution Approach 1:
The patent uses virtual camera systems that are optically coupled to physical cameras through beam splitters and mirrors. This creates virtual copies of the camera at different spatial locations, allowing simultaneous multi-viewpoint observation without requiring multiple independent physical cameras. The virtual cameras capture images simultaneously through optical path division.
Solution Approach 2:
The patent introduces optical intermediaries (beam splitters, mirrors, and optical paths) between the physical camera and the observation points. These intermediaries redirect light from different viewpoints to a single camera sensor, enabling simultaneous capture of multiple perspectives without the synchronization difficulties of coordinating multiple independent cameras.
3Speed
If high-speed camera is used to capture insect flight with high flapping-frequency, then detailed flapping motion can be recorded, but the wing surface appears parallel to projective direction causing blind observation regions
Solution Approach 1:
The patent merges multiple camera systems observing from different angles to capture high-speed flapping motion. By combining the viewpoints of the first and second camera systems, the system maintains continuous observation of the wing surface even during rapid flapping when the surface orientation changes, preventing blind regions from forming.
Solution Approach 2:
The patent adds spatial dimensionality to the observation system by positioning cameras at different angles and locations. This multi-dimensional observation approach ensures that at least one camera maintains a non-parallel projection direction to the wing surface during high-speed flapping, preserving measurement precision throughout the entire flapping cycle.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise measurement and reconstruction of three-dimensional deformation of bilateral insect wings, overcoming blind observation regions and asynchronism issues, providing detailed information on wing surfaces and flight modes, and facilitating automatic image sequence capture.
Implementation Method 1
a geometrical optic unit for imaging a high-speed CMOS camera to four virtual cameras to observe the flight of insect at multiple viewpoints
Implementation Method 2
double laser-sheet sources for projecting multiple parallel light-lines on the surface of wings and supplying the information about the deformation of wings
Implementation Method 3
an optoelectronic guiding equipment and method to lead the fee-flight of insect and trigger the high-speed camera to capture the image sequences automatically
Data Source
AI summary
The present invention relates to a high-performance computer vision system and method for measuring the wings deformation of insects with high flapping-frequency, large stroke-amplitude and excellent mobility during free-flight. A geometrical optic unit composed of a polyhedral reflector with four reflection-planes and four planar reflectors is used to image one high-speed CMOS camera to four virtual cameras, combined with double laser-sheet sources, multiple virtual stereo and structured-light sensors are available to observe the free-flight of insect at different viewpoints simultaneously. In addition, an optoelectronic guiding equipment is included to lead the free-flight of insect and trigger the camera to capture the image sequences of insect-flight automatically. The deformation of insect-wings can be reconstructed by the spatial coordinates of wing-edges and the distorted light-lines projected on the surface of wings.