Spectrum Information Transmission via Trilateral Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current hyper spectrum video sampling technologies face challenges in capturing high-resolution spectrum video information due to the high dimensionality of the data, which makes it difficult to directly capture and transmit dynamic scene spectrum data in real time with both high spatial and spectral resolution.
Innovation Solution
A method involving a first RGB camera for sampling a high spatial resolution video and a second sampling device for sampling a low spatial but high spectral resolution spectrum video, using estimated transmission ratio coefficients calculated from color integral curves to process and transmit spectrum information through a trilateral filtering algorithm, allowing for high-resolution spectrum information transmission across multiple scene points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If hyper spectrum video sampling is performed with high spatial and spectral resolution, then the quality of spectrum information is improved, but the device complexity and data processing difficulty increase significantly
Solution Approach 1:
The patent divides the hyper spectrum video sampling task into two separate sampling processes: (1) a first sampling device captures high spatial resolution video frames, and (2) a second sampling device captures spectrum information at specific sampling points. This segmentation allows each device to specialize in one dimension (spatial or spectral) rather than attempting to capture both simultaneously, thereby reducing individual device complexity while maintaining overall high resolution in both dimensions.
Solution Approach 2:
The patent transitions from attempting to capture all dimensions (spatial x, y and spectral λ) simultaneously to a sequential approach where spatial dimensions are captured first by the first sampling device, then spectral dimension is added by the second sampling device at selected points. This dimensional separation reduces the complexity burden on any single device while preserving the full hyper spectrum data structure.
2Measurement precision
If hyper spectrum video is captured with high spatial and spectral resolution, then the information quality is improved, but the loss of time increases due to the complexity of direct capture
Solution Approach 1:
The first sampling device performs preliminary action by capturing high spatial resolution video frames first. This preliminary capture establishes the spatial context and identifies sampling points before the second sampling device adds spectral information. This preliminary spatial mapping reduces the time required for the spectral sampling process, as the second device can efficiently target pre-identified points rather than searching for them during spectral acquisition.
Solution Approach 2:
The patent segments the video capture process into two time-efficient stages: (1) rapid spatial video capture by the first sampling device, and (2) targeted spectral sampling by the second device at identified points. This segmentation avoids the time penalty of attempting simultaneous high-resolution capture in both spatial and spectral domains, as each stage can be optimized independently for its specific resolution requirement.
3Area of stationary object
If spectrum information is transmitted to multiple scene points, then the coverage is improved, but the data transmission complexity increases
Solution Approach 1:
The patent uses the trilateral filtering algorithm to create copies of spectrum information from sampling points to surrounding scene points. Instead of directly measuring spectrum information at every scene point (which would require complex multi-point sampling systems), the system captures spectrum data at limited sampling points and then algorithmically copies and distributes this information to multiple scene points using the trilateral filter, which considers spatial, spectral, and temporal relationships. This copying approach achieves wide scene coverage while keeping the transmission system relatively simple.
Solution Approach 2:
The trilateral filtering algorithm acts as an intermediary between the limited spectrum measurements from the second sampling device and the comprehensive scene coverage requirement. This intermediary process intelligently distributes spectrum information from sampling points to surrounding scene points by considering spatial proximity, spectral similarity, and temporal continuity, thereby achieving extensive scene coverage without requiring proportionally complex transmission infrastructure.
4Measurement precision
If trilateral filtering is applied to transmit spectrum information across frames and domains, then the spectrum information transmission accuracy is improved, but the calculation complexity increases
Solution Approach 1:
The trilateral filtering process is segmented into three distinct dimensions that are processed separately but integrated together: (1) spatial filtering considering neighborhood pixel relationships, (2) spectral filtering considering wavelength continuity, and (3) temporal filtering considering frame-to-frame consistency. This segmentation of the filtering process into three manageable dimensions allows for high transmission accuracy through comprehensive multi-dimensional consideration, while keeping each individual filtering component relatively simple and computationally efficient.
Data Source
AI summary
A method for transmitting spectrum information is provided. The method includes: sampling a first video of a scene by a first sampling device and sampling a spectrum video of a sampling point in the scene by a second sampling device, and processing the spectrum video to obtain a spectrum information of the sampling point; calculating estimated transmission ratio coefficients of the spectrum video according to color integral curves of the first sampling device; estimating a location of the sampling point in each frame of the first video; and transmitting the spectrum information of the sampling point to a plurality of scene points in the first video according to the estimated transmission ratio coefficients and the location of the sampling point in each frame of the spectrum video through a trilateral filtering algorithm.