Pulse-Sequence Image Reconstruction for High-Speed Motion Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle to efficiently manage the rapid growth of video data, particularly in high-speed scenarios, leading to large redundancy, low time domain resolution, and blurring, while traditional image sensors fail to capture dynamic changes effectively, necessitating a new approach that accounts for both temporal and spatial information.
Innovation Solution
A method and device for generating images based on pulse sequences obtained from encoded information, utilizing a pulse camera to collect pulse signals representing space-time signal changes, followed by encoding these signals to reduce data rate and facilitate storage and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional image sensors are used to capture dynamic images, then the imaging process is simple, but the time domain resolution is low and blurring occurs in high-speed scenarios
Solution Approach 1:
The patent divides the imaging process into multiple independent pixel elements, each capable of capturing temporal information independently. Each pixel operates as an independent unit that can detect changes over time, enabling high time domain resolution without requiring complex post-processing. This segmentation of the sensor array allows parallel processing of temporal and spatial information.
Solution Approach 2:
The patent transitions from traditional two-dimensional spatial imaging to a three-dimensional representation combining spatial and temporal dimensions. By adding the time dimension to each pixel's output, the system creates a space-time coded representation that captures dynamic changes. This dimensional expansion enables high-speed motion capture while maintaining manageable data structure through encoding.
2Measurement precision
If pulse sequences are collected from each pixel to capture space-time signal changes, then high dynamic range and time resolution are achieved, but the data rate increases significantly
Solution Approach 1:
The patent applies parameter changes by transforming the raw pulse sequence data into encoded information through a coding process. The encoding modifies the representation parameters of the data, converting high-rate pulse sequences into a compressed format that maintains dynamic range information while reducing the data rate. This parameter transformation enables efficient storage and transmission without losing measurement precision.
Solution Approach 2:
The patent extracts only the essential temporal and spatial information from the complete pulse sequence data through encoding. By taking out and retaining only the necessary features (space-time coded information), the system reduces data volume while preserving the critical dynamic range characteristics. The encoding process filters out redundant information, keeping only what is needed for accurate reconstruction.
3Ease of manufacture
If traditional video coding is used to manage video data, then the processing is straightforward, but large redundancy remains and efficient storage is not achieved
Solution Approach 1:
The patent performs preliminary encoding action at the pixel level before final video processing. By encoding space-time information individually for each pixel in advance, the system prepares data in a compressed form that reduces redundancy early in the process. This preliminary encoding enables subsequent processing to work with already-compressed data, maintaining simplicity while reducing redundancy.
Solution Approach 2:
The patent merges spatial and temporal information into a unified space-time coded representation. By combining these dimensions in the encoding process, the system creates a compact data structure that inherently reduces redundancy. The merged representation allows efficient storage and processing by treating space and time as an integrated information unit rather than separate data streams.
Data Source
AI summary
A method includes: obtaining, from encoded information, a pulse sequence for each pixel in a plurality of pixels in a unit time period before a specified time, where the encoded information is obtained by encoding respective pulse sequences for the plurality of pixels, wherein the pulse sequence for a given pixel of the plurality of pixels represents a space-time signal change at the given pixel; calculating, for each pixel of the plurality of pixels, a pixel value of the pixel according to the pulse sequence for the pixel; and obtaining an image at the specified time according to a space arrangement of the pixels of the plurality of pixels, in accordance with the pixel values of the plurality of pixels at the specified time.