Real-time Data Processing Device for Superimposed Video and Drawing Preview
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for displaying camera video and hand-drawing input in a superimposing manner fail to provide real-time preview capabilities and reduce processing loads effectively, especially on low-throughput devices, often requiring resolution lowering which results in insufficient output.
Innovation Solution
A real-time data processing device that captures video and hand-drawing input, inverting video data from a raster format to raster and drawing data from a vector format, allowing for a superimposed display in a preview area with reduced processing load, using a touch panel unit with separate areas for video and drawing input, and encoding the data for storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time preview processing is performed on low-throughput devices using raster format for drawing data, then the device can display composite video data, but the processing load becomes too heavy for real-time operation
Solution Approach 1:
The patent divides the composite data generation into two separate processing paths: one for video data (raster format) and one for drawing data (vector format). The video data is processed through video inversion processing, while drawing data undergoes drawing inversion processing. These processed data are then combined in the real-time preview processing section, allowing low-throughput devices to handle each data type efficiently without the computational burden of converting and processing all drawing data in raster format in real-time.
Solution Approach 2:
The patent changes the data format parameter for drawing data from raster to vector format. This parameter change fundamentally alters the processing requirements: vector format drawing data can be inverted and processed more efficiently on low-throughput devices compared to raster format, enabling real-time preview capability while maintaining acceptable processing loads.
2Productivity
If resolution of data is lowered to enable real-time processing on low-throughput devices, then real-time preview becomes possible, but the resolution of data outputted to the network becomes insufficient
Solution Approach 1:
The patent implements separate processing paths for real-time preview and network output. For real-time preview, vector format drawing data is used with drawing inversion processing, enabling real-time performance on low-throughput devices. For network output, the system performs encoding processing to generate drawing data in raster format at high resolution, then combines it with video data through rendering processing. This segmentation allows different resolution requirements to be met for different output purposes simultaneously.
Solution Approach 2:
The patent employs dynamic processing based on the output destination. The system dynamically selects processing methods: vector format with drawing inversion for real-time preview, and raster format with encoding and rendering for high-resolution network output. This dynamic approach allows the same device to optimize processing for real-time operations while maintaining high resolution for final output.
Data Source
AI summary
In a real-time data processing device (1), when a camera video is inputted as video data in a raster format and a hand-drawing input is inputted as drawing data in a vector format, inverted video data in the raster format and inverted drawing data in the vector format are generated, a display of the drawing data in the vector format is made in a drawing area (A1) of a touch panel unit, and a superimposed display of the inverted video data in the raster format and the inverted drawing data in the vector format is made in a preview area (A2). Drawing data in the raster format is generated by performing encoding processing of the drawing data in the vector format, and composite data to be stored is generated by performing rendering processing of the video data in the raster format and the drawing data in the raster format.