Video Enrichment via Camera Parameter Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video enrichment techniques do not allow users to easily insert customized objects into videos received via telecommunications networks, resulting in unsatisfactory rendering for end-users.
Innovation Solution
A method and system where a server processes videos by generating an enriched stream that includes video images and camera position and calibration parameters, allowing terminals to insert and adapt enrichment objects based on these parameters for natural rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video enrichment is performed by inserting objects before broadcast, then video enrichment capability is provided, but user customization is not allowed and rendering is unsatisfactory
Solution Approach 1:
The server performs preliminary actions by extracting and transmitting camera parameters (position, orientation, focal length) along with the video stream before the terminal performs enrichment. This preliminary preparation enables the terminal to accurately adapt enrichment objects to match the camera's viewpoint, achieving both user customization and high rendering quality.
Solution Approach 2:
Camera parameters serve as an intermediary between the video stream and enrichment objects. The terminal uses these parameters as mediation to transform enrichment objects so they align with the camera's perspective, resolving the contradiction between customization and rendering quality by providing a bridge for accurate spatial alignment.
2Adaptability or versatility
If camera parameters are transmitted to terminals, then customized enrichment with natural rendering is enabled, but data transmission volume increases
Solution Approach 1:
The server extracts only the essential camera parameters (position, orientation, focal length) from the complete camera configuration, transmitting only these critical data elements to the terminal. This extraction approach enables customized enrichment while minimizing data transmission volume by sending only the necessary parameters rather than complete camera settings.
Solution Approach 2:
The patent transmits camera parameters selectively at specific points in the video stream (e.g., when camera viewpoint changes) rather than continuously for every frame. This local quality approach ensures customized enrichment capability while reducing overall data transmission volume by transmitting parameters only when necessary.
3Ease of operation
If enrichment objects are inserted without camera parameter adaptation, then processing simplicity is maintained, but rendering naturalness deteriorates
Solution Approach 1:
The terminal automatically performs adaptation of enrichment objects using the received camera parameters without requiring manual intervention or complex configuration from the user. The system serves itself by using the transmitted parameters to automatically calculate and apply the correct transformation, maintaining processing simplicity while achieving natural rendering.
Solution Approach 2:
The terminal changes the parameters of enrichment objects (position, size, orientation) based on the received camera parameters to match the camera's viewpoint. This parameter transformation approach enables natural rendering while keeping the process automated and simple, as the terminal merely applies mathematical transformations rather than performing complex manual adjustments.
Data Source
AI summary
A terminal includes an object adapter for augmenting an initial video which includes a succession of images acquired by a camera. The adapter is capable of adapting, at least in images following a first image of the initial video received by the terminal, at least one characteristic for viewing the augmentation object, which characteristic is selected and inserted into the first image. The adapter is capable of operating according to parameters of the camera, such as position and calibration parameters of the camera, which are associated with the images of the initial video, the parameters having been received by the terminal in association with the initial video.