Video Processing Encoding Perception Attributes Spatial Location
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing methods fail to associate perception attributes such as scent and touch with specific objects in video content, leading to an unsatisfactory user experience, especially in panoramic videos where different objects cannot provide distinct perceptions.
Innovation Solution
A video processing method that encodes perception attribute information and spatial location data for objects within the video bitstream or file, allowing terminal devices to render these attributes based on user interaction and spatial location, thereby enhancing the user experience by providing distinct perceptions for different objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If perception attribute information is encoded for all objects in the video, then user experience is improved, but device complexity and processing overhead increase
Solution Approach 1:
The patent applies local quality by selectively encoding perception attribute information only for specific objects that require enhanced perception, rather than uniformly encoding all objects. The server determines which objects need perception attributes based on their spatial locations and video content characteristics, thereby improving user experience for critical objects while avoiding unnecessary processing overhead for other objects.
Solution Approach 2:
The patent segments the video processing into distinct components: video content processing, object detection, spatial location determination, and perception attribute encoding. This segmentation allows the system to handle perception attributes as a separate layer that can be selectively applied to specific objects, reducing overall system complexity while maintaining enhanced perception capabilities where needed.
2Loss of information
If perception attribute information is added to video bitstream, then object-specific perception is achieved, but data transmission volume increases
Solution Approach 1:
The patent extracts perception attribute information as a separate component from the main video bitstream. By using supplemental enhancement information (SEI) messages or metadata structures, the perception attributes are carried independently alongside the video data, allowing the video content itself to remain unchanged while adding only the necessary perception information for enhanced user experience.
Solution Approach 2:
The patent implements partial action by encoding perception attributes only for specific objects rather than all objects in the video. The server selectively determines which objects require perception attribute encoding based on their importance to the video content and user experience, thereby adding only the necessary amount of data to achieve the desired perception enhancement without excessive data volume increase.
Data Source
AI summary
This application provides a video processing method and apparatus. The method includes: adding, by a server, perception attribute information of an object and spatial location information of the object to a video bitstream or a video file, and encapsulating the video bitstream or the video file, where the perception attribute information is used to indicate a property presented when the object is perceived by a user; and obtaining, by a terminal device, the video bitstream or the video file that carries the perception attribute information of the object and the spatial location information of the object, and performing perception rendering on a perception attribute of the object based on behavior of the user, the perception attribute information of the object and the spatial location information of the object.