Haptic Video Region Mapping with Grayscale Characterization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing haptic interaction technologies in media streaming, such as ISOBMFF and MPEG-DASH, can only support single haptic interaction settings for a single picture, failing to accommodate different haptic interaction settings across various regions of a video picture.
Innovation Solution
A gray-scale characterization method is employed to divide video pictures into regions based on haptic interaction signal waveforms, using a gray-scale information characterization map to accurately represent these regions, enabling different haptic interaction settings and enhancing interactivity and entertainment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single haptic interaction setting is applied to a single picture, then the system complexity is low and encoding is simple, but the system cannot support different haptic interaction settings across various regions of a video picture
Solution Approach 1:
The video picture is divided into multiple regions, each with its own haptic interaction settings. The system segments the haptic interaction information by creating separate haptic interaction signal streams for different picture regions, allowing independent control of haptic parameters (such as amplitude, frequency, duration) for each region while maintaining overall system manageability through modular processing
Solution Approach 2:
Different haptic interaction settings are applied to different regions of the video picture based on local requirements. Each picture region can have customized haptic parameters tailored to its specific content characteristics, enabling localized haptic feedback optimization without affecting other regions, thus achieving regional adaptability while keeping the overall system structured
2Adaptability or versatility
If haptic interaction information is encoded for each picture region, then regional haptic control is achieved, but encoding complexity and data volume increase
Solution Approach 1:
The patent combines multiple haptic interaction signal streams into a single integrated haptic interaction information structure. By merging the regional haptic signals into one unified data format that can be processed together, the system reduces encoding complexity and avoids the need for separate encoding pipelines for each region, thereby simplifying the overall encoding process while maintaining regional control capabilities
Solution Approach 2:
A universal haptic interaction information structure is designed to handle both single-region and multi-region haptic control scenarios. This multi-functional encoding approach allows the same encoding framework to accommodate varying numbers of regions and different haptic parameter configurations, reducing the need for multiple specialized encoding systems and lowering overall encoding complexity
Data Source
AI summary
Haptic interaction information processing methods, apparatuses and devices are provided, wherein the haptic interaction information processing method according to an embodiment of the present disclosure includes: counting a quantity of waveforms of haptic interaction signals in a target video picture, wherein the target video picture is a video picture in a target video, and the waveform of one haptic interaction signal corresponds to haptic interaction information of one video picture region in the target video picture; and generating a gray-scale information characterization map corresponding to the target video picture according to the quantity of the waveforms of the haptic interaction signals, wherein the gray-scale information characterization map is configured to characterize distribution positions of video picture regions in the target video picture.