Haptic Interaction Information Processing Method and Apparatus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing haptic interaction technologies in media streaming, such as ISOBMFF and MPEG-DASH, can only support single haptic interaction settings for a single picture, failing to accommodate different haptic interaction settings across various regions of a video picture.
Innovation Solution
A gray-scale characterization method is employed to divide video pictures into regions based on haptic interaction signal waveforms, using a gray-scale information characterization map to accurately represent these regions, enabling different haptic interaction settings and enhancing interactivity and entertainment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single haptic interaction setting is applied to a single picture, then the system complexity is reduced and encoding is simplified, but the ability to provide different haptic interactions for different video picture regions is lost
Solution Approach 1:
The video picture is segmented into multiple regions, each with its own haptic interaction settings. The system divides the picture into different areas (e.g., foreground, background, specific objects) and applies distinct haptic configurations to each region, enabling region-specific haptic feedback while maintaining manageable system complexity through structured segmentation
Solution Approach 2:
Different haptic interaction settings are applied to different regions of the video picture based on local requirements. Each region can have customized haptic parameters (intensity, frequency, type) tailored to its specific content needs, allowing the system to provide appropriate haptic feedback for different picture areas without requiring complete system redesign
2Measurement precision
If region-specific haptic interaction settings are implemented, then haptic feedback precision is improved, but encoding complexity and costs increase
Solution Approach 1:
Haptic interaction settings for different regions are predetermined and encoded into the video stream during the encoding phase. The encoding process pre-processes the video to include region-specific haptic metadata, so that during playback, the system can directly retrieve and apply these pre-configured settings without performing complex real-time analysis, thereby reducing runtime computational burden
Solution Approach 2:
The system uses simplified representations or templates for common haptic interaction patterns across different regions. Instead of encoding completely unique haptic settings for every region, reusable haptic templates or copied configurations are employed where applicable, reducing the overall encoding complexity while maintaining sufficient precision for various picture regions
Data Source
Figure 1~2
Figure 3~5
Figure 6~7
AI summary
Haptic interaction information processing methods, apparatuses and devices are provided, belonging to the field of haptic signal expression. The haptic interaction information processing method according to an embodiment of the present disclosure includes: (S101) counting a quantity of waveforms of haptic interaction signals in a target video picture, wherein the target video picture is a video picture in a target video, and the waveform of one haptic interaction signal corresponds to haptic interaction information of one video picture region in the target video picture; and (S102) generating a gray-scale information characterization map corresponding to the target video picture according to the quantity of the waveforms of the haptic interaction signals, wherein the gray-scale information characterization map is configured to characterize distribution positions of video picture regions in the target video picture.