Multisensory Playback Timing Using Estimated Video, Audio, and Haptic Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to provide a high-quality user experience due to unsynchronized presentation of visual, auditory, and haptic stimuli, leading to viewer discomfort when latency times cannot be measured.
Innovation Solution
An information processing apparatus that estimates latency times for video, acoustic, and haptic signals, and adjusts presentation timing using an additional latency time to synchronize these stimuli, ensuring they are presented in a comfortable order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If latency time measurement is implemented to synchronize stimuli, then user experience quality is improved, but system complexity increases and measurement capability is required
Solution Approach 1:
The patent creates a virtual model (copy) of the latency time characteristics by storing measured latency data in a lookup table. Instead of requiring continuous real-time measurement, the system pre-measures latency characteristics and stores them as reference data. During operation, the system retrieves and applies these pre-stored latency values to synchronize stimuli, eliminating the need for complex real-time measurement infrastructure while maintaining synchronization accuracy.
Solution Approach 2:
The patent performs latency measurement and characterization in advance before actual content delivery. By pre-measuring the latency characteristics of the playback system and storing these values in a lookup table, the system prepares synchronization parameters beforehand. This preliminary action allows the system to operate without complex real-time measurement capabilities during actual use, as all necessary latency compensation data is already available.
2Device complexity
If real-time latency measurement is avoided to simplify the system, then device complexity is reduced, but synchronization accuracy deteriorates
Solution Approach 1:
The patent replaces complex real-time measurement with a simplified approach using pre-stored latency data. The system creates a virtual representation of latency characteristics by storing measured values in a lookup table, then uses this copied data to achieve accurate synchronization without requiring ongoing real-time measurement infrastructure.
Solution Approach 2:
The patent uses a simple, inexpensive lookup table data structure to store latency compensation values. This disposable-like storage mechanism replaces complex measurement hardware and software, providing accurate timing synchronization through simple data retrieval and application rather than through ongoing complex measurement processes.
3Adaptability or versatility
If multiple stimuli types are presented simultaneously, then user experience richness is improved, but synchronization difficulty increases
Solution Approach 1:
The patent introduces a lookup table as an intermediary component between the multiple stimulus sources (video, audio, haptic) and the synchronization control logic. By storing pre-measured latency characteristics in this intermediate data structure, the system can retrieve appropriate compensation values for each stimulus type and apply them systematically, greatly simplifying the coordination of multiple simultaneous stimuli compared to direct real-time measurement and adjustment.
Data Source
AI summary
An information processing apparatus includes an estimation processing unit that estimates at least some of a video latency time from a reproduction instruction of a video signal to video presentation based on the video signal, an acoustic latency time from a reproduction instruction of an acoustic signal to acoustic presentation based on the acoustic signal, and a haptic sense latency time from a reproduction instruction of a haptic signal to haptic sense presentation based on the haptic signal, and a latency time determination unit that determines an additional latency time related to the haptic sense presentation on the basis of an estimation result of the estimation processing unit.