Haptic Actuator Synchronization via Audio Data Channels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing haptic systems are limited in their ability to scale and synchronize large numbers of haptic actuators with displayed content, failing to provide a fully immersive virtual reality experience due to unique custom interfaces and hardware limitations.
Innovation Solution
A system and method that synchronizes haptic feedback with video frame content using control messages over existing hardware connections like HDMI, DisplayPort, or USB Type C, allowing for the integration of multiple haptic actuators into wearable devices, such as suits, gloves, and head-mounted displays, and extends synchronization to light controllers for enhanced immersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If custom interfaces are used for each VR system, then haptic actuators can be controlled, but the system cannot scale to large numbers of actuators and requires significant hardware upgrades
Solution Approach 1:
The patent repurposes existing audio data channels (HDMI, DisplayPort, USB Type C) to carry both audio and haptic control data. The audio interface is made multi-functional by encoding haptic actuator control messages within the audio data stream, allowing a single interface to serve multiple purposes without requiring dedicated haptic communication hardware.
Solution Approach 2:
The patent introduces an intermediary encoding/decoding mechanism that translates haptic control data into audio-compatible data streams. This intermediary process allows haptic commands to be transmitted through audio channels by embedding them in audio frames, which are then extracted and processed by the haptic actuator without requiring direct haptic communication infrastructure.
2Ease of manufacture
If existing audio data channels are repurposed for haptic data transmission, then hardware upgrades are avoided, but synchronization precision must be maintained
Solution Approach 1:
The patent implements feedback mechanisms where the system monitors the transmission of haptic control data through audio channels and adjusts timing accordingly. The synchronized presentation of audio and haptic effects is maintained by using the same timing reference for both modalities, allowing the system to compensate for variations in processing delays and maintain precise synchronization despite using shared communication infrastructure.
Solution Approach 2:
The patent performs preliminary encoding of haptic control data into audio-compatible formats before transmission. By pre-processing the haptic data streams and synchronizing their timing with audio content in advance, the system ensures that when the data is transmitted through shared audio channels, the synchronization is already established and can be maintained without requiring complex real-time adjustment mechanisms.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Various systems and methods for synchronizing haptic actuators with displayed content are described herein. A system may include a computer system, a head-mounted display (HMD) system, and a number of actuators on a wearable device. The computer system may construct a data packet with a network address of a control mechanism on the wearable device and transmit the data packet to the HMD in a video/audio stream. The HMD may identify the data packet in the video/audio stream and forward the data packet to a bus. The control mechanism on the bus is able to retrieve the data packet and access a control message in the data packet, which is used to initiate an effect produced by the control mechanism. The control mechanism may be a haptics actuator, a light controller, or the like.