USB-C A/V Communication Path for Sub-7 ms VR Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-resolution audio/visual applications like VR and AR suffer from increased data transfer latencies and require multiple physical connections, leading to user discomfort and reduced mobility.
Innovation Solution
Implementing a USB type-C solution with a controller subsystem that routes A/V data directly to a local memory subsystem instead of host memory, reducing latency by using pointers to store and retrieve data efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high resolution (greater than 2,000 pixels per eye) is used to provide better immersive experience, then image quality is improved, but data transfer latency increases (greater than 7 milliseconds)
Solution Approach 1:
The system separates A/V data processing into two distinct memory pathways: local memory within the controller subsystem for time-critical A/V data, and host memory for other data. This segmentation allows high-resolution A/V data to be processed with low latency while maintaining overall system functionality.
Solution Approach 2:
The patent introduces a peripheral port (USB type-C) as an intermediary communication channel that provides a direct, low-latency pathway between the peripheral device and local memory, bypassing the host system for A/V data. This intermediary enables high-resolution data transfer with reduced latency.
2Productivity
If multiple cables are used between headset and host device to support high resolution, then data transfer capability is improved, but user mobility is reduced
Solution Approach 1:
The USB type-C peripheral port is designed as a universal interface that consolidates multiple data and power transmission functions into a single connection. This multi-functional port replaces multiple separate cables, maintaining high data transfer capability while improving user mobility by reducing cable clutter.
3Adaptability or versatility
If A/V data is stored in host memory, then system resource utilization is improved, but latency increases
Solution Approach 1:
The memory system is segmented into local memory within the controller subsystem and host memory in the host system. A/V data is specifically routed to local memory for immediate processing, while other data types continue to use host memory. This segmentation optimizes both latency for A/V data and overall system resource utilization.
Solution Approach 2:
The system performs preliminary routing of A/V data directly to local memory before host processing occurs. By pre-positioning time-critical A/V data in locally accessible memory, the system eliminates latency that would result from retrieving this data from host memory during time-sensitive operations.
Data Source
AI summary
Embodiments relate to a controller subsystem that includes a virtual reality (VR) subsystem to: identify data received from a peripheral device as related to an audio/visual (A/V) function of the peripheral device; direct, based on the identification that the data is related to the A/V function of the peripheral device, the data to be stored in a memory subsystem of the controller subsystem; and facilitate transmission of an indication of a storage location of the data in the memory subsystem to a host system that is communicatively coupled with the controller subsystem. The controller subsystem further includes a graphics engine to: identify, in a message received from the host system based on the transmission of the indication of the storage location of the data, instructions related to rendering the data; and generate, based on the data received from the peripheral device, rendered data. Other embodiments may be described and claimed.