Lid Controller Hub Architecture for Low-Latency Sensor Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing laptops face challenges in efficiently processing sensor data from lid components such as microphones, cameras, and touchscreens due to the need for data transmission across a hinge, leading to latency, power consumption issues, and limited industrial design possibilities.
Innovation Solution
The introduction of a lid controller hub that processes sensor data locally in the lid, synchronizing with the display's refresh rate and utilizing neural network accelerators for enhanced features like Wake on Voice and Face ID, while reducing power consumption and enabling improved industrial design.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If sensor data is processed at the base after transmission across the hinge, then the laptop can use existing computing resources, but latency increases and power consumption increases
Solution Approach 1:
The system divides the processing function into two segments: a lid controller hub in the lid that handles initial sensor data processing locally, and a base processor that handles higher-level processing. This segmentation allows low-latency local processing while utilizing the base processor for comprehensive computation, resolving the contradiction between processing capability and transmission latency.
Solution Approach 2:
The lid controller hub acts as an intermediary component between the lid sensors and the base processor. It receives sensor data, performs initial processing, and then transmits only necessary information to the base processor. This intermediary approach reduces the data transmission burden and latency while maintaining processing functionality.
2Extent of automation
If sensor data is transmitted across the hinge to the base for processing, then existing computing resources can be utilized, but power consumption increases
Solution Approach 1:
The processing function is segmented between the lid controller hub and base processor. The lid hub handles power-intensive initial processing locally, reducing the amount of data that needs to be transmitted across the hinge to the base. This segmentation reduces overall power consumption while maintaining processing capabilities.
Solution Approach 2:
The lid controller hub serves as an intermediary that performs preliminary processing of sensor data locally, filtering and preparing data before transmission to the base processor. This intermediary processing reduces the data volume and energy required for transmission across the hinge, thereby reducing overall power consumption.
3Ease of operation
If wires are routed across the hinge to connect lid sensors to the base, then sensor data can be transmitted, but industrial design possibilities are limited
Solution Approach 1:
The lid controller hub extracts the sensor data processing function from the base and places it in the lid, eliminating the need for extensive wire routing across the hinge. By taking out the processing capability to the lid, the design achieves cleaner aesthetics and greater industrial design flexibility while maintaining data transmission functionality.
Solution Approach 2:
The lid controller hub acts as an intermediary that consolidates sensor data processing in the lid, reducing the number of wires that need to cross the hinge. This intermediary component enables simpler wire routing and greater design flexibility while maintaining comprehensive sensor connectivity.
4Ease of operation
If touch sensor data is sampled independently from display refresh rate, then touch responsiveness can be maintained, but synchronization with display updates is lost
Solution Approach 1:
The system dynamically synchronizes touch sampling with display refresh rate through the lid controller hub. The hub adjusts touch sampling timing to coincide with display updates, creating a coordinated system where both touch and display operate in sync. This dynamic synchronization maintains both responsiveness and stability.
Solution Approach 2:
The lid controller hub implements feedback mechanisms to synchronize touch sampling with display refresh rate. By monitoring display timing and adjusting touch sampling accordingly, the system maintains synchronization between the two functions while preserving touch responsiveness through coordinated operation.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A lid controller hub (LCH) comprising processing components located in the lid of a mobile computing device, such as a laptop, processes sensor data generated by input sensors (microphones, cameras, touchscreen) and provides for improved and enhanced experiences over existing devices. For example, the LCH provides hardened privacy and the synchronization of touch display activities with the display refresh rate, the latter providing for a smoother and more responsive touch experience over existing designs. The LCH enables continuous gestures comprising touch gesture and in-air gesture portions as well as multi-plane gestures in which an initial touch gesture places the device into a mode or context in which it recognizes and acts upon subsequent in-air gestures. Touch operations of a mobile computing device can be based on user presence, user engagement, and a level of user interaction with the device.