XR Gesture Buffering for Fast and Accurate Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to provide seamless augmented and virtual reality experiences by accurately capturing and responding to user gestures in real-time, leading to suboptimal interaction and engagement.
Innovation Solution
An electronic device equipped with sensors, perception modules, and a service module that processes and stores gesture information over time intervals, enabling enhanced interaction with extended reality services by integrating user gestures through a sensor management and perception module interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If gesture information is processed in real-time only when requested, then response speed improves, but gesture recognition accuracy deteriorates
Solution Approach 1:
The system performs preliminary processing by storing raw sensor data and extracted gesture information in buffers during time intervals before any request occurs. This allows the data to be ready for immediate retrieval and processing when a request is made, achieving both real-time responsiveness and accurate gesture recognition through pre-computation and data preparation.
2Measurement precision
If all gesture data is stored continuously, then gesture recognition accuracy improves, but memory usage increases
Solution Approach 1:
The system extracts only the essential gesture information from raw sensor data and stores it separately in a buffer. By taking out only the relevant gesture characteristics rather than storing all raw sensor data continuously, the system maintains accurate gesture recognition while significantly reducing memory consumption compared to continuous full-data storage.
3Measurement precision
If multiple perception modules process data simultaneously, then gesture recognition accuracy improves, but device complexity increases
Solution Approach 1:
The system segments the perception architecture into distinct modules: sensor management module for data acquisition, multiple perception modules for parallel gesture analysis, and service module for result integration. This segmentation allows multiple perception modules to work simultaneously on different aspects of gesture recognition, improving accuracy while managing complexity through clear modular boundaries and defined interfaces.
Data Source
AI summary
A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions which, when executed by a processor of an electronic device with memory and at least one sensor, cause the electronic device to perform operations is provided. The operations include obtaining, through a sensor management module, data obtained using the at least one sensor in a first time interval, providing, to at least one perception module among a plurality of perception modules, the data through an interface configured for the plurality of perception modules, storing, through a service module, first gesture information of a user of the electronic device in the first time interval, obtained using the at least one perception module based on the data, after the first gesture information is stored, obtaining second gesture information in a second time interval after the first time interval, based on a request for gesture information of the user received from an application for an extended reality (XR) service provided to the user, and providing the XR service through the application based on the first gesture information and the second gesture information.