Wearable 3D User Model Augmentation via External Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable device systems, such as head-mounted displays (HMDs), struggle to generate or update a comprehensive 3D user model as they often lack data from external sources, resulting in incomplete or inaccurate representations due to limited perspectives and missing body parts.
Innovation Solution
The integration of data from external devices, like cameras and sensors, to supplement wearable device data, enabling a more accurate and complete 3D user model by providing differing perspective views and additional features like body dimensions, skin texture, and clothing information, which can be matched and combined with wearable device data to update the user model.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If wearable device sensors are used to generate user models, then the system can operate autonomously without external dependencies, but the model accuracy and completeness deteriorate due to limited perspectives
Solution Approach 1:
The patent combines data from multiple external devices (smartphones, tablets, laptops, cameras) with wearable device data to create a comprehensive user model. The system merges sensor data from different sources including visual data, body dimensions, body shape, skin texture, and clothing information to improve model accuracy while maintaining wearable device autonomy through selective data integration.
Solution Approach 2:
The wearable device acts as an intermediary that receives, processes, and integrates data from external devices. It selectively incorporates external sensor data while maintaining its own autonomous operation, serving as a mediator between external data sources and the user model generation process without requiring direct external device control.
2Loss of information
If data from multiple external devices is integrated, then the completeness of user model data improves, but the data processing complexity increases
Solution Approach 1:
The patent segments the data processing task by organizing external device data into distinct categories (visual data, body dimensions, body shape, skin texture, clothing information). Each data type is processed and integrated separately, allowing the system to manage complexity through structured organization while maintaining comprehensive data coverage from multiple external sources.
3Measurement precision
If external device data is used to supplement wearable device data, then the representation accuracy of unobserved body parts improves, but the system dependency on external sources increases
Solution Approach 1:
The system uses partial external device data selectively to improve specific aspects of the user model such as unobserved body parts, skin texture, and clothing details. Rather than requiring complete external data, the system incorporates only the necessary partial data from external sources to address specific modeling needs, maintaining system independence while improving representation accuracy where needed.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that use external device data to improve user data on a wearable device. For example, an example process may include receiving first sensor data, from a sensor of a wearable electronic device, depicting a user of the wearable electronic device. The process may further include receiving second sensor data depicting the user from a second device separate from the wearable electronic device. At least a part of the user depicted in the second sensor data is absent in the first sensor data. The process may further include determining that a portion of the second sensor data depicts the user based on a similarity between the first sensor data and second sensor data. The process may further include updating a user model based on the second sensor data.