Cross-Device Content Layout Using 3D Pose and Location Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cross-device interaction technologies face challenges in providing flexible and dynamic device formations that adapt to changing tasks and social situations, particularly in fixed and mobile setups, where devices often remain limited to flat surfaces or hand-held configurations, and sensing device positions in space is difficult.
Innovation Solution
The implementation of semi-fixed cross-device interaction via multiple self-spatially-aware armatures that allow devices to be poseable in 7DoF, enabling dynamic in-air device formations where devices can be easily attached or detached, and their locations and poses are tracked to control content presentation across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If devices are arranged in fixed configurations on flat surfaces, then device stability is improved, but device flexibility and reconfigurability deteriorate
Solution Approach 1:
The system transitions from static fixed configurations to dynamic reconfigurable arrangements. Multiple devices can be freely positioned and repositioned in 3D space, allowing the device formation to adapt dynamically to different tasks and user needs while maintaining stability through software-based spatial awareness and content coordination.
Solution Approach 2:
The patent extends device arrangements from traditional 2D flat surfaces to 3D spatial configurations. Devices can be positioned at different heights, angles, and locations in three-dimensional space, enabling more versatile and adaptive device formations that leverage vertical and angular dimensions beyond simple horizontal placement.
2Ease of operation
If devices are held in hand-held configurations, then device portability is improved, but device stability and precise positioning deteriorate
Solution Approach 1:
The system introduces software-based spatial tracking and coordination mechanisms as intermediaries between the user's manual device handling and the system's content management. Sensors and software track device locations and orientations, enabling precise digital positioning and content coordination even when devices are physically held by users in portable configurations.
3Adaptability or versatility
If multiple devices are coordinated in complex formations, then device versatility is improved, but system complexity deteriorates
Solution Approach 1:
The system implements self-service through automatic spatial awareness and content coordination. Devices automatically track their own positions and orientations, and the system autonomously coordinates content across devices based on their spatial relationships, eliminating the need for manual configuration and reducing system complexity despite supporting versatile multi-device formations.
Solution Approach 2:
The system manages complexity by focusing on key spatial parameters (location, orientation, distance) rather than controlling all possible device attributes. By coordinating devices based on changes in these fundamental spatial parameters, the system achieves versatility in complex formations while maintaining manageable system complexity through parameter-based control.
4Loss of information
If device positions are tracked in 3D space, then device spatial awareness is improved, but sensing difficulty deteriorates
Solution Approach 1:
The system employs multi-functional sensing approaches where devices use their existing cameras, sensors, and communication capabilities for spatial tracking in addition to their primary functions. This universal use of existing components for multiple purposes (communication, display, and spatial sensing) achieves 3D spatial awareness without requiring entirely new sensing systems, thereby reducing sensing difficulty.
Data Source
AI summary
The description relates to cooperatively controlling devices based upon their location and pose. One example can receive first sensor data associated with a first device and second sensor data associated with a second device. This example can analyze the first sensor data and the second sensor data to determine relative locations and poses of the first device relative to the second device and can supply the locations and poses to enable content to be collectively presented across the devices based upon the relative locations and poses.