AR Wearable Gaze-Based Interworking With External Input Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to effectively interwork with each other to provide a seamless augmented reality experience, particularly when a wearable device like smart glasses needs input from a separate device such as a smartphone.
Innovation Solution
A first electronic device, like wearable smart glasses, communicates with a second device (e.g., a smartphone) using sensors and cameras to determine user gaze and object recognition, allowing it to use the second device as an input device for augmented reality services based on user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a wearable device provides augmented reality service independently, then the device can function autonomously, but the device lacks input capabilities and user interaction options
Solution Approach 1:
The patent combines the wearable device (first electronic device) with a separate input device (second electronic device) into an integrated system. The wearable device merges AR display functionality with the external device's input capabilities through wireless communication, allowing the user to interact with AR content using the external device's keyboard, touchscreen, or other input mechanisms while maintaining the wearable's portability and autonomous AR rendering ability.
2Ease of operation
If a wearable device includes all input functions, then the device is self-sufficient, but the device size and complexity increase
Solution Approach 1:
The patent extracts the input device functionality from the wearable device and places it in a separate external device (second electronic device). This extraction allows the wearable device to remain lightweight and compact while still providing full input capabilities through the external device. The input functions (keyboard, touchscreen, etc.) are taken out of the wearable device and implemented in the external device that communicates wirelessly with the wearable device.
3Adaptability or versatility
If electronic devices interwork for augmented reality service, then the service functionality is enhanced, but the communication and coordination complexity increases
Solution Approach 1:
The patent implements a universal communication interface between the wearable device and external device that can handle multiple types of interactions (input transmission, AR content sharing, device control). The communication system is designed to be multi-functional, supporting various input methods (keyboard, touchscreen, voice) and various AR service scenarios (gaming, navigation, information display) through a single integrated communication protocol, thereby reducing the need for separate specialized communication systems for each function.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A device and a method of providing an augmented reality service in an electronic device by interworking with another electronic device is provided. A first electronic device includes a communication circuit, a camera, a sensor, a display device, and a processor, the display device, the sensor, and the camera, the processor configured to establish communication with a second electronic device, obtain information on at least one object included in a field of view of a user wearing the first electronic device through the camera or the sensor, obtain information on a user's gaze, determine whether to interwork with the second electronic device for an augmented reality service, based on the information on the user's gaze and the information on the at least one object, and when it is determined to interwork with the second electronic device, transmit interworking information on the augmented reality service to the second electronic device.