Mixed Environment Display for IoT Control via Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Internet-connected devices often lack user-friendly interfaces, particularly for managing multiple devices, as they typically rely on Web-based solutions that require users to maintain Web address records and navigate independently, leading to a suboptimal user experience due to the absence of display screens and touch screens, which are costly but provide better interaction.
Innovation Solution
A mixed environment display system that allows users to interact with remote devices using a first computing device, which captures and analyzes gestures to perform actions, displaying graphical elements with real-world views of objects, enabling users to control and receive status data from second computing devices through a transparent hardware display surface, facilitating easier management of multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If Web-based interface solutions are used to control Internet-connected devices, then device cost is reduced, but user experience deteriorates due to difficulty in managing multiple devices and lack of intuitive interaction
Solution Approach 1:
The patent introduces a camera as an intermediary tool that captures images of physical devices, bridging the gap between physical objects and their digital controls. The camera enables users to point at and select devices in the physical world, which are then displayed and controlled through a computing device, eliminating the need to manually navigate through web addresses while maintaining low device costs.
Solution Approach 2:
The patent creates visual copies of physical devices by capturing their images with a camera. These copied images are then displayed on a computing device screen, allowing users to interact with familiar visual representations of the devices rather than abstract web interfaces. This copying approach maintains simplicity while improving usability for managing multiple devices.
2Ease of operation
If display screens and touch screens are installed in Internet-connected devices, then user interaction improves, but device cost increases
Solution Approach 1:
The camera acts as an intermediary input device that enables intuitive interaction without requiring expensive display screens or touch screens on the Internet-connected devices themselves. Users interact through the camera and computing device interface, achieving good user interaction while keeping the Internet-connected devices simple and low-cost.
Solution Approach 2:
The patent replaces the need for mechanical display screens and touch interfaces on Internet-connected devices with a camera-based visual selection system. Instead of physical interaction surfaces on each device, the system uses image capture and digital display to enable interaction, substituting expensive hardware components with a software-based solution.
3Device complexity
If users manually navigate through Web addresses to access each device, then device complexity is reduced, but time consumption increases when managing multiple devices
Solution Approach 1:
The system performs preliminary action by capturing images of devices and preparing their visual representations in advance. When a user needs to access a device, the pre-captured images are already available for immediate selection and control, eliminating the time-consuming process of manually navigating through web addresses while maintaining simple device architecture.
Solution Approach 2:
The patent creates visual copies of devices that can be quickly selected and accessed without manual navigation. These copied images serve as direct access points to device controls, significantly reducing the time required to manage multiple devices while keeping the underlying device architecture simple and unchanged.
Data Source
AI summary
Technologies described herein provide a mixed environment display of attached control elements. The techniques disclosed herein enable users of a first computing device to interact with a remote computing device configured to control an object, such as a light, appliance, or any other suitable object. Configurations disclosed herein enable the first computing device to cause one or more actions, such as a selection of the object or the display of a user interface, by capturing and analyzing input data defining the performance of one or more gestures, such as a user looking at the object controlled by the second computing device. Rendered graphical elements configured to enable the control of the object can be displayed with a real-world view of the object.