Electronic Device Object Interaction via Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices lack the ability to automatically determine the location and orientation of objects in their environment, requiring manual input or dedicated remote controls to interact with surrounding objects and equipment, which can be cumbersome.
Innovation Solution
An electronic device equipped with wireless circuitry, including millimeter wave antenna arrays, wireless local area network antennas, and motion sensors, that uses control circuitry to determine the location and orientation of objects by synthesizing data from cameras, motion sensors, and wireless signals, allowing it to provide information or control functions when pointed at specific objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual input or dedicated remote controls are used to interact with objects, then control functionality is achieved, but ease of operation deteriorates due to cumbersome user interaction
Solution Approach 1:
The electronic device automatically detects objects in the environment using cameras, motion sensors, and wireless signals without requiring manual input from the user. The system self-determines object location, orientation, and identity, then automatically provides information or control functions, making the device serve itself in the interaction process
Solution Approach 2:
The patent replaces manual mechanical interaction (physical remote controls, button presses, and keyboard input) with automated sensing systems including cameras, motion sensors, and wireless signal detection. This substitution eliminates the need for dedicated remote controls by using environmental sensing and automated object recognition
2Adaptability or versatility
If the electronic device is unaware of surrounding objects, then device simplicity is maintained, but adaptability to environment deteriorates
Solution Approach 1:
The electronic device uses a multi-functional sensing system where cameras, motion sensors, and wireless circuitry serve multiple purposes: detecting object location, determining orientation, identifying object types, and enabling both information provision and control functions. This universal sensing approach allows the device to adapt to various environmental interactions without requiring separate dedicated systems
Solution Approach 2:
The sensing system is divided into distinct functional components: camera circuitry for visual detection, motion sensor circuitry for movement detection, and wireless circuitry for signal communication. Each component handles specific aspects of environmental awareness, and their results are synthesized by control circuitry to achieve comprehensive object awareness
3Ease of operation
If automated object detection is implemented, then ease of operation improves, but device complexity increases due to multiple sensors and processing requirements
Solution Approach 1:
The patent combines multiple sensing modalities (camera, motion sensors, wireless signals) and their processing functions into an integrated control system. The control circuitry synthesizes data from all sensing components to determine object location and orientation, merging multiple complex functions into a unified automated interaction system that improves ease of operation
Data Source
AI summary
An electronic device may be provided with control circuitry, wireless transceiver circuitry, and a display. The electronic device may be used to provide information to a user in response to being pointed at a particular object. The control circuitry may determine when the electronic device is pointed at a particular object using wireless control circuitry and/or motion sensor circuitry. In response to determining that the electronic device is pointed at a particular object, the control circuitry may take suitable action. This may include, for example, displaying information about an object when the electronic device is pointed at the object, displaying control icons for electronic equipment when the electronic device is pointed at the electronic equipment, and/or displaying a virtual object when the electronic device is pointed at real world object.