AR Voice Control With Visual Disambiguation for Device Selection

The patent introduces disambiguating information (such as labels, icons, or highlighted regions) as an intermediary element between the voice command and the target device. This intermediary provides additional identifying characteristics that resolve ambiguity when multiple devices of the same type are present, allowing the system to accurately determine which device the user intends to control without requiring complex disambiguation algorithms.

The patent adds a visual dimension to the voice control interface by displaying disambiguating information overlaid on the user's view of the environment. This creates a multi-modal interface where voice commands are supplemented by visual cues, enabling users to precisely identify and select among multiple devices of the same type through a combination of auditory and visual channels.

The patent segments the display of disambiguating information based on the spatial distribution and type of controllable objects detected in the environment. Rather than uniformly displaying all possible disambiguating information, the system selectively presents only the necessary identifying characteristics for objects that require disambiguation, reducing computational overhead and display complexity while maintaining precision where needed.

The patent implements partial action by providing disambiguating information only when and where it is necessary - specifically when multiple controllable objects of the same type are detected in the user's view. The system avoids excessive action by not displaying disambiguation cues for single objects or objects of different types, thereby optimizing the balance between precision and system complexity.