Line of Sight Interactive Object Activation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems are limited in their ability to activate and interact with interactive objects based solely on location and orientation, as they require the user to point a camera directly at the object, which can be inefficient and inaccurate, especially when the user is not looking at the object.

Innovation Solution

A system and method for remotely activating and interacting with interactive objects on a line of sight basis, using a processor-based system that includes modules for user location and orientation, object monitoring, map storage, line-of-sight computation, and activation, allowing for hands-free interaction by determining if the object is within the user's unobstructed line of sight and transitioning the object's state accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If location-based protocols (GPS or Wi-Fi positioning) are used to activate interactive objects, then the system can determine user proximity to objects, but it cannot determine user orientation or whether the user is actually looking at the object

Engineering Contradiction:
Improveuser location accuracyVSAvoiduser orientation information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines location protocols (GPS/Wi-Fi) with camera-based visual tracking to create a hybrid system. The camera captures images of the user's field of view, and image processing algorithms determine both the user's location and orientation by analyzing which interactive objects appear in the camera frame and their relative positions. This merging resolves the contradiction by providing both proximity and orientation information simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a camera as an intermediary device between the user and the interactive objects. The camera serves as a mediator that captures visual information about the user's line of sight, which is then processed to determine orientation. This intermediary enables the system to infer user intent and orientation without directly measuring head or eye position, resolving the information gap left by location-only protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If augmented reality applications require the user to point the camera directly at a point of interest, then the system can accurately identify the object, but the user interaction becomes complex and requires precise manual alignment

Engineering Contradiction:
Improveobject identification accuracyVSAvoiduser interaction simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent implements a system where the interactive objects themselves provide visual markers or identifiers that automatically appear in the augmented reality overlay when within the user's field of view. The system continuously monitors the camera feed and automatically identifies objects without requiring the user to manually aim or point the camera. This self-service approach maintains high identification accuracy while dramatically simplifying user interaction to merely looking at the object.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent pre-processes and stores information about interactive objects, including their locations, visual characteristics, and activation conditions. Before the user even looks at an object, the system has already prepared the data and is ready to immediately recognize and activate the object as soon as it enters the user's field of view. This preliminary preparation eliminates the need for complex real-time manual alignment while maintaining accurate object identification.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If the system activates interactive objects based solely on proximity, then activation can occur without line of sight verification, but information may be provided to users who are not actually interested or receptive to it

Engineering Contradiction:
Improveactivation speedVSAvoiduser interest information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent implements dynamic activation criteria that adapt based on the user's current state. The system continuously monitors whether the user is looking at an interactive object through camera-based line-of-sight detection. Activation only occurs when both proximity and line-of-sight conditions are met, creating a dynamic threshold that responds to real-time user behavior. This resolves the contradiction by maintaining fast activation (when conditions are met) while ensuring information is only provided when the user is actually interested.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback loops where the system continuously monitors user behavior (through camera analysis of field of view) and adjusts activation decisions accordingly. When the user looks at an interactive object, the system detects this through image processing and triggers activation. This feedback mechanism ensures that information is provided only when the user is receptive, resolving the contradiction between fast activation and user interest verification.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8810604B2System and method for activating, actioning and providing feedback on interactive objects within line of sight
Publication Date: 2014.08.19 MASTERCARD INT INC
  • US8810604B2 patent drawing
  • US8810604B2 patent drawing
  • US8810604B2 patent drawing

AI summary

Systems and methods are provided for line of sight, hands free interaction with interactive objects within a defined space on a line of sight basis. The system can include a base station in communication with one or more interactive objects having a variety of display options. Details about the display options are stored on the system along with the location of the interactive objects and layout of the surroundings of the interactive object. Users can carry devices that are in communication with the base station and that determine the user's location and head orientation and relay that information to the base station. Using the location and orientation of the user, the location of the interactive objects and the layout information about the surrounding area, the system can determine if the user is looking directly at an interactive object and can cause the interactive object to perform an action.