Transparent Display Multi-User Pointing Direction Determination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction display systems face challenges in accurately determining the pointing direction of multiple users interacting with transparent displays, leading to directional confusion and incorrect pairing of human features and touch points, which results in inappropriate display content being shown to users.
Innovation Solution
The proposed solution involves an interaction display method and system that uses image sensing devices and processing devices to extract local and global features, detect projection points, and pair them correctly to determine the pointing direction of operators, ensuring accurate display content alignment with user intentions, even in multi-user scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple users interact with the transparent display simultaneously, then the interaction display system can serve multiple users, but the system cannot correctly pair human features and touch points, causing directional confusion
Solution Approach 1:
The patent segments the pairing process into two distinct stages: first pairing local features (eye features) with global features (body features) to identify users, then pairing projection points with the already-identified global features to determine interaction targets. This segmentation prevents direct confusion between multiple users' features and touch points by establishing an intermediate identification layer.
Solution Approach 2:
The patent introduces global features (body features) as an intermediary element between local features (eye features) and projection points (touch points). This intermediary layer acts as a mediator that correctly associates multiple users' local features with their respective body features, and subsequently links touch points to the correct users, resolving the directional confusion problem.
2Quantity of substance
If the interaction display system detects many human features and touch points from multiple users, then it can capture comprehensive interaction data, but it cannot correctly estimate pointing directions, leading to incorrect display content
Solution Approach 1:
The patent divides the feature pairing process into two separate pairing operations: (1) pairing local features with global features to establish user identity, and (2) pairing projection points with global features to determine interaction intent. This segmentation allows the system to process large quantities of features from multiple users without confusion, as each pairing operation has a clear, specific goal.
Solution Approach 2:
The patent implements a feedback mechanism where the pairing results of local features with global features are used as the basis for the second pairing operation between projection points and global features. This sequential feedback approach ensures that pointing directions are estimated based on correctly identified user-feature associations, improving accuracy even when detecting many features from multiple users.
Data Source
AI summary
An interaction display method and an interaction display system are provided. The interaction display system includes a transparent display and at least one image sensing device. Image data of a plurality of operators is captured by the image sensing device. At least one local feature and at least one global feature of the operators are extracted from the image data, and at least one projection point on a display plane of the transparent display is detected. Each local feature and each global feature are paired. Each projection point and each global feature are paired. According to a pairing result between each local feature and each global feature and a pairing result between each projection point and each global feature, a pointing direction of one of the operators is determined, an interaction continuation operation is performed, and/or notification information is provided.