Pointing Action Unique Markers Multi-User Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-user communication systems, users often face difficulties in pointing to content on displays, especially when they are physically distant from each other, leading to ambiguous interactions and slowed communication processes, particularly with 3D content where pointing can result in incorrect locations for other participants.
Innovation Solution
The system generates unique visual markers for each user's pointing action, detected by processors using depth cameras and body pose recognition, which are displayed on all relevant screens, accompanied by the user's name, image, or video, ensuring all participants can see where the user is pointing, regardless of their location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users physically move closer to the display to point more accurately, then pointing precision is improved, but user comfort and accessibility deteriorate
Solution Approach 1:
The patent introduces an intermediary system consisting of depth cameras, body pose recognition algorithms, and visual markers that mediate between the user's pointing gesture and the display content. This allows users to point from a comfortable distance while the system accurately determines the pointing location through intermediate processing steps including depth estimation and marker generation.
2Adaptability or versatility
If multiple users point simultaneously in a multi-user environment, then interaction capability is improved, but ambiguity in identifying pointing targets increases
Solution Approach 1:
The patent segments the pointing interaction by assigning unique visual markers to each user's pointing action. Instead of treating multiple pointing gestures as a single ambiguous event, the system divides them into distinct, identifiable components with individual markers that include user identification, allowing simultaneous pointing actions to be clearly differentiated and tracked.
Solution Approach 2:
The patent employs visual markers with distinct colors and appearance characteristics to differentiate between multiple users' pointing actions. These colored markers provide immediate visual distinction, allowing participants to easily identify which user is pointing at which location, thereby resolving ambiguity in multi-user environments.
3Measurement precision
If depth cameras and body pose recognition are used to detect pointing actions, then pointing detection accuracy is improved, but system complexity increases
Solution Approach 1:
The patent makes the depth camera system multi-functional by using the same hardware infrastructure for both 3D content display and pointing action detection. The body pose recognition and depth estimation capabilities serve dual purposes: enabling immersive 3D viewing and accurately detecting pointing gestures, thereby reducing overall system complexity despite the advanced detection requirements.
Data Source
AI summary
An example method is provided in according with one implementation of the present disclosure. The method comprises detecting at least one pointing action directed at a display in a multi-user environment, and determining a location of each detected pointing action on the display and a displayed content being pointed to. The method also comprises communicating the location of each pointing action to all displays in the multi-user environment that are displaying the same content, and mapping the location of each pointing action to a local display layout at each of the displays in the multi-user environment that are displaying the same content. The method further comprises generating a unique marker for each pointing action on all displays of the multi-user environment that are displaying the same content, where each unique marker corresponds to the location of each pointing action performed by a different user.