Pointer-Object Linking for Intuitive Remote Communication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication systems fail to provide an intuitive understanding of objects indicated by communication partners during interactive communication through images, as the pointing direction may deviate due to camera position, leading to unclear identification of the indicated object.
Innovation Solution
An information processing apparatus and method that displays a captured image of the communication partner's space, linking a pointer (such as a fingertip) to the indicated object, allowing for clear visualization of the object being pointed at, even if the pointing direction appears to deviate from the object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a captured image of the communication partner's space is displayed, then remote communication is enabled, but the pointing direction may deviate from the indicated object due to camera position
Solution Approach 1:
An image linking line is introduced as an intermediary visual element that connects the pointer to the indicated object. This mediator compensates for the deviation caused by camera position by explicitly showing the relationship between the pointer and the target object, allowing accurate indication despite the distorted perspective in the captured image.
Solution Approach 2:
The system provides visual feedback by displaying the image linking line that connects the pointer to the indicated object. This feedback mechanism allows the communication partner to verify whether the pointer is correctly indicating the intended object, enabling real-time adjustment and ensuring accurate communication.
2Device complexity
If the captured image is displayed without additional visual aids, then the display is simple, but the object indicated by the pointer is not intuitively recognizable
Solution Approach 1:
The image linking line is displayed with distinct visual characteristics (such as color or line style) that differentiate it from other elements in the captured image. This visual enhancement makes the linking relationship obvious and intuitive, allowing users to easily understand which object is being indicated without adding complex interface elements.
3Productivity
If the pointer position is used directly to indicate the object, then the indication is direct, but the indicated object is unclear when the pointing direction deviates
Solution Approach 1:
The image linking line serves as a mediator that preserves the direct indication relationship while compensating for perspective distortion. It maintains the efficiency of direct pointing by connecting the pointer to the target, while simultaneously preventing information loss by making the indicated object clear and unambiguous despite deviation in the captured image.
Data Source
AI summary
An information processing apparatus, an information processing method, and a program that allow an intuitive grasp of an object indicated by a communication partner in communication through an image are provided. The information processing apparatus includes a control unit that controls interactive communication to display, on a display unit, a captured image of a space on a communication partner side acquired from the communication partner side, the control unit controlling to display an image linking a pointer used by a person on one side to an object indicated by the person.