Remote Dialogue Object Arrangement for Unobstructed Gaze Targets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote dialogue services using communication lines struggle to ensure that each participant's line of sight is directed to the intended gaze object without interference from other objects on the screen, leading to confusion about who the participants are looking at.
Innovation Solution
A terminal apparatus and server system that detects user gaze objects, controls the orientation and arrangement of displayed objects to ensure each participant's line of sight is directed to their intended gaze object and removes any interfering objects, using visible light and depth cameras to generate three-dimensional face objects and control screen arrangements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple objects are displayed on the screen during remote dialogue, then more information is presented, but it becomes difficult to determine which object each participant is gazing at
Solution Approach 1:
The patent applies color changes by displaying avatars with different color tones corresponding to different gaze objects. When a participant gazes at different objects, their avatar's color changes to indicate the gaze target, making it easy to understand who is looking at whom without obscuring any objects
Solution Approach 2:
The patent uses avatar copies that represent participants and display their gaze directions. These avatar copies show the gaze objects without blocking the actual objects being gazed at, thus preserving both the quantity of displayed objects and the clarity of gaze targets
2Quantity of substance
If objects are arranged to show all participants, then completeness of dialogue is maintained, but lines of sight may be blocked by other objects
Solution Approach 1:
The patent uses avatar copies to represent participants and indicate gaze directions. These avatars display the gaze objects without physically blocking the actual objects being gazed at, thus maintaining completeness of participant display while eliminating line of sight obstruction
Solution Approach 2:
The patent uses color changes in avatars to indicate gaze targets. This allows all participants to be displayed while clearly showing which objects each participant is gazing at, without any object blocking another's line of sight
Data Source
AI summary
A method performed by a terminal apparatus configured to communicate with a server, the method includes displaying, on a screen, a plurality of objects including first objects indicating faces of other users who are interlocutors of a user of the terminal apparatus, detecting an object on the screen at which the user is gazing, as the user's gaze object, transmitting information indicating the user's gaze object to the server, receiving information indicating each interlocutor's gaze object from the server, and controlling orientation of each of the first objects and arrangement of the plurality of objects so as to satisfy, on the screen, a first condition that each interlocutor's line of sight is directed to the interlocutor's gaze object, and a second condition that there are no objects, in each interlocutor's the line of sight, other than the interlocutor's gaze object.


