Gaze Parameter Conversion for Remote Performer Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional communication systems using text and audio fail to replicate the immersive experience of in-person communication, particularly for performers who cannot directly interact with remote viewers, leading to a gap in engagement and reaction awareness.
Innovation Solution
An information processing system that acquires and converts viewer gaze parameters into virtual gaze information, allowing performers to receive real-time feedback on viewer reactions and adjust their performance accordingly, using displays and audio outputs to convey this information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If text and audio information are used as communication means between distributor and viewers, then network communication is achieved, but the immersive communication experience is lost
Solution Approach 1:
The patent introduces gaze tracking technology as an intermediary to capture viewer reactions. Head-mounted displays with gaze trackers serve as mediators between viewers and the distributor, converting physical gaze directions into digital signals that convey viewer engagement and reaction information back to the performer.
Solution Approach 2:
The patent replaces traditional mechanical/text-based communication with optical and electronic systems. Head-mounted displays with gaze tracking sensors substitute for text input mechanisms, enabling non-verbal communication through eye movement detection and converting it into actionable data for the distributor.
2Adaptability or versatility
If viewers are located in remote locations via network, then content distribution is achieved, but direct interaction and gaze awareness are lost
Solution Approach 1:
The patent implements a feedback loop where head-mounted displays capture viewer gaze directions and reaction information, transmit it back to the distributor through the network, and enable the distributor to adjust content delivery in real-time based on this feedback, creating an interactive remote communication system.
Solution Approach 2:
The head-mounted display system serves multiple functions simultaneously: it displays content to the viewer, tracks gaze direction, captures viewer reactions, and communicates this information back to the distributor. This multi-functional device enables comprehensive remote interaction that would otherwise require multiple separate systems.
3Productivity
If performer cannot directly look at viewers in remote locations, then content distribution is enabled, but performance adjustment based on viewer reaction becomes difficult
Solution Approach 1:
The system provides real-time feedback to the distributor about viewer gaze directions and reactions, enabling the distributor to adjust the performed content dynamically. This feedback mechanism allows the performer to modify their delivery based on actual viewer engagement without requiring physical presence.
Solution Approach 2:
The patent enables dynamic adjustment of content delivery based on real-time viewer reactions. The system can adapt the performed content's characteristics, timing, and direction in response to changing gaze patterns and viewer responses, creating a flexible and responsive performance delivery system.
Data Source
AI summary
There is provided an information processing system to cause a performer who appears in content distributed in real time to give a performance according to a viewer's reaction in a remote location. The information processing system includes a control unit. The control unit acquires, from a terminal of a viewer on which content obtained by shooting a performance of a performer is being reproduced via a network in real time, a gaze parameter indicating a gaze of the viewer in a coordinate system of a space in which the viewer is present, the gaze parameter being acquired together with a viewer identification information for identifying the viewer. Moreover, the control unit converts the acquired gaze parameter to a gaze parameter indicating a virtual gaze of the viewer in a coordinate system of a space in which the performer is present. Furthermore, the control unit outputs, on the basis of the converted gaze parameter, gaze information indicating the virtual gaze of the viewer to an output device in the space in which the performer is present.