Eye Contact Simulation in Integrated Interactive Video Spaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current conferencing techniques face limitations in rendering images of users to simulate actual person-to-person interaction and struggle with maintaining eye contact, especially when users move during a session, affecting the realism and engagement of video communication.

Innovation Solution

The implementation of synchronized video cameras across different locations to generate an integrated interactive space, allowing for eye contact simulation and the creation of a virtual shared space for users to interact, using a common coordinate system and eye tracking technology to adjust images and maintain eye contact even when users are not directly facing the camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video cameras at different locations are synchronized to generate an integrated interactive space, then the realism and engagement of video communication is improved, but the device complexity increases

Engineering Contradiction:
Improverealism of video communicationVSAvoidcamera synchronization system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system divides the conferencing environment into multiple segmented video feeds from different camera locations, each captured independently and then synchronized through coordinate system transformations to create the integrated interactive space

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A central processing system acts as an intermediary that receives video feeds from multiple cameras, performs coordinate transformations, and renders the synchronized integrated interactive space, mediating between the complex camera system and the user experience

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If eye tracking technology is used to adjust images and maintain eye contact simulation, then the engagement of video communication is improved, but the manufacturing precision requirements increase

Engineering Contradiction:
Improveeye contact simulationVSAvoideye tracking accuracy
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary coordinate transformations and spatial calibrations during setup to establish accurate reference frames, so that during operation the eye tracking adjustments can be made more easily without requiring extremely high precision during the actual conferencing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts image parameters such as rotation angles and position coordinates based on eye tracking data and camera orientation, allowing flexible compensation for variations in eye contact positioning without requiring fixed high-precision manufacturing

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If a virtual shared space is created for user interaction, then the versatility of the conferencing system is improved, but the device complexity increases

Engineering Contradiction:
Improveinteractive capabilitiesVSAvoidvirtual environment system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual shared space serves multiple functions including displaying video feeds, showing shared content, and enabling interactive elements, allowing a single integrated environment to replace multiple separate conferencing tools and interfaces

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system transitions from traditional two-dimensional video call interfaces to a three-dimensional virtual shared space where users can interact with content and each other in spatial dimensions, adding depth and new interaction modalities to the conferencing experience

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9584766B2Integrated interactive space
Publication Date: 2017.02.28 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9584766B2 patent drawing
  • US9584766B2 patent drawing
  • US9584766B2 patent drawing

AI summary

Techniques for implementing an integrative interactive space are described. In implementations, video cameras that are positioned to capture video at different locations are synchronized such that aspects of the different locations can be used to generate an integrated interactive space. The integrated interactive space can enable users at the different locations to interact, such as via video interaction, audio interaction, and so on. In at least some embodiments, techniques can be implemented to adjust an image of a participant during a video session such that the participant appears to maintain eye contact with other video session participants at other locations. Techniques can also be implemented to provide a virtual shared space that can enable users to interact with the space, and can also enable users to interact with one another and/or objects that are displayed in the virtual shared space.