Shadow Image Display for Remote User Presence in Screen Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic conference systems using projectors and cameras, users' images are excluded from the screen when one site enlarges a shared screen, preventing the other site from seeing the user's presence and intended operation targets.

Innovation Solution

An information processing apparatus and method that determines the presence of a user at a position to operate shared content across multiple devices by using a server to calculate and display shadow images of users on the screens, ensuring their visibility even when screen sizes or orientations change.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a site enlarges a shared screen in electronic conference systems, then the content visibility is improved, but user images are excluded from the screen

Engineering Contradiction:
Improvescreen display areaVSAvoiduser presence information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The display screen is segmented into multiple regions: a first region for displaying the enlarged shared content and a second region for displaying the other site's user image. This segmentation allows both the enlarged content and user presence to be visible simultaneously without excluding either.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution transitions from a single-dimensional full-screen display to a two-dimensional multi-region display layout. By utilizing different spatial zones on the screen, the system can accommodate both enlarged content and user images without conflict.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If a site enlarges a shared screen, then the content detail visibility is improved, but the other site cannot see the user's intended operation targets

Engineering Contradiction:
Improvecontent detail visibilityVSAvoidoperation target information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

A shadow image is introduced as an intermediary visual element that represents the other site's user position and intended operation targets. This shadow image is displayed in the first region alongside the enlarged content, allowing both parties to understand each other's focus and intentions without losing detail visibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy (shadow image) of the other site's user position and operation intent, displaying it on the local screen. This copy conveys the remote user's intended targets and actions, enabling coordinated interaction while maintaining enlarged content visibility.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If screen sizes or orientations change, then the display adaptability is improved, but user presence representation accuracy deteriorates

Engineering Contradiction:
Improvedisplay adaptabilityVSAvoiduser presence representation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The display system dynamically adjusts the positioning and scaling of shadow images and content regions based on real-time screen orientation and size changes. This dynamic adaptation maintains the accurate spatial relationship between user positions and their shadow representations regardless of display configuration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters such as shadow image position, size, and placement according to screen orientation and resolution. By adjusting these parameters dynamically, the system preserves the accuracy of user presence representation across different display conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11256466B2Information processing apparatus, information processing method, and recording medium recording information processing program
Publication Date: 2022.02.22 FUJITSU LTD
  • US11256466B2 patent drawing
  • US11256466B2 patent drawing
  • US11256466B2 patent drawing

AI summary

An information processing apparatus includes: a memory; and a processor coupled to the memory and configured to: determine, when a first apparatus displays a part of contents, whether or not a user who operates a second apparatus which is different from the first apparatus is at a position where it is possible to operate the part of the contents among the contents displayed on the first apparatus; and cause the first apparatus to display an image indicating that the user is present at the position where it is possible to operate the part of the contents based on a determination result.