Remote Collaboration Image Adaptation via Virtual Position Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing communication technologies for remote collaboration, such as video conferencing, do not effectively adapt the display of an operation body's image in real-time based on the operation's location, leading to inefficiencies and discomfort during remote interactions.

Innovation Solution

An information processing system that acquires transmission information from an operation body's location and displays an image corresponding to the operation body's pointing position and virtual position at another location, reducing unnecessary information transmission and enhancing the realism of remote interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional video conferencing technology is used to transmit operation body images, then communication between remote places is enabled, but unnecessary information is transmitted and the realism of remote interactions is reduced

Engineering Contradiction:
Improveinformation transmission efficiencyVSAvoidadaptability of display to operation location
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent extracts only the essential information needed for remote collaboration - specifically the pointing position and virtual position of the operation body - from the complete video feed. By transmitting only these critical coordinates rather than full operation body images, the system reduces information transmission overhead while maintaining the ability to reconstruct realistic remote interactions at the display location.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by adapting the displayed operation body image to the specific characteristics of each display location. The system calculates virtual positions that account for the geometric relationship between the operation body's actual location and the display location, ensuring that the displayed image naturally conforms to the local display environment rather than using a uniform transmission approach.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If full operation body images are transmitted for remote collaboration, then realism of interactions is improved, but information transmission volume increases

Engineering Contradiction:
Improverealism of remote interactionsVSAvoidinformation transmission volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

Instead of transmitting actual operation body images, the patent creates a virtual copy by calculating the operation body's position relative to the display location. This virtual position copying approach reconstructs the essential spatial relationships needed for realism without transmitting the full visual information, thereby maintaining interaction authenticity while minimizing data transmission volume.

Inventive Principle:
Principle #26Copying

3Device complexity

If operation body images are displayed without adapting to display location, then system complexity is reduced, but user concentration and understanding deteriorate

Engineering Contradiction:
Improvesystem complexityVSAvoiduser concentration and understanding
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent performs preliminary calculations of the virtual position and pointing position relationships before displaying the operation body image. By pre-computing the geometric transformations needed to adapt images to different display locations, the system maintains ease of operation and user understanding without requiring complex real-time processing during the actual display phase.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11703941B2Information processing system, information processing method, and program
Publication Date: 2023.07.18 SONY GROUP CORP
  • US11703941B2 patent drawing
  • US11703941B2 patent drawing
  • US11703941B2 patent drawing

AI summary

There is provided an information processing system, method, and program capable of displaying an image corresponding to an operation body in a certain place adaptively generated for an operation of the operation body in another place, the system including an information acquisition unit configured to acquire first transmission information according to an operation of an operation body related to a first user located in a first place, the first transmission information being for communication with a second user located in a second place, and an output control unit configured to display, on a display surface in the second place, an image corresponding to the operation body generated based on a pointing position of the operation body in the second place and a first virtual position of the first user in the second place, the pointing position and the first virtual position being specified based on the first transmission information.