Remote Communication Sight Line Alignment via Face Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote communication technologies face challenges in aligning sight lines between users, making it difficult to achieve smooth communication as they rely on quantitative changes in eye direction, which are not easily quantifiable.

Innovation Solution

An information processing apparatus and method that includes a receiver unit, face detection unit, and superimposition unit to acquire and display the sight line position of a communication partner, allowing for precise alignment of sight lines by detecting face position and size from video signals and superimposing a marker indicating the sight line position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If quantitative changes in eye direction are used to align sight lines, then sight line alignment can be achieved, but it becomes difficult to completely align sight lines because eye direction is not easily quantifiable

Engineering Contradiction:
Improvesight line alignment precisionVSAvoidease of sight line alignment
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical/physical method of adjusting eye direction with an information processing system that detects face positions and calculates sight line directions using video signals and coordinate transformations. This substitution allows for precise digital measurement and adjustment of sight lines without requiring physical eye movement quantification.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary information processing apparatus that acts as a mediator between the two communication terminals. This intermediary calculates sight line directions, performs coordinate transformations, and provides alignment instructions, thereby simplifying the alignment process for users while achieving precise sight line alignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If sight line alignment technology is implemented, then communication smoothness is improved, but the system complexity increases due to the need for face detection and coordinate transformation

Engineering Contradiction:
Improvecommunication smoothnessVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The information processing apparatus performs multiple functions including face detection, sight line direction calculation, coordinate transformation, and alignment instruction generation. By consolidating these functions into a single multi-functional system, the patent reduces overall system complexity compared to having separate systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically detects face positions, calculates sight line directions, and generates alignment instructions without requiring manual user input or configuration. This self-service capability reduces the operational complexity for users while maintaining high communication smoothness.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10136101B2Information processing apparatus, communication system, and information processing method
Publication Date: 2018.11.20 SONY GROUP CORP
  • US10136101B2 patent drawing
  • US10136101B2 patent drawing
  • US10136101B2 patent drawing

AI summary

An information processing apparatus according to the present disclosure includes: a receiver unit that acquires information relevant to a sight line of a user of a communication partner from a communication partner terminal that performs remote communication; a face detection unit that detects information relevant to a position and a size of a face of the user of the communication partner, on the basis of a video signal that includes the face of the user of the communication partner; and a superimposition unit that displays and superimposes a sight line position of the user of the communication partner on the video signal including the face of the user of the communication partner, based on the information relevant to the sight line of the user of the communication partner and the information relevant to the position and the size of the face of the user of the communication partner.