Pointing Object Detection in Video Conferencing Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In television conference systems, users face labor-intensive tasks when trying to point to arbitrary positions on image information for other users, as existing systems lack efficient methods to indicate or display pointing positions.

Innovation Solution

An information processing apparatus with a detecting unit to identify pointing objects in captured images and generate pointing information, which is then used to superimpose a pointing image on a display screen, allowing for easy identification of pointing positions across user terminals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user manually operates a user terminal to display a marker or notify by audio sound to point to an arbitrary position on image information, then the pointing position can be indicated for other users, but the user has to take labor and the operation becomes complex

Engineering Contradiction:
Improveease of pointing operationVSAvoidoperation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables users to point to arbitrary positions on image information simply by moving their hands in the captured image, without requiring manual operation of the user terminal. The hand movement detection unit automatically detects the user's hand movement and converts it into pointing information, allowing the system to serve itself rather than requiring complex user operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical system of manual terminal operation with an optical/image-based detection system. Instead of requiring users to physically operate the terminal interface, the system captures images, detects hand movements within those images, and automatically generates pointing information, substituting mechanical interaction with image processing and computer vision techniques.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If existing systems transmit and receive images and audio sounds between distant user terminals, then communication is enabled, but there is no efficient method to indicate or display pointing positions

Engineering Contradiction:
Improvepointing indication capabilityVSAvoidpointing position information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent adds a new dimension to the communication system by superimposing pointing images onto the displayed image information. Instead of merely transmitting audio or text pointers, the system creates a visual overlay dimension that shows the user's hand position and pointing direction directly on the image content, providing intuitive spatial information about where the user is pointing.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The pointing image serves as an intermediary element between the user's hand movement and the final pointing position indication. The superimposed pointing image visually mediates the connection between the user's physical gesture in the captured image and the corresponding position on the displayed image information, making the pointing action transparent and understandable to other users.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9860484B2Information processing apparatus, information processing system and information processing method
Publication Date: 2018.01.02 SATURN LICENSING LLC
  • US9860484B2 patent drawing
  • US9860484B2 patent drawing
  • US9860484B2 patent drawing

AI summary

An information processing apparatus may include a detecting unit to detect a pointing object in a captured image, and a generation unit to generate pointing information based on detection of the pointing object by the detecting unit. The pointing information may indicate a position of the pointing object determined using a pointable range set based on a user in the captured image. The apparatus may further include a communication unit to transmit the pointing information to an external apparatus.