Laser Pointer Position Recognition for Projection Image Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projector systems require users to operate input devices like mice to perform operations on projection images, leading to process delays and limited intuitive interaction with objects within the projection image, especially when the user is near the screen.

Innovation Solution

An information processing apparatus and method that allows intuitive operation inputs to objects within a projection image by using a laser pointer, which includes a visible light imaging unit in the projector to recognize the laser pointer's position and transmit movement information for real-time object manipulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a mouse or input device is used to operate objects in the projection image, then operation precision is improved, but process delay increases and ease of operation deteriorates when the user is near the screen

Engineering Contradiction:
Improveoperation precisionVSAvoidprocess delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical mouse operation system with an optical laser pointer system. The projector captures the laser pointer's position on the projection screen and converts it into operation coordinates, eliminating the need for physical mouse movement and reducing process delay. The visible light imaging unit detects the laser pointer's position in real-time, providing immediate response without the mechanical delays of traditional input devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces the projection screen and visible light imaging unit as intermediaries between the user and the computer system. The laser pointer serves as a mediator that the user can see and control on the projection screen, while the imaging unit captures this visual information and translates it into operational commands, creating a direct visual-feedback control loop that reduces delay and improves intuitiveness.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a mouse or input device is used to operate objects in the projection image, then operation precision is improved, but ease of operation deteriorates when the user is near the screen

Engineering Contradiction:
Improveoperation precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical mouse operation system with an optical laser pointer system. The projector captures the laser pointer's position on the projection screen and converts it into operation coordinates, eliminating the need for physical mouse movement and reducing process delay. The visible light imaging unit detects the laser pointer's position in real-time, providing immediate response without the mechanical delays of traditional input devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses the projection screen itself as the operation interface. The laser pointer's position on the screen directly corresponds to the operation coordinates, and the imaging unit automatically captures and processes this information. This self-service approach eliminates the need for separate input devices and makes the operation intuitive and easy to perform when the user is near the screen.

Inventive Principle:
Principle #25Self-service

3Device complexity

If laser pointer position is recognized based only on captured image data, then device complexity is reduced, but measurement precision deteriorates under varying brightness conditions

Engineering Contradiction:
Improvedevice complexityVSAvoidirradiation position detection precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by setting the laser pointer detection threshold before the projection operation begins. The threshold is determined based on the ambient light conditions and projection brightness, allowing the system to accurately detect the laser pointer's position even when brightness conditions change during operation. This pre-calibration ensures consistent detection precision without requiring complex real-time adjustments.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless and intuitive operation of objects within a projection image using a laser pointer, reducing process delays and allowing for more natural interaction with projected content.

Implementation Method 1

a visible light imaging unit (13v) which performs visible light imaging for a projection image

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3015961B1Information processing device, control method, program, and storage medium
Publication Date: 2021.07.14 SONY GROUP CORP
  • EP3015961B1 patent drawingFigure 1
  • EP3015961B1 patent drawingFigure 2
  • EP3015961B1 patent drawingFigure 3

AI summary

[Object] To provide an information processing apparatus, control method, program, and storage medium capable of intuitively performing an operation input to an object within a projection image by moving a laser pointer. [Solution] There is provided an information processing apparatus including: a recognition unit which recognizes an irradiation position of laser light by a laser pointer to a projection image; an acquisition unit which acquires movement information of the laser pointer; and an output unit which outputs a control signal for causing display of an object within a projection image corresponding to the irradiation position to be changed in accordance with the movement information.