Remote Projection Area Designation via Camera-Projector Coordinate Mapping

Solution Overview

Problem

In projection mapping, it is cumbersome to designate and set display areas, especially when the projection target is installed in a high location, as existing technologies require manual operation at the installation site for each image change, leading to inefficiencies and difficulties in reaching the target.

Innovation Solution

An information generation method and system that identifies the correspondence between projector and camera coordinate systems using images projected and taken by a projector and camera, allowing for remote designation of display areas through a touch panel and processing device, enabling the generation of information to project images accurately within the designated area.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual operation is performed at the installation site to designate display area, then the display area can be set accurately, but it becomes cumbersome when projection target is installed in high location and requires repeated visits for image changes

Engineering Contradiction:

Improveease of display area designationVSAvoidtime for setting display area

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent creates a virtual copy of the projection target's display area on a smartphone or tablet screen. The camera captures the actual projection target, and the captured image is displayed on the mobile device, allowing users to designate display areas remotely through touch operations on the screen rather than physically accessing the high-location projection target.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent introduces a mobile device (smartphone or tablet) as an intermediary between the user and the projection target. The mobile device serves as a mediator that captures images of the projection target via its camera and provides a touch interface for designating display areas, eliminating the need for direct physical interaction with the high-location projection target.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If projection image is changed frequently to match events and seasons, then the projection mapping remains relevant and engaging, but the operation of setting display area becomes increasingly cumbersome

Engineering Contradiction:

Improveadaptability of projection imageVSAvoidease of display area setting

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a virtual copy of the projection target's display area on a smartphone or tablet screen. The camera captures the actual projection target, and the captured image is displayed on the mobile device, allowing users to designate display areas remotely through touch operations on the screen rather than physically accessing the high-location projection target.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system allows the mobile device to automatically capture images of the projection target and provide the touch interface for display area designation, making the system self-serving and eliminating the need for repeated physical visits to adjust the projection mapping for different events and seasons.

Inventive Principle:

Principle #25Self-service

3Illumination intensity

If projection target is installed in high location for optimal display, then the projection mapping achieves better visual effect, but user cannot reach the target to perform setting operations

Engineering Contradiction:

Improvevisual effect of projectionVSAvoidaccessibility for setting operation

Core Design Contradiction:

Illumination intensityVSEase of operation

Solution Approach 1:

The patent creates a virtual copy of the projection target's display area on a smartphone or tablet screen. The camera captures the actual projection target, and the captured image is displayed on the mobile device, allowing users to designate display areas remotely through touch operations on the screen rather than physically accessing the high-location projection target.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent introduces a mobile device (smartphone or tablet) as an intermediary between the user and the projection target. The mobile device serves as a mediator that captures images of the projection target via its camera and provides a touch interface for designating display areas, eliminating the need for direct physical interaction with the high-location projection target.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11818516B2Information generation method using projection image and taken image, information generation system, and non-transitory computer-readable storage medium storing program

Publication Date: 2023.11.14 SEIKO EPSON CORP

AI summary

An information generation method including identifying a correspondence relationship between a projector coordinate system and a camera coordinate system, the correspondence relationship identified based on a first image and a second image, the first image projected on a projection target from a projector, and the second image obtained by imaging the projection target using a camera in a state in which the first image is projected on the projection target, displaying, by a display device, a taken image of the projection target which is taken by the camera, receiving a first operation which designates a display area in the camera coordinate system, and generating information for making the projector project a projection image in which a projection object is disposed in the display area designated by the first operation based on the correspondence relationship and information which representing the display area designated by the first operation.