Integrated Projector Camera for Interactive Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display technologies, such as projectors used in game machines and media players, lack the ability to perform intuitive operations on projected images due to separate camera and projector setups, leading to calibration issues and non-interactive experiences, as they only offer image projection without touch detection or image recognition functions.

Innovation Solution

A display apparatus with integrated illumination units for image projection, position detection, and image recognition, utilizing a single device that projects images, detects positions, and recognizes objects on a projection plane using distinct illumination wavelengths, allowing for simultaneous image projection and interactive touch-like operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If separate camera and projector setups are used for image projection and detection, then image projection function is achieved, but calibration issues occur and interactive operations become difficult

Engineering Contradiction:
Improveinteractive operationVSAvoidposition detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines the projector and camera into a single integrated device, merging the image projection function and detection function into one unit. This eliminates the calibration issues between separate devices and enables direct interactive operations on the projected image, as the camera and projector share the same optical path and coordinate system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The projector is designed to perform multiple functions: image projection, position detection, and image recognition. By integrating the camera within the projector body and sharing optical components, the device achieves multi-functionality, allowing users to interact with projected images through touch-like operations while maintaining accurate position detection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple separate devices are used for image projection, position detection, and image recognition, then each function can be optimized independently, but device complexity increases and calibration becomes difficult

Engineering Contradiction:
Improvedetection functionVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges image projection, position detection, and image recognition functions into a single integrated projector device. The camera is positioned within the projector body, and both devices share common optical components such as the projection lens, reducing overall system complexity while maintaining full functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The projector is designed as a universal device that performs multiple functions: projecting images, detecting touch positions, and recognizing images. This multi-functionality is achieved by integrating the camera and sharing optical paths, allowing one device to replace what would traditionally require multiple separate devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If separate camera and projector are used, then each device can be optimized for its specific function, but the gap between projected and recognized images increases

Engineering Contradiction:
Improveimage recognition accuracyVSAvoidcalibration requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

By integrating the camera within the projector body and aligning their optical paths, the patent eliminates the spatial gap between projected and recognized images. The camera captures images from the same perspective as the projector displays them, ensuring accurate position detection and recognition without requiring complex calibration procedures.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and interactive operations on projected images by combining image projection, position detection, and image recognition within a single device, reducing calibration needs and enhancing user experience by eliminating the gap between projected and recognized images.

Implementation Method 1

an imaging device disposed at an optically conjugate position with the light valve

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10671221B2Display apparatus with detection function
Publication Date: 2020.06.02 SONY GROUP CORP
  • US10671221B2 patent drawing
  • US10671221B2 patent drawing
  • US10671221B2 patent drawing

AI summary

A display apparatus with detection function of the present disclosure includes a first illumination unit that outputs first illumination light, a light valve that generates image light by modulating the first illumination light on the basis of image data, a projection optical system that projects the image light onto a projection plane, a second illumination unit that outputs second illumination light used for position detection of a position detection object on the projection plane, a third illumination unit that outputs third illumination light used for image recognition of an image recognition object on the projection plane, an imaging unit where the second illumination light and the third illumination light enter through the projection optical system, and includes an imaging device disposed at an optically conjugate position with the light valve, and an image processing unit that performs position detection of the position detection object and image recognition of the image recognition object on the basis of a result of imaging by the imaging unit.