Illumination Control for Position Detection and Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Display apparatuses with detection functions face challenges in accurately switching between position detection and image recognition illumination lights due to system latency, leading to increased waiting times and reduced real-time properties, and existing solutions either complicate the apparatus with multiple imaging devices or reduce image resolution.

Innovation Solution

An image processing apparatus with a position detection illumination unit, image recognition illumination unit, illumination control unit, and imaging unit that controls the timing of these lights based on luminance information from captured images, allowing for separate and timely output of position detection and image recognition illumination, without the need for multiple imaging devices, and maintaining image resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the display apparatus switches between position detection illumination light and image recognition illumination light based on predetermined timing, then the system can perform both functions, but system latency causes inaccurate switching timing and increased waiting time

Engineering Contradiction:
Improvewaiting timeVSAvoidswitching timing accuracy
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The imaging unit continuously captures images and the image processing unit analyzes luminance information in real-time to detect when illumination light should be switched. This feedback mechanism replaces predetermined timing with actual detected timing, eliminating system latency issues and ensuring accurate switching without increasing waiting time.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The imaging unit continuously images the projection surface even before illumination light is emitted, so that when illumination light needs to be switched, the system already has current image data ready. This preliminary action allows immediate detection of luminance changes without waiting for predetermined timing cycles.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple imaging devices are used to perform position detection and image recognition simultaneously, then real-time properties improve, but the apparatus complexity increases

Engineering Contradiction:
Improvereal-time processing capabilityVSAvoidnumber of imaging devices
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

A single imaging unit performs both position detection and image recognition functions by capturing images under different illumination conditions. The imaging unit alternates between receiving position detection illumination light and image recognition illumination light, eliminating the need for multiple imaging devices while maintaining real-time processing capability through continuous imaging and analysis.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The imaging unit continuously captures images at regular intervals, and the illumination control unit periodically switches between position detection illumination light and image recognition illumination light. This periodic action allows a single imaging device to efficiently handle both functions in real-time by processing images in alternating sequences without loss of temporal resolution.

Inventive Principle:
Principle #19Periodic action

3Device complexity

If a single imaging device is used for both position detection and image recognition, then device complexity is reduced, but image resolution may be compromised

Engineering Contradiction:
Improvenumber of imaging devicesVSAvoidimage resolution
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The imaging unit captures images with higher resolution than strictly necessary for either function alone, and the image processing unit selectively processes only the portions needed for position detection or image recognition at any given time. This partial action approach maintains full image quality while using a single imaging device, as the complete image data is retained for both purposes.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11429229B2Image processing apparatus and display apparatus with detection function
Publication Date: 2022.08.30 SONY GROUP CORP
  • US11429229B2 patent drawing
  • US11429229B2 patent drawing
  • US11429229B2 patent drawing

AI summary

An image processing apparatus according to the present disclosure includes: a position detection illumination unit; an image recognition illumination unit; an illumination control unit; an imaging unit; and an image processing unit. The position detection illumination unit outputs position detection illumination light. The position detection illumination light is used for position detection on a position detection object. The image recognition illumination unit outputs image recognition illumination light. The image recognition illumination light is used for image recognition on an image recognition object. The illumination control unit controls the position detection illumination unit and the image recognition illumination unit to cause the position detection illumination light and the image recognition illumination light to be outputted at timings different from each other. The position detection illumination light and the image recognition illumination light enter the imaging unit at timings different from each other. The image processing unit determines switching between the position detection illumination light and the image recognition illumination light on the basis of luminance information regarding a captured image by the imaging unit. The image processing unit performs position detection on the position detection object on the basis of an imaging result of the imaging unit with the position detection illumination light switched on and performs image recognition on the image recognition object on the basis of an imaging result of the imaging unit with the image recognition illumination light switched on.