3D Shadow Scanning Using Integrated Light and Sensor Pixels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display devices, such as micro-LED and liquid crystal display devices, lack the capability to efficiently capture three-dimensional data of objects by simultaneously illuminating and sensing shadows, limiting their functionality in creating detailed three-dimensional structures.

Innovation Solution

An electronic device comprising a matrix of light emitting elements and image sensing elements on a shared substrate, where the light emitting area is moved to capture shadows and create three-dimensional data by alternately controlling the light emitting and image sensing elements, allowing for adjustable illumination and image sensing based on object structure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If display devices use conventional liquid crystal or organic EL structures, then they achieve basic display functionality, but they cannot efficiently capture three-dimensional data of objects

Engineering Contradiction:
Improvethree-dimensional data capture capabilityVSAvoidfunctionality in creating detailed three-dimensional structures
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The display device integrates both light emitting elements and image sensing elements within the same display area, enabling the device to perform multiple functions: displaying images and capturing three-dimensional shadow data of objects. This multi-functionality resolves the contradiction by making the display device adaptable for both traditional display purposes and advanced 3D measurement applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines light emitting elements and image sensing elements on the same substrate within the display area. This merging of illumination and sensing capabilities into a single integrated structure enables the device to simultaneously emit light for illumination and capture shadow images for three-dimensional data acquisition, thereby improving measurement precision while maintaining display functionality.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If light emitting elements and image sensing elements are arranged on the same substrate in a display area, then three-dimensional data capture capability is improved, but device complexity increases

Engineering Contradiction:
Improveshadow capture capabilityVSAvoidstructure with both light emitting and sensing elements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Each pixel unit in the display device is designed to perform multiple functions: displaying light and sensing shadows. By making each pixel unit universal in its functionality, the patent reduces the need for separate dedicated sensing components, thereby managing device complexity while improving three-dimensional data capture capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The display area is segmented into multiple pixel units, each containing both light emitting and image sensing elements. This segmentation allows for independent control and operation of each pixel unit, enabling flexible scanning patterns and shadow capture strategies that can be optimized for different measurement scenarios, thus managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the light emitting area is moved to scan the object, then detailed three-dimensional data can be captured, but the time required for measurement increases

Engineering Contradiction:
Improvedetail accuracy of three-dimensional dataVSAvoidmeasurement time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The light emitting area scans the object in a periodic manner, systematically moving through different regions of the object in a controlled sequence. This periodic scanning approach allows for efficient data collection by visiting each region at regular intervals, optimizing the balance between measurement detail and time consumption.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary scanning to identify regions of interest or areas requiring higher detail before conducting comprehensive measurements. This preliminary action allows the device to allocate measurement time more efficiently, focusing detailed scanning only where necessary, thereby reducing overall measurement time while maintaining required detail accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the creation of detailed three-dimensional data of objects by capturing shadows generated by the light emitting elements, allowing for flexible scanning and improved data accuracy depending on object complexity, and can be integrated into display devices like smartphones for 3D camera functionality.

Implementation Method 1

LED display devices using light emitting diodes (LEDs) which are self-luminous light emitting elements

Methodology Applied
Scientific EffectLight emitting diode: Light Emitting Diode

Implementation Method 2

capturing a shadow generated by the object by a plurality of image sensing elements

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11683463B2Method for controlling electronic device
Publication Date: 2023.06.20 JAPAN DISPLAY INC
  • US11683463B2 patent drawing
  • US11683463B2 patent drawing
  • US11683463B2 patent drawing

AI summary

According to one embodiment, a method for controlling an electronic device includes illuminating an object while moving a light emitting area formed by turning on light emitting elements simultaneously, capturing a shadow generated by the object by image sensing elements on a same substrate as the light emitting elements, and creating three-dimensional data about an outer shape of the object based on a shadow image.