Display and Imaging Elements Integration for Mobile Front Surface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile computing devices face challenges in expanding display area without increasing size, while accommodating a front-facing camera, due to limitations in traditional camera technologies and display resolution.

Innovation Solution

Integration of display and imaging elements within the same area on a mobile device's front surface, using Bayer filters to replace one green subpixel with a photodetector, allowing for both display and image capture functionality without significant size increase, by switching between display and imaging modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a traditional front-facing camera is added to a smartphone, then image capture functionality is achieved, but the display area is reduced

Engineering Contradiction:
Improveimage capture functionalityVSAvoiddisplay area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent merges the display and camera functions into a single integrated structure by incorporating imaging elements (photodetectors) within the display area. The display panel includes both display pixels and imaging pixels distributed across the same surface, allowing the display to simultaneously serve as both a visual output device and an image capture sensor, thereby eliminating the need for a separate front-facing camera module.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display panel is designed to perform multiple functions: it serves as both a display device for showing information and as an imaging device for capturing images. By integrating photodetectors alongside display pixels, the same physical area becomes universal, capable of both emitting light for display and detecting light for image capture, thus maximizing space utilization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Area of stationary object

If the display area is expanded without increasing smartphone size, then screen real estate increases, but space for camera components is reduced

Engineering Contradiction:
Improvedisplay areaVSAvoidcamera component space
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent combines the camera functionality within the display structure itself, eliminating the need for separate camera components. The imaging elements are integrated directly into the display panel layers, allowing the display area to be maximized without requiring additional space for traditional camera modules, lenses, and associated components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging elements are nested within the display panel structure. The photodetectors are positioned in specific layers of the display (such as replacing certain subpixels or positioned in gaps between display elements), effectively hiding the camera functionality within the display itself, similar to a nested doll structure where one function is contained within another.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Area of stationary object

If imaging elements are integrated within the display area, then both display and image capture are achieved in the same space, but manufacturing complexity increases

Engineering Contradiction:
Improvedisplay areaVSAvoidmanufacturing complexity
Core Design Contradiction:
Area of stationary objectVSEase of manufacture

Solution Approach 1:

The patent applies local quality by having different regions of the display panel serve different functions. Certain areas contain display pixels for showing information, while other areas contain imaging pixels for capturing images. The Bayer filter pattern and photodetector placement are optimized for local imaging functionality without compromising the overall display performance, allowing standardized manufacturing processes to be used with localized functional variations.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient use of display area for both image capture and display, reducing processing requirements and maintaining user experience with improved light collection and resolution, compatible with high-performance applications like VR and gaming.

Implementation Method 1

A position of the plurality of pixels is replaced with a photodetector

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11196969B2Image capture display
Publication Date: 2021.12.07 GOOGLE LLC
  • US11196969B2 patent drawing
  • US11196969B2 patent drawing
  • US11196969B2 patent drawing

AI summary

A display that includes a plurality of contiguous pixel areas. Each pixel area is divided into subpixels for displaying and a photodetector for imaging. The display can be configured into a display mode to display information using the subpixels for displaying or an imaging mode to capture image information using the photodetectors for imaging.