Display Camera Sensor Array Obstruction Handling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Display cameras struggle to capture undisturbed images when used concurrently with touch-sensitive displays, as user interactions often obstruct image sensors or require adjusting settings during image capture, leading to suboptimal image quality and user experience.

Innovation Solution

An integrated user interface unit with an image sensor array and a touch sensor, where the processor controls the activation, size, and number of image sensors based on touch or proximity, allowing for adaptive image capture and processing using super-resolution algorithms to form high-quality images despite obstructions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the display camera allows concurrent camera operation and touch display input, then user productivity and ease of operation are improved, but image quality deteriorates due to obstructions from user interactions

Engineering Contradiction:
Improveconcurrent operation capabilityVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The image sensor array is divided into multiple independently controllable image sensors, allowing selective activation of only those sensors not obstructed by user interactions. This segmentation enables the system to maintain high image quality by using only clear sensor data while preserving concurrent operation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts which image sensors are active based on real-time detection of obstructions from user interactions. The processor continuously monitors touch input locations and activates/disables image sensors accordingly, allowing the system to adapt to changing usage conditions and maintain image quality during concurrent operations.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If multiple image sensors are activated for concurrent operations, then device versatility is improved, but device complexity increases due to dynamic sensor configuration management

Engineering Contradiction:
Improveconcurrent operation supportVSAvoidsensor configuration management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses the touch sensor to automatically detect obstructions and the processor to automatically determine which image sensors to activate, eliminating the need for manual configuration. The system serves itself by using its own sensor data to make intelligent decisions about image sensor activation, reducing operational complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop where touch sensor input is continuously monitored, obstruction detection results feed into processor decisions about image sensor activation, and the outcome is reflected in the final image quality. This automated feedback mechanism simplifies the management of multiple image sensors during concurrent operations.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9723205B2Display camera operation
Publication Date: 2017.08.01 NOKIA TECHNOLOGIES OY
  • US9723205B2 patent drawing
  • US9723205B2 patent drawing
  • US9723205B2 patent drawing

AI summary

An apparatus including a processor and a user interface unit including a displaying surface (220) and an image sensor array (240) integrated therewith. The image sensor array includes a group of image sensors (340a, 340b, 340c), each image sensor being configured for capturing an image. A first image is captured with each active image sensor of the group of image sensors, a number of images is chosen from the first images and a second image is formed from the chosen images.