Electronic Device Camera Boundary Marker Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with cameras face challenges in capturing image data that includes additional information beyond a single image frame, particularly when dealing with display content and background scenes, as existing image sensors may not be able to capture a full image at one exact point in time, leading to incomplete data retrieval.

Innovation Solution

The method involves an electronic device capturing image data using a camera with an image sensor, where the device adjusts its field of view and lens position to include both display content and background scenes, and uses boundary markers embedded in the display content to determine and modify the image data, allowing for the generation of a complete image frame by combining multiple frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the image sensor captures a full pixel array at a single point in time, then the frame rate is maintained, but the captured image frame does not include additional information for subsequent handling of the captured image data

Engineering Contradiction:
Improveinformation completenessVSAvoidframe rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent segments the image capture process into multiple sequential captures of different regions (display content region and background scene region) rather than attempting to capture the entire field of view simultaneously. This allows comprehensive information collection while maintaining acceptable frame rates by processing regions separately.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by capturing the display content region first, then using that information to guide subsequent capture of the background scene region. This sequential approach ensures that boundary markers are identified and used to determine the extent of background capture needed, preventing information loss while optimizing the capture process.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the electronic device adjusts field of view and lens position to include both display content and background scenes, then complete image data is captured, but the device complexity increases

Engineering Contradiction:
Improveimage data completenessVSAvoidfield of view adjustment mechanism
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The electronic device performs self-service by using its own captured image data to identify boundary markers and automatically determine the extent of background scene capture needed. The processor analyzes the captured frames, detects boundary markers, and autonomously adjusts subsequent capture parameters without external intervention, reducing operational complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements feedback by using the captured display content and identified boundary markers to inform and adjust the subsequent background scene capture process. The system continuously monitors captured data, identifies boundaries, and uses this information to optimize future capture operations, creating a closed-loop system that reduces complexity through intelligent adaptation.

Inventive Principle:
Principle #23Feedback

3Productivity

If the image sensor cannot capture a full image at once, then the frame rate is maintained, but incomplete data retrieval occurs

Engineering Contradiction:
Improveframe rateVSAvoiddata retrieval completeness
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent maintains continuity of useful action by seamlessly transitioning between capturing the display content region and the background scene region. Rather than interrupting the capture process, the system continuously accumulates useful image data across multiple sequential captures, ensuring complete data retrieval while maintaining high frame rates through efficient processing.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent applies dynamics by making the capture process adaptive and flexible. The system dynamically adjusts the capture sequence based on identified boundary markers, optimizing the balance between frame rate and data completeness. This dynamic approach allows the system to respond to different scene configurations while maintaining efficient operation.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the electronic device to capture and process image data that includes both display content and background scenes effectively, providing a complete and accurate representation of the field of view, even when the image sensor cannot capture a full image at once, by using boundary markers to define the image boundaries and modify the data accordingly.

Implementation Method 1

The electronic device may capture image data by detecting light incident on an image sensor and converting the detected light into electrical signals

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP3236415B1Determining a boundary associated with image data
Publication Date: 2020.05.06 BLACKBERRY LTD
  • EP3236415B1 patent drawingFigure 1
  • EP3236415B1 patent drawingFigure 2
  • EP3236415B1 patent drawingFigure 3

AI summary

A method and device for determining a boundary associated with image data captured by an electronic device is provided. The electronic device may include a camera. In one aspect, a method includes: capturing the image data using the camera; based on the captured image data, detecting a boundary marker displayed by a display device, the boundary marker is periodically displayed to be undetectable by a human eye that is viewing the display device; and modifying, based on the boundary marker, image data captured by the camera.