Integrated Overlay Logic in Image Sensor for PIP Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional picture-in-picture (PIP) systems require large frame memories to store video data, leading to increased space occupation and high power consumption due to the need for separate memory devices and frequent memory access operations.

Innovation Solution

Integrating overlay logic within the first image sensor device, allowing synchronization of video image data streams from both image sensors, eliminating the need for a separate frame memory by directly processing and combining the streams within the same device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a separate frame memory is used to store video data for the second image, then the PIP image can be generated, but the system occupies a large amount of space and consumes high power

Engineering Contradiction:
ImprovePIP image generation capabilityVSAvoidsystem space occupation
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

The patent merges the frame memory function into the image sensor device by integrating a buffer memory and overlay processing logic within the same device. This allows the first image sensor to store and process both its own image data and the second image data from the frame memory, eliminating the need for a separate dedicated frame memory device and reducing overall system space occupation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The first image sensor device is designed to perform multiple functions: capturing the first image, buffering video data, storing second image data from the frame memory, and performing overlay processing to generate the composite PIP image. This multi-functional integration reduces the number of separate components needed in the system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If a separate frame memory is used to store video data, then the PIP image can be generated, but the power consumption increases due to frequent memory access operations

Engineering Contradiction:
ImprovePIP image generation capabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

By combining the buffer memory and overlay logic within the first image sensor device, the patent reduces the number of memory access operations required. The integrated buffer can directly exchange data with the overlay logic without requiring frequent accesses to a separate frame memory, thereby reducing power consumption associated with memory access operations.

Inventive Principle:
Principle #5Merging (Combining)

3Area of stationary object

If overlay logic is integrated within the first image sensor device, then system size and power consumption are reduced, but the device complexity increases

Engineering Contradiction:
Improvesystem space occupationVSAvoidimage sensor device complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent integrates several functions (buffer memory, frame memory, overlay logic) into the first image sensor device. While this increases the functional complexity of the device, it eliminates the need for separate dedicated components, reducing overall system complexity and space occupation. The integration allows for more efficient data flow and processing within a unified architecture.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This integration reduces system size and power consumption while maintaining the generation of high-quality composite PIP images, as both image sensors and their data streams are synchronized, enabling efficient processing without the need for intermediate storage.

Implementation Method 1

a first image sensor device for detecting light from a first subject and generating a first signal indicative of image data for the first subject

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a second image sensor device for detecting light from a second subject and generating a second signal indicative of image data for the second subject

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS9088750B2Apparatus and method for generating picture-in-picture (PIP) image
Publication Date: 2015.07.21 OMNIVISION TECHNOLOGIES INC
  • US9088750B2 patent drawing
  • US9088750B2 patent drawing
  • US9088750B2 patent drawing

AI summary

According to a picture-in-picture (PIP) system and method, a first image sensor device detects light from a first subject and generates a first signal indicative of image data for the first subject. A second image sensor device detects light from a second subject and generates a second signal indicative of image data for the second subject. Overlay logic combines the first and second signals to generate a picture-in-picture signal indicative of a combination of an image of the first subject and an image of the second subject, wherein the overlay logic is located within the first image sensor device. The first image sensor device generates a synchronization signal which is received by the second image sensor device and triggers the second image sensor device to generate the second signal indicative of image data for the second subject.