Ophthalmic Image Compositing via Frame Selection for Retinal Continuity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for ophthalmological diagnosis face challenges in acquiring high-quality, continuous images across multiple shooting positions, leading to incomplete or unanalyzable regions when compositing high-magnification images of the retina, which affects the evaluation of photoreceptors and retinal blood vessels.

Innovation Solution

An image processing apparatus that selects and composites frames from multiple moving images based on continuity of relative position, luminance properties, and image features to generate a representative image with improved continuity and reduced incomplete regions, using a selecting unit to determine the suitability of images for overlaying and forming a composite image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple high-magnification images are composited from different shooting positions, then the coverage area is improved, but the continuity and completeness of the composite image deteriorates due to incomplete or unanalyzable regions

Engineering Contradiction:
Improvecoverage areaVSAvoidimage continuity
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent segments the image selection process by evaluating and selecting specific frames from each moving image based on continuity criteria. The selecting unit divides the composite image creation into discrete frame selections from multiple moving images, ensuring each selected frame contributes to continuous coverage without gaps or unanalyzable regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by pre-evaluating frames from multiple moving images before compositing. The selecting unit assesses frame suitability based on relative position continuity, luminance properties, and image features in advance, selecting only appropriate frames for inclusion in the final composite image, thereby preventing incomplete regions from forming.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If frames are selected from multiple moving images for compositing, then the image quality is improved, but the complexity of the selection and compositing process increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements feedback through the selecting unit, which continuously evaluates frames from multiple moving images based on established criteria (relative position continuity, luminance properties, image features). The selection process uses feedback from frame quality assessment to determine which frames to include, creating a systematic approach that improves image quality while managing processing complexity through automated decision-making.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies parameter changes by evaluating frames based on multiple parameters including relative position continuity, luminance properties, and image features. The selecting unit changes the selection state of frames based on these parameter assessments, systematically determining which frames meet the quality criteria for inclusion in the composite image.

Inventive Principle:
Principle #35Parameter changes

3Area of stationary object

If high-magnification images are acquired at different shooting positions, then the observation coverage is improved, but the time required for image acquisition and processing increases

Engineering Contradiction:
Improveobservation coverageVSAvoidacquisition time
Core Design Contradiction:
Area of stationary objectVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-selecting appropriate frames from multiple moving images before the compositing operation. The selecting unit evaluates and identifies suitable frames in advance based on continuity and quality criteria, so that when compositing occurs, the process is expedited because the selection work has already been performed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by selecting frames that ensure continuous coverage across the composite image. The selecting unit identifies frames with continuous relative positions and consistent luminance properties, ensuring that the compositing process creates a seamless composite image without gaps or unanalyzable regions, thereby maximizing the efficiency of the observation coverage.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9918625B2Image processing apparatus and control method of image processing apparatus
Publication Date: 2018.03.20 CANON KK
  • US9918625B2 patent drawing
  • US9918625B2 patent drawing
  • US9918625B2 patent drawing

AI summary

An image processing apparatus generates one image by using at least one frame each of a plurality of moving images obtained by taking moving images of a plurality of different regions of an eye at different times. The apparatus includes a deciding unit configured to decide the at least one frame in each of the plurality of moving images, so that regions which have actually been shot are included in the plurality of moving images in the plurality of regions; and an image generating unit configured to generate one image by using the at least one frames decided from each of the plurality of moving images.