Moving Image Overlay with Split Update Rates for Readable Object Labels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In ultrasonic endoscopy, displaying anatomical regions in a moving image is challenging due to poor visibility of moving text and lack of user-friendly display options that do not interfere with operation.

Innovation Solution

A moving image processing apparatus that superimposes position and type information of detected objects on a moving image with different update frequencies, ensuring high visibility by stabilizing the display of type information relative to the position information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If text is displayed moving with the object in a moving image, then the text remains associated with the object, but the text becomes difficult to identify at a glance due to large movement

Engineering Contradiction:
Improvetext readabilityVSAvoidtext movement speed
Core Design Contradiction:
Loss of informationVSSpeed

Solution Approach 1:

The patent segments the text display into two distinct components: position information that moves with the object at full speed, and type information that moves at a reduced update frequency. This segmentation allows each component to optimize its movement characteristics - position information provides real-time tracking while type information maintains readability by updating less frequently, thus resolving the contradiction between object association and readability.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If text is displayed in response to user input for hiding/showing, then user control is provided, but the display cannot be controlled when the user operates the scope with both hands

Engineering Contradiction:
Improvedisplay control availabilityVSAvoidoperation environment requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements self-service by making the display of anatomical region information automatically responsive to scope operations without requiring additional user input. The system detects scope operation states and automatically adjusts the display accordingly, eliminating the need for separate control inputs and enabling operation control even when both hands are occupied with the scope.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If position information is updated every frame, then the position tracking is accurate, but the type information display becomes unstable

Engineering Contradiction:
Improveposition tracking accuracyVSAvoidtype information display stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent applies segmentation by separating the update frequencies of position information and type information. Position information is updated every frame to maintain accurate real-time tracking, while type information is updated at a lower frequency to ensure display stability. This differential update strategy resolves the contradiction between tracking precision and display stability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12608859B2Moving image processing apparatus, moving image processing method and program, and moving image display system for displaying information related to an object in the moving image
Publication Date: 2026.04.21 FUJIFILM CORP
  • US12608859B2 patent drawing
  • US12608859B2 patent drawing
  • US12608859B2 patent drawing

AI summary

The present disclosure allows information on an object included in a moving image to be superimposed on the moving image and displayed with high visibility. Position information and type information of an object included in frame images of an acquired moving image are acquired, a first display position at which the position information is to be displayed and a second display position at which the type information is to be displayed are determined, the sequentially acquired frame images are sequentially displayed on a display, the position information and the type information are displayed so as to be superimposed on each of the displayed frame images at the first display position and the second display position, the first display position is updated with a first update frequency, and the second display position is updated with a second update frequency lower than the first update frequency.