Display Control Apparatus for Smooth Thumbnail Preview

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in selecting the appropriate image tone for shooting conditions due to mismatch between live preview images and thumbnails, and experience stress from low frame rates causing dropped frames in thumbnail display.

Innovation Solution

A display control apparatus and method that displays a live preview image alongside processed images, with the ability to update these images upon user operation, allowing for intuitive selection and reduction of stress by ensuring smooth image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If thumbnails are updated at a high frame rate close to the live preview image frame rate, then the smoothness of thumbnail display is improved, but the processing time and computational load increase significantly

Engineering Contradiction:
Improvethumbnail update frame rateVSAvoidimage processing time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent applies partial action by selectively updating only certain thumbnails based on user interaction rather than continuously updating all thumbnails at maximum frame rate. The system updates thumbnails in response to specific user operations (such as touching or selecting a thumbnail), which reduces the overall processing load while maintaining smooth display performance for the user's area of interest.

Inventive Principle:
Principle #16Partial or excessive action

2Device complexity

If thumbnails are displayed at a lower frame rate to reduce processing load, then the computational complexity is reduced, but the display smoothness deteriorates and frames are dropped

Engineering Contradiction:
Improveprocessing complexityVSAvoiddisplay smoothness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements dynamic thumbnail updating where the update frequency and processing intensity adapt based on user interaction. When the user interacts with thumbnails (e.g., touching, selecting, or hovering), the system dynamically increases the update rate for those specific thumbnails to ensure smooth display. For non-interacted thumbnails, the update rate is reduced, thereby balancing processing complexity with display smoothness in a dynamic manner.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If sample images are displayed as thumbnails to show different image tones, then the user can select shooting conditions, but the mismatch between live preview and thumbnails makes it difficult for the user to imagine the actual tone change

Engineering Contradiction:
Improveshooting mode selectionVSAvoidimage tone accuracy
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent uses copying by generating thumbnail images that are direct copies or representations of the actual captured image data, processed with different tone settings. These thumbnails are derived from the same image data as the live preview, ensuring that the tone adjustments displayed in thumbnails accurately reflect what the user will see in the final captured image. This copying approach maintains consistency between thumbnail preview and actual output.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If multiple processed images are displayed simultaneously to show different image processing conditions, then the user can compare and select the best option, but the display area requirements and interface complexity increase

Engineering Contradiction:
Improveimage processing option comparisonVSAvoiddisplay area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent applies segmentation by dividing the display area into distinct regions: a main live preview image area and a separate thumbnail grid area. Each thumbnail is segmented as an individual selectable element within the grid. This segmentation allows multiple processed images to be displayed in an organized manner without overwhelming the user, while still providing sufficient comparison capability. The segmented layout optimizes the use of available display area.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9894262B2Display control apparatus to enable a user to check a captured image after image processing
Publication Date: 2018.02.13 SONY GROUP CORP
  • US9894262B2 patent drawing
  • US9894262B2 patent drawing
  • US9894262B2 patent drawing

AI summary

There is provided a display control apparatus including: a display control unit configured to cause a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and a determination unit configured to determine whether or not a predetermined user operation has been recognized. If it is determined that the predetermined user operation has been recognized, the display control unit updates the one or more processed images to be displayed.