JPEG Subimage Extraction via Auxiliary Code Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital image processing methods are inefficient for extracting subareas from images compressed with variable length codes, particularly in devices with scarce computational resources, as they often require re-encoding or decoding the entire image, leading to increased processor power consumption and longer processing times.

Innovation Solution

A method for processing variable length code encoded images involves defining a subarea, generating auxiliary code blocks based on differentially encoded parameters, and inserting these blocks between the original code blocks associated with the subarea, thereby avoiding re-encoding and decoding of the entire image, and maintaining alignment with the source data to reduce processor power and processing time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the entire image is re-encoded or decoded to extract a subarea, then the subarea extraction is achieved, but the processor power consumption and processing time increase significantly

Engineering Contradiction:
Improvesubarea extraction speedVSAvoidprocessor power consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent divides the image into multiple code blocks that are independently encoded. When extracting a subarea, only the relevant code blocks are selected and reassembled, rather than processing the entire image. This segmentation allows partial processing and avoids the computational burden of encoding or decoding the full image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary code blocks corresponding to the desired subarea from the original image stream. By taking out only the required portions and reassembling them with appropriate auxiliary code blocks, the system avoids processing unnecessary data, thereby reducing processor power consumption and extraction time.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If the entire image is re-encoded or decoded to extract a subarea, then the subarea extraction is achieved, but the processing time increases significantly

Engineering Contradiction:
Improvesubarea extraction speedVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The image is segmented into discrete code blocks that can be independently handled. This allows the system to quickly identify and extract only the blocks needed for the subarea without waiting for or processing the entire image, significantly reducing processing time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image is pre-encoded into code blocks with embedded metadata that identifies their positions and relationships. This preliminary organization allows for rapid subarea extraction by simply locating and reassembling the relevant blocks without performing time-consuming encoding or decoding operations during the extraction process.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If code blocks are extracted from different scan lines, then the subarea is formed, but alignment issues and bit-shifts occur

Engineering Contradiction:
Improvesubarea extraction simplicityVSAvoidcode block alignment
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces auxiliary code blocks as intermediaries between code blocks extracted from different scan lines. These auxiliary blocks contain synchronization information and alignment data that ensure proper positioning and alignment of the extracted code blocks, preventing bit-shifts and maintaining the integrity of the subarea structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent modifies the parameter structure of code blocks by embedding additional metadata that tracks their original positions and relationships within the full image. This parameter enhancement allows the extraction system to automatically adjust alignment and positioning when reassembling subareas from scattered code blocks, eliminating manual alignment procedures.

Inventive Principle:
Principle #35Parameter changes

4Productivity

If auxiliary code blocks are generated and inserted, then alignment is maintained and extraction efficiency is improved, but the data structure becomes more complex

Engineering Contradiction:
Improveextraction efficiencyVSAvoiddata structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The auxiliary code blocks are designed to nest within the existing code block structure, containing alignment and synchronization information in a hierarchical manner. This nesting approach allows the system to maintain the original simple code block format while embedding additional functionality, thereby improving extraction efficiency without significantly increasing overall structural complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentEP2371137B1Method, apparatus and computer program product for subimage extraction from JPEG encoded data
Publication Date: 2020.10.14 NOKIA TECHNOLOGIES OY
  • EP2371137B1 patent drawingFigure 1~2(c)
  • EP2371137B1 patent drawingFigure 2(d)~3
  • EP2371137B1 patent drawingFigure 4~7

AI summary

There is provided a method for processing a variable length code encoded image comprising a plurality of scan lines, wherein each scan line comprises a number of original code blocks comprising a differentially encoded parameter. The method comprises defining a subarea of the image comprising parts of a number of said scan lines, extracting the subarea, generating a set of auxiliary code blocks comprising an auxiliary differentially encoded parameter based on the first differentially encoded parameter of a first code block of a first current scan line in the subarea, and associating the auxiliary code blocks with the subarea. There is also provided an apparatus and a computer program product thereof.