Image Processing Segmentation for Heat and Cost Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The integration of an Image Signal Processor (ISP) within an Application Processor (AP) in electronic devices leads to increased chip costs and heat generation issues, and requires frequent hardware updates due to changing sensor specifications and processing algorithms, making it challenging to efficiently process image correction information, especially when it is complex or time-consuming.
Innovation Solution
An electronic device that acquires raw images and generates both basic and extended-level images, with the basic image being processed locally and the extended image being processed externally, allowing for differential image processing based on importance levels and leveraging external analysis information to enhance image quality without increasing data size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If an Image Signal Processor (ISP) is integrated within an Application Processor (AP), then device integration is improved, but chip price increases and heat generation worsens
Solution Approach 1:
The patent divides image processing into two segments: basic image processing performed by the local ISP and advanced/image correction processing performed by an external device. This segmentation allows the local device to maintain integration while offloading heat-generating complex processing to an external device, resolving the contradiction between integration and heat generation.
Solution Approach 2:
The patent extracts complex image correction processing from the local AP and performs it on an external device. By taking out the computationally intensive correction processing from the integrated system, the local device can maintain integration benefits while avoiding the heat generation associated with complex processing.
2Speed
If image correction processing is performed locally, then processing speed is improved, but processing capability for complex algorithms worsens
Solution Approach 1:
The patent segments processing into two categories: basic processing (performed locally for speed) and correction processing (performed externally for capability). This segmentation enables the system to achieve both fast basic processing and advanced correction capabilities that would be too complex for local hardware.
Solution Approach 2:
The patent introduces an external device as an intermediary to handle complex image correction processing. This intermediary enables advanced processing capabilities while allowing the local device to maintain fast basic processing, resolving the contradiction between speed and processing capability.
3Manufacturing precision
If advanced image correction algorithms are implemented, then image quality is improved, but hardware update frequency increases
Solution Approach 1:
The patent extracts advanced image correction algorithms from local hardware and implements them on an external device. This extraction allows the local hardware to remain stable and unchanged while still benefiting from advanced algorithms, thereby extending hardware lifecycle while maintaining improved image quality.
Solution Approach 2:
The patent changes the location parameter of algorithm execution from local hardware to external device. This parameter change enables the system to access advanced algorithms without modifying local hardware, thus improving image quality while extending hardware lifecycle.
4Measurement precision
If more image data is transmitted for processing, then processing accuracy is improved, but data transmission size increases
Solution Approach 1:
The patent segments image data into two parts: basic image data processed locally and correction target regions processed externally. This segmentation allows the system to transmit only relevant correction data to the external device, improving processing accuracy for critical regions while minimizing overall data transmission size.
Solution Approach 2:
The patent applies different processing qualities to different regions of the image. By identifying important regions and transmitting only those for external processing, the system achieves high processing accuracy where needed while keeping data transmission size manageable through selective processing.
Data Source
AI summary
An electronic device according to various embodiments of the present invention comprises a camera, a communication module, a display and a processor, wherein the processor can be set so as to: acquire a raw image corresponding to an external object by using the camera; generate a first level image having a first attribute and a second level image having a second attribute by using the raw image; transmit a first image, in which at least a part of the first level image is encoded, to an external electronic device by using the communication module such that the external electronic device generates analysis information on the first image; and generate a second image, in which at least a part of the second level image is encoded, on the basis of at least the analysis information, and transmit the second image to the external electronic device by using the communication module. Other embodiments could be possible in addition to the various embodiments of the present invention.