Electronic device for processing images together with external electronic device and operation method thereof
By identifying images in electronic devices and sending processing information to external devices, skipping unnecessary processing steps, the problem of inconsistent image signal processing in multiple devices is solved, and the efficiency and consistency of image processing is achieved.
Patent Information
- Application Number
- CN201980021615.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-03-23
- Filing Date
- 2019-03-25
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2039-03-25
AI Technical Summary
When performing image signal processing in multiple devices, redundancy or omitting processing operations may result in inconsistent processing due to different device performance and complexity.
By identifying the original image in the electronic device and performing processing according to the specified image signal processing set, partially processed information is sent to the external device during the processing process, causing the external device to skip unnecessary processing steps, and the image is realized using the communication module. Division of labor and collaborative work of processing.
Effectively prevent redundant execution or omitting processing, ensure consistency and efficiency of image processing, and avoid processing inconsistency caused by device differences.
Smart Images

Figure CN111937030B_ABST
Abstract
Description
Technical Field
[0001] Various embodiments relate to electronic devices for processing images and methods of operating the same. Background Art
[0002] Image processing by a general-purpose image signal processor (ISP) is performed in a single device to which multiple independent ISP image processing modules are connected.
[0003] When multiple devices perform ISP processing, the first device and the second device may perform ISP sequentially. Although the image processing operations of the first device and the second device have the same purpose, each device may have different performance, complexity, and sophistication. Alternatively, the ISP image processing module present in the first device may not exist in the second device. Summary of the invention
[0004] Technical issues
[0005] When a plurality of devices perform ISP processing on one image, the ISP processing performed by the first device that first performs the ISP processing may be different from the ISP processing performed by the second device that second performs the ISP processing due to various reasons related to the first device that first performs the ISP processing. As a result, the ISP processing operation performed in the first device may be redundantly performed, or the ISP processing operation that is not performed in the first device may be omitted in the second device.
[0006] According to various embodiments, when ISP processing is performed in a divided manner in a plurality of devices, information of the ISP processing performed in an electronic device may be transmitted to an external electronic device that may recognize the ISP processing information and perform the ISP processing.
[0007] Technical Solution
[0008] An electronic device according to various embodiments includes a memory, a communication module, and a processor, wherein the processor is configured to identify an original image, perform image processing on the original image according to a specified first image signal processing set, and during the image processing, send the original image on which at least a portion of the processing of the specified first image signal processing set is performed to an external electronic device by using the communication module, and send information corresponding to at least a portion of the processing to the external electronic device, so that the external electronic device skips the processing corresponding to at least a portion of the processing in the specified second image signal processing set included in the external electronic device by using the original image on which at least a portion of the processing is performed.
[0009] The method of controlling an electronic device according to various embodiments may include: identifying an original image, performing image processing according to a specified first image signal processing set by using the original image, and during the execution of the image processing, sending the original image on which at least a portion of the processing of the specified first image signal processing set has been performed to an external electronic device by using a communication module, and sending information corresponding to the at least partial processing to the external electronic device, so that the external electronic device skips the processing corresponding to the at least partial processing as a part of performing the image processing according to a specified second image signal processing set included in the external electronic device by using the original image on which at least a portion of the processing has been performed.
[0010] An electronic device according to various embodiments includes a communication module and a processor, wherein the processor is configured to receive an original image on which at least a portion of processing of a specified first image signal processing set has been performed from an external electronic device by using the communication module, receive information corresponding to the at least portion of the processing from the external electronic device, skip the processing corresponding to the at least portion of the processing in a specified second image signal processing set by using the original image on which at least a portion of the processing has been performed based on the information corresponding to the at least portion of the processing, and perform image processing by using the second image signal processing set based on a result of the skipping.
[0011] The method of controlling an electronic device according to various embodiments may include receiving an original image on which at least a portion of processing of a specified first image signal processing set has been performed from an external electronic device, receiving information corresponding to the at least partial processing from the external electronic device, skipping the processing corresponding to the at least partial processing in a specified second image signal processing set by using the original image on which at least a portion of the processing has been performed based on the information corresponding to the at least partial processing, and performing image processing by using the second image signal processing set based on a result of the skipping.
[0012] Beneficial Effects
[0013] According to various embodiments, when ISP processing is performed in a plurality of devices in a divided manner, information of the ISP processing performed in an electronic device may be transmitted to an external electronic device so that when the external electronic device performs the ISP processing, redundant execution or omission may be prevented. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 shows a network environment including electronic devices according to various embodiments;
[0015] Figure 2 is a block diagram of a camera module according to various embodiments;
[0016] Figure 3is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments;
[0017] Figure 4 is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments;
[0018] Figure 5 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments;
[0019] Figure 6 is an example of processing status information of an ISP image processing module according to various embodiments;
[0020] Figure 7 is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments;
[0021] Figure 8 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments; and
[0022] Fig. 9 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments. DETAILED DESCRIPTION
[0023] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or other components may be added to the electronic device 101. In some embodiments, some components may be implemented to be integrated together, for example, as if the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) is embedded in the display device 160 (eg, a display).
[0024] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may process or calculate various data. The processor 120 may load and process a command or data received from another component (e.g., sensor module 176 or communication module 190), and the processor 120 may store the result data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 that is independent of the main processor 121 in operation. In addition to or in place of the main processor 121, the auxiliary processor 123 may include an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor, a sensor hub processor, or a communication processor) that consumes less power than the main processor 121 or is specifically used for a specified function. Here, the auxiliary processor 123 may operate separately from the main processor 121 or be embedded in the main processor 121.
[0025] In this case, when the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101, or when the main processor 121 is in an active state (e.g., executing an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123. The memory 130 may store various data used by at least one component (e.g., the processor 120) of the electronic device 101, such as software (e.g., the program 140) and input data or output data for commands related to the software. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.
[0026] The program 140 , which is software stored in the memory 130 , may include, for example, an operating system (OS) 142 , middleware 144 , or an application 146 .
[0027] The input device 150 may be a device for receiving a command or data to be used for a component (eg, processor 120) of the electronic device 101 from outside (eg, a user) of the electronic device 101. The input device 150 may include, for example, a microphone, a mouse, or a keyboard.
[0028] The sound output device 155 may be a device for outputting a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker for general purposes such as playing multimedia or recording and playing, and a receiver for call reception purposes only. According to an embodiment, the receiver may be formed separately from or integrally with the speaker.
[0029] The display device 160 may be a device for visually providing information to a user of the electronic device 101. The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit or a pressure sensor capable of measuring the intensity of pressure relative to a touch.
[0030] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., the electronic device 102) coupled to the electronic device 101 by wire or wirelessly.
[0031] The sensor module 176 may generate an electrical signal or data value corresponding to an internal operating state (e.g., power or temperature) of the electronic device 101 or an external environmental state of the electronic device 101. The sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0032] The interface 177 may support a specified protocol that enables a wired or wireless connection with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0033] The connection end 178 may include a connector, such as an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector), which can physically connect the electronic device 101 to an external electronic device (e.g., the electronic device 102).
[0034] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. The haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
[0035] The camera module 180 may capture still images or moving images. According to embodiments, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
[0036] The power management module 188 may be a module that manages power supplied to the electronic device 101. The power management module 188 may be configured as, for example, at least a portion of a power management integrated circuit (PMIC).
[0037] The battery 189 may be a device for powering at least one component of the electronic device 101. The battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0038] The communication module 190 may support the establishment of a wired communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., the electronic device 102, the electronic device 104, or the server 108), and perform communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (e.g., the application processor) and support wired communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS communication module) or a wired communication module 194 (e.g., a LAN communication module or a power line communication module), and may communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). The communication modules 190 of the above-enumerated types may be implemented in a single chip in which at least some modules are integrated, or individually implemented in separate chips.
[0039] According to an embodiment, the wireless communication module 192 may identify and authenticate the electronic device 101 in the communication network using the user information stored in the user identification module 196 .
[0040] The antenna module 197 may include one or more antennas for transmitting or receiving signals or power to or from the outside. According to an embodiment, the communication module 190 (e.g., the wireless communication module 192) may transmit or receive signals to or from an external electronic device through an antenna suitable for a communication scheme.
[0041] At least some of the above components may be coupled to each other via an inter-peripheral communication scheme (e.g., a bus, general purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.
[0042] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via a server 108 coupled to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, some operations or all operations performed by the electronic device 101 may be performed in another electronic device or multiple other electronic devices. According to an embodiment, when the electronic device 101 must automatically or upon request perform a function or service, the electronic device 101 may request an external electronic device to perform at least some functions associated with the function or service, instead of running the function or service, or the electronic device 101 may request an external electronic device to perform at least some functions associated with the function or service in addition to running the function or service. The external electronic device receiving the request may perform the requested function or another function, and transmit the result of the execution to the electronic device 101. Then, the electronic device 101 may process or further process the received result to provide the requested function or service. To this end, cloud computing, distributed computing, or client-server computing technology, for example, may be used.
[0043] Figure 2 2 is a block diagram showing a camera module 180 according to various embodiments. Figure 2, the camera module 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), or an image signal processor 260. The lens assembly 210 may collect light emitted or reflected from an object whose image is to be captured. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210. In this case, the camera module 180 may form, for example, a dual camera, a 360-degree camera, or a spherical camera. The plurality of lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have at least one other lens property that is different from the lens properties of another lens assembly. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens. The flash 220 may emit a light source, wherein the emitted light source is used to enhance the light emitted from the object. The flash lamp 220 may include one or more light emitting diodes (LEDs) (eg, red, green, and blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or a xenon lamp.
[0044] The image sensor 230 may acquire an image corresponding to an object by converting light transmitted from the object via the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 may include one image sensor selected from image sensors having different properties (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented using, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.
[0045] The image stabilizer 240 may move or control (e.g., adjust the readout timing) the image sensor 230 or at least one lens included in the lens assembly 210 in response to the movement of the camera module 180 or the electronic device 101 including the camera module 180, so as to at least partially compensate for the negative effects of the movement (e.g., image blur). According to an embodiment, the image stabilizer 240 may be implemented with, for example, an optical image stabilizer, and such movement may be sensed using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180.
[0046] The memory 250 may at least temporarily store at least a portion of an image acquired via the image sensor 230 for subsequent image processing tasks. For example, if multiple images are captured quickly or image capture is delayed due to shutter lag, the acquired original image (e.g., a high-resolution image) may be stored in the memory 250, and its corresponding copy image (e.g., a low-resolution image) may be previewed via the display device 160. Then, if a specified condition is met (e.g., by a user's input or a system command), at least a portion of the original image stored in the memory 250 may be acquired and processed by, for example, the image signal processor 260. According to an embodiment, the memory 250 may be configured as at least a portion of the memory 130, or the memory 250 may be configured as a separate memory that operates independently of the memory 130.
[0047] The image signal processor 260 may perform image processing (e.g., depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening)) on an image acquired by the image sensor 230 or an image stored in the memory 250. Additionally or alternatively, the image signal processor 260 may perform control (e.g., exposure time control or readout timing control) on at least one of the components included in the camera module 180 (e.g., the image sensor 230). The image processed by the image signal processor 260 may be stored back to the memory 250 for further processing, or the image may be provided to an external component outside the camera module 180 (e.g., the memory 130, the display device 160, the electronic device 102, the electronic device 104, or the server 108). According to an embodiment, the image signal processor 260 may be configured as at least a part of the processor 120, or the image signal processor 260 may be configured as a separate processor that operates independently of the processor 120. When the image signal processor 260 is configured as a separate processor, the image processed by the image signal processor 260 may be displayed as it is or after being further processed by the processor 120 via the display device 160 .
[0048] According to an embodiment, the electronic device 101 may include two or more camera modules 180 having different properties or functions. In this case, for example, at least one camera module 180 may be a wide-angle camera, or a front camera, and at least another camera module may be a retractable camera or a rear camera.
[0049] Figure 3 is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments.
[0050] The electronic device 101 may include an image sensor 321, an image signal processor (ISP) 323, and a memory 325. The external electronic device 300 (e.g., the server 108) may include an identification module 331, an ISP 333, and a storage device 335. The identification module 331 may be a logic module and may be implemented with a processor of the external electronic device 300. The ISP 333 may also be implemented with a processor of the external electronic device 300, for example, the processor of the external electronic device 300 may perform both identification and image processing. Although not shown, the electronic device 101 may include a communication module (e.g., a communication interface or communication module 190) capable of sending and receiving data to and from the external electronic device 300. The external electronic device 300 may include a communication module capable of sending and receiving data to and from the electronic device 101.
[0051] The image sensor 321 (e.g., the image sensor 230) may obtain an image about an external object and generate an original image 322 (native image) corresponding to the obtained image. The image sensor 321 may transmit the original image 322 to the ISP 323. According to various embodiments, the image sensor 321 may generate a small original image 324 and send it to the external electronic device 300 through the communication module. According to another embodiment, the processor 327 of the electronic device 101 instead of the image sensor 321 may generate a small original image and send the generated small original image 324 to the external electronic device 300 through the communication module. The image sensor 321 may send the original image 322 in a compressed state to the ISP 323 or the external electronic device 300. The image sensor 321 may compress the original image 322 to partially process it and store the compressed original image 322 in the internal memory of the image sensor 321. The recognition module 331 of the external electronic device 300 may obtain the small original image 324 through the communication module and segment at least one image area from the small original image 324. The recognition module 331 can recognize each of at least one image area divided as a result of the segmentation. Correction area information 332 can be generated, which includes information related to the multiple image areas generated from the recognition module 331, such as coordinate information or recognition results of the image areas. The correction area information 332 can be sent to the electronic device 101. The ISP 323 can correct the original image 322 by using the correction area information 332, thereby generating a corrected image. The corrected image can have, for example, a YUV format. The corrected image can be stored in the memory 325. The corrected image can be compressed, for example, according to the Joint Photographic Experts Group (JPEG) scheme, and the compressed image can be stored in the memory 325.
[0052] In various embodiments of the present disclosure, the original image 322 provided from the image sensor 321 may be transmitted to the external electronic device 300 separately from the small original image 324. The original image 322 has a capacity greater than the small original image 324, so that the small original image 324 may be transmitted to the external electronic device 300 first, and then the original image 322 may be transmitted to the external electronic device 300. For example, when the ISP 323 performs correction on the original image 322, the original image 322 may be transmitted to the external electronic device 300. The original image 322 may be uploaded to the external electronic device 300 in the original form generated by the image sensor 321, or may be uploaded after preprocessing by lens distortion compensation or noise removal. The preprocessing may be performed in the external electronic device 300. The external electronic device 300 may perform preprocessing for demosaicing or image format change, or preprocessing for improving the image recognition rate. The ISP 333 of the external electronic device 300 may correct the received original image 322. The external electronic device 300 may correct the original image 322 by using the existing generated correction area information 332 or by using the scaled correction area information. The original image 322 may have a higher resolution than the small original image 324, so that the ISP 333 of the external electronic device 300 may obtain detailed scaled correction area information from the high-resolution image. The ISP 333 may generate the scaled correction area information by using the existing generated correction area information and the original image 322. The ISP 333 may obtain a high-quality image 334 by enhancing the original image 322 using the scaled correction area information. The high-quality image 334 may be stored in the storage device 335 of the external electronic device 300 and may be downloaded to the electronic device 101.
[0053] According to various embodiments, the image partially corrected in the ISP 323 may be transmitted to the external electronic device 300. In this case, the electronic device 101 may transmit information about the correction execution state together with the image partially corrected by the ISP 323 to the external electronic device 300. The external electronic device 300 may also perform correction by using the ISP 333 based on the received information about the correction execution state (e.g., ISP processing state information), which will be described in more detail.
[0054] Figure 4 is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments. Figure 5 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments.
[0055] In operation 410 , the electronic device 101 (eg, the processor 120 ) may recognize an original image. For example, the electronic device 101 may obtain the original image through the camera module 180 , or obtain the original image from another electronic device through the communication module 190 .
[0056] In operation 420, the electronic device 101 may start execution of image processing according to the first image processing set. Figure 5 , electronic device 510 (e.g., Figure 1 The electronic device 101 of the embodiment may identify the original image (native image) 515 that has been subjected to image processing. Depending on the type of electronic device, the electronic device 510 and the external electronic device 520 may have different image processing sets (e.g., image processing set 511 or image processing set 521). According to an embodiment, the image processing set 511 may be implemented in any one of a hardware configuration or a software configuration, and may be a part of the processor 120 of the electronic device 510 or an external electronic device 520 (e.g., Figure 1 The image processing set 511 may include a plurality of ISP image processing modules (e.g., ISP image processing modules 1-1 to 10-1) connected in sequence, and the electronic device 101 may continuously perform image processing by using a plurality of ISP image processing modules. The roles and performances of the ISP image processing modules included in each image processing set may vary depending on the electronic device. The execution order of the image processing algorithms in the image processing set may vary depending on the type of electronic device.
[0057] According to an embodiment, the first electronic device 510 may start performing image processing by using the image processing set 511. When the image processing starts, the first electronic device 510 may sequentially start performing image processing on the original image 515 by using a plurality of ISP image processing modules included in the image processing set 511. The second electronic device 520 (e.g., Figure 1 The second electronic device 104) can identify an original image 525 that is subjected to image processing. The second electronic device 520 can start performing image processing by using an image processing set 521 included in the second electronic device 520. When the image processing starts, the second electronic device 520 can sequentially start performing image processing on the original image 525 by using a plurality of ISP image processing modules included in the image processing set 521.
[0058] In operation 430, the electronic device 101 may transmit the original image on which at least a portion of the processing of the designated image processing set is performed to the external electronic device 300 by using the communication module during the execution of the image processing. The electronic device 101 may transmit the original image on which at least a portion of the processing of the image processing set included in the electronic device 101 is performed to the external electronic device 300 by utilizing the characteristics of the electronic device 101 (e.g., version information of the image processing set 511 of the electronic device 101, the power state of the electronic device 101, the environment when the original image is captured, user settings, etc.).
[0059] refer to Figure 5 , the first electronic device 510 may transmit the original image 515 to the external electronic device 530 by using the communication module 512 in a state where the first electronic device 510 has not performed image processing on the original image 515. The second electronic device 520 may transmit the original image to the external electronic device 530 by using the communication module 522 in a state where some 524 (e.g., ISP image processing modules 1-2, 2-2, and 3-2) in the image processing set 521 have performed processing on the original image 525 during the image processing starting from operation 420. Although not shown, according to another embodiment, the first electronic device 510 may transmit the original image generated by performing image processing on the original image 515 by using the entire image processing set 511 to the external electronic device 530 by using the communication module 512. When the first electronic device 510 performs image processing on the original image 515 by using the entire image processing set 511 and transmits the image-processed original image to the external electronic device 530, the external electronic device 530 may skip the image processing using the image processing set 531.
[0060] According to an embodiment, the first electronic device 510 may transmit the original image 515 to the external electronic device 530 by using the communication module 512. Alternatively, when the first electronic device 510 transmits the original image 515 to the external electronic device 530 by using the communication module 512, the first electronic device 510 may compress the original image 515 and generate and transmit a small original image.
[0061] In operation 440, the electronic device 101 may transmit information corresponding to at least part of the processing to the external electronic device 400 (eg, the external electronic device 300). Figure 4, the sending of the original image subjected to at least partial processing of the first image processing set and the sending of information corresponding to the at least partial processing are illustrated as a two-step operation, but the illustration is merely an example. According to various embodiments, the electronic device 101 may send the original image on which at least partial processing of the first image processing set has been performed to the external electronic device 400, and then send the information corresponding to the at least partial processing, or may send the original image on which at least partial processing of the first image processing set has been performed and the information corresponding to the at least partial processing to the external electronic device 400 through one communication signal. The electronic device 101 may send the information corresponding to the at least partial processing to the external electronic device 400, so that the external electronic device 400 skips at least partial processing of the image processing set included in the external electronic device 400. Reference Figure 5 , the first electronic device 510 may transmit image data corresponding to the original image 515 together with information corresponding to at least a portion of the processing. The electronic device 510 may combine the image data with information about a processing state of the ISP image processing module corresponding to the at least a portion of the processing information to generate first transmission data 513, and transmit the first transmission data 513 to the external electronic device 530. The external electronic device 520 may combine the original image 525 with information about a processing state of the ISP image processing module as header information to generate second transmission data 523, and transmit the second transmission data 523 to the external electronic device 530, the information about a processing state of the ISP image processing module being information corresponding to at least a portion of the processing of the image data corresponding to the original image after image processing by some 524 of the image processing set 521.
[0062] Figure 6 is an example of processing status information of the ISP image processing module according to various embodiments. According to various embodiments, the processing status information of the ISP image processing module may include at least one of device information or processing status information. The device information may include an electronic device (e.g., Figure 1 The electronic device 101) includes model information of the electronic device 101, version information of the image processing set included in the electronic device, version information of each of the multiple ISP image processing modules included in the image processing set of the electronic device, lens characteristic information included in the electronic device, and sensor model information included in the electronic device. Depending on the above information, the way of processing the original image and which ISP image processing module among the multiple ISP image processing modules included in the image processing set will be used by the electronic device for image processing may be different. The processing status information may include information about whether each ISP image processing module included in the image processing set of the electronic device performs processing. For example, in Figure 6In the present invention, when the electronic device sends an original image to an external electronic device 530 by performing image processing using ISP image processing modules 1, 2, and 3 and not performing image processing using ISP image processing modules 4, 5, and 6, the electronic device may store information indicating whether each ISP image processing module is to perform image processing in the processing status information of the ISP image processing module.
[0063] In operation 450, the external electronic device 400 may skip the processing corresponding to at least part of the processing as part of the image processing according to the specified image signal processing set included in the external electronic device by using the at least part of the processed original image. The external electronic device 400 may determine the processing to be skipped based on the received information corresponding to at least part of the processing. In operation 460, the electronic device 400 may perform the image processing according to the image signal processing set included in the external electronic device 400 by excluding the processing corresponding to at least part of the processing. For example, the external electronic device 400 may skip the image processing corresponding to at least part of the processing performed in the electronic device 101 to avoid redundant execution of the image processing.
[0064] refer to Figure 5 , the external electronic device 530 may separate the first transmission data 513 received using the communication module 533 into image data and processing status information of the ISP image processing module. When the image data is compressed and transmitted in the first electronic device 510, the processor 532 of the external electronic device 530 may decode the image data by using a decoder having a compression algorithm used for compression in the first electronic device 510.
[0065] According to an embodiment, the processor 532 of the external electronic device 530 may determine, based on information corresponding to at least a portion of the processing, an ISP image processing module that will perform image processing and an ISP image processing module that will not perform image processing among a plurality of ISP image processing modules included in the image processing set 531. For example, the processor 532 may determine that image processing is not performed in the first electronic device 510 based on information corresponding to at least a portion of the processing received from the first electronic device 510. The processor 532 may input the original image received from the first electronic device 510 to the ISP image processing modules 1-3, and sequentially start the execution of image processing, thereby performing image processing by using all of the plurality of ISP image processing modules included in the image processing set 531 included in the external electronic device 530. The external electronic device 530 may transmit the image-processed image to the first electronic device 510 by using the communication module 533.
[0066] According to an embodiment, the processor 532 may determine that image processing has been performed using a portion of the image processing set in the second electronic device 520 based on information corresponding to at least a portion of the processing received from the second electronic device 520. The processor 532 may determine that image processing has been performed on the original image 525 by using the ISP image processing modules 1-2, 2-2, and 3-2 in the second electronic device 520. The processor 532 may skip image processing using the ISP image processing modules 1-3, 2-3, and 3-3 to avoid redundant image processing because the ISP image processing modules 1-2, 2-2, and 3-2 are the same as the ISP image processing modules 1-3, 2-3, and 3-3 included in the external electronic device 530. The processor 532 may input the original image received from the second electronic device 520 to the ISP image processing module 4-3 and sequentially start the execution of the image processing. In addition to the ISP image processing modules 1-3, 2-3, and 3-3, the processor 532 may perform image processing by using a plurality of ISP image processing modules included in the image processing set 531 included in the external electronic device 530. The external electronic device 530 may transmit the image-processed image to the second electronic device 520 by using the communication module 533 .
[0067] Figure 7 is a diagram for describing operations of an electronic device and an external electronic device according to various embodiments. Figure 8 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments.
[0068] In operation 710, the electronic device 101 (eg, the processor 120) may send version information of the first image processing set as part of information corresponding to at least a portion of the processing to the external electronic device 700 (eg, Figure 3 External electronic device 300, Figure 4 External electronic device 400 or Figure 3 For example, the electronic device 101 can refer to Figure 4 The information corresponding to at least a portion of the processing described above sends the version information of the image processing set included in the electronic device 101 and the version information of the multiple ISP image processing modules included in the image processing set to the external electronic device 700. Alternatively, the electronic device 101 may send the version information of the ISP image processing corresponding to at least a portion of the processing to the external electronic device 700 through the information corresponding to at least a portion of the processing.
[0069] refer to Figure 8 , the first electronic device 810 (eg, Figure 1 The electronic device 101 or the processor 120 or Figure 4The electronic device 101 of the first electronic device 810 may transmit the version information of the image processing set 811 included in the first electronic device 810 and the version information of each of the plurality of ISP image processing modules included in the image processing set 811 to the external electronic device 830 (e.g., the server 108) through the first transmission data 813. The second electronic device 820 (e.g., Figure 1 The electronic device 104) can send the version information of the image processing set 821 included in the second electronic device 820 and the version information of each of the multiple ISP image processing modules included in the image processing set 821 to the external electronic device 830 through the second sending data 823.
[0070] In operation 720, the electronic device 700 may compare the version information of the first image processing set with the version information of the second image processing set included in the external electronic device 700. For example, the external electronic device 700 may compare the version information of the first image processing set included in the electronic device 101 with the version information of the second image processing set, and compare the version information of the multiple ISP image processing modules included in the first image processing set with the version information of the multiple ISP image processing modules included in the second image processing set. In operation 730, the external electronic device 700 may determine whether to skip the processing corresponding to at least part of the processing based on the result of the comparison. In operation 740, the electronic device 700 may perform image processing by using the second image processing set based on the result of the determination. The external electronic device 700 may determine whether to skip the processing corresponding to at least part of the processing performed in the electronic device 101 based on the result of the determination to perform image processing based on the result of the determination.
[0071] According to the embodiment, reference Figure 8 , external electronic device 830 (e.g., Figure 1 Server 108, Figure 3 External electronic device 300, Figure 4 External electronic device 400 or Figure 5 The external electronic device 530) can receive the first electronic device 810 (eg, Figure 1 Electronic equipment 101, Figure 4 Electronic equipment 101 or Figure 5The processor 832 of the external electronic device 830 may receive information corresponding to at least a portion of the processing corresponding to the original image 815 from the communication module 833. The processor 832 may compare version information of a plurality of ISP image processing modules included in the image processing set 811 with version information of a plurality of ISP image processing modules included in the image processing set 831 based on the information corresponding to at least a portion of the processing. The processor 832 may determine that image processing is not performed in the first electronic device 810 based on the information corresponding to at least a portion of the processing. The processor 832 may perform image processing on the original image received from the first electronic device 810 by using the image processing set 831.
[0072] According to an embodiment, the external electronic device 830 can receive information from the first electronic device 820 (eg, Figure 2 Electronic devices 104, Figure 4 Electronic equipment 101 or Figure 5 The processor 832 of the external electronic device 830 may receive information 813 corresponding to at least a portion of the processing corresponding to the original image 825. The processor 832 of the external electronic device 830 may receive information 813 corresponding to at least a portion of the processing from the communication module 833. The processor 832 may compare version information of a plurality of ISP image processing modules included in the image processing set 821 with version information of a plurality of ISP image processing modules included in the image processing set 831 based on the information corresponding to at least a portion of the processing. The processor 832 may determine that image processing has been performed in the second electronic device 820 by using the ISP image processing modules 1-2, 2-2, and 3-2 based on the information 823 corresponding to at least a portion of the processing. The processor 832 may compare version information of the image processing modules 1-2, 2-2, and 3-2 with version information of the image processing modules 1-3, 2-3, and 3-3.
[0073] According to an embodiment, even when image processing is performed by some ISP image processing modules included in the image processing set 821 of the second electronic device 820, in the case where some ISP image processing modules included in the image processing set 831 have a higher version, the processor 832 may perform image processing by using an ISP image processing module having a higher version among some ISP image processing modules included in the image processing set 831. For example, the versions of the ISP image processing modules 1-2 and 2-2 are the same as the versions of the ISP image processing modules 1-3 and 2-3, and the version of the ISP image processing module 2-3 is higher than the version of the ISP image processing module 3-3, the processor 832 may perform image processing without using the ISP image processing modules 1-3, 2-3, and 3-3. In another example, the version of the ISP image processing modules 1-2 and 2-2 is the same as the version of the ISP image processing modules 1-3 and 2-3, and the version of the ISP image processing module 2-3 is lower than the version of the ISP image processing module 3-3, the processor 832 can input the original image received from the second electronic device to the ISP image processing module 3-3, and perform image processing, so that image processing is performed sequentially from the ISP image processing module 3-3.
[0074] Fig. 9 is a diagram of a configuration in which an electronic device and an external electronic device perform ISP image processing according to various embodiments.
[0075] refer to Fig. 9 , external electronic device 930 (e.g., Figure 1 Server 108, Figure 3 External electronic device 300, Figure 4 External electronic device 400 or Figure 5 The image processing set 931 of the external electronic device 530 may include a first electronic device (eg, Figure 1 Electronic equipment 101, Figure 1 processor 120, Figure 4 Electronic equipment 101 or Figure 5 The external electronic device 930 may include an ISP image processing module not included in the image processing set 911 of the first electronic device 910 (for example, the image processing set 931). For example, the image processing set 931 may include an ISP image processing module 2-3 and an ISP image processing module 3-3 not included in the image processing set 911. Figure 1The external electronic device 930 receives an original image on which at least a portion of the processing by the ISP image processing module 1-1 is performed and information 913 corresponding to the at least partial processing. The external electronic device 930 may determine, based on the at least partially processed original image and the information 913 corresponding to the at least partially processed original image, that the original image has undergone image processing by the ISP image processing module 1-1. The external electronic device 930 may input the original image to the ISP image processing module 2-3 and sequentially perform image processing, so that the received original image is image processed by the ISP image processing module 2-3 and the ISP image processing module 3-3 that are not included in the image processing set 911. The external electronic device 930 may perform image processing on the original image by using the image processing set 931, and send the image-processed image to the first electronic device 910 by using the communication module 933.
[0076] According to various embodiments, electronic devices (eg, Figure 1 The electronic device 101 may include a memory (eg, Figure 1 Memory 130), communication module (e.g., Figure 1 communication module 190) and a processor (e.g., Figure 1 1 ), wherein the processor 120 is configured to identify an original image, perform image processing on the original image according to a specified first image signal processing set, and during the image processing, send the original image on which at least a portion of the processing of the specified first image signal processing set is performed to an external electronic device (e.g., Figure 3 an external electronic device 300), and sends information corresponding to at least part of the processing to the external electronic device 300, so that the external electronic device 300 skips the processing corresponding to at least part of the processing in the designated second image signal processing set included in the external electronic device 300 by using the original image on which at least part of the processing has been performed.
[0077] In the electronic device 101 according to the embodiment, the processor 120 may be configured to send version information about at least a portion of the first image signal processing set corresponding to at least a portion of the processing as a portion of the information corresponding to at least a portion of the processing to the external electronic device 300, so that the external electronic device 300 determines whether to skip the processing based on the version information. According to the embodiment, the processor 120 may be configured to receive from the external electronic device an image for which the first image processing module included in at least a portion of the first image signal processing set skipped the image processing when the version of the first image processing module is higher than the version of the second image processing module included in at least a portion of the external electronic device, and to receive from the external electronic device an image for which the first image processing module included in at least a portion of the first image signal processing set performed the image processing when the version of the first image processing module is lower than the version of the second image processing module included in at least a portion of the external electronic device. According to the embodiment, the processor 120 may be configured to receive, using the communication module, a corrected image obtained by the external electronic device 300 performing the image processing on the original image using the second image signal processing set. According to an embodiment, the information corresponding to at least part of the processing may include information about whether the image processing is performed by at least a part of the designated first image signal processing set and at least one of device model information of the electronic device, lens characteristic information of the electronic device, or sensor model information of the electronic device. According to an embodiment, the processor 120 may be configured to receive an image on which image processing by a first image processing module is performed from the external electronic device 300 when the first image processing module is not included in the first image signal processing set, wherein the first image processing module is included in the designated second image signal processing set included in the external electronic device 300.
[0078] The method of controlling the electronic device 101 according to various embodiments may include identifying an original image, performing image processing according to a specified first image signal processing set by using the original image, sending the original image on which at least a portion of the processing of the specified first image signal processing set has been performed to the external electronic device 300 by using the communication module 190 during the execution of the image processing, and sending information corresponding to the at least partial processing to the external electronic device 300, so that the external electronic device 300 skips the processing corresponding to the at least partial processing by using the original image on which at least a portion of the processing has been performed as part of performing the image processing according to a specified second image signal processing set included in the external electronic device 300.
[0079] According to an embodiment, the method may further include sending version information about at least a portion of the first image signal processing set corresponding to at least partial processing to an external electronic device as part of the information corresponding to at least partial processing to determine whether to skip processing based on the version information.
[0080] According to an embodiment, the method may further include receiving, from an external electronic device, an image on which image processing has been skipped by the first image processing module when a version of the first image processing module included in at least a portion of the first image signal processing set is higher than a version of the second image processing module included in at least a portion of the external electronic device, and receiving, from an external electronic device, an image on which image processing has been performed by the first image processing module included in at least a portion of the first image signal processing set when a version of the first image processing module is lower than a version of the second image processing module included in at least a portion of the external electronic device.
[0081] According to an embodiment, the method may further include receiving a corrected image obtained by the external electronic device 300 by performing image processing on the original image using the second image signal processing set. According to an embodiment, the information corresponding to at least part of the processing may include information on whether the image processing is performed by at least a part of the specified first image signal processing set and device model information of the electronic device 101, lens characteristic information of the electronic device, or sensor model information of the electronic device. According to an embodiment, the method may further include receiving, from the external electronic device 300, an image on which image processing by a first image processing module is performed when the first image processing module is not included in the first image signal processing set, the first image processing module being included in the specified second image signal processing set included in the external electronic device 300.
[0082] According to various embodiments, the electronic device 101 may include a communication module 190 and a processor 120, wherein the processor 120 is configured to receive an original image on which at least a portion of processing of a specified first image signal processing set is performed from an external electronic device 300 by using the communication module 190, receive information corresponding to the at least partial processing from the external electronic device 300, skip the processing corresponding to the at least partial processing in a specified second image signal processing set by using the original image on which at least a portion of the processing is performed based on the information corresponding to the at least partial processing, and perform image processing by using the second image signal processing set based on a result of the skipping.
[0083] According to an embodiment, the processor 120 may also be configured to receive version information about at least a portion of a first image signal processing set corresponding to at least partial processing, and determine based on the version information whether to perform processing corresponding to at least partial processing as part of performing image processing according to a specified second image signal processing set by using an original image on which at least partial processing has been performed.
[0084] According to an embodiment, the processor 120 may be further configured to compare version information about at least a portion of the first image signal processing set corresponding to at least a portion of the processing with version information about a designated second image signal processing set to determine whether to perform processing corresponding to at least a portion of the processing. According to an embodiment, the processor 120 may be further configured to skip image processing using at least a portion of the second image signal processing set when the version of at least a portion of the first image signal processing set corresponding to at least a portion of the processing is higher than the version of at least a portion of the designated second image signal processing set. According to an embodiment, the processor 120 may be further configured to perform image processing on the original image by performing image processing using at least a portion of the second image signal processing set when the version of at least a portion of the first image signal processing set corresponding to at least a portion of the processing is lower than the version of at least a portion of the designated second image signal processing set. According to an embodiment, the processor 120 may be configured to transmit, to the external electronic device 300, a second image corrected by performing image processing on the original image using the second image signal processing set using the communication module 190. According to an embodiment, the information corresponding to the at least partial processing may include information on whether the image processing is performed by at least a part of the designated first image signal processing set and at least one of device model information of the external electronic device 300, lens characteristic information of the external electronic device 300, or sensor model information of the external electronic device 300. According to an embodiment, the processor 120 may be configured to perform image processing by using the first image processing module when the first image processing module included in the second image signal processing set is not included in the first image signal processing set, and transmit the image on which the image processing is performed to the external electronic device 300.
[0085] The method of controlling an electronic device according to various embodiments may include receiving an original image on which at least a portion of processing of a specified first image signal processing set has been performed from an external electronic device, receiving information corresponding to the at least partial processing from the external electronic device, skipping the processing corresponding to the at least partial processing in a specified second image signal processing set by using the original image on which at least a portion of the processing has been performed based on the information corresponding to the at least partial processing, and performing image processing by using the second image signal processing set based on a result of the skipping.
[0086] According to an embodiment, the method may also include receiving version information about at least a portion of a first image signal processing set corresponding to at least a partial processing, and determining based on the version information whether to perform processing corresponding to at least a partial processing as part of performing image processing according to a specified second image signal processing set by using an original image on which at least a partial processing has been performed.
[0087] According to an embodiment, the method may further include comparing version information about at least a portion of the first image signal processing set corresponding to at least a portion of the processing with version information about a designated second image signal processing set to determine whether to perform processing corresponding to at least a portion of the processing. According to an embodiment, the method may further include, when the version of at least a portion of the first image signal processing set corresponding to at least a portion of the processing is higher than the version of at least a portion of the designated second image signal processing set, skipping image processing using at least a portion of the second image signal processing set. According to an embodiment, the method may further include, when the version of at least a portion of the first image signal processing set corresponding to at least a portion of the processing is lower than the version of at least a portion of the designated second image signal processing set, performing image processing on the original image by performing image processing using at least a portion of the second image signal processing set. According to an embodiment, the method may further include sending, to an external electronic device, a second image corrected by performing image processing on the original image using the second image signal processing set using a communication module. According to an embodiment, the information corresponding to at least a portion of the processing may include information about whether image processing is performed by at least a portion of the designated first image signal processing set and at least one of device model information of the external electronic device, lens characteristic information of the external electronic device, or sensor model information of the external electronic device. According to an embodiment, the method may further include performing image processing by using the first image processing module when the first image processing module included in the second image signal processing set is not included in the first image signal processing set, and transmitting the image on which the image processing is performed to an external electronic device.
[0088] According to various embodiments of the present disclosure, the electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0089] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or replacement forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the noun in the singular form corresponding to the item may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each phrase in the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of the items enumerated together in a corresponding phrase in the multiple phrases. The terms such as "first" and "second" or "first" and "secondly" used herein may represent various elements regardless of order and / or importance, and do not limit the corresponding elements. When describing an element (such as a first element) as being “operably or communicatively coupled” to another element (such as a second element) / an element (such as a first element) as being “operably or communicatively coupled to” or “connected to” another element (such as a second element), the element may be directly connected to the other element or may be connected to the other element via yet another element (for example, a third element).
[0090] The term "module" used herein may refer to a unit including, for example, a combination of one or more of hardware, software, and firmware, and may be used interchangeably with terms such as logic, logic block, part, or circuit. The module may be a single integral component suitable for performing one or more functions, or its smallest unit or part. For example, a module may be implemented as an application specific integrated circuit (ASIC).
[0091] The various embodiments set forth herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). The machine may call the stored instructions from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device 101) according to the disclosed embodiments. When the instructions are executed by a processor (e.g., processor 120), the functions corresponding to the instructions may be directly executed by the processor, or may be executed using other components under the control of the processor. One or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.
[0092] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be distributed (e.g., downloaded or uploaded) online, or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If distributed online, at least parts of the computer program product may be temporarily generated or may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).
[0093] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component, and the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performed the one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.
Claims
1. An electronic device, comprising: Memory; Communication module; and A processor, wherein the processor is configured to: Identify the original image; performing image processing on the original image according to a specified first image signal processing set; During the image processing, the original image on which at least a part of the processing of the designated first image signal processing set is performed is transmitted to an external electronic device by using the communication module; and Information corresponding to the at least partial processing is sent to the external electronic device, so that the external electronic device skips the processing corresponding to the at least partial processing in the specified second image signal processing set included in the external electronic device by using the original image on which the at least partial processing was performed.
2. The electronic device according to claim 1, wherein: The processor is configured to send version information about at least a portion of the first image signal processing set corresponding to the at least partial processing to the external electronic device as part of the information corresponding to the at least partial processing, so that the external electronic device determines whether to skip the processing based on the version information.
3. The electronic device according to claim 2, wherein: The processor is configured to: receiving, from the external electronic device, an image for which image processing is skipped by the first image processing module included in at least a part of the first image signal processing set, when the version of the first image processing module is higher than the version of the second image processing module included in at least a part of the external electronic device; as well as When a version of the first image processing module is lower than a version of a second image processing module included in at least a part of the external electronic device, an image on which image processing is performed by the first image processing module included in at least a part of the first image signal processing set is received from the external electronic device.
4. The electronic device according to claim 1, wherein: The processor is configured to receive, using the communication module, a corrected image obtained by the external electronic device by performing image processing on the original image using the second image signal processing set.
5. The electronic device according to claim 1, wherein: The information corresponding to the at least partial processing includes information about whether image processing is performed by at least a portion of the specified first image signal processing set, and at least one of device model information of the electronic device, lens characteristic information of the electronic device, or sensor model information of the electronic device.
6. The electronic device according to claim 1, wherein: The processor is configured to receive, from the external electronic device, an image on which image processing is performed by a first image processing module included in the designated second image signal processing set included in the external electronic device when the first image processing module is not included in the first image signal processing set.
7. An electronic device comprising: Communication module; and processor, Wherein, the processor is configured to: receiving, from an external electronic device by using the communication module, an original image on which at least a portion of the processing of the designated first image signal processing set is performed; receiving information corresponding to the at least part of the processing from the external electronic device; skipping the processing corresponding to the at least part of the processing in the designated second image signal processing set by using the original image on which the at least part of the processing is performed, based on the information corresponding to the at least part of the processing; and Based on the skipped result, image processing is performed by using the second image signal processing set.
8. The electronic device according to claim 7, wherein: The processor is configured to: receiving version information regarding at least a portion of the first image signal processing set corresponding to the at least a portion of the processing; and By using the original image on which the at least part of the processing is performed, it is determined based on the version information whether to perform processing corresponding to the at least part of the processing as a part of performing image processing according to the specified second image signal processing set.
9. The electronic device according to claim 7, wherein: The processor is configured to compare version information about at least a portion of the first image signal processing set corresponding to the at least partial processing with version information about the designated second image signal processing set to determine whether to perform the processing corresponding to the at least partial processing.
10. The electronic device according to claim 7, wherein: The processor is configured to skip image processing using at least a portion of the second image signal processing set when a version of at least a portion of the first image signal processing set corresponding to the at least partial processing is higher than a version of at least a portion of the designated second image signal processing set.
11. The electronic device according to claim 7, wherein: The processor is configured to perform image processing on the original image by performing image processing using at least a portion of the second image signal processing set when a version of at least a portion of the first image signal processing set corresponding to the at least partial processing is lower than a version of at least a portion of the designated second image signal processing set.
12. The electronic device according to claim 7, wherein: The processor is configured to transmit, to the external electronic device using the communication module, a second image corrected by performing image processing on the original image using the second image signal processing set.
13. The electronic device according to claim 7, wherein: The information corresponding to the at least partial processing includes information about whether image processing is performed by at least a portion of the specified first image signal processing set, and at least one of device model information of the external electronic device, lens characteristic information of the external electronic device, or sensor model information of the external electronic device.
14. The electronic device according to claim 7, wherein: The processor is configured to: performing image processing by using the first image processing module when the first image processing module included in the second image signal processing set is not included in the first image signal processing set; as well as The image on which the image processing is performed is transmitted to the external electronic device.
Citation Information
Patent Citations
Image signaling processor reconfigurable photographing apparatus and method of controlling the same
CN105814879A
Information processing device, camera with communication function, and information processing method
JP2014102691A