Apparatus and method for processing image data through a plurality of channels

Abstract

The present disclosure relates to a method of operation of an image processing device that generates an image using image data through a plurality of channels. According to the present disclosure, the method of operation of the image processing device may include: acquiring a plurality of channel data using infrared (IR) signals in each of the plurality of channels; detecting saturated image data among the plurality of channel data based on IR intensity values ​​of the plurality of channel data; reducing the IR level of an IR signal emitted through a saturated channel corresponding to the saturated image data; acquiring correction channel data using an IR signal with a reduced IR level in the saturated channel; and generating an image based on the correction channel data and the plurality of channel data.

Description

Technology Field

[0001] The present disclosure generally relates to an image processing system. More specifically, it relates to an apparatus and method for detecting a saturated image among images acquired through a plurality of channels and adaptively controlling the brightness of an infrared (IR) signal with respect to the saturated image. Additionally, the present disclosure relates to an apparatus and method for efficiently controlling an auto-exposure (AE) operation through compensation of auto-exposure (AE) data. Background Technology

[0003] A camera refers to a device that generates and processes surrounding images using optical equipment. In particular, a panoramic camera refers to an image processing device that divides a wide area into multiple regions and stitches together images of each of the multiple regions to generate a single image. That is, a panoramic camera can acquire image data through multiple channels and generate an image of a wide area through the processing of the image data.

[0004] The image processing device generates images under numerous environmental conditions, such as environments containing a large amount of reflected or saturated light, or environments containing high levels of contrast. Here, in order to efficiently generate ambient images under various optical environmental conditions, the image processing device performs an auto exposure (AE) operation that selects an exposure value to achieve a specific target luminance for a specific scene.

[0005] AE operation refers to a function that automatically controls the amount of light reaching the film and the exposure time by adjusting the aperture opening and the shutter speed. Through AE operation, the image processing device can automatically control the exposure value by considering the lighting incident on the subject, the amount of light from the subject and its surrounding environment, and the light reflectivity of the subject. In order to use AE operation smoothly, the image processing device must detect the amount of light in the imaging area in advance and control it so that a desired amount of light can flow into the image processing device.

[0006] When an image processing device is exposed to an environment exceeding the image brightness adjustment range, particularly when external illumination is very low, random noise may occur on the screen, making it impossible to distinguish subjects. To address this situation, the image processing device is equipped with IR illumination, either as an integrated unit or as a separate unit, to perform shooting functions even in environments with very low illumination or no light at all. In other words, the image processing device can capture the surroundings using IR signals generated by IR illumination.

[0007] According to the prior art, when a saturated region exists within an image in image data acquired through multiple channels, an image processing device performs an AE operation to uniformly darken the brightness of images from all channels to reduce the saturated region. In other words, there was a problem where images from all channels were affected by saturation even if the image was saturated in only one of the multiple channels, which led to a degradation in the overall performance of the image processing device. In response to this, there is a demand for the development of technology to efficiently process image data acquired through multiple channels.

[0008] The aforementioned technology is technical information that the inventor possessed for the derivation of the present invention or acquired during the process of deriving the present invention, and does not necessarily refer to known technology disclosed to the general public prior to the filing of the present invention. The problem to be solved

[0010] Based on the discussion above, the present disclosure provides an apparatus and method for processing image data acquired through a plurality of channels.

[0011] In addition, the present disclosure provides an apparatus and method for detecting a saturated channel among image data acquired through a plurality of channels and adaptively controlling the brightness of an IR (infrared) signal with respect to the saturated channel.

[0012] In addition, the present disclosure provides an apparatus and method for controlling the operation of an AE (auto exposure) through compensation of AE data for adjusting the brightness of an image.

[0013] In addition, the present disclosure provides an apparatus and method for reducing the saturated region within an image and reducing the power consumption of an image processing device through brightness control of an IR signal and AE operation control. means of solving the problem

[0015] According to various embodiments of the present disclosure, a method of operation of an image processing device for generating an image using image data through a plurality of channels may include: acquiring a plurality of channel data using infrared (IR) signals in each of the plurality of channels; detecting saturated image data among the plurality of channel data based on IR intensity values ​​of the plurality of channel data; reducing the IR level of an IR signal emitted through a saturated channel corresponding to the saturated image data; acquiring correction channel data using an IR signal with a reduced IR level in the saturated channel; and generating an image based on the correction channel data and the plurality of channel data.

[0016] According to another embodiment, the step of reducing the IR level of the IR signal emitted through the saturation channel may further include the step of maintaining the IR level of the IR signal emitted through at least one remaining channel excluding the saturation channel among the plurality of channels.

[0017] According to another embodiment, the method of operating an image processing device may further include the step of determining AE (auto exposure) data for adjusting the brightness of the image, and the step of determining whether to perform an AE operation of the image processing device based on the AE data.

[0018] According to another embodiment, the step of determining the AE data may include the step of determining initial AE data based on the plurality of channel data and the correction channel data, the step of determining compensation data regarding the data difference due to the reduction of the IR level, and the step of determining AE data by adding the compensation data to the initial AE data.

[0019] According to another embodiment, the compensation data may include the difference value between the AE data determined based on the plurality of channel data and the initial AE data.

[0020] According to another embodiment, the step of determining whether to perform the AE operation may include the step of maintaining the exposure time of the brightness of the image processing device so that the AE operation is not performed.

[0021] According to various embodiments of the present disclosure, an image processing device for generating an image using image data through a plurality of channels comprises a processor, wherein the processor acquires a plurality of channel data using infrared (IR) signals in each of the plurality of channels, detects saturated image data among the plurality of channel data based on IR intensity values ​​of the plurality of channel data, reduces the IR level of an IR signal emitted through a saturated channel corresponding to the saturated image data, acquires corrected channel data using an IR signal with a reduced IR level in the saturated channel, and generates an image based on the corrected channel data and the plurality of channel data.

[0022] According to another embodiment, the processor can maintain the IR level of an IR signal emitted through at least one remaining channel, excluding the saturated channel, among the plurality of channels.

[0023] According to another embodiment, the processor may determine AE (auto exposure) data for adjusting the brightness of the image and determine whether to perform an AE operation of the image processing device based on the AE data.

[0024] According to another embodiment, the processor may determine initial AE data based on the plurality of channel data and the correction channel data, determine compensation data regarding the data difference due to the reduction of the IR level, and determine AE data by adding the compensation data to the initial AE data.

[0025] According to another embodiment, the compensation data may include the difference value between the AE data determined based on the plurality of channel data and the initial AE data.

[0026] According to another embodiment, the processor can maintain the exposure time of the brightness of the image processing device so that the AE operation is not performed.

[0027] Various aspects and features of the invention are defined in the appended claims. Combinations of features of the dependent claims may be appropriately combined with features of the independent claims, not only as explicitly presented in the claims.

[0028] Additionally, one or more selected features of any one embodiment described in this disclosure may be combined with one or more selected features of any other embodiment described in this disclosure, and such alternative combination of features is possible if it at least partially alleviates one or more technical problems discussed in this disclosure or at least partially alleviates technical problems discernible from this disclosure by a person skilled in the art, and furthermore, such combination is possible if the specific combination or permutation of the embodiment features thus formed is not understood by a person skilled in the art to be incompatible.

[0029] In any described example implementation, two or more physically distinct components may alternatively be integrated into a single component if such integration is possible, provided that the same function is performed by the single component thus formed. Conversely, a single component of any embodiment described in this disclosure may alternatively be implemented by two or more distinct components that achieve the same function, where appropriate.

[0030] The objective of certain embodiments of the present invention is to solve, mitigate, or eliminate at least one of the problems and / or disadvantages associated with the prior art, at least partially. Certain embodiments are intended to provide at least one of the advantages described below. Effects of the invention

[0032] The apparatus and method according to various embodiments of the present disclosure enable efficient processing of image data acquired through a plurality of channels.

[0033] In addition, the apparatus and method according to various embodiments of the present disclosure detect a saturated channel among image data acquired through a plurality of channels and adaptively control the brightness of the IR signal with respect to the saturated channel, thereby enabling the reduction of a saturated area within the image.

[0034] In addition, the apparatus and method according to various embodiments of the present disclosure can reduce power consumption associated with the operation of AE by compensating for AE data for adjusting the brightness of an image.

[0035] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below. Brief explanation of the drawing

[0037] FIG. 1 illustrates an image processing system that generates an image using a plurality of channel data according to various embodiments of the present disclosure. FIG. 2 illustrates the configuration of an image processing device in an image processing system according to various embodiments of the present disclosure. FIG. 3 illustrates a schematic diagram of a method for processing channel data in an image-saturated environment in an image processing system according to various embodiments of the present disclosure. FIG. 4 illustrates a flowchart regarding a method in which an image processing device reduces a saturated area within an image through IR signal control in an image processing system according to various embodiments of the present disclosure. FIG. 5 illustrates a flowchart regarding a method in which an image processing device controls an AE operation through AE data compensation in an image processing system according to various embodiments of the present disclosure. Specific details for implementing the invention

[0038] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of other embodiments. A singular expression may include a plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art described in this disclosure. Terms used in this disclosure that are defined in a general dictionary may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined in this disclosure. In some cases, even terms defined in this disclosure are not to be interpreted to exclude the embodiments of this disclosure.

[0039] In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0040] The present disclosure relates to an apparatus and method for processing image data acquired through a plurality of channels. Specifically, when a saturated region is detected in an acquired image, the present disclosure darkens the brightness of the IR for that region and appropriately compensates for the AE data coming from the image sensor for the saturated region, thereby controlling the IR to be darkened while simultaneously preventing the AE from operating. That is, the present disclosure describes a technique for adaptively adjusting the brightness of the IR (infrared) signal with respect to a saturated channel and controlling the AE (auto exposure) operation through AE data compensation.

[0041] Hereinafter, various embodiments are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, since the technical concept of the present disclosure can be modified and implemented in various forms, it is not limited to the embodiments described in this specification. In describing the embodiments disclosed in this specification, if it is determined that specifically describing related prior art could obscure the essence of the technical concept of the present disclosure, such specific description of prior art is omitted. Identical or similar components are assigned the same reference number, and redundant descriptions thereof are omitted.

[0042] When an element is described in this specification as being "connected" to another element, this includes not only cases where they are "directly connected" but also cases where they are "indirectly connected" with another element in between. When an element is described as "comprising" another element, this means that, unless specifically stated otherwise, it does not exclude other elements in addition to the other elements but may include additional elements.

[0043] Some embodiments may be described by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a specific function. The functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks of the present disclosure may be implemented as algorithms executed on one or more processors. The functions performed by the functional blocks of the present disclosure may be performed by a plurality of functional blocks, or the functions performed by a plurality of functional blocks in the present disclosure may be performed by a single functional block. Additionally, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing, etc.

[0044] Additionally, in this disclosure, expressions such as "greater than" or "less than" have been used to determine whether specific conditions are satisfied or fulfilled; however, this is merely for illustrative purposes and does not exclude descriptions of "greater than" or "less than." Conditions described as "greater than" may be replaced with "greater than," conditions described as "less than" with "less than," and conditions described as "greater than and less than" with "greater than and less than."

[0045] Additionally, in the present disclosure, an image refers to an image conceptualized to visually capture information by a light beam or medium arranged in a plane or space. According to one embodiment of the present disclosure, an image may include still images and video images.

[0047] FIG. 1 illustrates an image processing system (100) that generates an image using a plurality of channel data according to various embodiments of the present disclosure. FIG. 1 illustrates an image processing system that generates a single panoramic image from image data through a plurality of channels.

[0048] The image processing system (100) generates an image from information obtained through optical equipment. That is, image information can pass through optical equipment and be transmitted to an image processing device (160), and the image processing device (160) can generate a single image by processing multiple channel data corresponding to the optical equipment. Referring to FIG. 1, the image processing system (100) may include multiple optical equipment (110-1 to 110-n) and an image processing device (160).

[0049] A plurality of optical devices (110-1 to 110-n) perform the function of transmitting information for image generation to an image processing device (160). The plurality of optical devices (110-1 to 110-n) can collect images for image generation using a plurality of lenses (111-1 to 111-n) and capture the collected images using a plurality of image sensors (113-1 to 113-n) to generate a plurality of channel data. Here, the plurality of optical devices (110-1 to 110-n) can directly emit an optical signal to a subject to acquire an optical signal. The plurality of optical devices (110-1 to 110-n) can acquire an optical signal reflected from a subject and generate a plurality of channel data from the reflected optical signal. According to one embodiment of the present disclosure, the optical signal may include an IR (infrared) signal. Each of the plurality of optical devices (110-1 to 110-n) can transmit the generated plurality of channel data to the image processing device (160).

[0050] The image processing device (160) performs the function of generating an image by processing information received from an image sensor. The image processing device (160) may include an image processor that generates an image from a signal output from an image sensor, and an image output device for outputting the image in a specific manner. Here, the image processor may be an image signal processor (ISP) or a digital signal processor (DSP), and the image output device may be a processor that converts the video image into various output methods, such as a composite video blanking and sync (CVBS) method, a serial digital interface (SDI) method, or a network (internet protocol) method, depending on how the video image is to be output.

[0051] According to the image processing system (100), a plurality of optical devices (110-1 to 110-n) may be arranged in different directions to precisely acquire a plurality of channel data. That is, a plurality of lenses (111-1 to 111-n) or a plurality of image sensors (113-1 to 113-n) corresponding to the plurality of lenses may be arranged in different directions to acquire channel data captured from different directions. According to one embodiment of the present disclosure, when there are a total of four optical devices connected to the image processing device (160), each of the four lenses may be arranged at 45-degree intervals, and channel data generated by passing through the four lenses and image sensors may be transmitted to the image processing device (160). The image processing device (160) may synthesize four channel data at 45-degree intervals to generate a 360-degree panoramic image.

[0052] According to the prior art, an image processing device analyzes multiple channel data and, when saturated image data is detected, performs an AE operation to adjust the brightness of the entire panoramic image. Specifically, when saturated image data is detected in the multiple channel data, the image processing device performs an AE operation to adjust the brightness of the entire panoramic image to be dark, thereby reducing the saturated area.

[0053] According to one embodiment, when an image through one image sensor is saturated, the image processing device reduced the overall exposure value through an AE operation, and consequently, there was a problem in that the brightness of the image through the remaining image sensor inevitably became darker due to the AE operation, even though the image through the other image sensor was not saturated. In addition, the image processing device consumed a large amount of power and the processing time was long as it performed an AE operation to process the image data overall. In contrast, the image processing device (160) according to the present disclosure can generate a precise panoramic image along with a reduction in the saturated area through IR signal control and AE data compensation. The specific operation of the image processing device (160) of the present disclosure is described in detail in FIGS. 2 to 5.

[0055] FIG. 2 illustrates the configuration (200) of an image processing device (160) in an image processing system (100) according to various embodiments of the present disclosure. Terms such as ‘… unit’, ‘… device’ used below refer to a unit that processes at least one function or operation, and this may be implemented as hardware or software, or a combination of hardware and software. The image processing device (160) may include a memory (210), a processor (220), a communication unit (230), and an input / output interface (240).

[0056] The memory (210) temporarily or permanently stores data such as basic programs, application programs, and setting information for the operation of the image processing device (160). The memory (210) may include a non-perishable permanent mass storage device such as RAM (random access memory), ROM (read only memory), and a disk drive, but the present invention is not limited thereto. These software components may be loaded from a computer-readable recording medium separate from the memory (210) using a drive mechanism. This separate computer-readable recording medium may include computer-readable recording media such as a floppy drive, disk, tape, DVD / CD-ROM drive, or memory card. According to an embodiment, the software components may be loaded into the memory (210) through a communication unit (230) rather than a computer-readable recording medium. Additionally, the memory (210) may provide stored data upon a request from the processor (220). According to one embodiment of the present disclosure, the memory (210) may store a plurality of channel data.

[0057] The processor (220) controls the overall operations of the image processing device (160). For example, the processor (220) can control the transmission and reception of signals through the communication unit (230). Additionally, the processor (220) can be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor (220) by the memory (210) or the communication unit (230). For example, the processor (220) can be configured to execute instructions received according to program code stored in a recording device such as the memory (210). The processor (220) can perform the function of the image processing device (160) generating an image from multiple channel data. The processor (220) may include an image processor such as an ISP or DSP, and can generate a panoramic image by synthesizing and processing image data through channels using the image processor. For example, the processor (220) can control the image processing device (160) to perform operations according to various embodiments described below.

[0058] The communication unit (230) performs functions for transmitting and receiving signals through a wireless channel. All or part of the communication unit (230) may be referred to as a transmitting unit, a receiving unit, or a transmitting and receiving unit. The communication unit (230) may provide functions for the image processing device (160) and at least one other node to communicate with each other through a communication network. According to one embodiment of the present disclosure, when the processor (220) of the image processing device (160) generates a request signal according to program code stored in a recording device such as a memory (210), the request signal may be transmitted to at least one other node through a communication network under the control of the communication unit (230). Conversely, a control signal, command, content, file, etc. provided under the control of the processor of at least one other node may be received by the image processing device (160) through the communication unit (230).

[0059] The input / output interface (240) may be a means for interfacing with an input / output device (not shown). In this case, the input device may be provided in the form of, for example, a device such as a keyboard or a mouse, and the output device may be provided in the form of a device such as a display unit for displaying images. As another example, the input / output interface (240) may be a means for interfacing with a device in which the functions for input and output are integrated into one, such as a touchscreen. Additionally, in other embodiments, the image processing device (160) may include more components than those shown in FIG. 2.

[0061] FIG. 3 illustrates a schematic diagram (300) regarding a method for processing channel data in an image-saturated environment in an image processing system (100) according to various embodiments of the present disclosure.

[0062] The image processing device (160) acquires image data through multiple channels and generates a single image from the acquired image data. Specifically, multiple lenses may be arranged in different directions, and each of the multiple lenses acquires channel data captured from a different direction and transmits it to the image processing device (160). The image processing device (160) can generate a panoramic image by synthesizing multiple channel data through multiple lenses.

[0063] Referring to FIG. 3, the image processing device (160) can emit an optical signal to a subject through a plurality of lenses and can acquire a plurality of channel data from the optical signal reflected from the subject. Here, at least a portion of the image acquired by the image processing device (160) may be saturated depending on the lens arrangement and the amount of light in the surrounding environment.

[0064] When saturated image data is detected among the acquired multiple channel data, the image processing device (160) can adaptively change the brightness of the IR signal and control the AE operation. Specifically, the image processing device (160) can check the IR intensity value in each of the multiple channel data. The image processing device (160) can detect saturated image data among the multiple channel data by comparing the IR intensity values ​​corresponding to each of the multiple channel data. Subsequently, the image processing device (160) can reduce the IR level of the IR signal emitted through the saturated channel corresponding to the saturated image data. Subsequently, the image processing device (160) can acquire the channel data again using the IR signal in which the IR level has been reduced in the saturated channel.

[0065] Additionally, the image processing device (160) can reduce power consumption associated with AE operation by controlling that AE operation is not performed through AE data compensation. Specifically, the image processing device (160) can determine AE data for adjusting the brightness of an image by compensating the AE data with compensation data regarding the data difference resulting from the reduction of the IR level. Here, the compensation data may indicate a difference between the exposure value determined according to multiple channel data before the reduction of the IR level and the exposure value determined according to multiple channel data after the reduction of the IR level. The image processing device (160) can determine whether to perform the AE operation of the image processing device based on the determined AE data.

[0066] According to one embodiment of the present disclosure, an image processing device (160) can acquire channel data through first to fourth lenses (301-1 to 301-4). The image processing device (160) can emit an IR signal to a subject through first to fourth lenses (301-1 to 301-4) and can acquire a plurality of channel data from the IR signal reflected from the subject. Here, if the subject is placed close to at least one lens, the image acquired by the image processing device (160) through the lens may be saturated. As shown in FIG. 3, if a wall surface (303) is placed around the first lens (301-1), the image acquired through the first lens (301-1) may be saturated. That is, channel data through the first lens (301-1) can be processed into saturated image data in which some areas within the image are IR saturated, and channel data through the second to fourth lenses (301-2 to 301-4) can be processed into normal image data. At this time, the image processing device (160) can reduce the IR level of the IR signal emitted through the first lens (301-1) and reacquire channel data using the reduced IR signal. That is, the image processing device (160) can generate a panoramic image by synthesizing the reduced channel data acquired through the first lens (301-1) and the channel data acquired through the second to fourth lenses (301-2 to 301-4). As a result, the image processing device (160) can reduce the saturated area within the image by adaptively controlling the IR level of the IR signal through the saturated channel.

[0067] Additionally, the image processing device (160) can determine the AE data by adding compensation data regarding the data difference resulting from the reduction of the IR level to the AE data. The image processing device (160) can determine the difference between the exposure value determined according to multiple channel data before the reduction of the IR level and the exposure value determined according to multiple channel data after the reduction of the IR level as compensation data, and determine the final AE data by adding the compensation data to the AE data. That is, since the AE data is compensated by the amount by which the level of the IR signal is reduced, the image processing device (160) determines that the exposure value is sufficient and does not perform the AE operation. As a result, the image processing device (160) can reduce the power consumed by not performing the AE operation.

[0069] FIG. 4 illustrates a flowchart (400) relating to a method in which an image processing device (160) reduces a saturated area within an image through IR signal control in an image processing system (100) according to various embodiments of the present disclosure. FIG. 4 illustrates a method of generating an image using image data through a plurality of channels.

[0070] Referring to FIG. 4, in step (401), the image processing device (160) acquires multiple channel data using IR signals in each of the multiple channels. The image processing device (160) can acquire channel data by emitting IR signals in each of the multiple channels and collecting IR signals reflected from a subject. According to one embodiment of the present disclosure, the multiple channel data may include at least one of saturated image data in which a portion of the image area is saturated and general image data that is not saturated.

[0071] In step (403), the image processing device (160) detects saturated image data among the plurality of channel data based on the IR intensity values ​​of the plurality of channel data. According to one embodiment of the present disclosure, the image processing device (160) checks the IR intensity values ​​in each of the plurality of channel data and can identify channel data having an IR intensity value greater than or equal to a preset threshold value as saturated image data.

[0072] In step (405), the image processing device (160) reduces the IR level of the IR signal emitted through the saturation channel corresponding to the saturated image data. According to one embodiment of the present disclosure, the image processing device (160) may reduce the IR level of the emitted IR signal with respect to the saturation channel in which the saturated image data is acquired. According to one embodiment of the present disclosure, the image processing device (160) may maintain the IR level of the emitted IR signal with respect to at least one remaining channel excluding the saturation channel among a plurality of channels.

[0073] In step (407), the image processing device (160) obtains correction channel data using an IR signal with a reduced IR level in the saturated channel. According to one embodiment of the present disclosure, the image processing device (160) may obtain correction channel data using a reduced IR signal with respect to the saturated channel. The image processing device (160) may use the channel data obtained in step (401) with respect to the remaining channels.

[0074] In step (409), the image processing device (160) generates an image based on correction channel data and a plurality of channel data. According to one embodiment of the present disclosure, the image processing device (160) receives correction channel data corresponding to a saturated channel and channel data corresponding to the remaining channels, and can generate a panoramic image by synthesizing the received channel data.

[0076] FIG. 5 illustrates a flowchart (500) relating to a method in which an image processing device (160) controls an AE operation through AE data compensation in an image processing system (100) according to various embodiments of the present disclosure. FIG. 5 illustrates a method in which the image processing device (160) determines whether to perform an AE operation after adaptively controlling the brightness of an IR signal.

[0077] Referring to FIG. 5, in step (501), the image processing device (160) determines AE data for adjusting the brightness of the image. The image processing device (160) may determine AE data for determining whether to perform AE operation. According to one embodiment of the present disclosure, the image processing device may determine initial AE data based on a plurality of channel data and correction channel data, determine compensation data regarding the data difference due to a decrease in IR level, and determine AE data by adding the compensation data to the initial AE data. Here, the compensation data may include the difference value between the AE data determined based on the plurality of channel data and the initial AE data.

[0078] In step (503), the image processing device (160) determines whether to perform an AE operation of the image processing device based on the AE data. The image processing device (160) may perform an AE operation if the AE data is below a preset threshold value. In response, the image processing device (160) may maintain the exposure time of the brightness of the image sensor so that the AE operation is not performed by increasing the value of the AE data through compensation data.

[0079] Methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0080] When implemented in software, a computer-readable storage medium may be provided for storing one or more programs (software modules). One or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. One or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims or specification of this disclosure.

[0081] Such programs (software modules, software) may be stored in random access memory, non-volatile memory including flash memory, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic disc storage devices, compact disc-ROM (CD-ROM), digital versatile discs (DVDs), or other forms of optical storage devices, magnetic cassettes. Alternatively, they may be stored in memory composed of some or all of these. Additionally, each constituent memory may include multiple units.

[0082] Additionally, the program may be stored on an attachable storage device that can be accessed via a communication network such as the Internet, Intranet, LAN (local area network), WAN (wide area network), or SAN (storage area network), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure through an external port. Additionally, a separate storage device on a communication network may be connected to a device performing an embodiment of the present disclosure.

[0083] In the specific embodiments of the present disclosure described above, the components included in the disclosure are expressed in a singular or plural form according to the specific embodiments presented. However, the singular or plural expression is selected to suit the situation presented for convenience of explanation, and the present disclosure is not limited to singular or plural components; even if a component is expressed in the plural form, it may be composed of a singular form, and even if a component is expressed in the singular form, it may be composed of a plural form.

[0084] Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, it is understood that various modifications are possible within the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be defined by the claims set forth below as well as equivalents thereof. Explanation of the symbols

[0086] 110-1 to 110-n multiple optical devices 111-1 to 111-n multiple lenses 113-1 to 113-n Multiple image sensors 160 Image Processing Unit 210 memory 220 processor 230 Communications Department 240 I / O interface 301-1 to 301-4 First to Fourth Lenses 303 Wall

Claims

Claim 1 A method of operation of an image processing device for generating an image using image data through multiple channels, comprising: a step of acquiring multiple channel data using infrared (IR) signals in each of the multiple channels; a step of detecting saturated image data among the multiple channel data based on IR intensity values ​​of the multiple channel data; a step of reducing the IR level of an IR signal emitted through a saturated channel corresponding to the saturated image data; a step of acquiring correction channel data using an IR signal with a reduced IR level in the saturated channel; and a step of generating an image based on the correction channel data and the multiple channel data, and further comprising a step of determining auto exposure (AE) data for adjusting the brightness of the image, wherein the step of determining the AE data comprises: a step of determining initial AE data based on the multiple channel data and the correction channel data; a step of determining compensation data regarding a data difference due to the reduction of the IR level; and a step of determining AE data by adding compensation data to the initial AE data. Claim 2 The method of claim 1, wherein the step of reducing the IR level of the IR signal emitted through the saturation channel further comprises the step of maintaining the IR level of the IR signal emitted through at least one remaining channel excluding the saturation channel among the plurality of channels. Claim 3 A method according to claim 1, further comprising the step of determining whether to perform an AE operation of the image processing device based on the AE data. Claim 4 delete Claim 5 A method according to claim 3, wherein the compensation data includes a difference value between the AE data determined based on the plurality of channel data and the initial AE data. Claim 6 A method according to claim 3, wherein the step of determining whether to perform the AE operation includes the step of maintaining the exposure time of the brightness of the image processing device so that the AE operation is not performed. Claim 7 An image processing device for generating an image using image data through multiple channels, wherein the image processing device includes a processor, and the processor acquires multiple channel data using infrared (IR) signals in each of the multiple channels, detects saturated image data among the multiple channel data based on IR intensity values ​​of the multiple channel data, reduces the IR level of an IR signal emitted through a saturated channel corresponding to the saturated image data, acquires correction channel data using an IR signal with a reduced IR level in the saturated channel, generates an image based on the correction channel data and the multiple channel data, determines auto exposure (AE) data for adjusting the brightness of the image, determines initial AE data based on the multiple channel data and the correction channel data, determines compensation data regarding a data difference due to the reduction of the IR level, and determines AE data by adding the compensation data to the initial AE data. Claim 8 In claim 7, the processor is an image processing device that maintains the IR level of an IR signal emitted through at least one remaining channel excluding the saturated channel among the plurality of channels. Claim 9 In claim 7, the processor is an image processing device that determines whether to perform an AE operation of the image processing device based on the AE data. Claim 10 delete Claim 11 An image processing device according to claim 9, wherein the compensation data includes a difference value between the AE data determined based on the plurality of channel data and the initial AE data. Claim 12 In claim 9, the processor is an image processing device that maintains the exposure time of the brightness of the image processing device so that the AE operation is not performed.

Images