Image processing device and operation method thereof
By using the target pixel detector, corrector and compensator in the image processing system to detect and correct the noise pixels in the image sensor, the problem of the average pixel value drop after the image sensor is removed is solved, and the image quality is improved.
Patent Information
- Application Number
- CN202210322371.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-09-09
- Filing Date
- 2022-03-30
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-03-30
AI Technical Summary
Existing image sensors have difficulty maintaining the average pixel value of the image after removing noise, resulting in a degradation of image quality.
An image processing system is designed, including a target pixel detector, a target pixel corrector and a target pixel compensator. By detecting noise pixels in the image sensor, correcting and compensating using the average value of adjacent pixels to ensure the average pixel of the image. The value remains stable.
The noise in the image is effectively removed, the average pixel value of the image is maintained, the image quality is improved, and the impact of noise on the image is reduced.
Smart Images

Figure CN115802181B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an image processing system, and more particularly, to an image processing system and an operating method thereof. Background Art
[0002] Image sensors are devices that capture images using semiconductors that react to light. Recently, with the development of the computer industry and the communication industry, there is an increasing demand for image sensors with improved performance for various products such as smartphones, digital cameras, game devices, the Internet of Things, robots, security cameras, and medical miniature cameras.
[0003] Image sensors can generally be classified as charge coupled device (CCD) image sensors or complementary metal oxide semiconductor (CMOS) image sensors. CCD image sensors have less noise and better image quality than CMOS image sensors. However, CMOS image sensors have a simple driving method and can be implemented for various scanning methods. In addition, because CMOS image sensors can be integrated on a single chip together with signal processing circuits, the product is easy to miniaturize, power consumption is very low, and because CMOS process technology can be used interchangeably, the manufacturing cost is low. Recently, CMOS image sensing systems have been increasingly used in mobile devices. Summary of the invention
[0004] Embodiments of the present disclosure provide an image processing system and an operating method thereof for maintaining an average pixel value of an image even after removing noise generated in the image.
[0005] According to an embodiment of the present disclosure, an image processing device may include: a target pixel detector, which is configured to detect a plurality of target pixels generating noise among a plurality of pixels included in an image sensor; a target pixel corrector, which is configured to change a target pixel value as a pixel value of a plurality of target pixels by using an average pixel value of adjacent pixels included in a preset range based on a position of each of the plurality of target pixels; and a target pixel compensator, which is configured to compensate the target pixel value using a cumulative value obtained by accumulating a value corresponding to a decimal fraction part of the average value.
[0006] According to one embodiment of the present invention, an image processing device may include: a target pixel detector configured to detect a plurality of target pixels generating noise among a plurality of pixels included in an image sensor; a target pixel corrector configured to change a target pixel value as a pixel value of a plurality of target pixels by using an average pixel value of contact pixels contacting in a horizontal direction based on a position of each of the plurality of target pixels; and a target pixel compensator configured to compensate the target pixel value based on a sum value of the pixel values of the contact pixels.
[0007] According to an embodiment of the present disclosure, a method for operating an image processing device may include: receiving pixel values of multiple pixels indicating an image; changing the pixel value of a first target pixel by using an average pixel value of adjacent pixels included within a predetermined range of a first target pixel generating noise among the multiple pixels; obtaining a first decimal value, which is a value corresponding to a decimal part of the average pixel value corresponding to the first target pixel; changing the pixel value of a second target pixel by using an average pixel value of adjacent pixels included within a predetermined range of a second target pixel generating noise among the multiple pixels; generating a cumulative value obtained by accumulating the second decimal value and the first decimal value, the second decimal value being a value corresponding to the decimal part of the average pixel value corresponding to the second target pixel; and compensating the pixel value of the first target pixel or the pixel value of the second target pixel based on the cumulative value.
[0008] According to an embodiment of the present disclosure, a method for operating an image processing device may include: receiving pixel values of multiple pixels indicating an image; detecting multiple target pixels generating noise among the multiple pixels; calculating a sum value of pixel values of contact pixels that are contacted in a vertical direction based on the position of each of the multiple target pixels; changing a target pixel value that is a pixel value of the multiple target pixels by using a corresponding average pixel value of the sum value; generating a cumulative value increased by one (1) in response to an odd sum value among the sum values; determining a target pixel among the multiple target pixels corresponding to the sum value obtained by increasing the cumulative value from an odd number to an even number as a compensation pixel; and adding a predetermined compensation value to the pixel value of the compensation pixel.
[0009] According to an embodiment of the present disclosure, an image processing device may include: an image sensor, which is configured to transmit a pixel value of a first pixel indicating an image; a target pixel detector, which is configured to detect a second pixel generating noise among the first pixels based on the pixel value of the first pixel; a target pixel corrector, which is configured to change a target pixel value which is a pixel value of a second pixel by using an average pixel value of a third pixel respectively determined according to a position of the second pixel in the image; a target pixel compensator, which is configured to compensate the target pixel value using a cumulative value obtained by accumulating a value corresponding to a decimal fraction part of the average value; and an output manager, which is configured to output the pixel value of the first pixel including the second pixel whose pixel value is compensated.
[0010] According to an embodiment of the present disclosure, it is possible to provide an image processing system that maintains an average pixel value of an image even after noise generated in the image is removed. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a diagram illustrating an image processing system according to an embodiment of the present disclosure.
[0012] Figure 2 is an example of an embodiment according to the present disclosure Figure 1 Figure 1. Image sensor diagram of an image sensor.
[0013] Figure 3 is a diagram illustrating noise generated in an image according to an embodiment of the present disclosure.
[0014] Figure 4 is a diagram illustrating noise generated in a phase detection auto focus pixel according to an embodiment of the present disclosure.
[0015] Figure 5 is a block diagram illustrating an image processing system according to an embodiment of the present disclosure.
[0016] Figure 6 is a diagram illustrating a target pixel and adjacent pixels according to an embodiment of the present disclosure.
[0017] Figure 7 is a diagram illustrating a target pixel and pixels adjacent to the target pixel according to an embodiment of the present disclosure.
[0018] Figure 8 is a diagram illustrating a randomly determined compensation value according to an embodiment of the present disclosure.
[0019] Fig. 9 is a flowchart illustrating a method of compensating a pixel value of a target pixel that changes based on an accumulation value according to an embodiment of the present disclosure.
[0020] Fig.10 is a flowchart illustrating a method of determining a compensation value according to an embodiment of the present disclosure.
[0021] Fig.11 is a flowchart illustrating a method of compensating a pixel value of a target pixel that changes based on an accumulation value according to another embodiment of the present disclosure.
[0022] Fig.12 is a flowchart illustrating a method of compensating a pixel value of a target pixel according to yet another embodiment of the present disclosure.
[0023] Fig.13 is a block diagram illustrating a computing system including an image sensor according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0024] The specific structural or functional description of the embodiments of the concepts disclosed in this specification or this application is only exemplified for describing the embodiments of the concepts disclosed in this application. The embodiments of the concepts disclosed in this application can be implemented in various forms and should not be interpreted as being limited to the embodiments described in this specification or this application.
[0025] Hereinafter, in order to describe the present disclosure in sufficient detail so that a person skilled in the art to which the present disclosure pertains can realize the technical spirit of the present disclosure, embodiments of the present disclosure will be described with reference to the accompanying drawings.
[0026] Figure 1 is a diagram illustrating an image processing system according to an embodiment of the present disclosure.
[0027] Reference Figure 1 , the image processing system 10 may include an image sensor 100 and an image processing device 200 .
[0028] The image processing system 10 may obtain an image. In addition, the image processing system 10 may store, display, or output an output image obtained by processing the image to an external device. The image processing system 10 may output the output image to a host according to a request of the host.
[0029] In an embodiment, the image processing system 10 may be implemented in the form of a package module, a component, etc. In this case, the image processing system 10 may be installed on a host. The host may be implemented as one of various electronic devices. For example, the host may be implemented as a digital camera, a mobile device, a smart phone, a personal computer (PC), a tablet PC, a notebook computer, a personal digital assistant (PDA), an enterprise digital assistant (EDA), a portable multimedia player (PMP), a wearable device, a black box, a robot, an autonomous driving vehicle, etc.
[0030] In another embodiment, the image processing system 10 can be implemented as an electronic device separated from the host. For example, the image processing system 10 can be implemented as an imaging device, a digital camera, a portable camera, a closed-circuit television (CCTV), a webcam, a security camera, an industrial visual camera, a mobile device, a smart phone, a PC, a tablet PC, a laptop, a PDA, an EDA, a PMP, a wearable device, a black box, a robot, an autonomous vehicle, a vehicle-mounted visual camera, a set-top box, a game console, an electronic dictionary, an e-book reader, a desktop computer, a server, an MP3 player, an intelligent medical device, a television, a digital video disc (DVD) player, a stereo, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a smart mirror, a smart window, an electronic key, an electronic photo frame, a digital billboard, a security control panel, etc. Here, the wearable device can be a smart watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, a head-mounted device (HMD), a skin pad, a tattoo, a bio-implanted circuit, etc.
[0031] The image sensor 100 may be implemented as a charge coupled device (CCD) image sensor and a complementary metal oxide semiconductor (CMOS) image sensor. The image sensor 100 may generate image data for an object (not shown) input (or captured) through a lens (not shown). The lens (not shown) may include at least one lens forming an optical system.
[0032] The image sensor 100 may include a plurality of pixels. The image sensor 100 may generate a plurality of pixel values DPX corresponding to the captured image in the plurality of pixels. The plurality of pixel values DPX generated by the image sensor 100 may be sent to the image processing apparatus 200. That is, the image sensor 100 may generate a plurality of pixel values DPX corresponding to a single frame.
[0033] The image processing device 200 may perform processing for improving the image quality of pixel data received from the image sensor 100 and output the processed image data. Here, the processing may be electronic image stabilization (EIS), interpolation, tone correction, image quality correction, resizing, etc.
[0034] exist Figure 1 In the embodiment of the present disclosure, the image processing device 200 may be implemented as a chip independent of the image sensor 100. In this case, the chip of the image sensor 100 and the chip of the image processing device 200 may be implemented as one package, for example, a multi-chip package. In another embodiment of the present disclosure, the image processing device 200 may be included as a part of the image sensor 100 to be implemented as a single chip.
[0035] In an embodiment, the image processing system 10 may further include a memory. The memory may be implemented as a non-volatile memory element. For example, the memory may be configured by various memory elements such as a read-only memory (ROM) that can only read data, a one-time programmable (OTP) memory that can only write once, an erasable programmable ROM (EPROM) that can erase and write stored data, a NAND flash memory, and a NOR flash memory.
[0036] Figure 2 is an example of an embodiment according to the present disclosure Figure 1 FIG. 1 is a diagram of an image sensor 100 .
[0037] Reference Figure 2 , the image sensor 100 may include a pixel array 110 , a row decoder 120 , a timing generator 130 , and a signal converter (or signal transducer) 140 .
[0038] The pixel array 110 may include a color filter array 111 according to an embodiment, and a photoelectric conversion layer 113 formed below the color filter array 111 and including a plurality of photoelectric conversion elements corresponding to each pixel of the color filter array 111. The pixel array 110 may include a plurality of pixels for outputting color information contained in incident light. Each of the plurality of pixels may output a pixel signal corresponding to the incident light passing through the corresponding color filter array 111.
[0039] The color filter array 111 may include a color filter that passes only a specific wavelength (e.g., red, blue, or green) of light incident on each pixel. In the present disclosure, the color filter may be represented as a color channel. Due to the color filter array 111, the pixel data of each pixel may indicate a value corresponding to the intensity of the specific wavelength of light.
[0040] Specifically, each of the plurality of pixels can accumulate photocharges generated according to incident light and generate a pixel signal corresponding to the accumulated photocharges. Each pixel can include a photoelectric conversion element (e.g., a photodiode, a phototransistor, a photogate, or a pinned photodiode) that converts the photosignal into an electrical signal, and at least one transistor for processing the electrical signal.
[0041] The pixel array 110 may include a plurality of pixels arranged in a row direction and a column direction. The pixel array 110 may generate a plurality of pixel signals VPX for each row. Each of the plurality of pixel signals VPX may be an analog pixel signal VPX.
[0042] The row decoder 120 may select one row among a plurality of rows in which a plurality of pixels are arranged in the pixel array 110 in response to an address and a control signal output from the timing generator 130 .
[0043] The signal converter 140 may convert a plurality of analog pixel signals VPX into a plurality of digital pixel values DPX. The plurality of digital pixel values DPX may be output in various modes. The signal converter 140 may perform correlated double sampling (CDS) on each signal output from the pixel array 110 in response to a control signal output from the timing generator 130, and perform analog-to-digital conversion on each signal on which CDS is performed to output each digital signal. Each digital signal may be a signal corresponding to the intensity of the wavelength of incident light passing through the corresponding color filter array 111.
[0044] The signal converter 140 may include a CDS block and an analog-to-digital converter (ADC) block. The CDS block may sequentially sample and hold a reference signal and an image signal group provided to each of a plurality of column lines included in the pixel array 110. That is, the CDS block may sample and hold the levels of the reference signal and the image signal corresponding to each column. The ADC block may output pixel data obtained by converting the CDS signal for each column output from the CDS block into a digital signal. To this end, the ADC block may include a comparator and a counter corresponding to each column.
[0045] In addition, the image sensor 100 according to an embodiment of the present disclosure may further include an output buffer 150. The output buffer 150 may be implemented as a plurality of buffers storing digital signals output from the signal converter 140. Specifically, the output buffer 150 may latch and output pixel data of each column provided from the signal converter 140. The output buffer 150 may temporarily store the pixel data output from the signal converter 140, and sequentially output the pixel data under the control of the timing generator 130. According to an embodiment of the present disclosure, the output buffer 150 may be omitted.
[0046] Figure 3 is a diagram illustrating noise generated in an image according to an embodiment of the present disclosure.
[0047] Reference Figure 3 , noise may be generated in the image 300 including a plurality of pixels. Among the plurality of pixels, a pixel whose pixel value differs from an adjacent pixel by a predetermined threshold or more may be determined as a pixel generating noise. Figure 3 An image in which noise is generated can be exemplified.
[0048] The image 300 including a plurality of pixels may include phase detection auto focus (PDAF) pixels 310, 320, 330, and 340 that do not maintain linear characteristics with adjacent pixels. The PDAF pixels 310, 320, 330, and 340 may be photodiode (PD) pixels. The PD pixels may not maintain linear characteristics with adjacent pixels because the characteristics of the pixels vary depending on the position. That is, the pixel values of the PDAF pixels 310, 320, 330, and 340 may be determined as noise.
[0049] The image 300 including a plurality of pixels may include a plurality of defective pixels 350 and 360. The plurality of defective pixels 350 and 360 may be generated due to various reasons. For example, each of the plurality of pixels included in the CMOS image sensor may accumulate photocharges generated according to incident light and generate a pixel signal corresponding to the accumulated photocharges. Interference light may be generated according to the distance between the plurality of pixels. When the interference light and the incident light are incident on the CMOS image sensor, noise may be generated at the output of the CMOS image sensor.
[0050] The difference between the pixel value of the pixel generating noise and the pixel value of the adjacent pixel may be greater than or equal to a predetermined threshold. The image processing device may determine a pixel whose pixel value differs from the pixel value of the adjacent pixel by a predetermined threshold or more as a pixel generating noise. For example, the image processing device may determine that noise is generated in the PDAF pixels 310, 320, 330, and 340 and the defective pixels 350 and 360.
[0051] Fixed pattern noise may be caused by non-uniformity generated during the production process of the CMOS image sensor. Fixed pattern noise caused by non-uniformity may be noise in the form of stripes in the vertical or horizontal direction. Defective pixels or PDAF pixels included in the CMOS image sensor may cause fixed pattern noise.
[0052] Figure 4 is a diagram illustrating noise generated in a PDAF pixel according to an embodiment of the present disclosure.
[0053] Reference Figure 4 , an on-chip lens (OCL) may be placed to allow light to be incident on the pixel. The size of the OCL may be changed to correspond to the pixel located below the OCL.
[0054] One OCL 420 may correspond to one normal pixel 421. When light is incident through one OCL 420, a pixel value may be output from one normal pixel 421.
[0055] The PDAF pixels 310 and 320 may correspond to one OCL 410. Since light is incident on the PDAF pixels 310 and 320 through one OCL 410, the pixel values of the PDAF pixels 310 and 320 may be different from the pixel value of one normal pixel 421.
[0056] When the difference between the pixel value of the PDAF pixels 310 and 320 and the pixel value of one normal pixel 421 is greater than or equal to a predetermined threshold, the image processing apparatus may determine that the PDAF pixels 310 and 320 are pixels generating noise. Noise may be generated in the PDAF pixels 310 and 320 due to the difference in OCL.
[0057] Figure 5 is a block diagram illustrating an image processing system according to an embodiment of the present disclosure.
[0058] Reference Figure 5 , the image processing device 200 may receive a plurality of pixel values from the image sensor 100 including a plurality of pixels. The image processing device 200 may remove noise based on the received plurality of pixel values. The image processing device 200 may include a target pixel detector 210, a target pixel corrector 220, and a target pixel compensator 230. Each of the target pixel detector 210, the target pixel corrector 220, and the target pixel compensator 230 may be implemented as hardware, software, or a combination of hardware and software. For example, the target pixel detector 210 may be a target pixel detection circuit operating according to an algorithm and / or a processor executing a target pixel detection code. The target pixel corrector 220 may be a target pixel correction circuit operating according to an algorithm and / or a processor executing a target pixel correction code. The target pixel compensator 230 may be a target pixel compensation circuit operating according to an algorithm and / or a processor executing a target pixel compensation code.
[0059] The target pixel detector 210 may detect a plurality of target pixels generating noise among a plurality of pixels included in the image sensor 100. The target pixel detector 210 may detect a pixel corresponding to a pixel value that differs from a pixel value of an adjacent pixel by a predetermined threshold or more as a target pixel. The difference between the pixel value of a defective pixel or the pixel value of a PDAF pixel and the pixel value of an adjacent pixel may be greater than a predetermined threshold. The target pixel detector 210 may detect a defective pixel or a PDAF pixel as a target pixel.
[0060] The target pixel corrector 220 may change the target pixel value as the pixel value of the plurality of target pixels by using the average pixel value of the adjacent pixels included in a preset range based on the position of each of the plurality of target pixels. The target pixel corrector 220 may change the target pixel value into an integer value, which is a value corresponding to the integer part of the average pixel value corresponding to the plurality of target pixels respectively. Since the target pixel corrector 220 uses only the integer value of the average pixel value when correcting the pixel value of the plurality of target pixels, the decimal fraction value corresponding to the decimal fraction part of the average pixel value may not be used. Since the decimal fraction value is not used, the total average pixel value of the image after correcting the plurality of target pixels may be less than the total average pixel value of the image before correcting the plurality of target pixels.
[0061] When the arrangement of the target pixels is regular, the average pixel value of the row or column including the target pixels may be reduced in the image. When the average pixel value of the row or column decreases, a fixed pattern noise with a regular arrangement may be generated. The fixed pattern noise generated in the image may increase correspondingly to the density of the target pixels included in the image. When the PDAF pixels are included in the image, the arrangement of the target pixels may be regular.
[0062] The target pixel compensator 230 may compensate the target pixel value using a cumulative value obtained by accumulating a value corresponding to a decimal fraction of the average pixel value. The target pixel compensator 230 may add the compensation value to the target pixel value. In an embodiment of the present disclosure, the compensation value may be 0 or 1.
[0063] The target pixel compensator 230 may further include a cumulative value manager 231, a sensor 232, and a compensation determiner 233. The cumulative value manager 231, also referred to as a cumulative manager, may generate a cumulative value obtained by accumulating decimal values, which are values corresponding to decimal fractions of average pixel values respectively corresponding to a plurality of target pixels. The sensor 232 may sense the occurrence of the decimal value when the average pixel value and the integer value of the average pixel value are different from each other. The compensation determiner 233 may determine each compensation value to be added to the target pixel value based on the cumulative value.
[0064] Whenever the target pixel corrector 220 changes the pixel value of the target pixel, the cumulative value manager 231 may generate a cumulative value obtained by accumulating the decimal fraction value of the average pixel value. The cumulative value manager 231 may accumulate the decimal fraction value of the average pixel value that is not used to change the pixel value of the target pixel. As the number of target pixels whose pixel values are changed increases, the cumulative value may increase.
[0065] The compensation determiner 233 may compare the cumulative value with a predetermined reference value in response to the occurrence of a decimal fraction value. When the cumulative value is greater than or equal to the predetermined reference value, the compensation determiner 233 may determine the compensation value to be 1. The cumulative value manager 231 may subtract the reference value from the cumulative value in response to the compensation value determined to be 1. The target pixel compensator 230 may add the compensation value determined to be 1 to the pixel value of the target pixel changed to an integer value. That is, the pixel value of the target pixel may be increased by 1. When the cumulative value is less than the reference value, the compensation determiner 233 may determine the compensation value to be 0. The pixel value of the target pixel whose compensation value is 0 may be maintained.
[0066] In another embodiment of the present disclosure, the compensation determiner 233 may determine a compensation value corresponding to a pixel value of a target pixel whose position is predetermined among a plurality of target pixels detected by the target pixel detector 210 to be 1. For example, a PDAF pixel may be a target pixel whose position is predetermined.
[0067] In another embodiment of the present disclosure, the compensation determiner 233 may determine the compensation value corresponding to the pixel value of the target pixel whose position is random among the target pixels detected by the target pixel detector 210 to be 1. For example, the defective pixel may be a target pixel whose position is random.
[0068] The cumulative value manager 231 may subtract the reference value from the cumulative value in response to the compensation value being determined to be 1. The cumulative value may decrease when the compensation value is determined to be 1. In an embodiment of the present disclosure, the cumulative value may be maintained within a certain range.
[0069] In an embodiment of the present disclosure, the predetermined reference value may be 1. When the pixel value of the first target pixel is corrected, a decimal value of the average pixel value may be generated. At this time, the cumulative value may be a decimal value corresponding to the first target pixel. Since the cumulative value is less than the predetermined reference value 1, the compensation value corresponding to the first target pixel may be determined to be 0. Since the compensation value corresponding to the first target pixel is 0, the pixel value of the first target pixel changed to an integer value may be maintained. When the pixel values of multiple target pixels are corrected, the cumulative value may increase. When the cumulative value is greater than or equal to 1, the pixel value of the target pixel changed to an integer value may increase by 1. When the compensation value is determined to be 1, the cumulative value manager 231 may subtract 1 from the cumulative value.
[0070] In another embodiment of the present disclosure, the compensation determiner 233 may randomly determine the compensation value to be 0 or 1 in response to the occurrence of a decimal value. When the average pixel value and the integer value of the average pixel value are different from each other, the sensor 232 may sense that a decimal value has occurred. For example, when the pixel value of the first target pixel is corrected, a decimal value of the average pixel value may be generated. At this time, the accumulated value may be a decimal value corresponding to the first target pixel. The compensation determiner 233 may determine the compensation value to be 1 in response to the occurrence of a decimal value.
[0071] The compensation determiner 233 may determine the compensation value as 0 or 1 according to a ratio determined based on the cumulative value. The number of compensation values determined as 1 may vary according to the cumulative value. For example, the number of target pixels may be 10. In response to the cumulative value among the 10 target pixels, the number of compensation values to be determined as 1 may be three. Among the target pixels, the target pixels whose compensation values are determined as 1 may be randomly selected, but the number may be the same as 3.
[0072] In yet another embodiment of the present disclosure, the image processing apparatus 200 may remove noise generated in an image obtained by the image sensor 100. The image processing apparatus 200 may include a target pixel detector 210, a target pixel corrector 220, and a target pixel compensator 230.
[0073] The target pixel corrector 220 may change the target pixel value as the pixel value of the plurality of target pixels by using the average pixel value of the contact pixels that contact each other in the horizontal direction based on the position of each of the plurality of target pixels. The contact pixels may be two pixels that contact each other in the horizontal direction or the vertical direction based on the position of each of the plurality of target pixels. The target pixel corrector 220 may change the target pixel value into an integer value that is a value corresponding to an integer part of the average pixel value that corresponds to the plurality of target pixels, respectively.
[0074] The target pixel compensator 230 can compensate the target pixel value based on the sum value of the pixel values of the contact pixels. The sum value can be a value obtained by summing the pixel values of two pixels adjacent to the target pixel in the horizontal direction, or can be a value obtained by adding the pixel values of two pixels adjacent to the target pixel in the vertical direction.
[0075] The target pixel compensator 230 may further include an accumulation value manager 231, a sensor 232, and a compensation determiner 233. The accumulation value manager 231 may generate an accumulation value increased by 1 in response to a sum value that is an odd number among the sum values. The sensor 232 may sense an increase in the accumulation value. The compensation determiner 233 may determine at least one compensation pixel to which a predetermined compensation value is added among the plurality of target pixels based on the accumulation value.
[0076] The compensation determiner 233 may determine that the target pixel corresponding to the sum value that increases the cumulative value from an odd number to an even number is a compensation pixel. The cumulative value may be increased only when the sum value is an odd number. The compensation determiner 233 may determine that the target pixel that increases the cumulative value to an even number among a plurality of target pixels is a compensation pixel. The target pixel compensator 230 may add 1 as a predetermined compensation value to the pixel value of the compensation pixel. In an embodiment of the present disclosure, the cumulative value may be an even number or an odd number while increasing in response to the sum value. The compensation pixel may be determined according to the cumulative value among a plurality of target pixels. The pixel value of the compensation pixel may be increased by 1.
[0077] In another embodiment of the present disclosure, the compensation determiner 233 may randomly determine the compensation pixel according to the ratio determined based on the cumulative value. A predetermined compensation value 1 may be added to the pixel value of the compensation pixel. The compensation pixel may be randomly determined among a plurality of target pixels, but the ratio determined as the compensation pixel among the plurality of target pixels may be constant.
[0078] Figure 6 is a diagram illustrating a target pixel and adjacent pixels according to an embodiment of the present disclosure.
[0079] Reference Figure 6 , a portion 600 of an image may include a target pixel 610 and neighboring pixels 620 located around the target pixel 610. The range of the neighboring pixels 620 may vary. Figure 6 The pixel value of the target pixel 610 can be obtained with Figure 5 The description corresponds to .
[0080] For example, it may be assumed that the pixel values of the neighboring pixels 620 are 10, 11, 11, 12, 13, 10, 10, and 15. The target pixel corrector 220 may calculate an average pixel value of the neighboring pixels 620. Specifically, the average pixel value may be 11.5. The target pixel corrector 220 may change the pixel value of the target pixel 610 from a previous value to 11. The integer value 11 of the average pixel value may become the pixel value of the target pixel, and the decimal fraction value 0.5 of the average pixel value may be accumulated by the cumulative value manager 231.
[0081] It may be assumed that there is a value 0.25 accumulated in the cumulative value manager 231. The cumulative value manager 231 may generate 0.75 as a cumulative value by adding 0.25 and a decimal value 0.5 of the average pixel value. The sensor 232 may sense the occurrence of the decimal value 0.5 of the average pixel value. When the sensor 232 senses the occurrence of the decimal value 0.5, the compensation determiner 233 may compare the cumulative value 0.75 with a predetermined reference value 1. Since the cumulative value 0.75 is less than the reference value 1, the compensation determiner 233 may determine the compensation value to be 0. Since the compensation value is 0, the pixel value of the target pixel may remain at 11.
[0082] It may be assumed that there is a cumulative value of 0.75 in the cumulative value manager 231. The cumulative value manager 231 may generate 1.25 as the cumulative value by adding 0.75 to the decimal value of 0.5 of the average pixel value. The sensor 232 may sense the occurrence of the decimal value of 0.5 of the average pixel value. When the sensor 232 senses the occurrence of the decimal value of 0.5, the compensation determiner 233 may compare the cumulative value 1.25 with a predetermined reference value 1. Since the cumulative value 1.25 is greater than the reference value 1, the compensation determiner 233 may determine the compensation value to be 1.
[0083] The target pixel compensator 230 may add the compensation value 1 to the pixel value 11 of the target pixel. The pixel value of the target pixel to which the compensation value is added may become 12. When the compensation determiner 233 determines the compensation value to be 1, the cumulative value manager 231 may subtract 1 from the cumulative value 1.25. The value accumulated in the cumulative value manager 231 may be 0.25.
[0084] In another embodiment of the present invention, it may be assumed that there is a value 0.75 accumulated in the cumulative value manager 231, and the decimal value of the target pixel 610 is 0.5. The cumulative value manager 231 may generate 1.25 as the cumulative value by adding 0.75 to the decimal value 0.5 of the average pixel value. The compensation determiner 233 may determine the target pixel 610 as a compensation pixel. The target pixel compensator 230 may add the compensation value to the pixel value of the compensation pixel.
[0085] Figure 7 is a diagram illustrating a target pixel and pixels adjacent to the target pixel according to an embodiment of the present disclosure.
[0086] Reference Figure 7, a portion 700 of an image may include a target pixel 710, pixels 720 and 730 adjacent to the target pixel 710 in a vertical direction, and pixels 740 and 750 adjacent to the target pixel 710 in a horizontal direction. The pixel values of the pixels 720 and 730 adjacent to the target pixel 710 in the vertical direction may be 11 and 15, respectively, while the pixel values of the pixels 740 and 750 adjacent to the target pixel 710 in the horizontal direction may be 13 and 14.
[0087] The target pixel corrector 220 may correct the pixel value of the target pixel 710 based on the pixel values of the pixels 720 and 730 adjacent to the target pixel 710 in the vertical direction. The sum value obtained by adding the pixel values of the pixels 720 and 730 adjacent to the target pixel 710 in the vertical direction may be 26. The target pixel corrector 220 may change the pixel value of the target pixel 710 to 13, which is an average pixel value of the sum value 26. Since the sum value 26 is an even number, the pixel value of the target pixel 710 may not be corrected.
[0088] The target pixel corrector 220 may correct the pixel value of the target pixel 710 based on the pixel values of the pixels 740 and 750 adjacent to the target pixel 710 in the horizontal direction. The sum value obtained by adding the pixel values of the pixels 740 and 750 adjacent to the target pixel 710 in the horizontal direction may be 27. At this time, the average pixel value of the sum value may be 13.5. The target pixel corrector 220 may change the pixel value of the target pixel 710 to 13, which is an integer value of the average pixel value. Since the sum value 27 is an odd number, the cumulative value manager 231 may generate a cumulative value obtained by adding 1 to the already accumulated value. When the already accumulated value is 1, the cumulative value may become 2.
[0089] Since the sum value 27 is an odd number, the sensor 232 can sense an increase in the cumulative value. Since the cumulative value 2 is an even number instead of 0, the compensation determiner 233 can determine the compensation value to be 1. The target pixel compensator 230 can add the compensation value 1 to the pixel value 13 of the target pixel 710. The value of the target pixel 710 to which the compensation value is added may be 14. In an embodiment of the present disclosure, the pixel value of the target pixel 710 may be changed in response to the pixel for pixel value correction.
[0090] In another embodiment of the present disclosure, it may be assumed that the value accumulated in the cumulative value manager 231 is an odd number and the sum value of the target pixel 710 is 27. The sum value 27 may increase the cumulative value from an odd number to an even number. The compensation determiner 233 may determine the target pixel 710 as a compensation pixel. The target pixel compensator 230 may add the compensation value to the pixel value of the compensation pixel.
[0091] Figure 8is a diagram illustrating a randomly determined compensation value according to an embodiment of the present disclosure.
[0092] Reference Figure 8 , a portion 800 of an image may include six target pixels 810, 820, 830, 840, 850, and 860. Among the six target pixels 810, 820, 830, 840, 850, and 860, 810, 820, 850, and 860 may correspond to PDAF pixels. Among the six target pixels 810, 820, 830, 840, 850, and 860, 830 and 840 may correspond to defective pixels. Figure 8 The method for determining the compensation value in can correspond to Figure 5 Description.
[0093] When the average pixel value of the pixel values of the adjacent pixels is an integer value, the compensation value may not be added to the target pixel. When a decimal value is included in the average pixel value of the pixel values of the adjacent pixels, the target pixel compensator 230 may add the compensation value to the target pixel. When the sensor 232 senses the occurrence of the decimal value, the compensation determiner 233 may randomly determine the compensation value to be added to the target pixel to be 0 or 1.
[0094] Specifically, the average pixel value corresponding to 810, 820, 830, and 840 among the six target pixels 810, 820, 830, 840, 850, and 860 may include a decimal fraction. The average pixel value corresponding to 850 and 860 among the six target pixels 810, 820, 830, 840, 850, and 860 may be an integer value. The compensation value may not be added to the target pixels 850 and 860.
[0095] The compensation determiner 233 may determine compensation values corresponding to the target pixels 810, 820, 830, and 840. The compensation value may be 0 or 1. The compensation value may be randomly determined, but the number of compensation values determined to be 1 may be determined in advance. For example, the number of compensation values determined to be 1 may be 1. When the compensation value corresponding to the target pixel 820 among the target pixels 810, 820, 830, and 840 is determined to be 1, the compensation values corresponding to the remaining target pixels 810, 830, and 840 may be determined to be 0. Similarly, when the compensation values corresponding to the target pixels 810, 820, and 830 are all 0, the compensation value corresponding to the target pixel 840 is determined to be 1.
[0096] The compensation determiner 233 may determine the compensation value as 0 or 1 according to the ratio determined based on the cumulative value. The number of compensation values determined as 1 in response to the cumulative value generated by the cumulative value manager 231 may be different. For example, when the cumulative value is 3, the number of compensation values determined as 1 may be 3.
[0097] In another embodiment of the present disclosure, the compensation determiner 233 may determine the compensation pixel to which the compensation value is added among the target pixels 810, 820, 830, and 840. The compensation pixel may be determined randomly, but the number of the compensation pixels may be determined in advance. The target pixel compensator 230 may add the compensation value to the pixel value of the compensation pixel.
[0098] In another embodiment of the present disclosure, the compensation determiner 233 may determine the compensation value corresponding to the pixel value of the target pixel whose position is predetermined among the target pixels detected by the target pixel detector 210 to be 1. The PDAF pixel may be a target pixel whose position is predetermined. The compensation determiner 233 may determine the compensation values of the target pixels 810, 820, 850, and 860 whose positions are predetermined to be 1.
[0099] In another embodiment of the present disclosure, the compensation determiner 233 may determine the compensation value corresponding to the pixel value of the target pixel whose position is random among the target pixels detected by the target pixel detector 210 as 1. The defective pixel may be a target pixel whose position is random. The compensation determiner 233 may determine the compensation values of the target pixels 830 and 840 whose positions are random as 1.
[0100] Fig. 9 is a flowchart illustrating a method of compensating a pixel value of a target pixel that changes based on an accumulation value according to an embodiment of the present disclosure.
[0101] Reference Fig. 9 , the image processing device 200 can remove the noise generated in the image.
[0102] In step S910, the target pixel detector 210 may detect a plurality of target pixels generating noise among a plurality of pixels included in the image sensor. The target pixel detector 210 may detect a pixel corresponding to a pixel value that differs from a pixel value of an adjacent pixel by a predetermined threshold or more as a target pixel. The difference between the pixel value of a defective pixel or the pixel value of a PDAF pixel and the pixel value of an adjacent pixel may be greater than a predetermined threshold. The target pixel detector 210 may detect a defective pixel or a PDAF pixel as a target pixel.
[0103] In step S920, the target pixel corrector 220 may change the target pixel value as the pixel value of the plurality of target pixels by using the average pixel value of the adjacent pixels included in the preset range based on the position of each of the plurality of target pixels. The target pixel corrector 220 may change the target pixel value into an integer value, which is a value corresponding to the integer part of the average pixel value corresponding to the plurality of target pixels respectively. Since the target pixel corrector 220 uses only the integer value of the average pixel value when correcting the pixel values of the plurality of target pixels, the decimal fraction value corresponding to the decimal fraction part of the average pixel value may not be used. Since the decimal fraction value is not used, the total average pixel value of the image after the plurality of target pixels are corrected may be less than the total average pixel value of the image before the plurality of target pixels are corrected.
[0104] In step S930, the target pixel compensator 230 may compensate the target pixel value using a cumulative value obtained by accumulating a value corresponding to a decimal fractional part of the average pixel value. The target pixel compensator 230 may add a compensation value determined based on the cumulative value to each target pixel value. In another embodiment of the present disclosure, the target pixel compensator 230 may determine at least one compensation pixel to which a predetermined compensation value is added among a plurality of target pixels.
[0105] Fig.10 is a flowchart illustrating a method of determining a compensation value according to an embodiment of the present disclosure.
[0106] Reference Fig.10 , the compensation determiner 233 may determine the compensation value corresponding to the target pixel as 0 or 1 based on the accumulated value.
[0107] In step S1010, the cumulative value manager 231 may generate a cumulative value obtained by accumulating decimal fraction values, which are values corresponding to the decimal fraction parts of the average pixel values respectively corresponding to the plurality of target pixels. The cumulative value manager 231 may accumulate decimal fraction values of the average pixel value that are not used when the pixel values of the target pixels are changed. As the number of target pixels whose pixel values are changed increases, the cumulative value may increase.
[0108] In step S1020 , the compensation determiner 233 may compare the accumulated value with a predetermined reference value in response to the occurrence of the decimal value. In an embodiment of the present disclosure, the predetermined reference value may be 1.
[0109] In step S1030, the compensation determiner 233 may determine the compensation value to be 1 when the cumulative value is greater than or equal to the predetermined reference value. The target pixel compensator 230 may add the compensation value determined to be 1 to the pixel value of the target pixel changed to an integer value. That is, the pixel value of the target pixel may be increased by 1.
[0110] In step S1040 , the cumulative value manager 231 may subtract the reference value from the cumulative value in response to the compensation value being determined to be 1. The cumulative value may be decreased when the compensation value is determined to be 1. In an embodiment of the present disclosure, the cumulative value may be maintained within a certain range.
[0111] In step S1050 , the compensation determiner 233 may determine the compensation value to be 0 when the cumulative value is less than the reference value. The pixel value of the target pixel whose compensation value is 0 may be maintained.
[0112] For example, when the pixel value of the first target pixel is corrected, a decimal value of the average pixel value may be generated. At this time, the cumulative value may be a decimal value corresponding to the first target pixel. Since the cumulative value is less than a predetermined reference value of 1, the compensation value may be 0, and the pixel value of the first target pixel changed to an integer value may be maintained. When the pixel values of a plurality of target pixels are corrected, the cumulative value may be increased. When the cumulative value is greater than or equal to 1, the pixel value of the target pixel changed to an integer value may be increased by 1.
[0113] Fig.10 The method for determining the compensation value can correspond to Figure 6 Description.
[0114] Fig.11 is a flowchart illustrating a method of compensating a pixel value of a target pixel that changes based on an accumulation value according to another embodiment of the present disclosure.
[0115] Reference Fig.11 , the compensation determiner 233 may determine at least one compensation pixel to which the compensation value is added among the plurality of target pixels based on the accumulated value.
[0116] In step S1110, the target pixel detector 210 may detect a plurality of target pixels generating noise among a plurality of pixels included in the image sensor 100. The target pixel detector 210 may detect pixels corresponding to pixel values different from pixel values of adjacent pixels by a predetermined threshold or more as target pixels.
[0117] In step S1120, the target pixel value as the pixel value of the plurality of target pixels may be changed using the average pixel value of the contact pixels that contact each other in the horizontal direction based on the position of each of the plurality of target pixels. The contact pixels may be two pixels that contact each other in the horizontal direction or the vertical direction based on the position of each of the plurality of target pixels. The target pixel corrector 220 may change the target pixel value into an integer value that is a value corresponding to an integer part of the average pixel value that corresponds to the plurality of target pixels, respectively.
[0118] In step S1130, the cumulative value manager 231 may generate a cumulative value by using the sum value of the contact pixels. The cumulative value manager 231 may generate a cumulative value increased by 1 in response to a sum value that is an odd number among the sum values.
[0119] In step S1140, the compensation determiner 233 may determine at least one compensation pixel to which a predetermined compensation value is added among a plurality of target pixels based on the cumulative value. The compensation determiner 233 may determine the target pixel corresponding to the sum that increases the cumulative value from an odd number to an even number as the compensation pixel. The cumulative value may be increased only when the sum value is an odd number.
[0120] In step S1150, the target pixel compensator 230 may add 1 as a predetermined compensation value to the pixel value of the compensation pixel. In an embodiment of the present disclosure, the cumulative value may be an even number or an odd number while corresponding to the increase in the sum value. The compensation pixel may be determined according to the cumulative value among a plurality of target pixels. The pixel value of the compensation pixel may be increased by 1.
[0121] Fig.11 The method for determining the compensation value can correspond to Figure 7 Description.
[0122] Fig.12 is a flowchart illustrating a method of compensating a pixel value of a target pixel according to yet another embodiment of the present disclosure.
[0123] Reference Fig.12 , the first target pixel value or the second target pixel value can be compensated.
[0124] In step S1210, the target pixel corrector 220 may change the pixel value of the first target pixel by using the average pixel value of the neighboring pixels included in the predetermined range of the first target pixel generating noise among the plurality of pixels. The target pixel corrector 220 may calculate the average pixel value of the neighboring pixels included in the predetermined range of the first target pixel, and change the pixel value of the first target pixel to an integer value of the average pixel value.
[0125] In step S1220, the target pixel corrector 220 may change the pixel value of the second target pixel by using the average pixel value of the neighboring pixels included in the predetermined range of the second target pixel generating the noise among the plurality of pixels. The target pixel corrector 220 may calculate the average pixel value of the neighboring pixels included in the predetermined range of the second target pixel, and change the pixel value of the second target pixel to an integer value of the average pixel value.
[0126] In step S1230, the cumulative value manager 231 can generate a cumulative value obtained by accumulating a first decimal value and a second decimal value, wherein the first decimal value is a value corresponding to the decimal part of the average pixel value corresponding to the first target pixel, and the second decimal value is a value corresponding to the decimal part of the average pixel value corresponding to the second target pixel.
[0127] In step S1240, the target pixel compensator 230 may compensate the pixel value of the first target pixel or the pixel value of the second target pixel based on the cumulative value. The compensation determiner 233 may select one of the first target pixel and the second target pixel. When the cumulative value is greater than or equal to a predetermined reference value, the compensation determiner 233 may add 1 to the pixel value of any one selected target pixel. The cumulative value manager 231 may subtract 1 from the cumulative value. In an embodiment of the present disclosure, when the cumulative value is less than the reference value, the compensation determiner 233 may add 0 to the pixel value of any one selected target pixel.
[0128] When the cumulative value is less than the reference value, the target pixel compensator 230 may compensate for the pixel value of the third target pixel generating noise among the plurality of pixels. Specifically, the target pixel corrector 220 may change the pixel value of the third target pixel by using the average pixel value of the adjacent pixels included in the predetermined range of the third target pixel. The cumulative value manager 231 may generate an additional cumulative value obtained by accumulating a third decimal value and the cumulative value, the third decimal value being a value corresponding to the decimal part of the average pixel value corresponding to the third target pixel. The target pixel compensator 230 may add the compensation value determined based on the cumulative value to the pixel value of the third target pixel.
[0129] Fig.13 is a block diagram illustrating a computing system 2000 including an image sensor 2010 according to an embodiment of the present disclosure.
[0130] Reference Fig.13 , the computing system 2000 includes an image sensor 2010, a processor 2020, a storage device 2030, a memory device 2040, an input / output device 2050, and a display device 2060. Fig.13Although not shown, the computing system 2000 may also include ports capable of communicating with a video card, a sound card, a memory card, a USB device, etc., or with other electronic devices.
[0131] The image sensor 2010 may generate image data corresponding to incident light. The display device 2060 may display the image data. The storage device 2030 may store the image data. The processor 2020 may control the operations of the image sensor 2010, the display device 2060, and the storage device 2030.
[0132] The processor 2020 may perform certain calculations or tasks. According to an embodiment of the present disclosure, the processor 2020 may be a microprocessor or a central processing unit (CPU). The processor 2020 may be connected to a storage device 2030, a memory device 2040, and an input / output device 2050 through an address bus, a control bus, and a data bus to perform communication. According to an embodiment of the present disclosure, the processor 2020 may also be connected to an expansion bus, such as a peripheral component interconnect (PCI) bus.
[0133] The storage device 2030 may include a flash memory device, a solid state drive (SSD), a hard disk drive (HDD), a CD-ROM, all types of non-volatile memory devices, and the like.
[0134] The memory device 2040 may store data required for the operation of the computing system 2000. For example, the memory device 2040 may include volatile memory devices such as dynamic random access memory (DRAM) and static random access memory (SRAM), and nonvolatile memory devices such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices.
[0135] The input / output device 2050 may include input devices such as a keyboard, a keypad, and a mouse, and output devices such as a printer and a display.
[0136] Image sensor 2010 may be connected to processor 2020 via a bus or other communication link to perform communications.
[0137] The image sensor 2010 may perform binning on a plurality of pixel data generated from a plurality of pixels included in a pixel array to generate binned pixel data uniformly distributed in the pixel array.
[0138] The image sensor 2010 may be implemented in various types of packages. For example, at least some configurations of the image sensor 2010 may be implemented using packages such as: package-on-package (PoP), ball grid array (BGA), chip-scale package (CSP), plastic lead chip carrier (PLCC), plastic dual in-line package (PDIP), wafer in waffle package, wafer in wafer form, chip on board (COB), ceramic dual in-line package (CERDIP), plastic metric quad flat package (MQFP), thin quad flat package (TQFP), small outline (SOIC), shrink small outline package (SSOP), thin small outline (TSOP), system-in-package (SIP), multi-chip package (MCP), wafer-level fabrication package (WFP), or wafer-level processing stacked package (WSP), etc.
[0139] According to an embodiment, the image sensor 2010 may be integrated in one chip together with the processor 2020 , or the image sensor 2010 and the processor 2020 may be integrated in different chips, respectively.
[0140] Furthermore, the computing system 2000 should be interpreted as all computing systems that use the image sensor 2010. For example, the computing system 2000 may include a digital camera, a mobile phone, a PDA, a PMP, a smart phone, and the like.
[0141] Since the present disclosure can be implemented in other specific forms without changing its technical spirit or essential features, it should be understood by those skilled in the art that the above embodiments are exemplary and not limiting in all aspects. The scope of the present disclosure is indicated by the appended claims rather than the detailed description, and all changes or modifications resulting from the meaning and scope of the claims and their equivalent concepts should be understood to be included in the scope of the present disclosure.
[0142] CROSS-REFERENCE TO RELATED APPLICATIONS
[0143] This application claims the priority of Korean Patent Application No. 10-2021-0120293 filed in the Korean Intellectual Property Office on September 9, 2021, the disclosure of which is incorporated herein by reference in its entirety.
Claims
1. An image processing device, comprising: an object pixel detector that detects a plurality of object pixels generating noise among a plurality of pixels included in the image sensor; a target pixel corrector that changes target pixel values of the plurality of target pixels by using an average pixel value of neighboring pixels of each of the plurality of target pixels; as well as a target pixel compensator including a compensation determiner that determines a compensation pixel that adds a compensation value to a pixel value among the plurality of target pixels based on an accumulated value obtained by accumulating values corresponding to decimal fractions of the average pixel value, The target pixel compensator compensates the target pixel value by using the accumulated value.
2. The image processing device according to claim 1, wherein: The target pixel corrector determines the range of the adjacent pixels according to a preset value.
3. The image processing device according to claim 2, wherein: The target pixel corrector converts the target pixel value to an integer portion of the average pixel value.
4. The image processing device according to claim 2, wherein: The target pixel compensator further comprises: an accumulation value manager that generates the accumulation value by accumulating decimal values, the decimal values being values corresponding to decimal fractions of the average pixel value, The compensation determiner determines the compensation values respectively based on the accumulated values.
5. The image processing device according to claim 4, wherein: The target pixel compensator also includes a sensor that senses the occurrence of the decimal fractional value.
6. The image processing device according to claim 4, wherein: The compensation determiner compares the cumulative value with a predetermined reference value in response to the occurrence of the decimal value, and determines the compensation value to be 1 when the cumulative value is greater than or equal to the reference value, and The accumulated value manager subtracts the reference value from the accumulated value in response to the compensation value being determined to be 1.
7. The image processing device according to claim 6, wherein: The compensation determiner determines the compensation value to be 0 when the cumulative value is less than the reference value.
8. The image processing device according to claim 5, wherein: The compensation determiner randomly determines the compensation value to be 0 or 1 in response to the occurrence of the decimal value.
9. The image processing apparatus according to claim 8, wherein: The compensation determiner determines the compensation value to be 0 or 1 according to a ratio determined based on the cumulative value.
10. The image processing apparatus according to claim 2, wherein: The target pixel compensator adds 1 to a pixel value of a target pixel whose position is predetermined among the plurality of target pixels.
11. The image processing device according to claim 2, wherein: The target pixel compensator adds 1 to a pixel value of a target pixel having a random position among the plurality of target pixels.
12. An image processing device, comprising: an object pixel detector that detects a plurality of object pixels generating noise among a plurality of pixels included in the image sensor; a target pixel corrector that changes target pixel values of the plurality of target pixels by using an average pixel value of contact pixels that are contacted in a horizontal direction based on a position of each of the plurality of target pixels; as well as a target pixel compensator that compensates the target pixel value based on the sum of the pixel values of the contact pixels, Wherein, the target pixel compensator comprises: an accumulated value manager that generates an accumulated value increased by 1 in response to an odd sum value among the sum values; and A compensation determiner determines at least one compensation pixel to which a predetermined compensation value is added among the plurality of target pixels based on the accumulated value.
13. The image processing apparatus according to claim 12, wherein: The target pixel corrector changes the target pixel value to an integer portion of the average pixel value.
14. The image processing apparatus according to claim 12, wherein: The target pixel compensator further comprises: A sensor senses an increase in the accumulated value.
15. The image processing apparatus according to claim 14, wherein: The compensation determiner determines a target pixel corresponding to a sum value for increasing the cumulative value from an odd number to an even number as the compensation pixel.
16. The image processing apparatus according to claim 14, wherein: The compensation determiner randomly determines the compensation pixel according to a ratio determined based on the cumulative value.
17. A method of operating an image processing device, the method comprising the steps of: receiving pixel values indicative of a plurality of pixels of an image; changing a pixel value of the first target pixel generating noise among the plurality of pixels by using an average pixel value of neighboring pixels included in a predetermined range of the first target pixel; Obtaining a first decimal value, the first decimal value being a value corresponding to a decimal portion of an average pixel value corresponding to the first target pixel; changing a pixel value of the second target pixel generating noise among the plurality of pixels by using an average pixel value of neighboring pixels included in a predetermined range of the second target pixel; generating a cumulative value obtained by accumulating a second decimal value and the first decimal value, the second decimal value being a value corresponding to a decimal portion of an average pixel value corresponding to the second target pixel; as well as compensating a pixel value of the first target pixel or a pixel value of the second target pixel based on the accumulated value, The step of compensating the pixel value of the first target pixel or the pixel value of the second target pixel comprises the following steps: selecting any one of the first target pixel and the second target pixel; and When the cumulative value is greater than or equal to a predetermined reference value, 1 is added to the pixel value of any one selected target pixel, and 1 is subtracted from the cumulative value.
18. The method according to claim 17, wherein: The step of selecting any one of the first target pixel and the second target pixel includes the step of adding 0 to a pixel value of the selected any one target pixel when the accumulated value is less than the reference value.
19. The method according to claim 18, further comprising the steps of: When the accumulated value is less than the reference value, compensating a pixel value of a third target pixel generating noise among the plurality of pixels, The step of compensating the pixel value of the third target pixel comprises the following steps: changing the pixel value of the third target pixel by using an average pixel value of adjacent pixels included in a predetermined range of the third target pixel; generating an additional cumulative value obtained by accumulating a third decimal value which is a value corresponding to a decimal portion of an average pixel value corresponding to the third target pixel and the cumulative value; and A compensation value determined based on the accumulated value is added to a pixel value of the third target pixel.
20. A method of operating an image processing device, the method comprising the steps of: receiving pixel values indicative of a plurality of pixels of an image; detecting a plurality of target pixels generating noise among the plurality of pixels; calculating a sum of pixel values of contact pixels that are in contact in a vertical direction based on a position of each of the plurality of target pixels; changing the target pixel value by using the corresponding average pixel value of the sum value; generating a cumulative value increased by 1 in response to an odd sum value among the sum values; determining a compensation pixel among the plurality of target pixels in response to the cumulative value changing from an odd number to an even number; and A predetermined compensation value is added to the pixel value of the compensation pixel.
21. An image processing device, the image processing device comprising: an image sensor that transmits a pixel value indicative of a first pixel of an image; a target pixel detector that detects a second pixel generating noise among the first pixels based on a pixel value of the first pixel; a target pixel corrector that changes a pixel value of the second pixel by using an average pixel value of third pixels respectively determined according to positions of the second pixel in the image; A target pixel compensator, the target pixel compensator: generating a cumulative value obtained by accumulating values corresponding to decimal fractions of the average pixel value; determining a compensation pixel among the second pixels based on the accumulated value; and compensating a pixel value of the compensation pixel by adding a compensation value determined based on the accumulated value; as well as An output manager that outputs the pixel value of the first pixel including the second pixel whose pixel value is compensated.
