Method and system for reconstructing one or more pixels for an image construction

The system addresses edge defects in non-functioning pixels by using an imager and actuator to reconstruct pixels with reference values and anti-aliasing, achieving high-quality images with reduced noise and moiré effects.

GB2706084APending Publication Date: 2026-11-11CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
GB2025004440
Authority / Receiving Office
GB · GB
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-03-26
Publication Date
2026-11-11

AI Technical Summary

Technical Problem

Conventional image construction systems fail to effectively correct defects in non-functioning pixels, particularly at edges, leading to noticeable artifacts and reduced image quality, especially in images with predominantly white or black areas.

Method used

A method and system utilizing an imager and actuator, such as a MEMS actuator, to identify non-functioning pixels and adjust the image plane to locate reference pixels for reconstruction, combined with an anti-aliasing filter to remove pattern defects and enhance image clarity.

Benefits of technology

The system provides high-quality images with reduced noise and moiré effects, maintaining high frames per second for video capture by selectively reconstructing critical pixels in real-time, ensuring accurate representation of important elements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method and apparatus for reconstructing one or more pixels comprising identifying (202) one or more locations (302, 312, figure 3A-B) of one or more non-functioning pixels (304, figure 3A) in at lea
Need to check novelty before this filing date? Find Prior Art

Description

The present disclosure in general relates to image construction. More particularly, the present disclosure relates to a method and a system for reconstructing one or more pixels for an image construction. BACKGROUND Dead pixels are a common phenomenon in imaging sensors and digital displays, resulting from one or more non functioning pixels that remain in an "off1 state. Generally, the one or more non functioning pixels appear as black spots on the displays, standing out from the surrounding areas. In addition, the one or more non functioning pixels are particularly noticeable because they do not respond to changes in light or image movement, maintaining their static appearance regardless of the scene. Further, all Complementary Metal Oxide Semiconductor (CMOS) sensors, regardless of the manufacturer, are susceptible to thousands of non functioning pixels. These imperfections are inherent to the imaging sensor manufacturing process and may be classified as either static defects, which are permanent, or dynamic defects, which are influenced by factors such as exposure and temperature. To ensure the visual integrity of images captured by imaging sensors, conventional image construction systems employ defect correction mechanisms. The defect correction mechanisms detect non functioning pixels using specialized algorithms and interpolate the pixel values based on the surrounding functional pixels. However, conventional systems for correcting non functional pixels, such as interpolating the pixel values or the application of median or Gaussian filters fail to correct defects occurring at or near edges are often, leading to noticeable artifacts. Additionally, setting an appropriate threshold value in conventional systems may pose challenges, resulting in further edge degradation. Furthermore, images with predominantly white or black areas are prone to increased noise, which reduces overall image quality and limits the effectiveness of conventional correction systems. Thus, there is a need for an improved solution that may solve the aforementioned problems of conventional image construction systems. SUMMARY Though image construction techniques are widely known, the existing solutions are not efficient in reconstructing good quality images. Therefore, there is a need for an improved method and system for image construction. It is therefore an object of the present disclosure to provide a method and a system for reconstructing one or more pixels for an image construction. This and other objects are achieved by means of a system and a method defined in the appended claims. The term exemplary is in the present context to be understood as serving as instance, example, or illustration. According to an aspect of the present disclosure, a method for reconstructing one or more pixels for an image construction is provided. The method comprises a step of identifying one or more locations of one or more non functioning pixels in at least one frame of an image. Further, the method comprises a step of performing an image plane adjustment to locate at least one reference pixel from one or more adjacent frames, within a proximity to the one or more non functioning pixels. The method also comprises a step of capturing one or more pixel values of the identified at least one reference pixel to reconstruct the one or more non functioning pixel. In addition, the method comprises a step of constructing the image using the reconstructed non functioning pixel. Optionally, the one or more non functioning pixels comprises at least one of: dead pixels, hot pixels, and / or stuck pixels. Optionally, the performing the image plane adjustment comprises adjusting position of an imager on an actuator in an image capturing device. Optionally, constructing the image involves replacing the one or more non functioning pixels with the one or more pixel values of the at least one reference pixel. Optionally, constructing the image further involves detecting a pattern defect in the image constructed using the reconstructed non functioning pixel and filtering the constructed image to remove the pattern defect and construct a filtered image. According to another aspect of the present disclosure, a method for constructing an image is provided. The method comprises a step of detecting a pattern defect in an image. Further, the method comprises a step of applying an anti aliasing filter to remove the pattern defect and constructing a filtered image based on filtering. According to another aspect of the present disclosure, a method for constructing an image is provided. The method comprises a step of detecting a pattern defect in an image. The method further comprises a step of applying an anti aliasing filter to remove the pattern defect. The method comprises constructing a filtered image based on filtering. According to another aspect of the present disclosure, a system for reconstructing one or more pixels for an image construction is provided. The system comprises an imager configured to identify one or more locations of one or more non functioning pixels in at least one frame of an image. Further, the system comprises an actuator configured to perform an image plane adjustment to locate at least one reference pixel from one or more adjacent frames, within a proximity to the one or more non functioning pixels. In addition, the system comprises a processing circuitry configured to capture one or more pixel values of the identified at least one reference pixel from the actuator to reconstruct the one or more non functioning pixel. In addition, the processing circuitry is configured to construct the image using the reconstructed non functioning pixel. Optionally, the actuator comprises Micro Electrical Mechanical Systems (MEMS) actuator comprising a 4 corner tilt type actuator configured to be controlled along three orthogonal axes, including an x axis, a y axis, and a z axis. Optionally, the actuator is further configured to perform the image plane adjustment comprising adjusting position of an imager on an actuator in an image capturing device. Optionally, the processing circuitry is configured to replace the one or more non functioning pixels with the one or more pixel values of the at least one reference pixel. Optionally, the processing circuitry further configured to detect a pattern defect in the image constructed using the reconstructed non functioning pixel. In addition, the system includes an anti aliasing filter to remove the pattern defect. The processing circuitry is further configured to construct a filtered image based on removal of the pattern defect. Optionally, the anti aliasing filter comprises an Optical Low Pass Filter (OLPF) arranged before the imager, wherein the OLPF is configured to filter a high frequency content from the image and pass a filtered image to the imager. Optionally, in an example, the pattern defect comprises a moire effect. Optionally, the system may be mounted on a vehicle (not shown) and may be configured to facilitate reconstruction of one or more pixels for the image construction when the vehicle is moving. In another example, the system may reconstruct one or more pixels for one or more images extracted from a video. Optionally, the system and the method for reconstructing one or more pixels for the image construction is selectively enabled based on user’s preference, in scenarios such as image capture of a traffic light. If system and method detect one or more non functioning pixels in the imager, the system and method need not reconstruct the one or more non functioning pixels every time as it reduces frames per second of the video captured. So, this construction of image (feature enablement) may be based on detecting any important pixel information which may be present in the area where one or more non functioning pixels are identified. Optionally, if there is a traffic light or pedestrian or car present exactly on one or more non functional pixels when the Image is captured, the system and method may be enabled so that the one or more non functioning pixels of traffic light or pedestrian or car may be rightly reconstructed onto the image frame. If the system and method are not enabled, there might be a loss true information of traffic light or pedestrian etc. According to another aspect of the present disclosure, there is provided a computer program when loaded and run on a system, causes processing circuitry of the system to perform corresponding steps of method for reconstructing one or more pixels for an image construction. According to another aspect of the present disclosure, there is provided a computer readable medium having stored thereon a computer program. Some embodiments disclosed herein have one or more of the following advantages: - With the proposed system and method, the imager in combination with the actuator captures actual pixels values of pixels without any edge defects and blurs in the image, thus providing good image quality and low noise. - The actuator's movement frequency is determined by a type of defect. For dynamic defects, such as hot or stuck pixels, the actuator is immediately activated upon defect detection and transmits the defect details to the processing circuitry in real time. - Anti Aliasing Filter in the proposed system, in combination with the actuator, actively reduces moire effect, enhancing the clarity and fidelity of the image without compromising other aspects of image quality. - The dynamic control of the actuator allows for real time adjustments of the Anti Aliasing Filter, ensuring optimal performance across various imaging scenarios and conditions. - The combination of the actuator and Anti Aliasing Filter is adaptable to diverse imaging environments, providing consistent moire reduction benefits in various real world settings. - The system using selective operation avoids unnecessary processing, maintaining high frames per second (FPS) for video capture, thereby improving driver confidence and system trustworthiness by accurately representing critical elements in the image frame without compromising the visual quality of less important areas. Other advantages may be readily apparent to one having skill in the art. Certain embodiments may have none, some, or all of the recited advantages. BRIEF DESCRIPTION OF THE DRAWINGS The foregoing will be apparent from the following more particular description of the example embodiments, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the example embodiments. FIG. 1 illustrates a block diagram of a system for reconstructing one or more pixels for an image construction, according to some embodiments herein; FIG. 2A and 2B illustrates a flowchart of a method for reconstructing one or more pixels for the image construction, according to some embodiments herein; FIG. 3A and 3B illustrates exemplary scenarios of reconstructing one or more pixels for the image construction, according to some embodiments; FIG. 4 illustrates a representation of an image capturing device configured in the system, according to some embodiments; FIG. 5 illustrates an exploded view of the image capturing device in the system, according to some embodiments; and FIG. 6 illustrates an example computing environment implementing the system, as shown in FIG. 1, FIG. 4, and FIG. 5, for reconstructing one or more pixels for the image construction, according to some embodiments herein. DETAILED DESCRIPTION Aspects of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. The systems and methods disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the aspects set forth herein. Like numbers in the drawings refer to like elements throughout. The terminology used herein is for the purpose of describing particular aspects of the disclosure only and is not intended to limit the invention. It should be emphasized that the term “comprises / comprising” when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Embodiments of the present disclosure will be described and exemplified more fully hereinafter with reference to the accompanying drawings. The solutions disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the embodiments set forth herein. It will be appreciated that when the present disclosure is described in terms of a system and a method, it may also be embodied in one or more processors and one or more memories coupled to the one or more processors, wherein the one or more memories store one or more programs that perform the steps, services and functions disclosed herein when executed by the one or more processors. As mentioned there remains a need to provide an improved solution for image construction. Accordingly, the present disclosure provides a method and a system for reconstructing one or more pixels for an image construction. The system of the present disclosure provides an imager in combination with an actuator that captures actual content of pixels without any edge defects and blurs in the image therefore providing good image quality and low noise. FIG. 1 illustrates a block diagram of a system 100 for reconstructing one or more pixels for an image construction, according to some embodiments herein. The system 100 may be mounted in a vehicle (not shown in FIG. 1) and may be configured to facilitate reconstruction of one or more pixels for an image construction when the vehicle is moving. In another example, the system 100 may reconstruct one or more pixels for one or more images extracted from a video. The system 100 comprises of processing circuitry or processor 110 and an image capturing device 400. The image capturing device 400 further comprises an imager 402 and an actuator 404. The imager 402 is configured to identify one or more locations of one or more non functioning pixels (shown later in FIG. 3A and 3B) in at least one frame (shown later in FIG. 3A and 3B) of an image. Further, the actuator 404 is configured to perform an image plane adjustment to locate at least one reference pixel from one or more adjacent frames, within a proximity to the one or more non functioning pixels. In an example, at least one reference pixel may be a pixel used as a baseline for comparison or calibration in image sensors or displays, often to correct the one or more non functioning pixels. In an example, the proximity of the one or more non functioning pixels may be one or more adjacent pixels in top or bottom or left or right of the one or more non functioning pixels. The processing circuitry 110 is configured to capture one or more pixel values of the identified at least one reference pixel from the actuator 404 to reconstruct the one or more non functioning pixel. Further, the processing circuitry 110 is configured to construct the image using the reconstructed non functioning pixel (shown later in FIG. 3A and 3B). In an example, the processing circuitry 110 may be coupled to a memory 120 for storing one or more pixels values of at least one reference pixel. In addition, the processing circuitry 110 may be communicatively coupled to the imager 402 and the actuator 404. In another example, the imager 402 may be configured to work in combination with the actuator 404 for reconstructing one or more pixels for the image construction. In an example, the imager 402 in combination with the actuator 404 is configured to capture actual pixel values of at least one reference pixel without any edge defects and blurs in the image therefore providing good image quality and low noise. Further, in another example, the actuator’s 404 movement frequency is determined by a type of defect. For dynamic defects, such as hot or stuck pixels, the actuator 404 is immediately activated upon defect detection and transmits the defect details to the processing circuitry 110 in real time so that hot or stuck pixels may be reconstructed. In some embodiments, the actuator 404 comprises Micro Electrical Mechanical Systems (MEMS) actuator comprising a 4 corner tilt type actuator configured to be controlled along three orthogonal axes, including an x axis, a y axis, and a z axis. In some embodiments, the actuator 404 is configured to perform the image plane adjustment comprising adjusting position of the imager 402 on the actuator 404 in the image capturing device 400 (as shown in FIG. 4). In some embodiments, the processing circuitry 110 is configured to replace the one or more non functioning pixels with the one or more pixel values of the at least one reference pixel (shown later in FIG. 3A and 3B). In some embodiments, the processing circuitry 110 is further configured to detect a pattern defect in the image constructed using the reconstructed non functioning pixel. In addition, the system 100 comprises an anti aliasing filter (as shown in FIG. 5) to remove the pattern defect. Furthermore, the processing circuitry 110 is configured to construct a filtered image based on removal of the pattern defect. In an example, the reconstructed non functioning pixel may be non functioning pixels whose value is estimated and replaced based on surrounding at least one reference pixel using the techniques mentioned in this description. In some embodiments, the anti aliasing filter (as shown in FIG. 5) comprises an Optical Low Pass Filter (OLPF) arranged before the imager 402, wherein the OLPF may be configured to filter a high frequency content from the image and pass a filtered image to the imager 402. In another embodiment, the pattern defect may comprise a moire effect which is a visual phenomenon that occurs when two repetitive patterns overlap and interfere with each other, creating a new pattern or wavy appearance that isn't present in either original pattern. In an example, the anti aliasing filter (as shown in FIG. 5) may be arranged to work in combination with the actuator 404 for actively reducing the moire effect and enhancing the clarity and fidelity of the image without compromising other aspects of image quality. In another example, the combination of the actuator 404 and the anti aliasing filter (as shown in FIG. 5) is adaptable to diverse imaging environments, providing consistent moire reduction benefits in various real world settings. In an example, the actuator 404 allows for real time adjustments of the anti aliasing filter (as shown in FIG. 5), ensuring optimal performance across various imaging scenarios and conditions. FIG. 2A and 2B illustrates a flowchart of a method 200A and 200B for reconstructing the +one or more pixels for the image construction, according to some embodiments herein. The method 200A may facilitate reconstruction of one or more pixels for the image construction by way of the system 100 as shown and described in context to FIG. 1 At step 202, the method 200A provides identifying, via the imager 402, the one or more locations of the one or more non functioning pixels in at least one frame of the image. At step 204, the method 200A provides performing the image plane adjustment, via the actuator 404, to locate at least one reference pixel from the one or more adjacent frames, within the proximity to the one or more non functioning pixels. In an example, the proximity of the one or more non functioning pixels may be one or more adjacent pixels in top or bottom or left or right of the one or more non functioning pixels. At step 206, the method 200A provides capturing, via the processing circuitry 110, the one or more pixel values of the identified at least one reference pixel to reconstruct the one or more non functioning pixel. At step 208, the method 200A provides constructing, via the processing circuitry 110, the image using the reconstructed non functioning pixel. In some embodiments of the method 200A, the one or more non functioning pixels may comprise at least one of: dead pixels, hot pixels, and / or stuck pixels. In some embodiments of the method 200A, performing the image plane adjustment may comprise adjusting position of the imager 402 on the actuator 404 in the image capturing device 400. In some embodiments of the method 200A, constructing the image comprises replacing the one or more non functioning pixels with the one or more pixel values of the at least one reference pixel (shown later in FIG. 3A and 3B). In some embodiments of the method 200A, constructing the image comprises detecting the pattern defect in the image constructed using the reconstructed non functioning pixel and filtering the constructed image to remove the pattern defect and construct the filtered image. In another embodiment, FIG.2B illustrates an alternate embodiment of the method 200A as discussed in FIG 2A. The method 200B of FIG. 2B may facilitate reconstruction of one or more pixels for the image construction by way of the system 100 of FIG. 1 At step 210, method 200B provides detecting, via the imager 402, the pattern defect in the image. At step 212, method 200B provides applying the anti aliasing filter (as shown in FIG. 5) to remove the pattern defect. At step 214, method 200B provides constructing the filtered image based on filtering. In an example, additional details of the method 200A, and the method 200B will now be explained in FIG. 3A and 3B. FIG. 3A, illustrates a first case 300A, when the imager 402 identifies a first location 302 from the one or more locations of one or more non functioning pixels 304 in at least one frame 306 of the image. The reconstruction of one or more pixels for the image construction is performed in the following steps: - Detecting the first location 302 of one or more non functioning pixels 304 in at least one frame 306 of the image. - Moving the imager 402, via the actuator 404, in an upward direction of the image plane towards at least one reference pixel 308. - Capturing one or more pixels values of at least one reference pixel 308 and storing the one or more pixel values in memory 120. - Moving the imager 402 back to the first location 302 and reconstructing the one or more non functioning pixels 304. - Constructing the image using the reconstructed non functioning pixels 310. FIG. 3B, illustrates a second case 300B, when the imager 402 identifies plurality of locations 312 from the one or more locations of the one or more non functioning pixels 304 in at least one frame 306 of the image. The reconstruction of one or more pixels for the image construction is performed in the following steps: - Detecting plurality of locations 312 of one or more non functioning pixels 304 in at least one frame 306 of the image. - Moving the imager 402, via the actuator 404, in a downward direction of the image plane towards plurality of reference pixels 314. - Capturing the one or more pixels values of plurality of the reference pixels 314 and storing the one or more pixel values in memory 120. - Moving the imager 402 back to plurality of locations 312 and reconstructing the one or more non functioning pixels 304. - Constructing the image using the reconstructed non functioning pixels 316. FIG. 4 illustrates a representation of the image capturing device 400 in the system 100, according to some embodiments herein. The image capturing device 400 comprises the imager 402 and the actuator 404. In an example, the actuator 404 comprises the MEMS actuator 404. The imager 402 is configured to identify one or more locations of one or more non functioning pixels in at least one frame of the image. Further, the MEMS actuator 404 is configured to perform image plane adjustment to locate at least one reference pixel from one or more adjacent frames, within the proximity to the one or more non functioning pixels. In an example, the MEMS actuator 404 may comprise the 4 corner tilt type actuator in combination with a Sony IMX 616 and an Integrated Sensing Platform (ISP). In another example, the MEMS actuator 404 may be communicatively coupled with a 4 channel MEMS driver 406. Furthermore, in an example, the 4 channel MEMS driver 406 may include a square PCB 420. FIG. 5 illustrates an exploded view of an image capturing device 400 in the system 100, according to some embodiments herein. The image capturing device 400 comprises the imager 402 configured to identify one or more locations of one or more non functioning pixels in at least one frame 306 of the image. In addition, the image capturing device 400 comprises the actuator 404. The actuator 404 is configured to perform image plane adjustment to locate at least one reference pixel from one or more adjacent frames, within the proximity to the one or more non functioning pixels. In an example, the actuator 404 comprises a frame 408 and a stage 410. In an example, the frame 408 is support structure for the actuator 404. The frame 408 provides a stable base and defines a boundary for the actuator's 404 movement. Further, in an example, the stage 410 is a moving component of the actuator 404. The stage 410 is arranged to carry a load (For example, imager, lens, mirror, or another element) that needs precise positioning or movement. In another example, the image capturing device 400 includes the anti aliasing filter 412. The anti aliasing filter 412 may comprise the Optical Low Pass Filter (OLPF) arranged before the imager 402. In an example, the OLPF is configured to filter a high frequency content from the image and pass the filtered image to the imager 402. In an example, the system 100 and the method 200A, 200B for reconstructing the one or more pixels for the image construction is selectively enabled based on a user’s preference, in scenarios such as image capture of a traffic light. If system 100 and method 200A, 200B detect one or more non functioning pixels 304 in the imager 402, the system 100 and method 200A, 200B need not reconstruct the non functioning pixels 304 every time as it reduces frames per second of the video captured. So, this construction of image (feature enablement) may be based on detecting any important pixel information which may be present in the area where one or more non functioning pixels 304 are identified. In an example, if there is a traffic light or pedestrian or car present exactly on one or more non functional pixels 304 when the Image is captured, the system 100 and method 200A, 200B may be enabled so that the one or more non functioning pixels 304 of traffic light or pedestrian or car may be rightly reconstructed onto the image frame 306. If the system 100 and method 200A and 200B are not enabled, there might be a loss true information of traffic light or pedestrian etc. As the system 100 uses selective operation, unnecessary processing is avoided, which maintains high frames per second (FPS) for the video capture. Thereby improving driver confidence and system trustworthiness by accurately representing critical elements in the image frame 306 without compromising the visual quality of less important areas. FIG. 6 illustrates an example computing environment 600 implementing the system 100, as shown in FIG. 1, FIG. 4, and FIG. 5 for reconstructing the one or more pixels for an image construction, according to some embodiments herein. As depicted in FIG. 6, the computing environment 600 comprises at least one data processing unit 606 that is equipped with a control unit 602 and an Arithmetic Logic Unit (ALU) 604, a plurality of networking devices 608 and a plurality Input output, I / O devices 610, a memory 612, a storage 614. The data processing unit 606 may be responsible for implementing the system 100 and method 200A and method 200B described in FIGs 1 to 5. For example, the data processing unit 606 in some embodiments be equivalent to the processing circuitry 110 of the system 100 as described above in reference with FIG. 1. The data processing unit 606 is capable of executing software instructions stored in memory 612. The data processing unit 606 receives commands from the control unit 602 in order to perform its processing. Further, any logical and arithmetic operations involved in the execution of the instructions are computed with the help of the ALU 604. The computer program is loadable into the data processing unit 606, which may, for example, be comprised in an electronic apparatus (such as the platform). When loaded into the data processing unit 606, the computer program may be stored in the memory 612 associated with or comprised in the data processing unit 606. According to some embodiments, the computer program may, when loaded into and run by the data processing unit 606, cause execution of method steps according to, for example, any of the methods illustrated in FIG. 2A and 2B as described herein. The overall computing environment 600 may be composed of multiple homogeneous and / or heterogeneous cores, multiple CPUs of different kinds, special media, and other accelerators. Further, the plurality of data processing unit 606 may be located on a single chip or over multiple chips. The algorithm comprising of instructions and codes required for the implementation are stored in either the memory 612 or the storage 614 or both. At the time of execution, the instructions may be fetched from the corresponding memory 612 and / or storage 614 and executed by the data processing unit 606. In case of any hardware implementations various networking devices 608 or external I / O devices 610 may be connected to the computing environment to support the implementation through the networking devices 608 and the I / O devices 610. The embodiments disclosed herein can be implemented through at least one software program running on at least one hardware device and performing network management functions to control the elements. The elements shown in FIG. 6 include blocks which can be at least one of a hardware device, or a combination of hardware device and software module. Reference signs • System 100 • Processing circuitry 110 • Memory 120 • Method 200A and 200B • First case 300A • First Location 302 • One or more non functioning pixels 304 • Image frame 306 • Reference pixel 308 • Second case 300B • Plurality of locations 312 • Plurality of reference pixels 314 • Reconstructed non functional pixels 310, 316 • Image capturing device 400 • Imager 402 • Actuator or MEMS actuator 404 5 • 4 channel MEMS driver 406 • Frame 408 • Stage 410 • Anti aliasing filter 412 • Square PCB 420 io • Computing environment 600 • Control unit 602 • Arithmetic Logic Unit (ALU) 604 • Processing unit 606 • Network devices 608 15 • I / O devices 610 • Memory 612 • Storage 614

Claims

1. A method (200A) for reconstructing one or more pixels for an image construction, c h aracterizedinthat, the method comprising:identifying (202) one or more locations (302, 312) of one or more non functioning pixels (304) in at least one frame (306) of an image;performing (204) an image plane adjustment to locate at least one reference pixel (308, 314) from one or more adjacent frames, within a proximity to the one or more non functioning pixels (304);capturing (206) one or more pixel values of the identified at least one reference pixel (308, 314) to reconstruct the one or more non functioning pixel (304); andconstructing (208) the image using the reconstructed non functioning pixel (310, 316).

2. The method (200A) according to claim 1, wherein the one or more non functioning pixels (304) comprises at least one of: dead pixels, hot pixels, and / or stuck pixels.

3. The method (200A) according to any of the preceding claims, wherein the performing (204) the image plane adjustment comprises adjusting position of an imager (402) on an actuator (404) in an image capturing device (400).

4. The method (200A) according to any of the preceding claims, wherein constructing (208) the image comprises:replacing the one or more non functioning pixels (304) with the one or more pixel values of the at least one reference pixel (308, 314).

5. The method (200A) according to any of the preceding claims, wherein the constructing (208) the image comprises:detecting a pattern defect in the image constructed using the reconstructed non functioning pixel (310, 316);filtering the constructed image to remove the pattern defect and construct a filtered image.

6. A method (200B) for constructing an image, characterizedinthat, the method comprising:detecting (210) a pattern defect in an image;applying (212) an anti aliasing filter (412) to remove the pattern defect; and construct (214) a filtered image based on filtering.

7. A system (100) for reconstructing one or more pixels for an image construction, c h a racterizedinthat, the system comprising:an imager (402) configured to identify one or more locations (302, 312) of one or more non functioning pixels (304) in at least one frame (306) of an image;an actuator (404) configured to perform an image plane adjustment to locate at least one reference pixel (308, 314) from one or more adjacent frames, within a proximity to the one or more non functioning pixels (304); andprocessing circuitry (110) configured to:capture one or more pixel values of the identified at least one reference pixel (308, 314) from the actuator (404) to reconstruct the one or more non functioning pixel (304); andconstruct the image using the reconstructed non functioning pixel (310, 316).

8. The system (100) according to claim 7, wherein the actuator (404) comprises Micro Electrical Mechanical Systems (MEMS) actuator comprising a 4 corner tilt type actuator configured to be controlled along three orthogonal axes, including an x axis, a y axis, and a z axis.

9. The system (100) according to any of the claims 7 or 8, wherein the actuator (404) is further configured to:perform the image plane adjustment comprising adjusting position of the imager (402) on the actuator (404) in an image capturing device (400).

10. The system (100) according to any of the claims 7 to 9, wherein the processing circuitry (110) is configured to:replace the one or more non functioning pixels (304) with the one or more pixel values of the at least one reference pixel (308, 314).

11. The system (100) according to any of the claims 7 to 10, wherein the processing circuitry (110) is further configured to:detect a pattern defect in the image constructed using the reconstructed non functioning pixel (310, 316).an anti aliasing filter (412) to remove the pattern defect;wherein the processing circuitry (110) is further configured to construct a filtered image based on removal of the pattern defect.

12. The system (100) according to any of the claims 7 to 11, wherein the anti aliasing filter (412) comprises an Optical Low Pass Filter (OLPF) arranged before the imager (402), wherein the OLPF is configured to filter a high frequency content from the image and pass a filtered image to the imager (402).

13. The system (100) according to any of the claims 7 to 12, wherein the pattern defect comprises a moire effect.

14. A computer program comprising instructions, which, when the program is executed by a computer, cause the computer to carry out a method of any one of the claims 1 to 6.

15. A computer readable medium having stored thereon the computer program of claim 14.

Citation Information

Patent Citations

  • ViewUS2017/0237919A1onEspacenetopensinnewtab

  • ViewUS2009/0016638A1onEspacenetopensinnewtab

  • ViewUS11252359B1onEspacenetopensinnewtab

  • ViewKR100723208B1onEspacenetopensinnewtab