High resolution image generation based on sub-pixel imaging

Abstract

One among various embodiments discloses a method to generate sub-pixel shifted images. The method includes generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, propagating the generated light through a layer supporting a specimen, and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images. A high-resolution image of the specimen can be generated based on the plurality of sub-pixel shifted images. The plurality of light emitting elements is locatable over a first range of separation distances with respect to the layer, and the layer is locatable over a second range of separation distances with respect to the image sensor.

Description

HIGH RESOLUTION IMAGE GENERATION BASED ON SUB-PIXEL IMAGINGCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] The present application claims the benefit of U.S. Provisional Application titled, “SYSTEM AND METHODS FOR IMPROVED BIOBURDEN AND / OR STERILITY TESTING,” filed on May 6, 2024, and having Serial No. 63 / 643,126. The present application claims the benefit of U.S. Provisional Application titled, “SYSTEM AND METHODS FOR IMPROVED TIMING FOR BIOBURDEN AND / OR STERILITY TESTING,” filed on May 6, 2024, and having Serial No. 63 / 643,140. The present application claims the benefit of U.S. Provisional Application titled, “SYSTEM AND METHODS FOR IMPROVED FILTRATION FOR BIOBURDEN AND / OR STERILITY TESTING,” filed on May 6, 2024, and having Serial No. 63 / 643,142. The present application claims the benefit of U.S. Provisional Application titled, “IMPROVED CARTRIDGES / CONSUMABLES FOR BIOBURDEN AND / OR STERILITY TESTING,” filed on May 6, 2024, and having Serial No. 63 / 643,132. The present application claims the benefit of U.S. Provisional Application titled, “SYSTEM AND METHODS FOR IMPROVED CONTACT AND IMAGING IN BIOBURDEN AND / OR STERILITY TESTING,” filed on May 6, 2024, and having Serial No. 63 / 643,135. The subject matter of these related applications is hereby incorporated herein by reference.BACKGROUNDField of the Various Embodiments

[0002] The various embodiments relate generally to generating high resolution images, and, more specifically, generating high resolution images based on sub-pixel shifted shadow images.Description of the Related Art

[0003] An image sensor is typically used to convert light into electrical signals that can be used for generating an electronic image. A quality of the electronic image can be indicated by a resolution parameter in the form of pixel density. The pixel density is typically constrained by the density of the light sensing elements of the image sensor. However, certain computer- implemented image processing techniques can be used to generate higher resolution images from raw images created from electronic signals produced by an image sensor. For example, some popular image processing apps can apply techniques such as up-sampling and superresolution to generate higher resolution images. Up-sampling typically involves modifyingthe size of pixels in a raw image and super-resolution typically involves increasing a pixel count of a raw image based on techniques such as inferring and reconstructing missing pixels.

[0004] One drawback associated with conventional image processing techniques such as described above is that generating a higher resolution image can be constrained by the poor quality of raw images obtained by use of an image sensor having a limited number of sensing elements. In this example, the raw images may have too many missing pixels for an image processor to generate an authentic high-resolution image.

[0005] As the foregoing illustrates, what is needed in the art are more effective ways to produce higher quality raw images and to improve upon techniques for producing high resolution images using the higher quality raw images.SUMMARY

[0006] In an example embodiment, a method to generate sub-pixel shifted images includes generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, propagating the generated light through a layer supporting a specimen, and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images. The plurality of sub-pixel shifted images do not include artifacts that may be present in sub-pixel shifted images generated by use of at least some prior art imaging systems such as the prior art system described above with reference to FIGs 1 A-C. The method can further include steps such as evaluating at least some of the plurality of sub-pixel shifted images to detect any anomaly if present in the specimen and / or using at least some of the plurality of sub-pixel shifted image for generating a high-resolution image of the specimen.

[0007] At least one technical advantage of the disclosed techniques herein relative to the prior art is that, with the disclosed techniques, certain types of imaging artifacts that can be present in prior art high-resolution images are eliminated.

[0008] Another technical advantage of the disclosed techniques includes an imaging system that offers a capability to flexibly locate a layer, such as a petri dish, at any of various intermediate locations between a lighting element and an image sensor. The image sensor is configured to produce a plurality of electrical signals based on shadows created by propagating light produced by the lighting element, through the layer. The plurality of output signals, which are indicative of a plurality of sub-pixel shifted images, can be operated upon to generate a high-resolution image.

[0009] These technical advantages provide one or more technological improvements over prior art approaches.BRIEF DESCRIPTION OF THE DRAWINGS

[0010] So that the manner in which the above recited features of the various embodiments can be understood in detail, a more particular description of the inventive concepts, briefly summarized above, can be had by reference to various embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of the inventive concepts and are therefore not to be considered limiting of scope in any way, and that there are other equally effective embodiments.

[0011] FIG. 1 A illustrates a prior art lighting element of an imaging system.

[0012] FIG. IB illustrates an imaging system that includes the prior art lighting element shown in FIG. 1 A.

[0013] FIG. 1C illustrates another imaging system that includes the prior art lighting element shown in FIG. 1 A.

[0014] FIG. 2 illustrates a lighting element according to various embodiments.

[0015] FIG. 3 illustrates an example imaging system that includes the lighting element shown in FIG. 2.

[0016] FIG. 4 illustrates another example imaging system that includes the lighting element shown in FIG. 2.

[0017] FIG. 5 shows an example evaluation system that includes a specimen evaluation unit containing the lighting element shown in FIG. 2.

[0018] FIG. 6 illustrates an example sample module that can be a part of the specimen evaluation unit shown in FIG. 5.

[0019] FIG. 7 is a flow diagram of method steps to generate sub-pixel shifted images according to an embodiment.DETAILED DESCRIPTION

[0020] In the following description, numerous specific details are set forth to provide a more thorough understanding of the various embodiments. However, it will be apparent to one skilled in the art that the inventive concepts can be practiced without one or more of these specific details. For explanatory purposes, multiple instances of like objects are symbolizedwith reference numbers identifying the object and parenthetical numbers identifying the instance where needed. While the invention may be described within the context of a use case associated with a specific imaging system, the inventive concepts described herein are broader than that particular use case and can be applied in any appropriate context / use case. In certain instances, this application may reference directly or indirectly to ePetri technology which, in some instances, refers to certain technology described in U.S. Patent Nos. 9,426,429, 9,643,184, 9,569,664, and 9,343,494, the disclosures of all of which are incorporated herein by reference in their entireties.

[0021] FIG. 1 A illustrates a prior art lighting element 105 of an imaging system. The lighting element 105 includes a set of light-emitting components arranged in a spatially uniform configuration. The spatially uniform configuration corresponds to a square matrix array having eight rows and eight columns. In an example implementation, each of the lightemitting components is a light emitting diode (LED).

[0022] FIG. IB illustrates an imaging system 150 that includes the prior art lighting element 105. The imaging system 150 further includes an image sensor 115 containing a number of detection elements such as CMOS detectors or charge coupled detectors (CCD). In the illustrated example, eight detection elements are shown arranged adjacent to each other in one row. Additional detection elements can be present in additional rows of the image sensor 115. Further included in the imaging system 150 is a layer, such as a transparent layer 110 for placement of a specimen 118. The layer can be transparent in some embodiments and tinted with a color in other embodiments. The transparent layer 110 is typically made of glass and may be referred to as a petri plate, petri dish, or a cell-culture dish. The transparent layer 110 can be either mounted directly upon a top surface of the image sensor 115 or upon an intermediate film (a plastic sheet, for example) that is placed upon the top surface of the image sensor 115. This arrangement effectively renders a separation distance “d2” between the transparent layer 110 and the top surface of the image sensor 115 as being close to zero. Furthermore, the distance “d2” is negligible in comparison to a separation distance “dl” between the transparent layer 110 and a light-emitting surface of the lighting element 105. In this example, the light-emitting surface of the lighting element 105 propagates light generated by the array of light-emitting components shown in FIG. 1A.

[0023] In one application, a raster scanning operation is applied to the array of lightemitting components of the lighting element 105, which can be an array of LEDs. The raster scanning operation employs a sequential activation procedure whereby each LED in a first rowof LEDs is activated sequentially followed by sequential activation of each LED in a second row of LEDs, and so on. Thus, in the illustration shown in FIG. 2, LED l is activated over a preset time period, followed by activation of LED 2 for the preset time period, followed by activation of LED 3 for the preset time period, and so on. After activation of LED 8, the LEDs of an adjacent row (not shown) are similarly activated in a sequential manner, followed by sequential activation of LEDs of the next adjacent row, and so on. The activation is repeated cyclically from the first row, after LED 8 of the last row is activated.

[0024] The illustration depicts a snapshot of a set of light beams corresponding to a row scanning sequence. The set of light beams is angularly emitted towards the image sensor 115. In the example illustration, the set of light beams is incident upon detection element (4) of the image sensor 115. As is known, a LED emits non-coherent light that radiates in multiple directions. Not shown are many other light beams that are emitted by each LED and produce a shadow of the transparent layer 110 and the specimen 118 placed thereon, upon the top surface of the image sensor 115.

[0025] The illustrated set of light beams correspond to a focal point 119 on the transparent layer 110, which is negligibly close to the top surface of the image sensor 115. The dashed line oval 121 shows an expanded view of the light beams propagating through the specimen 118 at the focal point 119. The distance “pl” corresponds to a width of the detection element (4) and thus corresponds to one pixel. The distance “si” corresponds to a separation distance between a beam emitted by the LED l and a beam emitted by adjacent LED 2 and is referred to as a sub-pixel distance. In this example, the lighting element 105 has eight LEDs in each row. Correspondingly, the distance “pl” is subdivided into eight sub-pixels (“si” through” s8”). The width of each of the eight sub-pixel distances is identical as a result of the equidistant spacing between LEDs (LED l through LED 8).

[0026] As indicated above, each of the light beams is one among many beams produced by a corresponding LED and a shadow created by the light beams is projected on to the top surface of the image sensor 115. The image sensor 115 generates output in the form of electrical signals, in response to a first projected shadow corresponding to the light beams of the LED L The electrical signals are provided to a computer, which generates a first subpixel shifted image based on the electrical signals. Seven more sub-pixel shifted images that are sub-pixel shifted with reference to the first sub-pixel shifted image are generated corresponding to light beams produced by the other seven LEDs. The eight sub-pixel shifted images generated as a result of the light beams of the eight LEDs can be operated upon by thecomputer to generate a high-resolution image of the specimen 118 (by executing a software algorithm, for example).

[0027] FIG. 1C illustrates an imaging system 155 that includes the prior art lighting element 105. In this case, the transparent layer 110 is located at a distance “d4” above the top surface of the image sensor 115, where d4 > d2 (d2 is shown in FIG. IB). The illustrated set of example light beams correspond to a focal point 122 on the transparent layer 110. Unlike the shadow created by the light beams shown in FIG. 1 A, the shadow created by the light beams shown in FIG. IB is spread out over a larger area on the top surface of the image sensor 115. More particularly, the illustrated light beam produced by LED l is incident upon a spot between detection element (7) and detection element (8) of the image sensor 115.Consequently, the image sensor 115 fails to produce an electrical signal, or produces a weak electrical signal, when the light beam is incident upon the image sensor 115. If no electrical signal is produced, the computer fails to generate a portion of an image corresponding to the spot between detection element (7) and detection element (8) of the image sensor 115. If the electrical signal is weak, a portion of an image corresponding to the spot between detection element (7) and detection element (8) of the image sensor 115 can be an imaging artifact.

[0028] Due to the equidistant sub-pixel spacing (described above), each of the other light beams produced by the other LEDs are incident upon spots between adjacent detection elements. Consequently, each of the sub-pixel shifted images generated at the time of incidence of the other light beams upon the image sensor 115 either lacks image information at these spots or includes imaging artifacts. As a result of this shortcoming, a high-resolution image produced by a computer based on operating upon these low-quality sub-pixel shifted images can contain image artifacts. In at least some cases, the high-resolution image appears as a pixelated image. It is therefore desirable to provide an improved image system that eliminates the low-quality sub-pixel shifted images.

[0029] FIG. 2 illustrates a lighting element 205 in accordance with various embodiments. The lighting element 205 includes a number of light-emitting components arranged in a spatially non-uniform configuration. In one embodiment, each of the light-emitting components is a light emitting diode (LED) and the non-uniform configuration is based on a random arrangement of the LEDs upon a substrate. In another embodiment, a repetition of LEDs is avoided along any radial axis of the lighting element 205. Such an arrangement can improve performance of a Fourier transform as will be understood by those skilled in the art. The random arrangement of LEDs (indicated by dark circles) does not conform to a squarematrix array grid notwithstanding the position of some LEDs randomly coinciding with grid lines or vertices of the grid. In one implementation, all the LEDs are identical. In another implementation, some or all of the LEDs differ from each other in various ways such as emission wavelength, emission color, shape, and / or size.

[0030] In the illustrated embodiment, a lighting element controller 210 is coupled to the lighting element 205 for activating the LEDs in various ways. In the illustrated example, the lighting element controller 210 includes a LED activation sequence generator 220 coupled to a LED driver 215 in a configuration that activates the LEDs of the lighting element 205 in accordance with various activation sequences.

[0031] FIG. 3 illustrates an imaging system 300 that includes the lighting element 205 according to an embodiment. The imaging system 300 further includes an image sensor 315 containing a number of detection elements such as CMOS detectors or charge coupled detectors (CCD). In one embodiment, the image sensor 315 is identical to the image sensor 115 described above. In the illustrated example, eight detection elements are shown arranged adjacent to each other in one row. Additional detection elements can be present in additional rows of the image sensor 315.

[0032] Further included in the imaging system 300 is a transparent layer 310 for placement of a specimen 318. In one embodiment, the transparent layer 310 is identical to the transparent layer 110 described above. The transparent layer 310 is typically made of glass and may be referred to as a petri plate, petri dish, or a cell-culture dish. The transparent layer 310 can be either mounted directly upon a top surface of the image sensor 315 or upon an intermediate film (a plastic sheet, for example) that is placed upon the top surface of the image sensor 315. This arrangement effectively renders a separation distance “d2” between the transparent layer 310 and the top surface of the image sensor 315 as being close to zero. Furthermore, the distance “d2” is negligible in comparison to a separation distance “dl” between the transparent layer 310 and a light-emitting surface of the lighting element 205.

[0033] In this example embodiment, the lighting element 205 emits light generated by the array of light-emitting components shown in FIG. 2. In one implementation, a sequential activation operation is carried out upon the LEDs of the lighting element 205 in accordance with one or more pre-configured activation sequences. The LED activation sequence generator 220 shown in FIG. 2 and described above can be configured to generate the preconfigured activation sequences. In another implementation, a sequential activation operation is carried out upon the LEDs of the lighting element 205 in accordance with random activationsequences that can be generated by the LED activation sequence generator 220 shown in FIG. 2 and described above.

[0034] The illustration includes a cutaway view of the lighting element 205 containing eight LEDs. In this example, the cutaway view includes eight LEDs placed in accordance with the random arrangement shown in FIG. 2. LED l can be at a first location on a 3D map 316, LED 2 can be at a second location on the 3D map 316, and so on for all eight LEDs. Each of the LEDs emits non-coherent light that radiates in multiple directions. Not shown are many other light beams that are emitted by each LED and produce a shadow of the transparent layer 310 and the specimen 318 placed thereon, upon the top surface of the image sensor 315.

[0035] The illustrated set of light beams correspond to a focal point 319 on the transparent layer 310, which is negligibly close to the top surface of the image sensor 315. The dashed line oval 321 shows an expanded view of the light beams propagating through the specimen 318 at the focal point 319 and falling upon detection element (4) of the image sensor 315. The designation “pl” corresponds to a width of the detection element (4) and thus corresponds to one pixel. Unlike the equidistant sub-pixel spacing described above with reference to FIG. IB and shown in dashed line oval 121, the sub-pixel spacing shown in dashed line oval 321 has a non-uniform characteristic and can encompass various sub-pixel widths as a result of the eight LEDs being arranged in a spatially non-uniform configuration. For example, the distance between LED l and LED 2 in the 3D map 316 is different than a distance between LED 2 and LED 3 in the 3D map 316, and so on. In this example, a pixel (indicated by distance “pl”) includes eight sub-pixels having non-uniform widths.

[0036] The image sensor 315 generates electrical signals in response to the incident light beams and provides the electrical signals to a computer (not shown) for generating eight subpixel shifted images. The eight sub-pixel shifted images can be operated upon by the computer (by executing a software algorithm, for example) to generate a high-resolution image of the specimen 318 in accordance with an embodiment.

[0037] FIG. 4 illustrates an imaging system 400 that includes the lighting element 205 in accordance with an embodiment. In this case, the transparent layer 310 is located at a distance “d4” above the top surface of the image sensor 315, where d4 > d2 (d2 is shown in FIG. IB and FIG. 3). The illustrated set of example light beams correspond to a focal point 419 on the transparent layer 310. Unlike the shadow created by the light beams shown in FIG. 3 upon the detection element (4) of the image sensor 315, the shadow created by the light beams shown in FIG. 4 is spread out over a larger area on the top surface of the image sensor 315. Moreparticularly, the illustrated light beam produced by LED l is incident upon a detection element (8) of the image sensor 315 at an activation time “tl” of LED l. The detection element (8) produces a first electrical signal in response.

[0038] The first electrical signal can be provided to a computer which, in one embodiment, generates a first sub-pixel shifted image based on the first electrical signal and position information associated with LED l . The computer can be pre-configured with position information of LED l and the other LEDs of the lighting element 205. In one implementation, the position of each LED is defined by Cartesian coordinates, such as a set of eight two-dimensional (2D) x-y Cartesian coordinates corresponding to the eight LEDs. The position information of the LEDs can be stored in a lookup table that is accessible to the computer.

[0039] In another embodiment, a computer generates the first sub-pixel shifted image based on the first electrical signal, position information associated with LED l, and in at least some cases, based on additional information. The additional information can include a separation distance between the lighting element 205 and the transparent layer 310 (“d3” in the illustrated example), a separation distance between the transparent layer 310 and the image sensor 315 (“d4” in the illustrated example), a separation distance between the lighting element 205 and the image sensor 315, and / or an angle of incidence of light upon a respective detection element of the image sensor 315 (detection element (8), in this example).

[0040] Furthermore, the illustrated light beam produced by LED 2 is incident upon the detection element (7) of the image sensor 315 at an activation time “t2” of LED 2. The detection element (7) produces a second electrical signal in response. The second electrical signal is provided to the computer which generates a second sub-pixel shifted image based on the second electrical signal, position information associated with LED 2, and in at least some cases, based on additional information such as described above.

[0041] The illustrated light beam produced by LED 3 is incident upon the detection element (6) of the image sensor 315 at an activation time “t3” of LED 3. The detection element (6) produces a third electrical signal in response. The third electrical signal is provided to the computer which generates a third sub-pixel shifted image based on the third electrical signal, position information associated with LED 3, and in at least some cases, based on additional information such as described above.

[0042] The illustrated light beam produced by LED 4 is incident upon the detection element (6) of the image sensor 315 at an activation time “t4” of LED 4. The detectionelement (6) produces a fourth electrical signal in response. The fourth electrical signal is provided to the computer which generates a fourth sub-pixel shifted image based on the fourth electrical signal, position information associated with LED 4, and in at least some cases, based on additional information such as described above.

[0043] The illustrated light beam produced by LED 5 is incident upon the detection element (5) of the image sensor 315 at an activation time “t5” of LED 5. The detection element (5) produces a fifth electrical signal in response. The fifth electrical signal is provided to the computer which generates a fifth sub-pixel shifted image based on the fifth electrical signal, position information associated with LED 5, and in at least some cases, based on additional information such as described above.

[0044] The illustrated light beam produced by LED 6 is incident upon the detection element (3) of the image sensor 315 at an activation time “t6” of LED 6. The detection element (3) produces a sixth electrical signal in response. The sixth electrical signal is provided to the computer which generates a sixth sub-pixel shifted image based on the sixth electrical signal, position information associated with LED 6, and in at least some cases, based on additional information such as described above.

[0045] The illustrated light beam produced by LED 7 is incident upon the detection element (2) of the image sensor 315 at an activation time “t7” of LED 7. The detection element (2) produces a seventh electrical signal in response. The seventh electrical signal is provided to the computer which generates a seventh sub-pixel shifted image based on the seventh electrical signal, position information associated with LED 7, and in at least some cases, based on additional information such as described above.

[0046] The illustrated light beam produced by LED 8 is incident upon the detection element (1) of the image sensor 315 at an activation time “t8” of LED 8. The detection element (1) produces an eighth electrical signal in response. The eighth electrical signal is provided to the computer which generates an eighth sub-pixel shifted image based on the eighth electrical signal, position information associated with LED 8, and in at least some cases, based on additional information such as described above.

[0047] The eight sub-pixel shifted images can be operated upon by the computer to generate a high-resolution image of the specimen 318 in accordance with an embodiment. In an example implementation, the computer generates the high-resolution image of the specimen 318 based on executing a software application. The software application can include an algorithm that evaluates sub-pixel shifted images that are generated by use of the electricalsignals provided by the eight LEDs at the times “tl” through “t8” (corresponding to one activation sequence) and at other times corresponding to additional activation sequences. One or more of the sub-pixel shifted images offer the best focus for viewing contaminants (if any) that may be present in the specimen 318.

[0048] In one implementation, the high-resolution image of the specimen 318 is based on evaluating a number of sub-pixel shifted images generated over an extended period of time using multiple activation sequences. Evaluating the sub-pixel shifted images over the extended period of time can be carried out to evaluate a specimen culture that changes over time. The sub-pixel shifted images obtained by use of the imaging system 400 incorporating the lighting element 205 typically do not contain artifacts such as can be present in sub-pixel shifted images obtained by use of the prior art imaging system 155 described above.

[0049] The description provided above with reference to FIG. 4 is equally applicable to any other imaging system that includes the lighting element 205. The transparent layer 310 can be at any location between the lighting element 205 and the image sensor 315 in such an imaging system. More particularly, the separation distance “d3” can have any value over a first range of separation distances, the separation distance “d4” can have any value over a second range of separation distances, and the separation distance between the lighting element 205 and the image sensor 315 can have any value over a third range of separation distances.

[0050] FIG. 5 shows an evaluation system 500 that includes a specimen evaluation unit 505 communicatively coupled to a computer 515. In one embodiment, the specimen evaluation unit 505 is a stand-alone unit that is communicatively coupled to the computer 515 either wirelessly or via a wired connection. An example wireless connection is a Bluetooth connection. An example wired connection is an Ethernet connection. In another embodiment, the specimen evaluation unit 505 and the computer 515 are co-located in an integrated configuration inside an enclosure.

[0051] The specimen evaluation unit 505 can include “n” sample modules 510 (n > 1). Each of the sample modules 510 can include the components described above with reference to the imaging system 300 and the imaging system 400. In an embodiment, each of the one or more sample modules 510 can be configured to evaluate the specimen 318 described above. Thus, the “n” sample modules 510 can be configured for evaluating “n” specimens over an extended period of time under different conditions. A first specimen placed in sample module (1) 510-1 can be evaluated at a first ambient temperature, a second identical specimen placed in sample module (2) 510-2 can be evaluated at a second ambient temperature, and so on. Inone implementation, evaluation of each of the specimens can involve detecting a contaminant such as detecting a contaminant in a drug specimen, detecting a contaminant in a fluid specimen, or detecting a pollutant in a liquid specimen. In another implementation, evaluation of a culture specimen can involve an automated enumeration of bacterial and fungal colonies. In another implementation, two or more sample modules 510 can be configured to evaluate more than one kind of specimen 310.

[0052] Communication link 540 is selected to support conveying of electrical signals generated by one or more image sensors included in the “n” sample modules. The image sensor(s) can be identical to, or substantially similar to, the image sensor 315 described above. The computer 515 includes a processor 520 and a memory 525 and can further include components (not shown) such as associated with an input / output interface (keyboard, display, etc.) and associated with communications (wireless communications, connectivity to a communication network, etc.).

[0053] In this example embodiment, the memory 525 includes high-resolution image generation software 530 and high-resolution image evaluation software 530. The processor 520 can execute the high-resolution image generation software 530 for generating one or more high-resolution images each based on a sequence of sub-pixel shifted images. The sub-pixel shifted images are generated based on electrical signals provided by sensing elements of an image sensor 315 and position information of the randomly placed LEDs in the lighting element 205 in the manner described above with reference to FIG. 3 and FIG. 4.

[0054] In an example embodiment, the processor 520 performs a digital focusing operation to obtain focus upon a high-resolution image corresponding to a plane of interest through the specimen 318. The plane of interest provides a cross-sectional view of the specimen 318 and can be located height- wise along a horizontal axis that extends cross- sectionally through a central portion of the specimen 318. The focusing operation includes determining and using a motion vector calculated at the plane of interest. In general, a motion vector can refer to a translational motion of projection images in a sequence of low-resolution projection images. The translational motion can be dependent on one or more factors, primarily on an amount of shift observed in any of various 2D planes that are parallel to the transparent layer 310 on which the specimen 318 is placed and / or parallel to the surface of the image sensor 315 upon which light propagated through the specimen 318 is incident. In an example implementation, the motion vector is defined by 2D Cartesian coordinates, and a high-resolution image of the specimen 318 is constructed by use of an algorithm that operatesupon data associated with a sequence of a subpixel shifted projection images and a motion vector of the sub-pixel shifted images of the sequence. In this embodiment, the sequence of sub-pixel shifted images used for generating the high-resolution image corresponds to the number of lighting elements of the lighting element 205 that are activated for generating the sub-pixel shifted images. Sub-pixel shifted images corresponding to a pixel boundary (between two sensing elements of the imaging sensor 315) if any are generated are omitted during generation of a high-resolution image.

[0055] In an embodiment, the computer 515 is configure to generate a set of high- resolution images over an extended time period based on electrical signals provided by the specimen evaluation unit 505. In various implementations, the electrical signals can be provided by the specimen evaluation unit 505 to the computer 515 in accordance with one of a repetitive schedule, an intermittent schedule, or a random schedule.

[0056] The processor 520 can execute the high-resolution image evaluation software 535 for evaluating one or more high-resolution images generated by the high-resolution image generation software 530. In some cases, evaluating the high-resolution image(s) can involve detecting a contaminant, and / or evaluating growth characteristics of a culture. The high- resolution image evaluation software 535 is typically configured to detect and provide an indication of contaminants that may be invisible to the human eye or are not yet at a stage where visible to the human eye. In some cases, the high-resolution image evaluation software 535 is configured to interact with a human who can visually inspect one or more images. The visual inspection may be carried out via a display screen of the computer 515.

[0057] FIG. 6 illustrates an embodiment of a sample module 510 of the specimen evaluation unit 505 shown in FIG. 5. In this example, the sample module 510 includes the lighting element 205 and the image sensor 315 that have been described above. The sample module 510 further include a nutrient cartridge 615 and a temperature control element 620. The nutrient cartridge 615 houses the specimen 318 on a transparent layer 310. The specimen 318 may be placed in contact with a nutrient such as agar that is filled into the nutrient cartridge 615 on top of the specimen 318. In other embodiments, the nutrient cartridge 615 can be replaced by one or more other elements that provide support to the transparent layer 310. The lighting element 205, the nutrient cartridge 615, and the image sensor 315 of the sample module 510 function in the manner described above with reference to FIG. 3 and FIG. 4.

[0058] As shown, a separation distance exists between the transparent layer 310 of thenutrient cartridge 615 and a top surface of the image sensor 315 upon which light is incident after propagating through the specimen 318 contained in the nutrient cartridge 615. The separation distance can vary in accordance with various factors such as the structure of the nutrient cartridge 615 and the structure of the sample module 510. The electrical signals generated by the image sensor 315 are provided to the computer 310 via an I / O 625 (an Ethernet card or Bluetooth circuit, for example). The computer 515 generates one or more high resolution images that can be evaluated for purposes such as detecting the presence of contaminants in the specimen 318 if any such contaminants are present.

[0059] In various embodiments, the nutrient cartridge 615 is disposable after use. An advantage offered by the disposable cartridge is savings in cost compared to a prior art image sensor, such as the image sensor 115, which is typically discarded after a single use. The reason for discarding the prior art image sensor after a single use is due to residual contamination of a top surface of the sensor upon which a specimen has been placed. The prior art image sensor is typically more expensive than the disposable nutrient cartridge 615.

[0060] The temperature control element 620 can be provided in the sample module 510 for incubation purposes of the specimen 318. In a prior art scenario, heat generated by a CMOS image sensor was used to generate heat. Heating control was implemented in a relatively crude fashion by turning the CMOS image sensor on and off by use of a “bang-bang” control loop. Cooling was achieved by use of an additional component in the form of a forward- biased thermo-electric cooler (TEC).

[0061] An improvement provided in accordance with one or more embodiments involves the use of a single component to achieve both heating and cooling. In one such embodiment, the temperature control element 620 is a TEC configured to operate in a dual-purpose role as both a heating element and a cooling element. In an example implementation, the TEC is a part of a H-bridge circuit that is configured to place the TEC in a forward bias condition over a first period of time to operate as a heating element, and to place the TEC in a reverse bias condition over a second period of time to operate as a cooling element. The time periods, repetition rate, and other factors of the forward bias and reverse bias conditions can be controlled by a computer in order to achieve a desired ambient temperature processor in the sample module 510. In terms of heating operations, a TEC intrinsically operates as a heat pump and thus achieves very high operating efficiency. The efficiency can be greater than 100% in some cases when used for heating.

[0062] FIG. 7 is a flow diagram of an example method 700 to generate sub-pixel shifted images. Although the method steps are described with respect to the systems of FIGS 2-6 persons skilled in the art will understand that any system configured to perform the method steps, in any order, is within the scope of the various embodiments.

[0063] As shown, method 700 begins at step 705, which involves generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration. Example lighting element 205 described herein contains such a plurality of light emitting elements.

[0064] Step 710 of the method 700 involves propagating the generated light through a transparent layer supporting a specimen. This aspect is described above with reference to FIGs 3 through 6 wherein light generated by the lighting element 205 is propagated through the transparent layer 310.

[0065] Step 715 of the method 700 involves generating a plurality of output signals from an image sensor configured to detect the light propagated through the transparent layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images. This aspect is described above with reference to FIGs 3 through 6 where the image sensor 315 generates a plurality of output signals based on detecting light beams propagated through the transparent layer 310 supporting the specimen 318, the plurality of output signals indicative of a plurality of sub-pixel shifted images.

[0066] The method can further include steps such as evaluating at least some of the plurality of sub-pixel shifted images to detect any anomaly if present and / or using at least some of the plurality of sub-pixel shifted image for generating a high-resolution image of the specimen. The generation can be based in part on determining a motion vector of a plane of interest corresponding to a horizontal cross-sectional view of the specimen. The high- resolution image can be constructed by use of an algorithm that operates upon data associated with a sequence of a subpixel shifted projection images and by use of a motion vector of the sub-pixel shifted images of the sequence. In one embodiment, the sequence of sub-pixel shifted images used for generating the high-resolution image corresponds to an activation sequence of the lighting elements of the lighting element 205. Any sub-pixel shifted image that falls on a pixel boundary (between two sensing elements of the imaging sensor 315) is ignored.

[0067] In sum, a method described above for generating sub-pixel shifted images can include generating light by sequentially activating each of a plurality of light emittingelements arranged in a spatially non-uniform configuration, propagating the generated light through a transparent layer supporting a specimen, and generating a plurality of output signals from an image sensor configured to detect the light propagated through the transparent layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images. A high-resolution image of the specimen can be generated based on the plurality of sub-pixel shifted images. The plurality of light emitting elements is locatable over a first range of separation distances with respect to the transparent layer, and the transparent layer is locatable over a second range of separation distances with respect to the image sensor.

[0068] At least one technical advantage of the disclosed techniques herein relative to the prior art is that, with the disclosed techniques, certain types of imaging artifacts that can be present in prior art high-resolution images are eliminated.

[0069] Another technical advantage of the disclosed techniques includes an imaging system that offers a capability to flexibly locate a transparent layer, such as a petri dish, at any of various intermediate locations between a lighting element and an image sensor. The image sensor is configured to produce a plurality of electrical signals based on shadows created by propagating light produced by the lighting element, through the transparent layer. The plurality of output signals, which are indicative of a plurality of sub-pixel shifted images, can be operated upon to generate a high-resolution image. These technical advantages provide one or more technological improvements over prior art approaches.

[0070] 1. In some embodiments, a computer-implemented method to generate sub-pixel shifted images comprises generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, wherein the light propagates through a layer supporting a specimen, and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images.

[0071] 2. The computer-implemented method of clause 1, wherein the spatially non- uniform configuration of the plurality of light emitting elements is based on non-uniform spacing between light emitting elements.

[0072] 3. The computer-implemented method of clauses 1 or 2, wherein the plurality of light emitting elements is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

[0073] 4. The computer-implemented method of any of clauses 1-3, further comprising generating a high-resolution image of the specimen based on the plurality of sub-pixel shifted images.

[0074] 5. The computer-implemented method of any of clauses 1-4, wherein generating the high-resolution image comprises omitting one or more images corresponding to a pixel boundary.

[0075] 6. The computer-implemented method of any of clauses 1-5, wherein generating the high-resolution image comprises determining a motion vector of a plane of interest corresponding to a cross-sectional view of the specimen.

[0076] 7. The computer-implemented method of any of clauses 1-6, wherein determining the motion vector comprises obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image.

[0077] 8. The computer-implemented method of any of clauses 1-7, wherein the location of each of the plurality of each of the plurality of light emitting elements is defined by a Cartesian coordinate.

[0078] 9. In some embodiments, one or more non-transitory computer-readable media store instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, propagating the generated light through a layer supporting a specimen, and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images.

[0079] 10. The one or more non-transitory computer-readable media of clause 9, wherein the spatially non-uniform configuration of the plurality of light emitting elements is based on non-uniform spacing between light emitting elements.

[0080] 11. The one or more non-transitory computer-readable media of clauses 9 or 10, wherein the plurality of light emitting elements is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

[0081] 12. The one or more non-transitory computer-readable media of any of clauses 9-11, further comprising generating a high-resolution image of the specimen based on the plurality of sub-pixel shifted images.

[0082] 13. The one or more non-transitory computer-readable media of any of clauses 9-12, wherein generating the high-resolution image comprises omitting one or more images corresponding to a pixel boundary.

[0083] 14. The one or more non-transitory computer-readable media of any of clauses 9-13, wherein generating the high-resolution image comprises determining a motion vector of a plane of interest corresponding to a cross-sectional view of the specimen.

[0084] 15. The one or more non-transitory computer-readable media of any of clauses 9-14, wherein determining the motion vector comprises obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image.

[0085] 16. The one or more non-transitory computer-readable media of any of clauses 9-15, wherein the location of each of the plurality of each of the plurality of is defined by a Cartesian coordinate.

[0086] 17. In some embodiments, an imaging system comprises a lighting element comprises a plurality of light emitting elements arranged in a spatially non-uniform configuration, a layer supporting a specimen, the layer arranged to propagate light generated by the lighting element, an image sensor arranged to generate a plurality of output signals associated with the light propagated through the layer supporting the specimen, and a computer configured to generate a plurality of sub-pixel shifted images based on evaluating the plurality of output signals of the image sensor.

[0087] 18. The imaging system of clause 17, wherein the lighting element is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

[0088] 19. The imaging system of clauses 17 or 18, wherein the computer comprises a memory storing a high-resolution image generation software and a processor coupled to the memory that executes the high-resolution image generation software by performing the steps of obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image, determining a motionvector of a plane of interest corresponding to a cross-sectional view of the specimen, and generating a high-resolution image of the specimen based on at least the motion vector.

[0089] 20. The imaging system of any of clauses 17-19, further comprising a thermoelectric cooler that is operable in a first configuration to heat the specimen and further operable in a second configuration to cool the specimen.

[0090] Any and all combinations of any of the claim elements recited in any of the claims and / or any elements described in this application, in any fashion, fall within the contemplated scope of the present invention and protection.

[0091] The descriptions of the various embodiments have been presented for purposes of illustration but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments.

[0092] Aspects of the present embodiments can be embodied as a system, method or computer program product. Accordingly, aspects of the present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that can all generally be referred to herein as a “module,” a “system,” or a “computer.” In addition, any hardware and / or software technique, process, function, component, engine, module, or system described in the present disclosure can be implemented as a circuit or set of circuits. Furthermore, aspects of the present disclosure can take the form of a computer program product embodied in one or more computer readable medium having computer readable program code embodied thereon.

[0093] Any combination of one or more computer readable medium can be utilized. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable readonly memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storagemedium can be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0094] Aspects of the present disclosure are described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine. The instructions, when executed via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / acts specified in the flowchart and / or block diagram block or blocks. Such processors can be, without limitation, general purpose processors, special-purpose processors, application-specific processors, or field-programmable gate arrays.

[0095] The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams can represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function. It should also be noted that, in some alternative implementations, the functions noted in the block can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustration, and combinations of blocks in the block diagrams and / or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

[0096] While the preceding is directed to embodiments of the present disclosure, other and further embodiments of the disclosure can be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims

WHAT IS CLAIMED IS:

1. A computer-implemented method to generate sub-pixel shifted images, comprising: generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, wherein the light propagates through a layer supporting a specimen; and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images.

2. The computer-implemented method of claim 1, wherein the spatially non-uniform configuration of the plurality of light emitting elements is based on non-uniform spacing between light emitting elements.

3. The computer-implemented method of claim 1, wherein the plurality of light emitting elements is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

4. The computer-implemented method of claim 1, further comprising: generating a high-resolution image of the specimen based on the plurality of sub-pixel shifted images.

5. The computer-implemented method of claim 4, wherein generating the high-resolution image comprises omitting one or more images corresponding to a pixel boundary.

6. The computer-implemented method of claim 4, wherein generating the high-resolution image comprises determining a motion vector of a plane of interest corresponding to a cross- sectional view of the specimen.

7. The computer-implemented method of claim 6, wherein determining the motion vector comprises obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image.

8. The computer-implemented method of claim 7, wherein the location of each of the plurality of each of the plurality of light emitting elements is defined by a Cartesian coordinate.

9. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: generating light by sequentially activating each of a plurality of light emitting elements arranged in a spatially non-uniform configuration, wherein the light propagates through a layer supporting a specimen; and generating a plurality of output signals from an image sensor configured to detect the light propagated through the layer supporting the specimen, the plurality of output signals indicative of a plurality of sub-pixel shifted images.

10. The one or more non-transitory computer-readable media of claim 9, wherein the spatially non-uniform configuration of the plurality of light emitting elements is based on non- uniform spacing between light emitting elements.

11. The one or more non-transitory computer-readable media of claim 9, wherein the plurality of light emitting elements is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

12. The one or more non-transitory computer-readable media of claim 9, further comprising: generating a high-resolution image of the specimen based on the plurality of sub-pixel shifted images.

13. The one or more non-transitory computer-readable media of claim 12, wherein generating the high-resolution image comprises omitting one or more images corresponding to a pixel boundary.

14. The one or more non-transitory computer-readable media of claim 12, wherein generating the high-resolution image comprises determining a motion vector of a plane of interest corresponding to a cross-sectional view of the specimen.

15. The one or more non-transitory computer-readable media of claim 14, wherein determining the motion vector comprises obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image.

16. The one or more non-transitory computer-readable media of claim 15, wherein the location of each of the plurality of each of the plurality of is defined by a Cartesian coordinate.

17. An imaging system comprising: a lighting element comprising a plurality of light emitting elements arranged in a spatially non-uniform configuration, wherein the light propagates through a layer supporting a specimen; an image sensor arranged to generate a plurality of output signals associated with the light propagated through the layer supporting the specimen; and a computer configured to generate a plurality of sub-pixel shifted images based on evaluating the plurality of output signals of the image sensor.

18. The imaging system of claim 17, wherein the lighting element is locatable over a first range of separation distances with respect to the layer, and wherein the layer is locatable over a second range of separation distances with respect to the image sensor.

19. The imaging system of claim 17, wherein the computer comprises a memory storing a high-resolution image generation software and a processor coupled to the memory that executes the high-resolution image generation software by performing the steps of: obtaining information about a location of each of the plurality of light emitting elements associated with a corresponding generated sub-pixel shifted image; determining a motion vector of a plane of interest corresponding to a cross-sectional view of the specimen; and generating a high-resolution image of the specimen based on at least the motion vector.

20. The imaging system of claim 17, further comprising: a thermo-electric cooler that is operable in a first configuration to heat the specimen and further operable in a second configuration to cool the specimen.

Images