Sensing systems and methods

Abstract

The sensing system 200 includes a first encoding aperture 210 configured to receive incident light and transmit an encoded image of the object 230. The sensing system 200 includes a light replication component 250 configured to detect the encoded image and emit a replicated encoded image. The sensing system 200 includes a second encoding aperture 260 configured to receive the replicated encoded image and transmit a decoded image. The sensing system 200 includes a sensor 220 configured to detect the decoded image.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a sensing system and method, in particular but not exclusively to an encoded aperture sensing system for detecting an image. The sensing system can be incorporated into an electronic device such as a mobile phone or tablet computer. BACKGROUND

[0002] The present disclosure relates to a sensing system adapted to detect an image. A well-known example of a simple sensing system for detecting an image is a pinhole camera. A pinhole camera comprises a single aperture (i.e. a pinhole). The pinhole receives incoming light and transmits a single inverted image that can be detected by an eye or a sensor. The amount of light transmitted by the pinhole at least partly determines the signal-to-noise ratio of the pinhole camera. Increasing the size of the pinhole reduces the resolution of the pinhole camera (e.g. blurring occurs near the edges of the detected image). Reducing the size of the pinhole reduces the signal (i.e. less light is transmitted through the smaller pinhole) and the resolution of the pinhole camera is eventually limited by diffraction.

[0003] To overcome at least some of the limitations of a pinhole camera, the pinhole can be replaced with an encoded aperture. An encoded aperture is a substrate comprising an optical encoding pattern of substantially opaque regions and substantially transparent regions. An encoded aperture transmits a greater amount of light than a pinhole because an image incident on the encoded aperture is transmitted by each of the substantially transparent regions and is thereby replicated multiple times (corresponding to the number of substantially transparent regions). More light is transmitted through the multiple apertures and so an encoded aperture achieves a greater signal-to-noise ratio than a pinhole camera. However, the sensor receives multiple overlapping inverted images that arrive at the sensor surface from different angles. That is, the sensor receives an encoded image that is a convolution of the optical encoding pattern of the encoded aperture and the image to be detected. To understand the sensed encoded image and to reconstruct the image to be detected, the encoded image is decoded using knowledge of the optical encoding pattern of the encoded aperture.

[0004] Figure 1 An example of a known sensing system 100 is schematically depicted in Fig. 1. The known sensing system 100 comprises an encoded aperture 110 configured to receive incoming light and transmit an encoded image. The encoded aperture 110 comprises an optical encoding pattern of substantially transparent regions and substantially opaque regions. Light passing through the substantially transparent regions forms the encoded image. The encoded image can comprise multiple inverted and overlapping images of an object 130 illuminated by the incoming light. The known sensing system 100 further comprises a sensor 120 configured to detect the encoded image. The encoded image comprises a convolution of the image of the object 130 and the pattern of the encoded aperture 110. The sensor 120 is in communication with a processor 140. The processor 140 is configured to receive a signal from the sensor 120 indicative of the detected encoded image. The processor 140 comprises a computational algorithm configured to mathematically decode the encoded image to produce a reconstructed image of the object 130.

[0005] Some problems associated with such known sensing systems 100 are that the processor 140 needs to decode the encoded image (i.e., perform a complex deconvolution of the pattern of the encoding aperture 110 and the image of the object 130). The decoding algorithm is complex and computationally demanding, requiring a large amount of processing time and a large amount of energy to perform.

[0006] It is therefore an object of the present disclosure to provide a sensing system that addresses one or more of the above problems or at least provides a useful alternative. SUMMARY

[0007] Generally speaking, the present disclosure proposes to overcome the above problems by optically decoding the encoded image using a light replication assembly and a second encoding aperture. This arrangement advantageously reduces or avoids the need for complex computational algorithms, as the decoding is performed optically using the second encoding aperture. The light replication assembly advantageously reduces or avoids information loss that can occur using optical decoding.

[0008] According to one aspect of the present invention, there is provided a sensing system comprising a first encoding aperture configured to receive incident light and transmit an encoded image. The sensing system comprises a light replication assembly configured to detect the encoded image and emit a replicated encoded image. The sensing system comprises a second encoding aperture configured to receive the replicated encoded image and transmit a decoded image. The sensing system comprises a sensor configured to detect the decoded image.

[0009] The sensing system optically decodes the encoded image rather than computationally decoding the encoded image. The encoded image is received by a camera / display pair (i.e., the light replication assembly), and a replicated image of the encoded image is provided to an inverse filter mask (i.e., the second encoding aperture) designed based on the first filter mask (i.e., the first encoding aperture). The second encoding aperture provides a deconvolution of the encoded image and transmits a decoded image to another camera (i.e., the sensor). In this way, the decoding is performed optically without recourse to a computational process involving complex algorithms.

[0010] Optical decoding of the encoded image can have been previously avoided in the technical field of encoding aperture sensing systems for a variety of reasons. These reasons can include, for example, perceived difficulties in manufacturing the first and second encoding apertures, perceived difficulties in using negative and various scaled decoding coefficients, and ease of data storage for computational decoding. As a result, known sensing systems use complex algorithms to reconstruct the image using computational resources.

[0011] The highly complex and numerical computational image processing used in known sensing systems is replaced by optical processing in the present sensing system. The sensing system advantageously reduces or eliminates the need to create, store and implement complex computational algorithms for decoding the encoded image. Reducing the computational burden of the sensing system advantageously allows the device comprising the sensing system (e.g. a mobile phone) to focus on other tasks, thereby freeing up data space. Furthermore, optical decoding uses less energy than computational decoding, thereby increasing the efficiency of the sensing system. The reduced energy usage makes the sensing system suitable for use in mobile devices that use portable energy sources (e.g. batteries) that would otherwise struggle to meet the demands of computational decoding.

[0012] The light replication component can emit the replicated encoded image towards the second encoding aperture such that there is substantially no loss of light during the encoding and decoding process. That is, all the information carried by the incident light is used to reconstruct the image of the object. Thus, the light replication component advantageously avoids loss of information, thereby improving the signal-to-noise ratio of the sensing system.

[0013] The sensing system achieves all the benefits of an encoding aperture (such as improved signal-to-noise ratio) while avoiding the main drawback of high computational load involved in computational decoding. The sensing system can be manufactured smaller than known sensing systems and can be implemented on an integrated circuit chip.

[0014] The optical encoding pattern of the second encoding aperture can be an inverse pattern of the optical encoding pattern of the first encoding aperture.

[0015] The first encoding aperture and / or the second encoding aperture can comprise a random optical encoding pattern.

[0016] Using a randomly generated optical encoding pattern advantageously enables greater design flexibility of the first and / or second encoding aperture.

[0017] The first encoding aperture and / or the second encoding aperture can comprise a uniform redundant array or a modified uniform redundant array.

[0018] Uniform redundant arrays (URA) and modified uniform redundant arrays (MURA) are families of mask patterns that are proportional to prime numbers. While they offer less design flexibility than randomly generated patterns, URAs and MURAs produce less measurement noise than randomly generated patterns.

[0019] The first encoding aperture and / or the second encoding aperture can comprise a Fresnel zone plate, an optimized random pattern, a uniform redundant array, a hexagonal uniform redundant array, a modified uniform redundant array, etc.

[0020] The first encoding aperture and the second encoding aperture can comprise substantially the same pattern.

[0021] Using first and second encoding apertures that are substantially identical advantageously simplifies the sensing system and avoids the need to produce encoding apertures with significantly different patterns. The grid pattern of the first encoding aperture can differ from the grid pattern of the second encoding aperture by a single grid and still be considered substantially identical.

[0022] The first encoding aperture and / or the second encoding aperture can comprise a controllable display.

[0023] The controllable display can comprise a liquid crystal display (LCD).

[0024] Using an encoding aperture with a coded display advantageously allows the encoding aperture to adapt to a given scene. For example, a controllable display can be used to increase or decrease the size of the substantially transparent portion and / or the substantially opaque portion of the first and / or second encoding aperture. As another example, using a controllable display to replicate the pattern of the first encoding aperture and / or the second encoding aperture multiple times can be used to achieve a fully coded field of view in which all directions of the incident flux are fully modulated by the first and / or second encoding aperture. As another example, using a controllable display to apply multiple patterns with different amounts of blur on the first encoding aperture and / or the second encoding aperture can increase the speed at which the sensing system can reconstruct a depth map of an object.

[0025] The second encoding aperture can be mounted on the sensor.

[0026] Mounting the second encoding aperture on the sensor advantageously reduces the size of the sensing system.

[0027] The light replication assembly can comprise an incident light receiving surface and an opposing light emitting surface.

[0028] The light replication assembly can comprise a substantially transparent planar substrate. The light replication assembly can comprise one or more bipolar junction transistors provided on the substrate, the or each transistor comprising a collector region adjacent the light receiving surface, an emitter region adjacent the light emitting surface, and a base region between the collector region and the emitter region. The light replication assembly can comprise circuitry for biasing the bipolar transistors in use. The or each transistor can be configured and biased in use such that the collector region and the base region of the transistor operate as a photodiode, and the base region and the emitter region operate as a light emitting diode.

[0029] The transistor or each transistor can be configured and biased so as to amplify the intensity of emitted light relative to incident light. The light replication assembly can comprise a plurality of said bipolar junction transistors arranged as a two-dimensional array across said planar substrate. The plurality of bipolar transistors can be provided as raised discrete structures on said planar substrate. The collector region can be provided adjacent to said planar substrate, and the planar substrate provides said incident light receiving surface. One or both of said light receiving surface and said light emitting surface can comprise an anti-reflective coating. The transparent planar substrate can comprise sapphire. The transistors can comprise gallium arsenide or indium phosphide devices. The light replication assembly can comprise a Lambertian surface.

[0030] The light replication assembly can comprise an organic photodiode, an organic phototransistor or an organic light emitting diode.

[0031] The use of an organic photodiode, an organic phototransistor or an organic light emitting diode can advantageously improve the flexibility of the light replication assembly.

[0032] According to another aspect of the disclosure, there is provided an electronic device comprising a sensing system. The electronic device can be a mobile phone, a tablet computer, an interactive display or the like.

[0033] According to another aspect of the disclosure, there is provided a method of sensing light, comprising receiving incident light using a first coded aperture and transmitting a coded image. The method comprises detecting the coded image and emitting a replicated coded image. The method comprises receiving the replicated coded image using a second coded aperture and transmitting a decoded image. The method comprises detecting the decoded image.

[0034] According to another aspect of the disclosure, there is provided a computer program comprising computer readable instructions configured to cause a computer to perform the aforementioned method.

[0035] According to another aspect of the disclosure, there is provided a computer readable medium carrying the aforementioned computer program.

[0036] Different features of different aspects can be combined in different ways. BRIEF DESCRIPTION OF DRAWINGS

[0037] Some embodiments of the disclosure will now be described, by way of example only, and with reference to the accompanying drawings in which:

[0038] Figure 1 A known sensing system is schematically depicted;

[0039] Figure 2 A sensing system according to the disclosure is schematically depicted;

[0040] By Figures 3A-3CFigure 3, consisting of

[0041] Figure 4, consisting of Figure 4A and Figure 4B Figure 4, consisting of

[0042] Figure 5, consisting of Figure 5A and Figure 5B Figure 5, consisting of

[0043] Figure 6 Figure 6, consisting of

[0044] Figure 7 Figure 7, consisting of DETAILED DESCRIPTION

[0045] Generally speaking, the present disclosure provides a sensing system that utilizes a first coded aperture and a second coded aperture to optically encode and decode an image of a scene and / or object to be detected. The image is first acquired by a sensor assembly of a light replication assembly, the image representing a convolution of an image of the object and a known pattern of the first coded aperture. The encoded image is then re-illuminated by means of an emission assembly of the light replication assembly through the second coded aperture (e.g. having a pattern inverse to the first coded aperture). The second coded aperture is configured to perform a deconvolution of the encoded image. In this way, a final sensor receives and detects a reconstructed decoded image of the object.

[0046] Some examples of the solution are provided in the attached drawings.

[0047] Figure 2 Figure 6, consisting of

[0048] The sensing system 200 includes a light replication assembly 250 configured to receive and detect the encoded image and emit a replicated encoded image. The light replication assembly 250 includes an incident light receiving surface 252 and an opposing light emitting surface 254. The light receiving surface 252 receives the encoded image transmitted by the first encoding aperture 210. The light receiving surface 252 can include an intermediate sensor configured to detect the encoded image. The intermediate sensor can include a plurality of sensing elements, such as photodiodes, charge-coupled devices (CCDs), or complementary metal-oxide-semiconductor (CMOS) based sensors. The plurality of sensing elements can be arranged to form an array, such as a grid array. The encoded image includes a convolution of the image of the object 230 and the optical encoding pattern of the first encoding aperture 210.

[0049] The light emitting surface 254 can include an emitter configured to emit the replicated encoded image. That is, the light emitting surface 254 can receive information indicative of the encoded image detected by the light receiving surface 252 and use the information to reconstruct and emit the replicated encoded image. The emitter can include a plurality of light emitting elements, such as light emitting diodes (LEDs), light emitting transistors (LETs), or the like. The plurality of light emitting elements can be arranged to form an array, such as a grid array. An example of the light replication assembly 250 is described in more detail with reference to FIG. 3.

[0050] The sensing system 200 includes a second encoding aperture 260. The second encoding aperture 260 is configured to receive the replicated encoded image emitted by the light replication assembly 250 and transmit a decoded image. The second encoding aperture 260 includes an optical encoding pattern of substantially transmissive regions 262 and substantially opaque regions 264. Light passing through the substantially transmissive regions 262 forms the decoded image. The decoded image can include a reconstruction of the image of the object 230. Decoding of the encoded image can be performed using various methods, such as deconvolution, correlation, and / or Fresnel diffraction.

[0051] Deconvolution can generally be applicable to decoding an image regardless of the arrangement of the first encoding aperture 210. Deconvolution can include performing a Fourier transform and / or an inverse Fourier transform of the first encoding aperture 210. Deconvolution can include applying a Wiener filter that assumes at least some knowledge of the measurement noise affecting the encoded image. Deconvolution can include using a matched filter technique that assumes at least some knowledge of the arrangement of the first encoding aperture 210. Correlation can involve performing a cross-correlation function involving the optical encoding pattern of the first encoding aperture 210 and the encoded image. Correlation can be particularly effective when the first encoding aperture 210 includes a uniform redundant array (URA) or a modified uniform redundant array (MURA). Such an encoding aperture can produce a Dirac delta function when convolved (or cross-correlated) with itself (i.e., a matched filter process). A Fresnel diffraction approximation can be used as a far-field approximation, where the object 230 is far enough away from the sensing system 200 such that the incident light rays can be considered substantially parallel.

[0052] Reconstruction of the original image of the object 230 can be obtained through deconvolution involving the encoded image and the first encoding aperture 210. In mathematical terms, the encoded image R detected by the light receiving surface 252 of the light replication component 250 can take the following form:

[0053] Equation 1: R = O * A

[0054] where O represents the image of the object 230 and A represents the optical encoding pattern of the first encoding aperture 210. The first encoding aperture 210 can be designed (e.g., as a URA or MURA encoding aperture) to satisfy the following equation:

[0055] Equation 2: A * A = δ

[0056] where δ is a Dirac delta function. By designing the first encoding aperture 210 to satisfy Equation 2, and by designing the second encoding aperture 260 to be substantially identical to the first encoding aperture 210 (i.e., both can be represented by the same variable A), the convolution of the encoded image with the second encoding aperture 260 can be represented by the following relationship:

[0057] Equation 3: R * A = O * A * A = O * (A * A) = O * δ = O

[0058] where O* is the decoded image (i.e., the reconstructed image) of the object 230. That is, the autocorrelation of the first encoding aperture 210 and the second encoding aperture 260 is used to decode the encoded image, thereby reconstructing the image of the object 230 at the sensor 220.

[0059] The reconstructed image (i.e., the decoded image) may include an autocorrelation convolution of object 230 and the first coding aperture 210 and the second coding aperture 260. The reconstructed image of object 230 may contain artifacts unless the autocorrelation results in a Dirac delta function (i.e., a substantially perfect inverse of the first coding aperture 210). Therefore, the optical coding pattern of the second coding aperture 260 may depend at least in part on the optical coding pattern of the first coding aperture 210. That is, the pattern of the second coding aperture 260 may be configured to invert the convolution of the image of object 230 performed by the pattern of the first coding aperture 210.

[0060] Sensing system 200 includes sensor 220. Sensor 220 is configured to detect a decoded image transmitted through a second coded aperture 260. Sensor 220 may include multiple sensing elements, such as photodiodes, CCDs, and / or CMOS-based sensors. The multiple sensing elements may be arranged to form an array, such as a grid array. Sensor 220 receives an image of object 230 that has been optically encoded by a first coded aperture 210 and subsequently optically decoded by a second coded aperture 260, thereby avoiding the need for complex decoding algorithms.

[0061] The dimensions of the sensing system 200 (i.e., the dimensions of the first encoding aperture 210, the optical replication component 250, the second encoding aperture 260, and the sensor 220) can be selected to incorporate the sensing system 200 into a given electronic device (e.g., a mobile phone).

[0062] Depend on Figures 3A-3C Figure 3 schematically depicts three different views of the optical replication assembly 300 according to the present disclosure. Figure 3A A schematic view of the light receiving surface 310 of the light replication assembly 300 is shown. Figure 3B A schematic view from the side of the light replication component 300 is depicted. Figure 3C A schematic view of the light emitting surface 330 of the light replication assembly 300 is shown.

[0063] In the example of FIG. 3, the light replication assembly 300 includes a planar substrate 320. The substrate 320 can be substantially transparent. A plurality of bipolar junction transistors 340 are provided on the substrate 320. Each transistor 340 includes a collector region 342 adjacent the light receiving surface 310. Each transistor 340 also includes an emitter region 344 adjacent the light emitting surface 330. Each transistor 340 also includes a base region 346 between the collector region 342 and the emitter region 344. The light replication assembly 300 includes circuitry (not shown) configured to bias the bipolar transistors 340 when the light replication assembly 300 is in use. Each transistor 340 can be configured and biased in use so that the collector region 342 and the base region 346 of the transistor 340 operate as a photodiode, while the base region 346 and the emitter region 344 operate as a light emitting diode. The array of emitter regions 344 is configured to reproduce and emit a coded image (i.e., a convolution of the first coded aperture and the object to be imaged) toward a second coded aperture of a sensing system.

[0064] The light replication assembly 300 can include alternative elements. For example, the light replication assembly 300 can include an array of phototransistors paired with an array of LEDs. The LEDs on the light emitting surface 330 can be driven (e.g., linearly driven) by light sensed by the phototransistors on the light receiving surface 310. Alternatively, the light replication assembly 300 can include an array of organic photodiodes or phototransistors paired with an array of organic LEDs (OLEDs) to provide an organic version of the light replication assembly 300.

[0065] By Figure 4A and Figure 4B FIG. 4, which consists of Figure 4A An optical arrangement 400 is schematically depicted that does not include a light replication assembly. Figure 4B An optical arrangement 450 is schematically depicted that includes a light replication assembly 480. Reference is made to Figure 4AThe first and second light rays 422, 424 propagate through the first and second transmissive portions 412, 414 of the first coded aperture 420. The third and fourth light rays 426, 428 propagate through the first and second transmissive portions 432, 434 of the second coded aperture 430. The second coded aperture 430 is configured to receive light transmitted by the first coded aperture 420. However, the first through fourth light rays 422-428 do not reach the first and second transmissive portions 432, 434 of the second coded aperture 430. In this way, the optical information carried by the first through fourth light rays 422-428 is lost, thereby reducing the signal-to-noise ratio of the system 400. That is, a substantial portion of the light will not reach the sensor located behind the second coded aperture 430.

[0066] With reference to Figure 4B The first and second light rays 452, 454 propagate through the first and second transmissive portions 472, 474 of the first coded aperture 470. The third and fourth light rays 456, 458 propagate through the first and second transmissive portions 492, 494 of the second coded aperture 490. The light replication assembly 480 receives light transmitted by the first coded aperture 470. The encoded image transmitted by the first coded aperture 470 is detected by the light replication assembly 480. The light replication assembly 480 emits a replicated encoded image toward the first and second transmissive portions 492, 494 of the second coded aperture 490 such that none of the light rays 452-458 are lost from the system 450. That is, all of the optical information carried by the light rays 452-458 is used to reconstruct an image of the object 460. Accordingly, the light replication assembly 480 advantageously avoids information loss, thereby improving the signal-to-noise ratio of the system 450.

[0067] By Figure 5A and Figure 5BFigure 5, composed of a first coded-aperture optical encoding pattern 500 and a second coded-aperture optical encoding pattern 550, schematically depicts an example of a first coded-aperture optical encoding pattern 500 and an example of a second coded-aperture optical encoding pattern 550 according to the present disclosure. The first coded aperture 500 and the second coded aperture 550 are depicted with grid axes starting at zero and ending at ten to form an eleven by eleven grid pattern. The first coded aperture 500 and the second coded aperture 550 include substantially transparent regions 510 (represented by white regions) and substantially opaque regions 520 (represented by black regions). In the example of Figure 5, the regions are shaped as squares or a grid. In the example of Figure 5, the first coded aperture 500 and the second coded aperture 550 both include a Modified Uniform Redundancy Array (MURA). MURAs are a family of mask patterns that are proportional to prime numbers. MURAs can advantageously introduce less noise to the convolution and / or deconvolution of the encoded image compared to other types of coded apertures.

[0068] In the example of Figure 5, the first coded aperture 500 is substantially identical to the second coded aperture 550. The only difference between the first coded aperture 500 and the second coded aperture 550 is the first pixel (i.e., the (0,0) region) 530. In the first coded aperture 500, the first pixel 530 is substantially opaque. In the second coded aperture 550, the first pixel 530 is substantially transparent. The first coded aperture 500 can be designed from a MURA pattern using Legendre coefficients. The second coded aperture 550 can be designed so as to provide a substantially ideal deconvolution (i.e., Dirac delta function) of the first coded aperture 500. In the example of Figure 5, changing the state of the first pixel 530 between the first coded aperture 500 and the second coded aperture 550 achieves a Dirac delta function (i.e., a substantially ideal deconvolution of the encoded image).

[0069] Alternative patterns can be used. For example, the first coded aperture 500 and / or the second coded aperture 550 can include a random pattern or a random array (e.g., an Optimized Random Array (ORA)).

[0070] The first encoding aperture 500 and / or the second encoding aperture 550 can comprise a controllable display. The controllable display can for example comprise a liquid crystal display (LCD). The controllable display can be used to provide any desired encoding aperture pattern. The first encoding aperture 210 and / or the second encoding aperture 260 can be adapted to a given scene. For example, the controllable display can be used to increase or decrease the size of the substantially transparent regions and / or the substantially opaque regions of the first encoding aperture 210 and / or the second encoding aperture 260. As another example, replicating the pattern of the first encoding aperture 210 and / or the second encoding aperture 260 multiple times using the controllable display can be used to achieve a fully encoded field of view in which all directions of the incident flux are encoded by the first encoding aperture 210 and / or the second encoding aperture 260. That is, substantially all of the light directed towards the light receiving surface 252 of the light replication assembly 250 and / or the sensor 220 is modulated by the first encoding aperture 210 and / or the second encoding aperture 260, rather than a portion of the light being lost (i.e. as is the case for a partially encoded field of view). As another example, applying multiple patterns with different amounts of blurring on the first encoding aperture 210 and / or the second encoding aperture 260 using the controllable display can increase the speed at which a depth map of the object 230 can be reconstructed using measurements performed by the sensing system 200.

[0071] Figure 6 An electronic device 600 comprising a sensing system 610 according to the present disclosure is schematically depicted. In the example of Figure 6 The electronic device 600 is a mobile phone. The mobile phone 600 can utilize the sensing system 610 to take photographs and / or videos that can be displayed on an electronic display 620 of the mobile phone 600. The mobile phone 600 can utilize the sensing system 610 to provide motion or gesture recognition and / or control functionality. By reducing or avoiding the need for complex computational algorithms to decode the encoded images, the sensing system 610 can advantageously reduce the energy consumption of the mobile phone 600, thereby extending the battery life of the mobile phone 600.

[0072] Figure 7 A flowchart of a method of sensing light according to the present disclosure is shown. A first step 700 of the method comprises receiving incident light using a first encoding aperture and transmitting an encoded image. A second step 710 of the method comprises detecting the encoded image. A third step 720 of the method comprises transmitting a replicated encoded image. A fourth step 730 of the method comprises receiving the replicated encoded image using a second encoding aperture and transmitting a decoded image. A fifth step 740 of the method comprises detecting the decoded image.

[0073] The sensing system of the present disclosure can form part of a compact system (e.g., the second coded aperture can be mounted on the sensor). The sensing system can not experience wavelength limitations. The sensing system can be implemented on curved and / or flexible surfaces. Embodiments of the present invention can be used in many different electronic devices, including for example, camera systems, mobile phones, flexible electronic systems (e.g., wearable technology, where energy conservation can be a major factor). Further applications include faster facial recognition, faster gesture recognition, augmented reality, virtual reality, where the central processing unit (CPU) can be freed from complex image decoding algorithms. Depth maps, dynamic videos, and / or four-dimensional light fields of images, objects, and / or scenes can be acquired from measurements performed using the sensing system. Coded aperture based systems using compressive sensing principles can be used for super-resolution imaging, spectral imaging, and / or video capture.

[0074] List of reference signs:

[0075] 100 known sensing system

[0076] 110 coded aperture

[0077] 120 sensor

[0078] 130 object

[0079] 140 processor

[0080] 200 sensing system

[0081] 210 first coded aperture

[0082] 212 transmissive region

[0083] 214 opaque region

[0084] 220 sensor

[0085] 230 object

[0086] 250 light replication component

[0087] 252 light receiving surface

[0088] 254 light emitting surface

[0089] 260 second coded aperture

[0090] 262 transmissive region

[0091] 264 opaque region

[0092] 300 light replication component

[0093] 310 light receiving surface

[0094] 320 substrate

[0095] 330 light emitting surface

[0096] 340 bipolar junction transistor

[0097] 342 collector region

[0098] 344 emitter region

[0099] 346 base region

[0100] 400 optical arrangement not including a light replication component

[0101] 410 object

[0102] 412 first transmissive portion

[0103] 414 second transmissive portion

[0104] 420 first coded aperture

[0105] 422 first light ray

[0106] 424 second light ray

[0107] 426 third light ray

[0108] 428 fourth light ray

[0109] 430 second coded aperture

[0110] 432 first transmissive portion

[0111] 434 second transmissive portion

[0112] 450 optical arrangement including a light replication component

[0113] 452 first light ray

[0114] 454 second light ray

[0115] 456 third light ray

[0116] 458 fourth light ray

[0117] 460 object

[0118] 470 first coded aperture

[0119] 472 first transmissive portion

[0120] 474 second transmissive portion

[0121] 480 light replication component

[0122] 490 second coded aperture

[0123] 492 first transmissive portion

[0124] 494 second transmissive portion

[0125] 500 first coded-aperture optical encoding pattern

[0126] 510 transmissive region

[0127] 520 opaque region

[0128] 530 first pixel

[0129] 550 second coded-aperture optical encoding pattern

[0130] 600 electronic device

[0131] 610 sensing system

[0132] 620 electronic display

[0133] 700 first step 710 of the method second step 720 of the method third step 730 of the method fourth step 740 of the method fifth step

[0134] Those skilled in the art will appreciate that, in the foregoing specification and the accompanying drawings, terms such as "above", "along", "side" and the like are made with reference to conceptual illustrations (such as those shown in the drawings) and are used only to facilitate reference to the objects. These terms are not intended to be limiting in nature. Thus, these terms are understood to refer to objects when in the orientation as shown in the drawings.

[0135] While the disclosure has been described in accordance with preferred embodiments thereof, it is understood that these embodiments are illustrative only and that modifications and alternatives will occur to those skilled in the art upon reading the foregoing specification and accompanying drawings. Such modifications and alternatives are deemed within the scope of the appended claims. Each feature disclosed or shown in this specification can be incorporated in any embodiment, either alone or in any appropriate combination with any other feature disclosed or shown in this specification.

Claims

1. A sensing system, comprising: The first coding aperture is configured to receive incident light and transmit a coded image; An optical copying component configured to detect the encoded image and emit the copied encoded image; A second encoding aperture is configured to receive the copied encoded image and the transmitted decoded image; as well as A sensor configured to detect the decoded image.

2. The sensing system according to claim 1, wherein the optical coding pattern of the second coding aperture is the inverse pattern of the optical coding pattern of the first coding aperture.

3. The sensing system according to claim 1, wherein the first coded aperture and / or the second coded aperture comprises a random optical coded pattern.

4. The sensing system according to claim 1, wherein the first encoding aperture and / or the second encoding aperture comprises a uniform redundancy array or a modified uniform redundancy array.

5. The sensing system of claim 1, wherein the first coded aperture and the second coded aperture comprise substantially the same pattern.

6. The sensing system according to claim 1, wherein the first coded aperture and / or the second coded aperture includes a controllable display.

7. The sensing system of claim 1, wherein the second encoding aperture is mounted on the sensor.

8. The sensing system of claim 1, wherein the light replication component comprises an incident light receiving surface and an opposing light emitting surface.

9. The sensing system of claim 8, wherein the optical replication component comprises: A substantially transparent planar substrate; One or more bipolar junction transistors are provided on the substrate, the transistor or each transistor including a collector region adjacent to the light receiving surface, an emitter region adjacent to the light emitting surface, and a base region between the collector region and the emitter region; as well as Circuitry for biasing the transistor in use. The transistor, or each transistor, is configured and biased in use such that the collector region and the base region of the transistor operate as a photodiode, while the base region and the emitter region operate as a light-emitting diode.

10. The sensing system of claim 1, wherein the optical replication component comprises an organic photodiode, an organic phototransistor, or an organic light-emitting diode.

11. An electronic device comprising a sensing system according to any one of claims 1-10.

12. A method for sensing light, comprising: The first coded aperture is used to receive incident light and transmitted coded images; The coded image transmitted through the first coded aperture is detected at the light-receiving surface of the component by the optical replication component; A copied coded image is emitted from the opposing light-emitting surfaces of the optical copying component, and the copied coded image is spatially registered with the detected coded image; The copied coded image is optically decoded and transmittedly decoded using a second coded aperture; as well as Detect the decoded image.

13. A computer program including computer-readable instructions configured to cause a computer to perform the method according to claim 12.

14. A computer-readable medium carrying a computer program according to claim 13.

Images