Pixelated programmable neutral density filter array

TWI939453BActive Publication Date: 2026-09-21QUALCOMM INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
TW111108623
Authority / Receiving Office
TW · TW
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-05-04
Filing Date
2022-03-09
Publication Date
2026-09-21
Estimated Expiration
2042-03-08

AI Technical Summary

Technical Problem

Existing photography techniques struggle to capture high dynamic range scenes without image artifacts by combining multiple images with different exposure times, leading to misalignment and resource-intensive processing.

Method used

A camera system with a pixelated programmable neutral density filter array that allows individual control of light attenuation for each filter, enabling a single exposure to capture a high dynamic range image without over- or under-exposure, using a filter array over the pixel array to adjust light levels based on image analysis.

Benefits of technology

This approach generates high dynamic range images without artifacts, saving computing resources by eliminating the need for multiple image processing and alignment, while ensuring accurate alignment and reducing resource consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure TWG2TB001911570_001
    Figure TWG2TB001911570_001
  • Figure TWG2TB001911570_002
    Figure TWG2TB001911570_002
  • Figure TWG2TB001911570_003
    Figure TWG2TB001911570_003
Patent Text Reader

Abstract

In some configurations, the device can receive a first image from the camera's pixel array. The device can configure filter settings based at least in part on the first image. The filter can be included within a filter array arranged in association with the pixel array within the camera. The device can then enable the pixel array to capture a second image. Many other configurations are described.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to filters, and for example to pixelated programmable neutral density filter arrays. Prior Technology

[0002] In photography and optics, neutral density (ND) filters reduce or modify the intensity of all wavelengths or colors of light equally without altering the hue of the color reproduction. For example, ND filters can be used to reduce the amount of light entering a camera lens to allow for combinations of aperture, exposure time, and sensor sensitivity settings that would otherwise result in overexposed images. Summary of the Invention

[0003] In some forms, a method includes: receiving a first image by a device and from a pixel array of a camera; configuring settings of a filter by the device based at least in part on the first image, wherein the filter is included in a filter array arranged in association with the pixel array within the camera; and causing the pixel array to capture a second image by the device.

[0004] In some embodiments, a device includes: one or more memory modules and one or more processors coupled to the memory modules, configured to: receive a first image from a pixel array of a camera; configure settings of a filter at least in part based on the first image, wherein the filter is included in a filter array arranged in the camera in association with the pixel array; and cause the pixel array to capture a second image.

[0005] In some forms, a non-transitory computer-readable medium stores a set of instructions, the set of instructions including one or more instructions that, when executed by one or more processors of the device, cause the device to: receive a first image from a pixel array of a camera; configure settings of a filter based at least in part on the first image, wherein the filter is included in a filter array arranged in association with the pixel array within the camera; and cause the pixel array to capture a second image.

[0006] In some embodiments, an apparatus includes: components for receiving a first image from a pixel array of a camera; components for configuring settings of a filter at least in part based on the first image, wherein the filter is included in a filter array arranged in the camera in association with the pixel array; and components for causing the pixel array to capture a second image.

[0007] As substantially described with reference to the drawings and specifications, the various types typically include methods, apparatus, systems, computer program products, non-transitory computer-readable media, user equipment, user gear, wireless communication equipment, and / or processing systems.

[0008] The foregoing has provided a fairly broad overview of the features and technical advantages of the examples according to this disclosure in order to better understand the following detailed description. Additional features and advantages will be described below. The disclosed concepts and specific examples can be readily used as the basis for modifying or designing other structures to achieve the same purpose of this disclosure. Such equivalent structures do not depart from the scope of the appended claims. The features of the concepts disclosed herein, their organization and operation, and the associated advantages will be better understood from the following description when considered in conjunction with the diagrams. Each diagram is provided for illustrative and descriptive purposes, and not as a limiting definition of the claims. Simple Explanation of the Diagram

[0009] To gain a more detailed understanding of the features described above, a more specific description can be obtained by referring to several examples, some of which are shown in the figures. However, it should be noted that the figures only illustrate certain typical examples of this disclosure and should not be considered a limitation on its scope, as the description may acknowledge other equally valid examples. Identical element symbols in different figures may identify the same or similar elements.

[0010] Figure 1 is a diagram illustrating an example environment in which the pixelated programmable neutral density filter array described herein can be implemented, according to the present disclosure.

[0011] Figure 2 is a diagram illustrating example components of one or more devices shown in Figure 1 according to this disclosure, such as user equipment 110 and / or wireless communication device 120.

[0012] Figures 3A-3B are diagrams illustrating examples associated with pixelated programmable neutral density filter arrays according to this disclosure.

[0013] Figure 4 is a flowchart of an example process associated with a pixelated programmable neutral density filter array according to the present disclosure. Implementation

[0014] The various forms of this disclosure are described more fully below with reference to the accompanying drawings. However, this disclosure may be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout this disclosure. Rather, these forms are provided to make this disclosure thorough and complete, and to fully convey the scope of this disclosure to those skilled in the art. Based on the teachings herein, those skilled in the art should understand that the scope of this disclosure is intended to cover any form disclosed herein, whether implemented independently of or in combination with any other form of this disclosure. For example, any number of forms set forth herein may be used to implement an apparatus or method. Furthermore, the scope of this disclosure is intended to cover an apparatus or method practiced using a structure, function, or structure and function other than or different from the various forms of this disclosure set forth herein. It should be understood that any form of the disclosure herein may be embodied by one or more elements of a claim.

[0015] In photography, "dynamic range" can refer to the range of contrast or color between the brightest and darkest tones in an image, a scene captured by a camera, etc. Typically, the dynamic range of a natural scene (e.g., sunset, sunrise, mountains, lakes, etc.) can be large (e.g., up to 140 dB) relative to the dynamic range that can be captured by a camera's image sensor (e.g., up to 90 dB). To capture the relatively large dynamic range of a scene, a camera can be configured to capture multiple (e.g., 3, 4, 5, etc.) images of the scene using different exposure times. For example, a camera can use long exposure times (e.g., 0.5 seconds, 1.0 second, 3.0 seconds, etc.) to capture the dark tones of the scene and short exposure times (e.g., 1.0 microsecond, 5.0 microsecond, etc.) to capture the bright tones of the scene. A camera can align and / or combine multiple images to generate a high dynamic range (HDR) image of the scene (e.g., an HDR image).

[0016] However, because multiple images are captured at different times, the position of an object in one image of a scene may differ from the position of an object in another image of the scene. These differing object positions can prevent the multiple images from being properly aligned. As a result, combining multiple images can cause image artifacts (e.g., features, distortions, etc., that appear in the generated HDR image of a scene that does not exist in the actual scene) to appear in the HDR image of the scene.

[0017] Some implementations described herein enable a camera to capture HDR images of a scene using a single exposure time. For example, the camera may include an array of pixels formed on the surface of an image sensor. A corresponding filter array may be located above the pixel array, such that each filter is located above a corresponding pixel in the pixel array. Each filter may be communicatively coupled to the image sensor to allow the amount of light attenuated by each filter to be individually programmable. When a user activates the camera, the camera may generate a preview image to be displayed to the user. The camera may analyze the preview image to determine whether each filter should attenuate light, and if so, to determine the amount of light that each filter in the filter array should attenuate. The camera may configure each filter based on determining whether a filter should attenuate light and / or the amount of light that a filter should attenuate. The camera may capture images of the scene based at least in part on configuring each filter in the filter array.

[0018] In this way, HDR images of a scene can be generated from a single image without overexposure and / or underexposure. By generating HDR images of a scene from a single image, the camera can prevent image artifacts that might otherwise appear in images generated from multiple images captured using different exposure times. Furthermore, the camera can save computational resources (e.g., processor resources, memory resources, communication resources, etc.) that would otherwise be used to store, align, and combine multiple images.

[0019] Figure 1 is a diagram of an example environment 100 in which the systems and / or methods described herein may be implemented. As shown in Figure 1, environment 100 may include user equipment 110, wireless communication equipment 120, and network 130. The devices in environment 100 may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.

[0020] User equipment 110 includes one or more devices capable of receiving, generating, storing, processing, and / or providing information associated with a pixelated programmable neutral density filter array, as described elsewhere herein. User equipment 110 may include communication devices and / or computing devices. For example, user equipment 110 may include wireless communication devices, mobile phones, user equipment, laptops, tablets, desktop computers, game consoles, set-top boxes, wearable communication devices (e.g., smartwatches, smart glasses, head-mounted displays, or virtual reality headsets) or similar types of devices.

[0021] Similar to user equipment 110, wireless communication device 120 includes one or more devices capable of receiving, generating, storing, processing, and / or providing information associated with one or more devices described herein. For example, wireless communication device 120 may include a base station, access point, etc. Additionally or alternatively, similar to user equipment 110, wireless communication device 120 may include communication and / or computing devices, such as mobile phones (e.g., smartphones, cordless phones, etc.), laptops, tablets, handheld computers, desktop computers, gaming devices, wearable communication devices (e.g., smartwatches, smart glasses, etc.) or similar types of devices.

[0022] Network 130 includes one or more wired and / or wireless networks. For example, network 130 may include cellular networks (e.g., long-term evolution (LTE) networks, code division multiple access (CDMA) networks, 3G networks, 4G networks, 5G (new radio) networks, another type of next-generation network, etc.), public land mobile network (PLMN), local area network (LAN), wide area network (WAN), metropolitan area network (MAN), telephone network (e.g., public switched telephone network (PSTN)), private network, self-organizing network, intranet, internet, fiber-based network, cloud computing network, etc., and / or combinations of these or other types of networks. In some embodiments, network 130 may include a data network and / or communicate with a data platform (e.g., a network platform, a cloud-based platform, a non-cloud-based platform, etc.) that is capable of receiving, generating, processing, and / or providing information associated with a pixelated programmable neutral density filter array, as described elsewhere herein.

[0023] The number and arrangement of devices and networks shown in Figure 1 are provided as examples. In practice, compared to the devices and / or networks shown in Figure 1, there may be additional devices and / or networks, fewer devices and / or networks, different devices and / or networks, or devices and / or networks with different arrangements compared to those shown in Figure 1. Furthermore, the two or more devices shown in Figure 1 may be implemented within a single device, or the single device shown in Figure 1 may be implemented as multiple distributed devices. Additionally or alternatively, the set of devices in environment 100 (e.g., one or more devices) may perform one or more functions described as being performed by another set of devices in environment 100.

[0024] Figure 2 is a diagram illustrating example components of device 200 according to the present disclosure. Device 200 may correspond to user equipment 110 and / or wireless communication device 120. In some cases, user equipment 110 and / or wireless communication device 120 may include one or more devices 200 and / or one or more components of device 200. As shown in Figure 2, device 200 may include bus 205, processor 210, memory 215, storage component 220, input component 225, output component 230, communication interface 235, and / or camera 240.

[0025] Bus 205 includes components that allow communication between components of device 200. Processor 210 is implemented in hardware, firmware, or a combination of hardware and software. Processor 210 is a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), or other types of processing components. In some cases, processor 210 includes one or more processors that can be programmed to perform functions. Memory 215 includes random access memory (RAM), read-only memory (ROM), and / or another type of dynamic or static storage device (e.g., flash memory, magnetic memory, and / or optical memory) that stores information and / or instructions for use by processor 210.

[0026] Storage component 220 stores information and / or software related to the operation and use of device 200. For example, storage component 220 may include hard disks (e.g., magnetic disks, optical disks, magneto-optical disks, and / or solid-state disks), compact discs (CDs), digital versatile discs (DVDs), floppy disks, cassette tapes, magnetic tapes, and / or other types of non-transitory computer-readable media, and corresponding drives.

[0027] Input component 225 includes components that allow device 200 to receive information, such as via user input (e.g., touchscreen display, keyboard, keypad, mouse, button, switch, and / or microphone). Additionally or alternatively, input component 225 may include components for determining the location or orientation of device 200 (e.g., a global positioning system (GPS) component or a global navigation satellite system (GNSS) component) and / or for sensing information (e.g., sensors, actuators, accelerometers, speed sensors, motion sensors, infrared sensors, temperature sensors, pressure sensors, or other types of position or environmental sensors such as accelerometers, gyroscopes (e.g., micro-electro-mechanical system (MEMS) gyroscopes, or similar devices).

[0028] In some embodiments, the sensor may include one or more passive components of one or more integrated circuits (e.g., on a packaged silicon die) and / or one or more flexible circuits to enable communication with one or more components of device 200. In some embodiments, the sensor may include an optical sensor having a field of view, which can determine one or more characteristics of the environment of device 200 in that field of view. Additionally or alternatively, the sensor may include a light sensor (e.g., a complementary metal oxide semiconductor (CMOS) sensor, a charge coupled device (CCD) sensor, etc.), a magnetometer (e.g., a Hall effect sensor, anisotropic magnetoresistive (AMR) sensor, a giant magneto-resistive sensor (GMR) sensor, etc.), etc.

[0029] Output component 230 includes components that provide output information from device 200 (e.g., a display, speaker, haptic feedback component, and / or audio or visual indicator). Communication interface 235 includes transceiver-like components (e.g., transceiver and / or separate receiver and transmitter) that enable device 200 to communicate with other devices, such as via wired connection, wireless connection, or a combination of wired and wireless connection. Communication interface 235 may allow device 200 to receive information from another device and / or provide information to another device. For example, communication interface 235 may include an Ethernet interface, optical interface, coaxial interface, infrared interface, radio frequency interface, universal serial bus (USB) interface, wireless LAN interface (e.g., Wi-Fi interface), and / or cellular network interface.

[0030] Camera 240 includes one or more devices capable of capturing images (such as one or more still images and / or image sequences forming a video). For example, camera 240 may include a still camera (e.g., a digital camera), a video camera (e.g., a digital video camera), etc. In some cases, camera 240 may be movable and / or may include a movable lens, and camera 240 and / or lens may move automatically (e.g., orient, zoom, and / or focus) based on internal functions (e.g., for identification, tracking, etc.) and / or instructions from another device (e.g., processor 210).

[0031] In some configurations, as shown in Figure 2, camera 240 includes a pixel array 245 and a filter array 250. The pixel array 245 may include a microscopic sensor (e.g., a photodiode, photodetector, etc.) disposed in an image sensor, such as a charge-coupled device (CCD), complementary metal-oxide-semiconductor (CMOS) sensor, etc. The pixel array 245 may be configured to receive light propagating through the aperture of camera 240 and convert the light into an electric current. The image sensor may determine one or more characteristics (e.g., amount and / or wavelength (e.g., color)) of the light received at a pixel, at least in part, based on the electric current generated by the pixel. The image sensor may generate digital pixels for the pixel, at least in part, based on one or more characteristics of the light. Camera 240 may generate an image of the scene, at least in part, based on the digital pixels generated for each pixel of pixel array 245.

[0032] Filter array 250 may include an array of filters configured to selectively attenuate light entering through the aperture of camera 240 and / or received by pixel array 245. For example, filter array 250 may include an array of ND filters and / or filters configured to attenuate another type of light. Filter array 250 may be connected to the image sensor of camera 240 so that the amount of light attenuated by each filter can be individually programmed (e.g., by processor 210) to attenuate light received by pixels, as described herein.

[0033] Device 200 can execute one or more processes described herein. Device 200 can execute these processes based on software instructions stored in a non-transitory computer-readable medium such as memory 215 and / or storage component 220, executed by processor 210. Computer-readable medium is defined herein as a non-transitory memory device. Memory devices include memory space within a single physical storage device or memory space distributed across multiple physical storage devices.

[0034] Software instructions may be read into memory 215 and / or storage component 220 via communication interface 235 from another computer-readable medium or from another device. When executed, the software instructions stored in memory 215 and / or storage component 220 may cause processor 210 to perform one or more processes described herein. Additionally or alternatively, hard-wired circuitry may be used in place of or in combination with software instructions to perform one or more processes described herein. Therefore, the configurations described herein are not limited to any particular combination of hardware circuitry and software.

[0035] In some embodiments, device 200 includes components for performing one or more processes described herein and / or components for performing one or more operations of the processes described herein. For example, device 200 may include components for receiving a first image from a pixel array of a camera; components for configuring settings of a filter at least in part based on the first image, wherein the filter is included in a filter array arranged in association with the pixel array within the camera; and components for causing the pixel array to capture a second image. In some embodiments, such components may include one or more components of device 200 described in conjunction with FIG. 2, such as bus 205, processor 210, memory 215, storage component 220, input component 225, output component 230, communication interface 235, and / or camera 240.

[0036] The number and arrangement of components shown in Figure 2 are provided as an example. In practice, device 200 may include additional components, fewer components, different components, or components with different arrangements compared to those shown in Figure 2. Additionally or alternatively, the set of components of device 200 (e.g., one or more components) may perform one or more functions described as being performed by another set of components of device 200.

[0037] Figures 3A and 3B are diagrams illustrating an example 300 associated with a pixelated programmable filter array according to this disclosure. As shown in Figures 3A and 3B, user equipment 110 includes a camera 240 configured to capture images of a scene based on signals sent by an image processor, as described herein. As shown in Figure 3A, camera 240 includes a pixel array 245, a filter array 250, and a plurality of microlenses.

[0038] Pixel array 245 may include a plurality of pixels arranged in a grid and / or formed in an image sensor (e.g., CCD, CMOS sensor, etc.) of camera 240. Filter array 250 may include a plurality of filters arranged in a grid such that each filter of filter array 250 is in front of a corresponding pixel of pixel array 245. In some cases, filter array 250 includes a plurality of ND filters. Similarly, a plurality of microlenses may be arranged in a grid such that each microlens is in front of a corresponding filter and / or pixel and / or positioned to focus a portion of the light propagating through the aperture of camera 240 through the filter and onto the pixels of pixel array 245.

[0039] As indicated by component symbol 310, user device 110 launches a camera application. For example, user device 110 may launch the camera application based on input received from a user of user device 110. The camera application may be associated with a user interface that allows users to control camera 240 to capture images, view preview images of a scene, edit or manipulate captured images, etc.

[0040] As indicated by component symbol 320, the image processor receives a preview image. In some cases, the image processor receives the preview image based on launching an application. The preview image may depict a scene or physical environment to be captured by camera 240 as an image. For example, the image processor may, at least in part, open the aperture of camera 240 based on launching a camera application. Light can propagate through the aperture to multiple microlenses. The multiple microlenses can focus the light through filter array 250 onto the pixels of pixel array 245.

[0041] In some cases, the pixels of pixel array 245 receive unfiltered light. For example, the image processor may, at least in part, initiate an application to set the filter settings of filter array 250 to a preset setting. Based at least in part on this preset setting, the filters of filter array 250 may not attenuate light propagating through the filters. In some cases, the preview image may include a low dynamic range image (e.g., an image with a dynamic range of less than 90 dB).

[0042] The pixels of pixel array 245 can sense one or more characteristics (e.g., intensity, quantity, amplitude, frequency, wavelength, color, etc.) of light (e.g., light waves) received by the pixels and can provide the image processor with corresponding information for recognizing one or more characteristics. The image processor can generate a preview image based on the information received from the pixels of pixel array 245.

[0043] As an example, the pixels of pixel array 245 may generate electrical signals based at least in part on receiving a portion of light propagating through an aperture. The electrical signals may be converted into digital pixels (e.g., by an image sensor) and provided to an image processor. The image processor may determine one or more characteristics of the light received by the pixels based on the digital pixels. The image processor may identify pixels of the display of user equipment 110 associated with the pixels of pixel array 245. The image processor may illuminate the identified pixels based on one or more characteristics of the light received by the pixels of pixel array 245.

[0044] In some cases, the image processor may receive a preview image and / or display a preview image based at least in part on the mode of operation associated with the camera 240. For example, a user may provide input via a user interface associated with a camera application (e.g., the user may select input elements displayed through the user interface). The image processor may receive the input and may cause the camera 240 to switch to preview mode at least in part based on that input. The image processor may receive a preview image based at least in part on the camera 240 switching to and / or being in preview mode.

[0045] In some cases, the preview image comprises multiple images (e.g., video). For example, the image processor may receive a stream of data (e.g., digital pixels) from the image sensor and / or pixel array 245 based on the camera switching to preview mode. The image processor may use the pixels of the user device 110's display to be illuminated based on the data stream so that the preview image is displayed to the user.

[0046] As indicated by component symbol 330, the image processor determines the attenuation setting of the filter. The attenuation setting of the filter may correspond to the light attenuation level associated with the filter (e.g., the amount of light to be attenuated by the filter). The image processor may determine the attenuation setting of the filter based on pixel characteristics associated with pixel array 245 and / or pixels adjacent to (e.g., behind) the filter.

[0047] In some cases, pixel characteristics can be indicated in the preview image at least in part based on the sensing characteristics of the pixels. For example, pixel characteristics may include the dynamic range of the preview image, the intensity of light received by the pixel, the amount of light received by the pixel, the amplitude of the light wave received by the pixel, the frequency of the light wave received by the pixel, the wavelength of the light wave received by the pixel, the color of the light received by the pixel, etc. In some cases, the attenuation setting determined for the first filter of the filter array 250 is different from the attenuation setting determined for the second filter of the filter array 250.

[0048] Alternatively and / or additionally, the image processor may determine the attenuation settings of the filters based on user input. For example, the user may input information indicating (e.g., via a user interface associated with a camera application) such as: a portion of the image to be attenuated (e.g., background, foreground, specific object, etc.), the color to be attenuated, a portion of the image not to be attenuated, the amount of attenuation to be applied to a portion of the image, etc. The image processor may determine the attenuation settings of one or more filters of the filter array 250 based on user input.

[0049] As indicated by component symbol 340, the image processor configures each filter according to a corresponding attenuation setting determined for the filter. In some cases, the filter array 250 is formed of a liquid crystal layer disposed between the pixel array 245 and the aperture of the camera 240. The image processor can configure one or more individual filters of the filter array 250, at least in part, based on the position of one or more liquid crystals controlling the liquid crystal layers that form one or more individual filters.

[0050] As shown in Figure 3B, and via component symbol 350, camera 240 captures a filtered image. In some cases, camera 240 captures the filtered image based on user input. For example, the user can select input elements displayed via a user interface associated with the camera application, physical buttons included on the user device 110, etc., to cause camera 240 to capture an image of the physical environment. The filters of filter array 250 can attenuate light propagating through the camera's aperture, at least in part, based on corresponding attenuation settings configured for each filter.

[0051] Camera 240 can generate a filtered image based at least in part on the filter attenuation of light propagating through the aperture of camera 240 using filter array 250. The filtered image may include an HDR image captured using a single exposure time (e.g., an HDR image captured over a period of time during a single exposure). As indicated by element symbol 360, the image processor displays (e.g., via a display associated with user device 110 and / or camera 240) the image and / or stores the image in memory associated with user device 110 and / or camera 240.

[0052] In this way, HDR images can be generated from a single image captured using a single exposure time, without overexposure and / or underexposure. By generating HDR images from a single image, camera 240 can prevent image artifacts that might otherwise occur in images generated from multiple images captured using a combination of different exposure times. Furthermore, camera 240 can save computational resources that would otherwise be used to store, align, and / or combine multiple images to form an HDR image.

[0053] As described above, Figures 3A-3B are provided as examples. Other examples may differ from those described with respect to Figures 3A-3B.

[0054] Figure 4 is a diagram illustrating an example flow 400 performed by a device, for example, according to this disclosure. Example flow 400 is an example of a device (e.g., user equipment 110 and / or wireless communication device 120) performing operations associated with a pixelated programmable neutral density filter array.

[0055] As shown in Figure 4, in some cases, process 400 may include receiving a first image depicting the physical environment from the pixel array of a camera (block 410). For example, a device (e.g., using processor 210, memory 215, storage component 220, input component 225, output component 230, communication interface 235, and / or camera 240) may receive the first image depicting the physical environment from the pixel array of a camera, as described above.

[0056] As further shown in Figure 4, in some embodiments, process 400 may include configuring filter settings at least partially based on the first image, wherein the filter is included within a filter array arranged in the camera in association with the pixel array (block 420). For example, as described above, a device (e.g., using processor 210, memory 215, storage component 220, input component 225, output component 230, communication interface 235, and / or camera 240) may configure filter settings at least partially based on the first image, wherein the filter is included within a filter array arranged in the camera in association with the pixel array. In some embodiments, the filter is included within a filter array arranged in the camera in association with the pixel array.

[0057] As further shown in Figure 4, in some cases, process 400 may include causing the pixel array to capture a second image of the physical environment according to the settings of the filter (block 430). For example, a device (e.g., using processor 210, memory 215, storage component 220, input component 225, output component 230, communication interface 235 and / or camera 240) may cause the pixel array to capture a second image of the physical environment according to the settings of the filter, as described above.

[0058] Process 400 may include additional patterns, such as any single pattern or any combination of patterns as described below and / or related to one or more other processes described elsewhere herein.

[0059] The first sample, the first image, is received at least in part based on the camera being in preview mode.

[0060] In a second state sample, either alone or in combination with a first state sample, the first image includes a low dynamic range image and the second image includes a high dynamic range image.

[0061] In a third state sample, either alone or in combination with one or more of the first and second state samples, a light attenuation level is configured corresponding to at least partially based on the characteristics of the light wave, wherein the characteristics are indicated in the first image at least partially based on the pixels of the pixel array that senses the characteristics.

[0062] In a fourth state sample, either alone or in combination with one or more of the first to third state samples, the pixel is located at a pixel position within the pixel array, which is related to the filter position of the filter within the filter array.

[0063] In a fifth state sample, either alone or in combination with one or more of the first to fourth state samples, the characteristic includes at least one of the frequency or amplitude of the light wave.

[0064] In a sixth state sample, either alone or in combination with one or more of the first to fifth state samples, the filter array comprises an array of neutral density filters, and the filters are at least one of the neutral density filters.

[0065] In a seventh state sample, either alone or in combination with one or more of the first to sixth state samples, the data of the second image depicts a portion of the physical environment according to the filter settings, wherein the pixel data is associated with pixels arranged in the pixel array at pixel positions in the pixel array, the pixel positions corresponding to the filter positions of the filters within the filter array.

[0066] In an eighth state sample, either alone or in combination with one or more of the first to seventh state samples, process 400 includes configuring another setting of another filter of the filter array based at least in part on the first image, wherein the pixel array captures a second image according to the settings of the filter and the other filter.

[0067] In the ninth state sample, either alone or in combination with one or more of the first to eighth state samples, the filter setting is a different optical attenuation level than another setting of another filter.

[0068] In a tenth state sample, either alone or in combination with one or more of the first to ninth states, the filter array is formed by a liquid crystal layer disposed between the pixel array and the camera aperture, wherein the filter is configured based on controlling the position of one or more liquid crystals of the liquid crystal layer forming the filter.

[0069] In the eleventh state sample, either alone or in combination with one or more of the first to tenth state samples, the second image comprises a high dynamic range image captured during the time period of a single exposure.

[0070] Although Figure 4 shows example blocks of process 400, in some cases, process 400 may include additional blocks, fewer blocks, different blocks, or blocks with different arrangements compared to those depicted in Figure 4. Additionally or alternatively, two or more blocks of process 400 may be executed in parallel.

[0071] The following provides an overview of some of the features disclosed herein:

[0072] Example 1: A method includes: receiving by a device and from a pixel array of a camera a first image depicting an entity environment; configuring by the device and at least in part based on the first image a filter setting, wherein the filter is included in a filter array arranged in the camera in association with the pixel array; and causing the pixel array to capture a second image of the entity environment according to the filter setting.

[0073] State 2: According to the method of State 1, wherein the first image is received at least in part based on the camera being in preview mode.

[0074] State 3: According to the method of either State 1 or 2, wherein the first image includes a low dynamic range image and the second image includes a high dynamic range image.

[0075] State 4: According to any one of states 1 to 3, a light attenuation level is set corresponding to a configuration at least partially based on the characteristics of the light wave, wherein the characteristics are indicated in the first image at least partially based on the pixels of the pixel array that senses the characteristics.

[0076] State 5: According to the method of State 4, the pixel is located in the pixel position within the pixel array, and the pixel position is related to the filter position of the filter in the filter array.

[0077] State 6: According to the method of State 4, wherein the characteristic includes at least one of the frequency of the light wave or the amplitude of the light wave.

[0078] State 7: The method according to any one of states 1 to 6, wherein the filter array comprises an array of neutral density filters, and the filters are at least one of the neutral density filters.

[0079] State 8: According to any one of the states 1 to 7, the pixel data of the second image depicts a part of the entity environment according to the filter settings, wherein the pixel data is associated with pixels arranged in the pixel array at pixel positions corresponding to filter positions of filters within the filter array.

[0080] Version 9: The method according to any one of versions 1 to 8 further includes configuring another setting of another filter of the filter array at least in part based on the first image, wherein the pixel array captures the second image according to the setting of the filter and the setting of the other filter.

[0081] State 10: According to the method of State 9, wherein the setting of the filter is a light attenuation level different from that of another setting of another filter.

[0082] Version 11: According to any one of versions 1 to 10, the filter array is formed by a liquid crystal layer disposed between the pixel array and the aperture of the camera, and the filter is configured based on controlling the position of one or more liquid crystals of the liquid crystal layer forming the filter.

[0083] Sample 12: The method according to any one of Samples 1 to 11, wherein the second image comprises a high dynamic range image captured during the time period of a single exposure.

[0084] State 13: An apparatus for wireless communication at a device, comprising a processor; memory coupled to the processor; and instructions stored in the memory and executable by the processor to cause the apparatus to perform a method of one or more of states 1 to 12.

[0085] State 14: A device for wireless communication, including a memory and one or more processors coupled to the memory, the memory and the one or more processors being configured to perform a method of one or more of states 1 to 12.

[0086] Format 15: An apparatus for wireless communication, comprising at least one component for performing a method of one or more formats 1 to 12.

[0087] Format 16: A non-transitory computer-readable medium storing code for wireless communication, the code including instructions executable by a processor to perform methods of one or more formats 1 to 12.

[0088] Format 17: A non-transitory computer-readable medium storing an instruction set for wireless communication, the instruction set including one or more instructions, when executed by one or more processors of the device, causing the device to perform one or more formats of formats 1 to 12.

[0089] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the various forms to the precise forms disclosed. Modifications and variations can be made based on the foregoing disclosure, or modifications and variations can be derived from the practice of these forms.

[0090] As used herein, the term "component" is intended to be interpreted broadly as hardware, firmware, and / or a combination of hardware and software. As used herein, a processor is implemented in combination of hardware, firmware, and / or hardware and software. Clearly, the systems and / or methods described herein can be implemented in various forms of hardware, firmware, and / or hardware and software combinations. The actual dedicated control hardware or software code used to implement these systems and / or methods is not limited to these forms. Therefore, this document describes the operation and behavior of systems and / or methods without reference to any specific software code—it should be understood that software and hardware can be designed to be at least partially based on the description herein.

[0091] As used in this article, depending on the context, a threshold value can refer to a value that is greater than, greater than or equal to, less than, less than or equal to, equal to, or not equal to the threshold value.

[0092] Although specific combinations of features are described in the request and / or disclosed in the specification, these combinations are not intended to limit the disclosure of individual states. In fact, many of these features can be combined in ways not specifically described in the request and / or disclosed in the specification. Although each listed subsidiary request may directly depend on one request, the disclosure of individual states includes combinations of each subsidiary request with every other request in the request set. As used herein, the phrase “at least one” in the list of items means any combination of these items, including single members. For example, “at least one of a, b, or c” is intended to cover a, b, c, ab, ac, bc, and abc, as well as any combination having multiple identical elements (e.g., aa, aaa, aab, aac, abb, acc, bb, bbb, bbc, cc, and ccc, or any other order of a, b, and c).

[0093] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly described as such. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and may be used interchangeably with “one or more.” Furthermore, as used herein, the article “the” is intended to include one or more items in relation to the article “the” and may be used interchangeably with “one or more.” Furthermore, as used herein, the terms “set” and “group” are intended to include one or more items (e.g., related items, unrelated items, or a combination of related and unrelated items) and may be used interchangeably with “one or more.” If only one is intended to be used, use the phrase “only one” or similar language. Furthermore, as used herein, the terms “has,” “have,” “having,” etc., are intended to be open-ended terms. Additionally, unless explicitly stated otherwise, the phrase “based on” is intended to mean “at least partially based on.” Furthermore, as used herein, the term “or” is intended to be included when used in a series of forms and may be used interchangeably with “and / or” unless explicitly stated otherwise (e.g., if with “any” or “only one”).

[0094] 100: Environment 110: User Equipment 120: Wireless communication equipment 130: Internet 200: Equipment 205: Busbar 210: Processor 215: Memory 220: Storage component 225: Input Component 230: Output Component 235: Communication Interface 240: Camera 245: pixel array 250: Filter Array 300: Example 310: Launch the camera application 320: Receive preview image 330: Determine the filter attenuation setting 340: Configure each filter according to the corresponding attenuation setting determined for the filter. 350: Capture filtered images 360: Display / Save Images 400: Process 410: Square 420: Square 430: Square

Claims

1. A method for capturing an image, comprising: The device receives a first image from a camera's pixel array, wherein the first image is received and provided for display based at least in part on the camera being in preview mode; the device configures a first setting of a first filter, comprising a plurality of filters included in a filter array, based at least in part on the first image; the device receives user input associated with a portion of the first image, the portion comprising less than the entire first image, the user input indicating an amount of attenuation to be applied to the portion of the first image; the device configures a second setting of a second filter, comprising the plurality of filters included in the filter array, associated with the portion of the first image, the first setting differing from the second setting, and the filter array being arranged within the camera in association with the pixel array; and the device causes the pixel array to capture a second image.

2. The method as described in request item 1, wherein, The first image includes a low dynamic range image and the second image includes a high dynamic range image.

3. The method as described in request item 1, wherein, The first setting corresponds to an optical attenuation level configured at least in part based on the characteristics of light waves, wherein the characteristics are indicated in the first image at least in part based on the pixels of the pixel array that sense the characteristics.

4. The method as described in request item 3, wherein, The pixel is located in the pixel position within the pixel array, and the pixel position is related to the filter position of the first filter within the filter array.

5. The method as described in request item 3, wherein, The characteristic includes at least one of the following: the frequency of the light wave; or the amplitude of the light wave.

6. The method as described in request item 1, wherein, The filter array includes a neutral density filter array, and the first filter is at least one of the neutral density filters.

7. The method as described in request item 1, wherein, The pixel data of the second image depicts a portion of the physical environment according to the first setting of the first filter, wherein the pixel data is associated with pixels arranged in the pixel position of the pixel array, the pixel position corresponding to the filter position of the first filter in the filter array.

8. The method as described in claim 1, further comprising: A third setting of a third filter included in the plurality of filters in the filter array is configured at least in part based on the first image, wherein the pixel array captures the second image according to the first setting of the first filter, the second setting of the second filter, and the third setting of the third filter.

9. The method as described in claim 8, wherein, The first setting of the first filter is a light attenuation level that is different from the light attenuation level of the third setting of the third filter.

10. The method as described in claim 1, wherein, The filter array is formed by a liquid crystal layer disposed between the pixel array and the aperture of the camera, wherein the first filter is configured based on controlling the position of one or more liquid crystals in the liquid crystal layer forming the first filter.

11. The method as described in claim 1, wherein, The second image includes a high dynamic range image captured during the time period of a single exposure.

12. An apparatus for capturing an image, comprising: One or more memory units; A device, coupled to one or more processors and said one or more memories, is configured to: receive a first image from a pixel array of a camera, wherein said first image is received at least in part based on the camera being in preview mode and provided for display; configure a first setting of a first filter of a plurality of filters included in a filter array, at least in part based on said first image; receive user input associated with a portion of said first image, said portion of said first image comprising less than the entire first image, said user input indicating an amount of attenuation to be applied to said portion of said first image; configure a second setting of a second filter of the plurality of filters included in the filter array, the second filter being associated with said portion of said first image, said first setting being different from said second setting, and said filter array being arranged within the camera in association with said pixel array, at least in part based on said user input; and cause said pixel array to capture a second image.

13. The apparatus as claimed in claim 12, wherein, The first image includes a low dynamic range image and the second image includes a high dynamic range image.

14. The apparatus as claimed in claim 12, wherein, The first setting corresponds to an optical attenuation level configured at least in part based on the characteristics of light waves, wherein the characteristics are indicated in the first image at least in part based on the pixels of the pixel array that sense the characteristics.

15. The apparatus as claimed in claim 14, wherein, The characteristic includes at least one of the following: the frequency of the light wave; or the amplitude of the light wave.

16. The apparatus as claimed in claim 12, wherein, The one or more processors are further configured to: configure a third setting of a third filter of the plurality of filters included in the filter array based at least in part on the first image, wherein the pixel array captures the second image according to the first setting of the first filter, the second setting of the second filter, and the third setting of the third filter.

17. The apparatus as claimed in claim 12, wherein, The filter array is formed by a liquid crystal layer disposed between the pixel array and the aperture of the camera, wherein the first filter is configured based on controlling the position of one or more liquid crystals in the liquid crystal layer forming the first filter.

18. The apparatus as claimed in claim 12, wherein, The second image includes a high dynamic range image captured during the time period of a single exposure.

19. A non-transitory computer-readable medium storing an instruction set, the instruction set comprising: One or more instructions, when executed by one or more processors of the device, cause the device to: receive a first image from a camera's pixel array, wherein the first image is received at least in part based on the camera being in preview mode and provided for display; configure a first setting of a first filter of a plurality of filters included in a filter array, at least in part based on the first image; receive user input associated with a portion of the first image, the portion of the first image comprising less than the entire first image, the user input indicating an amount of attenuation to be applied to the portion of the first image; configure a second setting of a second filter of the plurality of filters included in the filter array, the second filter being associated with the portion of the first image, the first setting being different from the second setting, and the filter array being arranged within the camera in association with the pixel array; and cause the pixel array to capture a second image.

20. The non-transitory computer-readable medium as described in claim 19, wherein, The first image includes a low dynamic range image and the second image includes a high dynamic range image.

21. The non-transitory computer-readable medium as described in claim 19, wherein, The first setting corresponds to an optical attenuation level configured at least in part based on the characteristics of light waves, wherein the characteristics are indicated in the first image at least in part based on the pixels of the pixel array that sense the characteristics.

22. The non-transitory computer-readable medium as described in claim 19, wherein, The one or more instructions further cause the device to: configure a third setting of a third filter of the plurality of filters included in the filter array, at least in part, based on the first image, wherein the pixel array is caused to capture the second image according to the first setting of the first filter, the second setting of the second filter, and the third setting of the third filter.

23. The non-transitory computer-readable medium as described in claim 19, wherein, The filter array is formed by a liquid crystal layer disposed between the pixel array and the aperture of the camera, wherein the first filter is configured based on controlling the position of one or more liquid crystals in the liquid crystal layer forming the first filter.

24. The non-transitory computer-readable medium as described in claim 19, wherein, The second image includes a high dynamic range image captured during the time period of a single exposure.

25. An apparatus for capturing an image, comprising: Components for receiving a first image from a camera's pixel array, wherein the first image is received and provided for display based at least in part on the camera being in preview mode; components for configuring a first setting of a first filter of a plurality of filters included in a filter array based at least in part on the first image; components for receiving user input associated with a portion of the first image, the portion of the first image comprising less than the entire first image, the user input indicating an amount of attenuation to be applied to the portion of the first image; components for configuring a second setting of a second filter of the plurality of filters included in the filter array based at least in part on the user input, the second filter being associated with the portion of the first image, the first setting being different from the second setting, and the filter array being arranged within the camera in association with the pixel array; and components for causing the pixel array to capture a second image.

26. The apparatus as claimed in claim 25, wherein, The first image includes a low dynamic range image and the second image includes a high dynamic range image.

27. The apparatus as claimed in claim 25, wherein, The first setting corresponds to an optical attenuation level configured at least in part based on the characteristics of light waves, wherein the characteristics are indicated in the first image at least in part based on the pixels of the pixel array that sense the characteristics.

28. The apparatus of claim 25, further comprising: Components for configuring a third setting of a third filter of the plurality of filters included in the filter array based at least in part on the first image, wherein the pixel array captures the second image according to the first setting of the first filter, the second setting of the second filter, and the third setting of the third filter.

29. The apparatus as claimed in claim 25, wherein, The filter array is formed by a liquid crystal layer disposed between the pixel array and the aperture of the camera, wherein the first filter is configured based on controlling the position of one or more liquid crystals in the liquid crystal layer forming the first filter.

30. The apparatus as claimed in claim 25, wherein, The second image includes a high dynamic range image captured during the time period of a single exposure.

Citation Information

Patent Citations

  • Adjustable neutral density filter system for dynamic range compression from scene to imaging sensor

    US20070242141A1

  • System and method for processing image data using an image signal processor having back-end processing logic

    US20120081385A1

  • Accurate photo detector measurements for lidar

    US20180259645A1

  • High dynamic range optical sensing device employing broadband optical filters integrated with light intensity detectors

    US20200344430A1