Ambient light sensing apparatus and method and terminal device

By directly measuring the optical information of ambient light using quantum dot filter arrays and processing components, the problem of measuring optical information during photography in terminal devices is solved, achieving efficient and accurate image correction.

CN116366744BActive Publication Date: 2026-02-03CORE VISION (BEIJING) TECHNOLOGY CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202111600272.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-24
Publication Date
2026-02-03
Estimated Expiration
2041-12-24

AI Technical Summary

Technical Problem

Terminal devices have difficulty directly measuring the optical information of ambient light when taking pictures, which leads to increased image correction errors and increased computing resource consumption.

Method used

Using a quantum dot filter array and processing components, optical information, including light intensity, color temperature, color, and white balance, is obtained by directly measuring the quantum dot pixel information of ambient light through the quantum dot filter array, and then corrected by the processing components.

Benefits of technology

It improves the accuracy of optical information, reduces the consumption of computing resources, and enhances the efficiency and accuracy of image correction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116366744B_ABST
    Figure CN116366744B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an ambient light sensing device and method and a terminal device. The device comprises: a quantum dot filter array comprising a plurality of quantum dot filters, each quantum dot filter being configured to sense ambient light of a preset wavelength and obtain quantum dot pixel information corresponding to the preset wavelength; and a processing component configured to determine quantum dot spectrum information of the ambient light based on the quantum dot pixel information, and determine optical information of the ambient light based on the quantum dot spectrum information. The ambient light sensing device according to the embodiments of the present disclosure can measure quantum dot pixel information of ambient light through a quantum dot filter array, and then obtain optical information of the ambient light. The quantum dot filter array has a small volume and can be arranged at a position directly facing a light source, such as an upper edge of a terminal, to directly measure ambient light, obtain optical information with high accuracy, and reduce the operation process of indirectly obtaining optical information and the occupation of operation resources.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to an ambient light sensing device, method, and terminal equipment. Background Technology

[0002] When taking photos, mobile phones and other terminal devices typically need to measure the optical information of ambient light to perform image corrections, such as color correction and white balance correction. However, the optical sensors in these devices are usually large and difficult to position directly facing the light source. Therefore, it is difficult to directly measure the optical information of the light source, and optical information is usually obtained indirectly through calculations. The optical information obtained in this way often contains errors, which can lead to distortion and color difference in the corrected image. Furthermore, obtaining optical information through calculations increases the consumption of computing resources. Summary of the Invention

[0003] This disclosure presents an ambient light sensing device, method, and terminal equipment.

[0004] According to one aspect of this disclosure, an ambient light sensing device is provided, comprising: a quantum dot filter array and a processing component, wherein the quantum dot filter array includes a plurality of quantum dot filters, each of which is used to sense ambient light of a preset wavelength to obtain quantum dot pixel information corresponding to the preset wavelength; the processing component is used to: determine quantum dot spectral information of the ambient light based on the quantum dot pixel information corresponding to the plurality of quantum dot filters respectively; and determine optical information of the ambient light based on the quantum dot spectral information, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information.

[0005] In one possible implementation, determining the quantum dot spectral information of the ambient light based on the quantum dot pixel information corresponding to the plurality of quantum dot filters includes: combining the quantum dot pixel information to obtain the quantum dot spectral information of the ambient light.

[0006] In one possible implementation, determining the optical information of the ambient light based on the quantum dot spectral information includes: determining the color information of incident light at multiple locations in the ambient light based on the quantum dot spectral information; and averaging the color information of the incident light at the multiple locations to obtain the color information of the ambient light.

[0007] In one possible implementation, the device further includes an ambient light lens for acquiring an image of ambient light.

[0008] In one possible implementation, the processing component is further configured to: determine the position of the light source based on the image of the ambient light; and correct the optical information based on the position of the light source to obtain corrected optical information.

[0009] In one possible implementation, the quantum dot filter array includes an infrared filter, and the processing component is further configured to: determine infrared optical information based on the quantum dot pixel information obtained from the infrared filter; and determine physiological indicators based on the infrared optical information.

[0010] According to one aspect of this disclosure, a terminal device is provided, comprising: an ambient light sensing device disposed at the upper edge of the terminal device for acquiring optical information of ambient light above the terminal device; and a processor for performing correction processing on an image captured by the terminal device based on the optical information to obtain a corrected image.

[0011] In one possible implementation, the optical information includes white balance information, wherein correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: performing white balance correction processing on the image based on the white balance information to obtain the corrected image.

[0012] In one possible implementation, the optical information includes color information, wherein correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: performing color correction processing on the image based on the color information to obtain the corrected image.

[0013] According to one aspect of this disclosure, an ambient light sensing method is provided, the method comprising: determining quantum dot spectral information of ambient light based on quantum dot pixel information corresponding to a plurality of quantum dot filters respectively; and determining optical information of the ambient light based on the quantum dot spectral information, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information.

[0014] In one possible implementation, determining the quantum dot spectral information of ambient light based on quantum dot pixel information corresponding to multiple quantum dot filters includes: combining the quantum dot pixel information to obtain the quantum dot spectral information of the ambient light.

[0015] In one possible implementation, determining the optical information of the ambient light based on the quantum dot spectral information includes: determining the color information of incident light at multiple locations in the ambient light based on the quantum dot spectral information; and averaging the color information of the incident light at the multiple locations to obtain the color information of the ambient light.

[0016] In one possible implementation, the method further includes: acquiring an ambient light image through an ambient light lens; determining the position of a light source based on the ambient light image; and correcting the optical information based on the position of the light source to obtain corrected optical information.

[0017] In one possible implementation, the method further includes: determining infrared optical information based on quantum dot pixel information obtained from an infrared filter; and determining physiological indicators based on the infrared optical information.

[0018] According to one aspect of this disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the above-described ambient light sensing method.

[0019] According to one aspect of this disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the above-described ambient light sensing method.

[0020] According to the ambient light sensing device of the present disclosure, the quantum dot pixel information of ambient light can be measured by a quantum dot filter array, thereby obtaining the optical information of the ambient light. The quantum dot filter array is small in size and can be placed at the upper edge of the terminal, or at a position directly facing the light source, allowing direct measurement of ambient light with high accuracy. Furthermore, the quantum dot filter array can measure spectral line information of multiple predetermined wavelength bands, increasing the channels and luminous flux of incident light and thus increasing the amount of optical information of the incident light. Further, this ambient light sensing device reduces the computational process for indirectly obtaining optical information, reduces the consumption of computational resources, and improves processing efficiency.

[0021] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0022] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.

[0024] Figure 1 A block diagram of an ambient light sensing device according to an embodiment of the present disclosure is shown;

[0025] Figure 2 A schematic diagram of a quantum dot filter array according to an embodiment of the present disclosure is shown;

[0026] Figure 3 A schematic diagram of an ambient light sensing device according to an embodiment of the present disclosure is shown;

[0027] Figure 4 A flowchart illustrating an ambient light sensing method according to an embodiment of the present disclosure is shown;

[0028] Figure 5 A block diagram of an electronic device according to an embodiment of the present disclosure is shown;

[0029] Figure 6 Another block diagram of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0030] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0031] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0032] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0033] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0034] Figure 1 A block diagram of an ambient light sensing device according to an embodiment of the present disclosure is shown, such as Figure 1 As shown, the device includes: a quantum dot filter array 11 and a processing component 12.

[0035] The quantum dot filter array 11 includes multiple quantum dot filters, each of which is used to sense ambient light of a preset wavelength to obtain quantum dot pixel information corresponding to the preset wavelength.

[0036] The processing component 12 is used for:

[0037] The quantum dot spectral information of the ambient light is determined based on the quantum dot pixel information corresponding to the plurality of quantum dot filters respectively.

[0038] Based on the quantum dot spectral information, the optical information of the ambient light is determined, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information.

[0039] According to the ambient light sensing device of the present disclosure, the quantum dot pixel information of ambient light can be measured by a quantum dot filter array, thereby obtaining the optical information of the ambient light. The quantum dot filter array is small in size and can be set at the upper edge of the terminal or at a position directly facing the light source. It can directly measure the ambient light, obtain high accuracy of optical information, and reduce the computational process of indirectly obtaining optical information, thereby reducing the occupation of computing resources and improving processing efficiency.

[0040] In one possible implementation, the quantum dot filter array may include multiple quantum dot filters, each capable of sensing ambient light at different wavelengths. The ambient light at a predetermined wavelength sensed by each quantum dot filter forms spectral information for that wavelength. Multiple quantum dot filters can obtain spectral information for multiple wavelengths at any location in the environment, i.e., the spectral information of the incident light at that location. This spectral information at each location can be represented as quantum dot pixel information in an image. Multiple quantum dot filters increase the number of incident light channels, and the multiple quantum dot filters corresponding to multiple wavelengths of spectral information can constitute more finely segmented spectral information, i.e., the spectral information of ambient light. This spectral information can accurately distinguish similar colors, thereby improving the accuracy of the optical information of ambient light.

[0041] Furthermore, quantum dot filters can sense ambient light of a preset wavelength through fluorescence. In related technologies, ordinary filters can filter out ambient light of other wavelengths, retaining only the preset wavelength. Quantum dot filters, however, not only retain the preset wavelength but also emit fluorescence of the preset wavelength when illuminated by ambient light, thereby enhancing the ambient light at that wavelength and increasing its luminous flux, resulting in richer optical information. The spectral information obtained through a quantum dot filter array has detailed band divisions and rich information content, providing richer and more accurate optical information.

[0042] Figure 2 A schematic diagram of a quantum dot filter array according to an embodiment of the present disclosure is shown, such as Figure 2As shown, the quantum dot filter array may include multiple quantum dot filters, each used to acquire spectral information at a preset wavelength, i.e., to acquire quantum dot pixel information. After processing by a CMOS (Complementary Metal Oxide Semiconductor) chip module, the quantum dot pixel information across multiple bands can constitute the spectral information of ambient light. In the example, the number of spectral bands can be between 3 and 255, providing richer spectral information compared to a typical color camera. This disclosure does not limit the number of bands.

[0043] In the example, spectral information can also be processed through a CMOS chip module. For example, the spectral information can be converted into a transmittable electrical signal and transmitted to the processing component via a signal transmission line for further processing.

[0044] In the example, a lens module can also be placed in front of the quantum dot filter array to form a spectral camera by combining the above-mentioned devices (lens, quantum dot filter array, CMOS chip module, signal transmission line, etc.) for installation on a mobile terminal device. Ambient light can be irradiated onto the quantum dot filter array through the lens and processed as described above to obtain spectral information. Alternatively, a lens can be omitted, and the quantum dot filter array, CMOS chip module, signal transmission line, etc., can be combined to form a spectral sensor. This disclosure does not limit whether a lens module is provided.

[0045] In one possible implementation, the processing component can process the quantum dot pixel information transmitted by the quantum dot filter array, for example, by parsing the quantum dot pixel information to obtain quantum dot spectral information of ambient light.

[0046] In one possible implementation, determining the quantum dot spectral information of the ambient light based on the quantum dot pixel information corresponding to the plurality of quantum dot filters includes: determining spectral line information of a plurality of preset wavelengths based on the quantum dot pixel information; and determining the quantum dot spectral information of the ambient light based on the spectral line information of the plurality of preset wavelengths.

[0047] In this example, the quantum dot pixel information refers to the spectral information at multiple locations in the environment, specifically the spectral line information at multiple preset wavelengths at each location. For instance, the spectral information at location A may include red spectral lines sensed by the red filter in the quantum dot filter array, green spectral lines sensed by the green filter, etc. Based on the above method, the spectral line information at multiple preset wavelengths at location A can be analyzed. Furthermore, the spectral line information at each location that can be measured by the quantum dot spectrometer can be obtained through the above method.

[0048] In the example, the quantum dot spectral information of the ambient light incident on the quantum dot filter array can be determined based on the spectral line information at each location. For instance, the spectral line information at each location can be combined to obtain the spectral line information of the incident light at multiple locations that the quantum dot filter array can acquire, i.e., the quantum dot spectral information of the ambient light.

[0049] In one possible implementation, the optical information of ambient light can be determined based on the quantum dot spectral information of the ambient light. In an example, a quantum dot filter array can be positioned at the upper edge of the terminal to directly measure the optical information of light sources such as sunlight and artificial light. This information is then used by the terminal device to correct the color, white balance, and other aspects of the captured image. For instance, the quantum dot filter array can be positioned at the upper edge of a mobile phone, and the detected quantum dot spectral information can be transmitted to a processing component via a signal transmission line for correcting the image captured by the phone's camera. Since the shooting direction of the terminal device's camera is inconsistent with the measurement direction of the quantum dot filter array—that is, the quantum dot filter array measures the optical information of the surrounding environment, not the optical information of each pixel in the image captured by the camera—the optical information of the surrounding environment can be averaged, and the averaged optical information can be used as the basis for white balance or color correction of the image. For example, in outdoor scenarios where a mobile phone camera is used for photography, a quantum dot filter array can measure the optical information of sunlight in the sky. Furthermore, the quantum dot filter array can receive sunlight incident from multiple locations and measure the optical information of sunlight at these multiple locations. This optical information can then be averaged to obtain the optical information of the ambient light. This optical information can be used as the basis for white balance correction in images taken with a mobile phone.

[0050] In one possible implementation, the optical information can be color information. Determining the optical information of the ambient light based on the quantum dot spectral information includes: determining the color information of incident light at multiple locations in the ambient light based on the quantum dot spectral information; and averaging the color information of the incident light at the multiple locations to obtain the color information of the ambient light. In an outdoor scenario where a mobile phone camera is used to take photos, the quantum dot filter array can obtain the spectral information of incident light at multiple locations in the sky. The processing component can determine the color information of the incident light at multiple locations based on the spectral information of the incident light at multiple locations, and average the color information at the multiple locations in the sky to obtain the color information of the ambient light. This ambient light color information can be used to perform color correction on images taken by the mobile phone, for example, hue or saturation correction.

[0051] In this way, a benchmark for optical information at multiple locations in the environment can be determined through averaging, and this benchmark can be used as the basis for correcting images captured by terminal devices, thereby improving the accuracy of correction and enhancing the color reproduction of images.

[0052] In one possible implementation, an image of the light source is acquired simultaneously with the quantum dot spectral information of the light source. For example, the ambient light sensing device may further include an ambient light lens for acquiring an image of the ambient light. The shooting direction of this lens may be consistent with the measurement direction of the quantum dot filter array. For instance, both the ambient light lens and the quantum dot filter array can be positioned at the upper edge of the terminal device, with both the shooting direction of the ambient light lens and the measurement direction of the quantum dot filter array pointing towards the light source above. Therefore, while the quantum dot filter array measures the quantum dot spectral information of the light source, the ambient light lens can capture an image of the ambient light, i.e., an image of the light source.

[0053] In one possible implementation, the processing component is further configured to: determine the position of the light source based on the image of the ambient light; and correct the optical information based on the position of the light source to obtain corrected optical information.

[0054] In the example, the region with the highest light intensity can be identified in an image of ambient light, and the location of this region can be determined as the position of the light source. Furthermore, optical information can be corrected based on this information. For example, quantum dot spectral information includes spectral line information from multiple locations in the environment; at the location of the light source (e.g., the sun), the spectral lines of red light at that location can be corrected. As another example, other optical information at that location, such as light intensity, can be adjusted. This disclosure does not limit the type of optical information corrected.

[0055] In this way, the position of the light source can be determined from the image of the ambient light, and the optical information of the ambient light can be corrected to further improve the accuracy of the optical information.

[0056] In one possible implementation, infrared optical information can be measured using a quantum dot filter array, and this infrared optical information can be used for processing such as temperature measurement. The quantum dot filter array includes infrared filters, and the processing component is further configured to: determine infrared optical information based on the quantum dot pixel information obtained from the infrared filters; and determine physiological indicators based on the infrared optical information. Examples of physiological indicators include blood oxygen saturation, body temperature, blood pressure, blood lipid levels, blood glucose levels, and facial information. This disclosure does not limit the specific categories of physiological indicators.

[0057] In this example, ambient light may include visible light, as well as invisible light such as infrared and / or ultraviolet light. Invisible light, such as infrared light, can be measured using quantum dot filters, and the optical information from the measured infrared light can be further processed. For example, when an object emits thermal radiation, it may simultaneously emit infrared light; the temperature of the object can be measured using the infrared light emitted by the object. This temperature measurement method can also be used in the medical field, for example, to measure human body temperature or blood oxygen levels.

[0058] In this example, the quantum dot filter array may include an infrared filter for measuring infrared light. Through the infrared filter, the quantum dot filter array can measure the spectral information of the infrared light, and the processing component can determine infrared optical information based on the spectral information. For example, infrared optical information such as the wavelength and intensity of the infrared light can be obtained. Furthermore, the processing component can further process the infrared optical information; for example, temperature information can be determined based on the infrared optical information. In this example, the infrared optical information can be applied to the medical field, and physiological indicators such as body temperature and blood oxygen content can be measured using the infrared optical information. This disclosure does not limit the application areas of infrared optical information.

[0059] According to the ambient light sensing device of the present disclosure, the quantum dot pixel information of ambient light can be measured by a quantum dot filter array, thereby obtaining the optical information of the ambient light. The quantum dot filter array is small in size and can be placed at the upper edge of the terminal, or at a position directly facing the light source, allowing direct measurement of ambient light with high accuracy. Furthermore, the quantum dot filter array can measure spectral line information of multiple predetermined wavelength bands, increasing the channels and luminous flux of incident light and thus increasing the amount of optical information of the incident light. Further, this ambient light sensing device reduces the computational process for indirectly obtaining optical information, reduces the consumption of computational resources, and improves processing efficiency.

[0060] In one possible implementation, this disclosure also provides a terminal device, which may include: the ambient light sensing device disposed at the upper edge of the terminal device for acquiring optical information of the ambient light above the terminal device; and a processor for performing correction processing on the image captured by the terminal device based on the optical information to obtain a corrected image.

[0061] In one possible implementation, the terminal device may include a camera for capturing images, videos, etc. An ambient light sensor may be positioned at the upper edge of the terminal device. When taking a photo using the terminal device, the ambient light sensor measures the optical information of the ambient light from the overhead light source. The source of light in the environment is the light source; directly measuring the optical information of the light source improves measurement accuracy and the accuracy of image correction.

[0062] In one possible implementation, the optical information includes white balance information, wherein correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: performing white balance correction processing on the image based on the white balance information to obtain the corrected image.

[0063] In the example, the optical information may include white balance information, which is a measure of the accuracy of white when the three primary colors of red, green, and blue in an image are mixed to generate white. If the white balance accuracy is low, color differences may occur; for example, an image taken in a room with fluorescent lighting will appear greenish, an image taken under indoor tungsten lighting will appear yellowish, and an image taken in sunlight shadows will appear bluish. An ambient light sensor can measure optical information with higher accuracy, where the optical information may include white balance information, for example, white balance information can be determined based on the color information of ambient light.

[0064] In the example, the color information determined by the ambient light sensor is highly accurate, and therefore the white balance information is also highly accurate. This white balance information can be used to correct the white balance of the image, thereby reducing color difference.

[0065] In one possible implementation, the optical information includes color information, wherein correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: performing color correction processing on the image based on the color information to obtain the corrected image.

[0066] In the example, the optical information may include color information, such as hue, saturation, and brightness. Color difference may also occur if the color information of the image is inaccurate; for example, an error in hue may lead to color inaccuracy, i.e., color difference. Additionally, if an image has poor color rendering for a certain wavelength of light, it may result in low saturation of colors in that wavelength, thus causing the colors in that wavelength to appear dull in the image.

[0067] In the example, the optical information may include color information, which may include hue information. The hue information in the image can be corrected based on this hue information. For example, accurate hue information measured by an ambient light sensor can replace inaccurate hue information in the image to correct the hue and improve color reproduction. As another example, the saturation of light in each wavelength band can be determined using color information, and compensation can be applied to wavelength bands with lower saturation to improve the color capture effect of that wavelength band. This disclosure does not limit the type of correction processing.

[0068] Figure 3 A schematic diagram of an ambient light sensing device according to an embodiment of the present disclosure is shown, such as... Figure 3As shown, the quantum dot filter array of the ambient light sensing device can be relatively small in size and can be set at the upper edge of the terminal device to directly measure the quantum dot pixel information of the light source above.

[0069] In one possible implementation, the processing component can combine the quantum dot pixel information of each pixel to obtain the quantum dot spectral information of ambient light. Furthermore, the optical information of the ambient light can be determined based on the quantum dot spectral information. For example, a quantum dot filter array can measure quantum dot pixel information at multiple locations in the environment, and the processing component can determine the quantum dot spectral information based on the quantum dot pixel information, and further determine the color information at multiple locations in the environment based on the quantum dot spectral information. The color information can be averaged to determine the color information of the ambient light, and this averaged color information can be used as a reference for the color information in the environment to perform color correction on the image captured by the terminal device.

[0070] In the example, the terminal device may have other cameras and sensors, such as monochrome cameras, color cameras, etc., and the sensors may include photosensors, etc. This disclosure does not limit the types of cameras and sensors.

[0071] In the example, the camera can be used to capture images, but the color information or white balance information in these images may contain errors, resulting in color differences. An ambient light sensor, on the other hand, can directly measure the optical information of the light source. The optical information obtained from the ambient light sensor is highly accurate and can be used as a reference to correct color differences in the image. For example, color information in the optical information can be used to correct color information in the image, adjusting hue, saturation, etc. Alternatively, white balance information in the optical information can be used to correct the white balance of the image, reducing color differences.

[0072] In one possible implementation, the ambient light sensing device can be used in the fields of image color correction and white balance correction, as well as in the fields of light source spectral detection, dye color recognition, and screen color correction. This disclosure does not limit the application fields of the ambient light sensing device.

[0073] Figure 4 A flowchart illustrating an ambient light sensing method according to an embodiment of the present disclosure is shown, the method comprising:

[0074] Step S11: Determine the quantum dot spectral information of ambient light based on the quantum dot pixel information corresponding to the multiple quantum dot filters respectively;

[0075] Step S12: Determine the optical information of the ambient light based on the quantum dot spectral information, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information.

[0076] In one possible implementation, determining the quantum dot spectral information of ambient light based on quantum dot pixel information corresponding to multiple quantum dot filters includes: combining the quantum dot pixel information to obtain the quantum dot spectral information of the ambient light.

[0077] In one possible implementation, determining the optical information of the ambient light based on the quantum dot spectral information includes: determining the color information of incident light at multiple locations in the ambient light based on the quantum dot spectral information; and averaging the color information of the incident light at the multiple locations to obtain the color information of the ambient light.

[0078] In one possible implementation, the method further includes: acquiring an ambient light image through an ambient light lens; determining the position of a light source based on the ambient light image; and correcting the optical information based on the position of the light source to obtain corrected optical information.

[0079] In one possible implementation, the method further includes: determining infrared optical information based on quantum dot pixel information obtained from an infrared filter; and determining physiological indicators based on the infrared optical information.

[0080] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further.

[0081] In addition, this disclosure also provides electronic devices, computer-readable storage media, and programs, all of which can be used to implement any of the ambient light sensing methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the corresponding descriptions in the method section and will not be repeated here.

[0082] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0083] In some embodiments, the apparatus provided in this disclosure may have functions or include modules that can be used to perform the methods described in the above method embodiments. Specific implementations can be referred to the descriptions in the above method embodiments, and for brevity, will not be repeated here.

[0084] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the above-described method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0085] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured as described above.

[0086] Electronic devices can be provided as terminals, servers, or other forms of devices.

[0087] Figure 5 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other terminal.

[0088] Reference Figure 5 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0089] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0090] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0091] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0092] Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0093] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0094] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0095] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0096] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0097] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0098] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of an electronic device 800 to perform the above-described method.

[0099] Figure 6 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 may be provided as a server. (Refer to...) Figure 6 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0100] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0101] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0102] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0103] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0104] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0105] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0106] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0107] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0108] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0109] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0110] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. An ambient light sensing device, characterized in that, The device includes: a quantum dot filter array and a processing component. The quantum dot filter array includes multiple quantum dot filters, each of which is used to sense ambient light of a preset wavelength to obtain quantum dot pixel information corresponding to the preset wavelength. The number of wavelength bands corresponding to the multiple quantum dot filters is greater than or equal to 3 and less than or equal to 255. The ambient light includes visible light and invisible light. The quantum dot filter array directly measures the optical information of the light source corresponding to the ambient light. The processing component is used for: The quantum dot spectral information of the ambient light is determined based on the quantum dot pixel information corresponding to the plurality of quantum dot filters respectively. Based on the quantum dot spectral information, the optical information of the ambient light is determined, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information; The processing component is specifically used for: Based on the quantum dot spectral information, the optical information of incident light at multiple locations in the ambient light is determined; The optical information of the incident light at the multiple locations is averaged to obtain the optical information of the ambient light. The device further includes an ambient light lens for acquiring an image of the ambient light, wherein the shooting direction of the ambient light lens is consistent with the measurement direction of the quantum dot filter array. The processing component is also used for: Determine the position of the light source based on the image of the ambient light; The optical information is corrected according to the position of the light source to obtain the corrected optical information.

2. The apparatus according to claim 1, characterized in that, Based on the quantum dot pixel information corresponding to the plurality of quantum dot filters, the quantum dot spectral information of the ambient light is determined, including: The quantum dot pixel information is combined to obtain the quantum dot spectral information of the ambient light.

3. The apparatus according to claim 1, characterized in that, Based on the quantum dot spectral information, the optical information of the ambient light is determined, including: Based on the quantum dot spectral information, the color information of incident light at multiple locations in the ambient light is determined; The color information of the incident light at the multiple locations is averaged to obtain the color information of the ambient light.

4. The apparatus according to claim 1, characterized in that, The quantum dot filter array includes infrared filters. The processing component is also used for: Infrared optical information is determined based on the quantum dot pixel information obtained from the infrared filter; Physiological indicators are determined based on infrared optical information.

5. A terminal device, characterized in that, include: According to any one of claims 1-4, the ambient light sensing device is disposed on the upper edge of the terminal device and is used to acquire optical information of the ambient light above the terminal device; The processor is used to perform correction processing on the image captured by the terminal device based on the optical information to obtain the corrected image.

6. The device according to claim 5, characterized in that, The optical information includes white balance information. The process of correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: Based on the white balance information, the image is subjected to white balance correction processing to obtain the corrected image.

7. The device according to claim 5, characterized in that, The optical information includes color information. The process of correcting the image captured by the terminal device based on the optical information to obtain a corrected image includes: Based on the color information, the image is subjected to color correction processing to obtain the corrected image.

8. An ambient light sensing method, characterized in that, The method includes: The quantum dot spectral information of ambient light is determined based on the quantum dot pixel information corresponding to multiple quantum dot filters. The quantum dot pixel information corresponding to the multiple quantum dot filters is obtained by sensing ambient light of a preset wavelength using the multiple quantum dot filters included in the quantum dot filter array. The number of wavelength bands corresponding to the multiple quantum dot filters is greater than or equal to 3 and less than or equal to 255. The ambient light includes visible light and invisible light. The quantum dot filter array directly measures the optical information of the light source corresponding to the ambient light. Based on the quantum dot spectral information, the optical information of the ambient light is determined, wherein the optical information includes at least one of light intensity information, color temperature information, color information, and white balance information; Determining the optical information of the ambient light based on the quantum dot spectral information includes: Based on the quantum dot spectral information, the optical information of incident light at multiple locations in the ambient light is determined; The optical information of the incident light at the multiple locations is averaged to obtain the optical information of the ambient light. The method further includes: The position of the light source is determined based on the image of the ambient light acquired by the ambient light lens, wherein the shooting direction of the ambient light lens is consistent with the measurement direction of the quantum dot filter array; The optical information is corrected according to the position of the light source to obtain the corrected optical information.

9. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the method of claim 8.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method of claim 8.

Citation Information

Patent Citations

  • Automatic white balance processing method and device and electronic equipment

    CN111294576A

  • Multispectral sensor, imaging device, and image processing method

    CN113676628A

  • Apparatus, and associated method, for facilitating white balancing of an image

    US20130163866A1