Spectrum sensor, camera module, electronic equipment and color temperature determination method and device

Abstract

The invention relates to a spectrum sensor, a camera module, electronic equipment and a color temperature determination method and device. The spectrum sensor comprises an optical filter array and a pixel array, the optical filter array comprises a minimum repetitive unit, the minimum repetitive unit comprises a plurality of optical filter groups, different optical filter groups comprise different color channel optical filters, and the same color channel optical filters in the optical filter groups are arranged at intervals; pixels in the pixel array are in one-to-one correspondence with the color channel optical filters, and the pixels convert filtered light penetrating through the color channel optical filters into electric signals. The spectrum sensor can acquire electric signals in different spatial positions in more wave band ranges.

Description

Technical Field

[0001] This application relates to the field of image processing technologies, and particularly to a spectral sensor, a camera module, an electronic device, a color temperature determination method, and a device. Background Art

[0002] With the development of image processing technologies, Auto White Balance (AWB) is widely applied to process image data to restore the true colors of images. The white balance parameters can generally be determined by the color temperature, so relatively accurate color temperature data is required.

[0003] In traditional technologies, the spectral distribution information of the shooting environment is obtained through a single-point color temperature sensor in an electronic device, and the accuracy of the obtained color temperature data is relatively low. Summary of the Invention

[0004] Embodiments of this application provide a spectral sensor, a camera module, an electronic device, a color temperature determination method, and a device. The spectral sensor can collect electrical signals in more wavelength bands at different spatial positions.

[0005] In a first aspect, this application provides a spectral sensor. The spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit. The minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0006] In a second aspect, this application further provides a camera module. The camera module includes a lens and the spectral sensor according to any one of the first aspect; the color channel filters in the filter array of the spectral sensor filter the ambient light passing through the lens, and the pixels in the pixel array of the spectral sensor convert the filtered light obtained after being filtered by the color channel filters into electrical signals.

[0007] In a third aspect, this application further provides an electronic device. The electronic device includes: the camera module according to the second aspect; and a housing, and the camera module is disposed on the housing.

[0008] For the above spectral sensor, camera module, and electronic device, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes multiple filter groups, and the multiple filter groups include various color channel filters. The various color channel filters can filter to obtain filtered light in multiple band ranges. The pixels in the pixel array convert the filtered light in multiple band ranges into electrical signals, that is, electrical signals corresponding to multiple band ranges can be obtained. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter to obtain filtered light in the same band range at different spatial positions, and then electrical signals in the same band range at different spatial positions can be obtained. That is, the above spectral sensor can collect electrical signals in more band ranges at different spatial positions.

[0009] Fourthly, the present application further provides a method for determining color temperature, which is applied to the spectral sensor described in any item of the first aspect. The method includes:

[0010] Combining the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group;

[0011] Based on the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit, determining the spectral distribution information corresponding to the minimum repeating unit;

[0012] Based on the spectral distribution information corresponding to each minimum repeating unit, determining the color temperature of the shooting scene.

[0013] Fifthly, the present application further provides a device for determining color temperature, which is applied to the spectral sensor described in any item of the first aspect. The device includes:

[0014] A combining module, configured to combine the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group;

[0015] A curve determination module, configured to determine the spectral distribution information corresponding to the minimum repeating unit based on the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit;

[0016] A color temperature determination module, configured to determine the color temperature of the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit.

[0017] Sixthly, the present application further provides an electronic device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps of the method described in any item of the fourth aspect are implemented.

[0018] In a seventh aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method according to any one of the fourth aspects are implemented.

[0019] In an eighth aspect, the present application further provides a computer program product, including a computer program. When the computer program is executed by a processor, the steps of the method according to any one of the fourth aspects are implemented.

[0020] In the above color temperature determination method, device, electronic device, computer-readable storage medium, and computer program product, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes multiple filter groups, and the multiple filter groups include various color channel filters. The various color channel filters can filter to obtain filtered light in multiple band ranges. The pixels in the pixel array convert the filtered light in the multiple band ranges into electrical signals, that is, electrical signals corresponding to multiple band ranges can be obtained. Based on the electrical signals corresponding to the multiple band ranges, more comprehensive spectral distribution information is obtained, thereby improving the comprehensiveness of the spectral distribution information. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter to obtain filtered light in the same band range at different spatial positions, and then electrical signals in the same band range at different spatial positions are obtained. That is, the coverage range in the spatial dimension is improved through the interval arrangement structure. Compared with only obtaining the electrical signal in this band range at one spatial position, more basic data is provided for generating more comprehensive spectral distribution information, thereby improving the accuracy of the spectral distribution information. The color temperature of the shooting scene is determined using the above spectral distribution information, thereby improving the accuracy of the color temperature. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments of the present application or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0022] Figure 1 It is a schematic diagram of a spectral sensor in an embodiment;

[0023] Figure 2 It is a schematic diagram of a minimum repeating unit in an embodiment;

[0024] Figure 3 It is a schematic diagram of merging in an embodiment;

[0025] Figure 4 Schematic diagram of the minimum repeating unit in another embodiment;

[0026] Figure 5 Schematic diagram of the minimum repeating unit in another embodiment;

[0027] Figure 6 Schematic diagram of a filter group in one embodiment;

[0028] Figure 7 Schematic diagram of a filter group in another embodiment;

[0029] Figure 8 Schematic diagram of a filter group in another embodiment;

[0030] Figure 9 Schematic flowchart of a method for determining color temperature in one embodiment;

[0031] Figure 10 Structural block diagram of a device for determining color temperature in one embodiment;

[0032] Figure 11 Internal structure diagram of an electronic device in one embodiment. Detailed implementation manners

[0033] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0034] In some exemplary embodiments, a spectral sensor is provided. The spectral sensor is applied to an electronic device, and the electronic device can be but is not limited to various personal computers, laptop computers, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, smart cars, etc., and the portable wearable devices can be smart watches and smart bracelets, etc.

[0035] In some exemplary embodiments, the spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit, and the minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0036] Among them, a spectral sensor refers to a sensor that collects the intensities of light with different wavelengths, that is, a spectral sensor refers to a sensor that collects the intensities of light with different colors, and the spectral sensor can be used to collect spectral distribution information. The spectral sensor can be composed of multiple layers. The spectral sensor includes, but is not limited to, a filter array layer, a pixel array layer, and a circuit layer. The spectral sensor can include one circuit layer or multiple circuit layers. The filter array layer is composed of a filter array, the pixel array layer is composed of a pixel array, and the circuit layer is composed of a signal processing circuit. For example, the schematic diagram of the spectral sensor is as shown in Figure 1 Figure 2. The spectral sensor includes a filter array layer 102, a pixel array layer 104, and a circuit layer 106. A quadrilateral in the filter array 102 represents a color channel filter, that is, the filter array 102 is composed of multiple color channel filters.

[0037] A filter array refers to an array composed of filters, and the filters are used to selectively transmit light within a specific wavelength range. A color channel filter refers to a filter that allows light of a specific color to pass through and blocks light of other colors. The light of a specific color refers to light within a specific wavelength range. It can be understood that a filter that allows light within a specific wavelength range to pass through and blocks light of other wavelengths. The minimum repeating unit refers to the basic structural unit that composes the filter array. It can be understood that the filter array is composed of multiple minimum repeating units. The number of filter groups in the minimum repeating unit can be set according to actual needs. The number of filter groups can be odd or even. For example, the number of filter groups in the minimum repeating unit can be 2, 3, 4, or 16, etc. A filter group refers to the structural unit that composes the minimum repeating unit, and the minimum repeating unit is composed of various different filter groups. For example, the schematic diagram of the minimum repeating unit is as shown in Figure 2As shown, the minimum repeating unit consists of four filter groups, namely filter group 202, filter group 204, filter group 206, and filter group 208. Filter group 202 includes color channel filters Ch1, Ch2, Ch3, and Ch4, and the four color channel filters Ch1 in filter group 202 are arranged at intervals, the four color channel filters Ch2 are arranged at intervals, the four color channel filters Ch3 are arranged at intervals, and the four color channel filters Ch4 are arranged at intervals; Filter group 204 includes color channel filters Ch5, Ch6, Ch7, and Ch8; Filter group 206 includes color channel filters Ch9, Ch10, Ch11, and Ch12; Filter group 208 includes color channel filters Ch13, Ch14, Ch15, and Ch16; The above Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11, Ch12, Ch13, Ch14, Ch15, and Ch16 represent different color channel filters. Different color channel filters can transmit light in different wavelength ranges. It can be understood that different color channel filters can transmit light of different colors.

[0038] A pixel array refers to an array composed of pixels. The pixel array is located below the filter array, that is, the filter array covers the pixel array. A pixel refers to the basic structural unit that makes up the pixel array, and a pixel can be composed of independent photosensitive elements. Each pixel corresponds to a color channel filter one by one, that is, a color channel filter covers each pixel. The pixel converts the filtered light passing through the color channel filter covering it into an electrical signal. Filtered light refers to the light passing through the color channel filter, that is, light in a specific wavelength range or of a specific color. An electrical signal refers to a signal representing the filtered light. The electrical signal can be a voltage signal or a current signal, etc. The amplitude of the electrical signal is proportional to the intensity of the filtered light.

[0039] Exemplarily, the spectral sensor in the electronic device includes a filter array and a pixel array. The filter array includes a minimum repeating unit. The minimum repeating unit includes multiple filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0040] In this embodiment, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes multiple filter groups, and each of the multiple filter groups includes multiple color channel filters. The multiple color channel filters can filter out filtered light in multiple band ranges. The pixels in the pixel array convert the filtered light in the multiple band ranges into electrical signals, that is, electrical signals corresponding to multiple band ranges can be obtained. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter out filtered light in the same band range at different spatial positions, and then electrical signals in the same band range at different spatial positions can be obtained. That is, the above spectral sensor can collect electrical signals in more band ranges at different spatial positions.

[0041] In some exemplary embodiments, the spectral sensor further includes a signal processing circuit. The signal processing circuit is configured to combine the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group.

[0042] Among them, the signal processing circuit refers to a circuit that processes the electrical signals converted by the pixels. Combining refers to the process of synthesizing the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group into a combined signal. Combining can be to average the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group; combining can be to perform weighted averaging on the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group.

[0043] Exemplarily, the signal processing circuit in the circuit layer of the spectral sensor will average the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group. For example, the schematic diagram of combining is as Figure 3As shown, the electrical signals of the pixels corresponding to the 4 color filters Ch1 in the filter group 302 in the minimum repeating unit are averaged to obtain the combined signal of the color filter Ch1; the electrical signals of the pixels corresponding to the 4 color filters Ch2 in the filter group 302 are averaged to obtain the combined signal of the color filter Ch2; the electrical signals of the pixels corresponding to the 4 color filters Ch3 in the filter group 302 are averaged to obtain the combined signal of the color filter Ch3; the electrical signals of the pixels corresponding to the 4 color filters Ch4 in the filter group 302 are averaged to obtain the combined signal of the color filter Ch4; and so on, to obtain the combined signals corresponding to the color filters Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11, Ch12, Ch13, Ch14, Ch15, and Ch16 respectively. The pixels corresponding to the minimum repeating unit originally output 64 electrical signals. After combining, the pixels corresponding to the minimum repeating unit only need to output 16 combined signals, reducing the amount of data output by the spectral sensor, reducing the power consumption of the electronic device, and improving the signal-to-noise ratio of the data output by the spectral sensor by combining the electrical signals.

[0044] In this embodiment, the signal processing circuit of the spectral sensor combines the electrical signals of multiple pixels corresponding to the color channel filters in the filter group to obtain the combined signal corresponding to the color channel filters in the filter group, reducing the amount of data output by the spectral sensor, reducing the power consumption of the electronic device, and improving the signal-to-noise ratio of the data output by the spectral sensor by combining the electrical signals.

[0045] In some exemplary embodiments, the color channel filters of the same color in the filter group are arranged at intervals, including: the color channel filters of the same color in the same row of the filter group are arranged at intervals, and the color channel filters of the same color in the same column of the filter group are arranged at intervals.

[0046] Among them, the arrangement of the color channel filters of the same color in the same row at intervals means that there are other color channel filters between the color channel filters of the same color in the same row. The number of other color channel filters between the two closest color channel filters of the same color in a straight line in the same row can be 1 or more, and the number of other color channel filters between the two closest color channel filters of the same color in a straight line in the same row can be set according to actual needs and is not limited here. For example, as Figure 3 shown in the minimum repeating unit, there is one color filter Ch2 between the two color filters Ch1 in the same row of the filter group 302, or the schematic diagram of the minimum repeating unit is as Figure 4As shown, between two color filters Ch1 in the same row of the filter group 402, there are color filters Ch2 and Ch3 spaced therebetween.

[0047] The spaced arrangement of the same color channel filters in the same column means that there are other color channel filters between the same color channel filters in the same column. The number of other color channel filters between the two closest same color channel filters in a straight line in the same column can be one or more, and the number of other color channel filters between the two closest same color channel filters in a straight line in the same column can be set according to actual needs and is not limited here. For example, as Figure 3 shown in the minimum repeating unit, between two color filters Ch3 in the same column of the filter group 302, there is one color filter Ch1 spaced therebetween.

[0048] Exemplarily, the spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit. The minimum repeating unit includes multiple filter groups. Different filter groups include different color channel filters. And the same color channel filters in the same row of the filter group are spaced apart. The same color channel filters in the same column of the filter group are spaced apart. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0049] In some exemplary embodiments, the spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit. The minimum repeating unit includes multiple filter groups. Different filter groups include different color channel filters. Each filter group includes at least 3 different color channel filters. And the same color channel filters in the same row of the filter group are spaced apart. The same color channel filters in the same column of the filter group are spaced apart. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal. For example, as Figure 3 shown in the minimum repeating unit, each filter group includes 4 different color channel filters, or, as Figure 4 shown in the minimum repeating unit, each filter group includes 6 different color channel filters.

[0050] In this embodiment, the same color channel filters in the filter group are spaced apart. The spaced-apart same color channel filters can filter out filtered light in the same band range at different spatial positions, and then obtain electrical signals in the same band range at different spatial positions. That is, the spaced arrangement structure improves the coverage range in the spatial dimension. Compared with only obtaining the electrical signal in this band range at one spatial position, it provides more basic data for generating spectral distribution information.

[0051] In some exemplary embodiments, the same color channel filters in the filter group are arranged at intervals, including: the filter group includes a first channel filter and a second channel filter. The first channel filter is located on the first diagonal line in the first direction and on the diagonal lines parallel to the first diagonal line. The second channel filter is located on the second diagonal line in the second direction and on the diagonal lines parallel to the second diagonal line. There is an included angle between the first direction and the second direction.

[0052] Among them, the first channel filter and the second channel filter refer to two different color channel filters, that is, the wavelength ranges of the filtered light obtained by the first pass filter and the second pass filter are different. The filter group includes a first channel filter and a second channel filter, indicating that each filter group includes 2 different color channel filters. The first diagonal line and the second diagonal line refer to the two diagonal lines of the filter group. The first direction refers to the direction of the first diagonal line, and the second direction refers to the direction of the second diagonal line. For example, the schematic diagram of the minimum repeating unit is as Figure 5 shown. The minimum repeating unit includes 4 filter groups, namely filter group 502, filter group 504, filter group 506, and filter group 508. If filter group 502 includes a first channel filter Ch1 and a second channel filter Ch2, then the line segment formed by the first channel filters Ch1 located at (0, 0), (1, 1), (2, 2), and (3, 3) is the first diagonal line. The line segment formed by the first channel filters Ch1 on (0, 2) and (1, 3) is the diagonal line parallel to the first diagonal line. The line segment formed by the first channel filters Ch1 on (2, 0) and (3, 1) is the diagonal line parallel to the first diagonal line. Similarly, the line segment formed by the second channel filters Ch2 located at (0, 3), (1, 2), (2, 1), and (3, 0) is the second diagonal line. The line segment formed by the second channel filters Ch2 on (0, 1) and (1, 0) is the diagonal line parallel to the second diagonal line. The line segment formed by the second channel filters Ch2 on (2, 3) and (3, 2) is the diagonal line parallel to the first diagonal line. There is an included angle between the first direction and the second direction. The included angle between the first direction and the second direction is determined by the number and arrangement of the color filters in the filter group. For example, the included angle between the first direction and the second direction can be 90 degrees, that is, the first direction and the second direction are perpendicular. The included angle between the first direction and the second direction can also be 45 degrees or 60 degrees, etc.

[0053] Exemplarily, the spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit, and the minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters. Each filter group includes two different color channel filters, that is, the filter group includes a first channel filter and a second channel filter. The first channel filter is located on the first diagonal line in the first direction and on the diagonal lines parallel to the first diagonal line. The second channel filter is located on the second diagonal line in the second direction and on the diagonal lines parallel to the second diagonal line. There is an angle between the first direction and the second direction. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0054] In this embodiment, when the filter group includes a first channel filter and a second channel filter, the first channel filter is located on the first diagonal line in the first direction and on the diagonal lines parallel to the first diagonal line, and the second channel filter is located on the second diagonal line in the second direction and on the diagonal lines parallel to the second diagonal line, so as to realize the staggered arrangement of the same color channel filters in the filter group, and further obtain electrical signals with the same band range at different spatial positions. That is, the coverage range in the spatial dimension is improved through the staggered arrangement structure. Compared with only obtaining the electrical signal of this band range at one spatial position, more basic data is provided for generating spectral distribution information.

[0055] In some exemplary embodiments, in the first merging mode, the signal processing circuit is used to merge the electrical signals of all pixels corresponding to the same color channel filter in the filter group to obtain the merged signal corresponding to the color channel filter in the filter group.

[0056] Among them, the first merging mode refers to the mode of merging the electrical signals of all pixels corresponding to the same color channel filter in the filter group. In different merging modes, the functions of the signal processing circuit are different.

[0057] Exemplarily, when the electronic device determines that the current power consumption is greater than the power consumption threshold, it determines that the current merging mode is the first mode, and the signal processing circuit merges the electrical signals of all pixels corresponding to the same color channel filter in the filter group to obtain the merged signal corresponding to the color channel filter in the filter group. Among them, the current power consumption refers to the current power consumption of the electronic device, and the power consumption threshold refers to the threshold for comparison with the current power consumption. The current power consumption being greater than the power consumption threshold indicates that the current power consumption of the electronic device is relatively high. At this time, the amount of data output by the spectral sensor can be reduced, and the first merging mode is used to output the merged information corresponding to the color channel filters in each filter group of the spectral sensor, reducing the amount of data output by the spectral sensor and reducing the power consumption of the electronic device.

[0058] For example, as Figure 5 shown in the schematic diagram of the minimum repeating unit, the filter bank 502 includes 8 color channel filters Ch1. In the first merging mode, the signal processing circuit merges the electrical signals of the pixels corresponding to the 8 color channel filters Ch1 in the filter bank respectively, to obtain the merged signal corresponding to the color channel filter Ch1. The first merging mode is used to merge the minimum repeating unit as Figure 5 shown, to obtain 2 * 4 merged signals.

[0059] In this embodiment, in the first merging mode, the signal processing circuit merges the electrical signals of all pixels corresponding to the same color channel filter in the filter bank, to obtain the merged signal corresponding to the color channel filter in the filter bank, reducing the amount of data output by the spectral sensor and lowering the power consumption of the electronic device. Moreover, by merging the electrical signals, the signal-to-noise ratio of the data output by the spectral sensor is improved.

[0060] In some exemplary embodiments, in the second merging mode, for each sub-region in the filter bank, the signal processing circuit is used to merge the electrical signals of all pixels corresponding to the same color channel filter in the sub-region, to obtain the merged signal corresponding to the color channel filter in the sub-region.

[0061] Among them, the second merging mode refers to the mode of merging the electrical signals of all pixels corresponding to the same color channel filter in the sub-region. The amount of data output by the spectral sensor in the second mode is greater than the amount of data output by the spectral sensor in the first mode. A sub-region refers to the unit that makes up the filter bank, and the filter bank can be divided into multiple sub-regions according to actual needs. A sub-region may include one minimum repeating sub-region, or a sub-region may also include multiple minimum repeating sub-regions. A minimum repeating sub-region refers to the minimum repeating unit that makes up the filter bank. For example, the schematic diagram of the filter bank is as Figure 6 shown. The filter bank includes sub-region 602 and sub-region 604. The region composed of the color channel filter Ch1 located at (0, 0) and (1, 1), and the color channel filter Ch2 located at (1, 0) and (0, 1) is a minimum repeating sub-region. The region composed of the color channel filter Ch1 located at (0, 2) and (1, 3), and the color channel filter Ch2 located at (0, 3) and (1, 2) is a minimum repeating sub-region. Then, sub-region 602 includes 2 minimum repeating sub-regions. Similarly, sub-region 604 also includes 2 minimum repeating sub-regions; or, the schematic diagram of the filter bank is as Figure 7 shown. The filter bank includes sub-region 702 and sub-region 704.

[0062] Exemplarily, when the electronic device determines that the current power consumption is equal to or less than the power consumption threshold, it determines that the current merging mode is the second mode. For each sub-region in the filter group, the signal processing circuit merges the electrical signals of all pixels corresponding to the filter of the same color channel in the sub-region to obtain the merged signal corresponding to the filter of the color channel in the sub-region. When the current power consumption is equal to or less than the power consumption threshold, the data volume output by the spectral sensor can be increased at this time to provide more basic information for generating the spectral distribution information subsequently. Then, the first merging mode is used to output the merged information corresponding to the color channel filters in each filter group of the spectral sensor, which reduces the data volume output by the spectral sensor to a certain extent and reduces the power consumption of the electronic device. For example, as Figure 6 shown in the sub-region 602, the signal processing circuit merges the electrical signals of the pixels corresponding to the color channel filter Ch1 located at (0, 0), (1, 1), (0, 2), and (1, 3) respectively to obtain the merged signal corresponding to the color channel filter Ch1 in the sub-region 602. The second merging mode is used to merge the minimum repeating unit as shown in Figure 5 to obtain 4*4 merged signals.

[0063] In this embodiment, in the second merging mode, the signal processing circuit merges the electrical signals of all pixels corresponding to the filter of the same color channel in the sub-region to obtain the merged signal corresponding to the filter of the color channel in the sub-region. That is, compared with merging the electrical signals of all pixels corresponding to the filter of the same color channel in the filter group in the first merging mode, the data volume output by the spectral sensor in the second merging mode is larger. While reducing the data volume output by the spectral sensor, it provides more basic information for generating the spectral distribution information subsequently, reduces the power consumption of the electronic device, and improves the signal-to-noise ratio of the data output by the spectral sensor by merging the electrical signals.

[0064] In some exemplary embodiments, in the third merging mode, the signal processing circuit is used to merge the electrical signals of the pixels corresponding to the filter of the same color channel at the same position in each minimum repeating sub-region of the filter group to obtain the merged signal corresponding to the filter of the color channel at the position. Among them, the third merging mode refers to the method of merging the electrical signals of the pixels corresponding to the filter of the same color channel at the same position in each minimum repeating sub-region of the filter group to obtain the merged signal corresponding to the filter of the color channel at the position. The data volume output by the spectral sensor in the third mode is greater than the data volume output by the spectral sensor in the second mode.

[0065] Exemplarily, when the electronic device determines that the current power consumption is equal to or less than the power consumption threshold, it determines that the current merging mode is the third mode. The signal processing circuit merges the electrical signals of the pixels corresponding to the same color channel filter at the same position in each minimum repeating sub-region of the filter group to obtain the merged signal corresponding to the color channel filter at this position. For example, the schematic diagram of the filter group is as shown in Figure 8 which includes minimum repeating sub-regions 802, 804, 806, and 808. The color channel filter Ch1 at (0, 0) has the same position in the minimum repeating sub-region 802, the color channel filter Ch1 at (0, 2) has the same position in the minimum repeating sub-region 804, the color channel filter Ch1 at (2, 2) has the same position in the minimum repeating sub-region 806, and the color channel filter Ch1 at (2, 0) has the same position in the minimum repeating sub-region 808, and the color channel filters are the same. In the third mode, the signal processing circuit processes the electrical signals of the pixels corresponding to the color channel filter Ch1 at (0, 0), the electrical signals of the pixels corresponding to the color channel filter Ch1 at (0, 2), the electrical signals of the pixels corresponding to the color channel filter Ch1 at (2, 2), and the electrical signals of the pixels corresponding to the color channel filter Ch1 at (2, 0) to obtain the merged signal corresponding to the color channel filter. Using the third merging mode to merge the minimum repeating unit as shown in Figure 5 obtains 4 * 8 merged signals.

[0066] In this embodiment, in the third merging mode, the signal processing circuit is used to merge the electrical signals of the pixels corresponding to the same color channel filter at the same position in each minimum repeating sub-region of the filter group to obtain the merged signal corresponding to the color channel filter at the position. That is, compared with merging the electrical signals of all pixels corresponding to the same color channel filter in the sub-region in the second merging mode, the amount of data output by the spectral sensor is larger in the third merging mode. While reducing the amount of data output by the spectral sensor, it provides more basic information for subsequent generation of spectral distribution information, reduces the power consumption of the electronic device, and improves the signal-to-noise ratio of the data output by the spectral sensor by merging the electrical signals.

[0067] In some exemplary embodiments, the number of different color channel filters in the filter group is the same.

[0068] Wherein, the number refers to the total number of the same color channel filters in the filter group.

[0069] Exemplarily, the spectral sensor in the electronic device includes a filter array and a pixel array. The filter array includes a minimum repeating unit. The minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters. The same color channel filters in the filter group are arranged at intervals, and the number of different color channel filters in the filter group is the same. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

[0070] In this embodiment, the number of different color channel filters in the filter group is the same, that is, the different color channel filters are evenly arranged in the filter group, and filtered light with different band ranges at different spatial positions can be filtered out, and then electrical signals with different band ranges at different spatial positions can be obtained, providing more basic data for generating spectral distribution information.

[0071] In some exemplary embodiments, the minimum repeating unit includes N filter groups, the N filter groups include M different color channel filters, and each filter group includes M divided by N different color channel filters, where M and N are both positive integers.

[0072] Exemplarily, each minimum repeating unit in the spectral sensor includes N filter groups, the N filter groups include M different color channel filters, and each filter group includes M divided by N different color channel filters, where M and N are both positive integers. For example, as Figure 4 shown, the minimum repeating unit includes 2 filter groups, the 2 filter groups include 12 different color channel filters, and each filter group includes 6 different color channel filters. Or, as Figure 5 shown, the minimum repeating unit includes 4 filter groups, the 4 filter groups include 8 different color channel filters, and each filter group includes 2 different color channel filters.

[0073] In this embodiment, each filter group includes M divided by N different color channel filters, that is, different filter groups include different color channel filters. Each filter group can filter out filtered light with different band ranges, and multiple filter groups can filter out filtered light with more band ranges, laying a foundation for improving the comprehensiveness of spectral distribution information.

[0074] In some exemplary embodiments, N is 4 and M is 16, and the arrangement of the minimum repeating unit is:

[0075] Ch1 Ch2 Ch1 Ch2 Ch5 Ch6 Ch5 Ch6

[0076] Ch3 Ch4 Ch3 Ch4 Ch7 Ch8 Ch7 Ch8

[0077] Ch1 Ch2 Ch1 Ch2 Ch5 Ch6 Ch5 Ch6

[0078] Ch3 Ch4 Ch3 Ch4 Ch7 Ch8 Ch7 Ch8

[0079] Ch9 Ch10 Ch9 Ch10 Ch13 Ch14 Ch13 Ch14

[0080] Ch11 Ch12 Ch11 Ch12 Ch15 Ch16 Ch15 Ch16

[0081] Ch9 Ch10 Ch9 Ch10 Ch13 Ch14 Ch13 Ch14

[0082] Ch11 Ch12 Ch11 Ch12 Ch15 Ch16 Ch15 Ch16

[0083] Among them, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11, Ch12, Ch13, Ch14, Ch15, and Ch16 represent different color channel filters, that is, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11, Ch12, Ch13, Ch14, Ch15, and Ch16 represent 16 different color channel filters. The wavelength ranges of the filtered light obtained by each color channel filter are different, and the wavelength ranges of the filtered light obtained by each color channel filter can be set according to actual needs. The wavelength ranges filtered by each color channel filter are not limited here.

[0084] In this embodiment, the minimum repeating unit includes 4 filter groups, and the 4 filter groups include 16 different color channel filters. Then, 16 types of filtered light with different wavelength ranges can be filtered through the minimum repeating unit, thereby obtaining 16 types of electrical signals with different wavelength ranges, that is, the spectral distribution information obtained includes 16 types of electrical signals with different wavelength ranges, providing more basic data for generating the spectral distribution information.

[0085] In some exemplary embodiments, it is characterized in that N is 4, M is 8, and the arrangement of the minimum repeating unit is:

[0086] Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4

[0087] Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3

[0088] Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4

[0089] Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3

[0090] Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8

[0091] Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7

[0092] Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8

[0093] Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7

[0094] Among them, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7 and Ch8 represent different color channel filters.

[0095] In some exemplary embodiments, N is 4, M is 8, and the arrangement of the minimum repeating unit is:

[0096] Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4 Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8

[0097] Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3 Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7

[0098] Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4 Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8

[0099] Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3 Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7

[0100] Among them, 8 Ch1s and 8 Ch2s form a filter group, 8 Ch3s and 8 Ch4s form a filter group, 8 Ch5s and 8 Ch6s form a filter group, and 8 Ch7s and 8 Ch8s form a filter group.

[0101] In this embodiment, the minimum repeating unit includes 4 filter groups, and the 4 filter groups include 8 different color channel filters. Thus, 8 bands of filtered light can be obtained through the minimum repeating unit, and 8 bands of electrical signals can be obtained accordingly. That is, the spectral distribution information obtained includes 8 bands of electrical signals, providing more basic data for generating the spectral distribution information.

[0102] In some exemplary embodiments, the imaging module includes a lens and the spectral sensor of any one of the above embodiments. The color channel filters in the filter array of the spectral sensor filter the ambient light passing through the lens, and the pixels in the pixel array of the spectral sensor convert the filtered light obtained after passing through the color channel filters into electrical signals.

[0103] Among them, the imaging module refers to a module with an image acquisition function, and the imaging module includes, but is not limited to, a lens, an image sensor, a spectral sensor, etc. The lens refers to an optical lens that focuses ambient light, and the lens can focus the ambient light onto the spectral sensor.

[0104] Exemplarily, an electronic device includes an imaging module, the imaging module includes a lens and the spectral sensor of any one of the above embodiments. The color channel filters in the filter array of the spectral sensor filter the ambient light passing through the lens, and the pixels in the pixel array of the spectral sensor convert the filtered light obtained after passing through the color channel filters into electrical signals.

[0105] In this embodiment, the imaging module focuses the ambient light onto the spectral sensor through the lens. The color channel filters in the filter array of the spectral sensor filter the ambient light to obtain the filtered light corresponding to the color passing through the filter. The pixels corresponding to the color channel filters in the pixel array convert the filtered light into electrical signals, providing accurate basic data for subsequent generation of spectral distribution information.

[0106] In some exemplary embodiments, the electronic device includes: the imaging module in the above embodiments; and a housing, and the imaging module is disposed on the housing.

[0107] Among them, the housing refers to the structural shell in the electronic device for accommodating, supporting, and protecting internal electronic components and modules, usually made of plastic, metal, or composite materials.

[0108] Exemplarily, the imaging module in the electronic device is disposed on the housing of the electronic device.

[0109] In this embodiment, the imaging module in the electronic device is disposed on the housing of the electronic device to facilitate the imaging module to collect image data and spectral distribution information.

[0110] In some exemplary embodiments, a method for determining color temperature is applied to the spectral sensor in any of the above embodiments. The spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit, and the minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal. The flowchart of the color temperature determination method is as shown in Figure 9 shown, and includes:

[0111] Step 902: Combine the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group.

[0112] Exemplarily, the electronic device acquires the electrical signal corresponding to each pixel in the spectral sensor. For each filter group in the filter array of the spectral sensor, the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group are combined to obtain a combined signal corresponding to the color channel filter in the filter group.

[0113] Step 904: Based on the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit, determine the spectral distribution information corresponding to the minimum repeating unit.

[0114] Among them, the spectral distribution information refers to the distribution of the energy or intensity of the optical signal in different wavelength bands. The spectral distribution information can be represented by a spectral distribution curve.

[0115] Exemplarily, the electronic device determines the spectral distribution information corresponding to the minimum repeating unit according to the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit.

[0116] Step 906: Based on the spectral distribution information corresponding to each minimum repeating unit, determine the color temperature of the shooting scene.

[0117] Among them, the shooting scene refers to the environment for shooting image data or the environment for recording video. The color temperature is a parameter characterizing the color characteristics of the light source in the shooting scene, and the unit of the color temperature is Kelvin.

[0118] Exemplarily, the electronic device determines the color temperature of the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit.

[0119] In an exemplary embodiment, the electronic device determines the color temperature of the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit, including: for the spectral distribution information corresponding to each minimum repeating unit, using the CIE color temperature calculation method (CCT Estimation based on Spectral Power Distribution), based on the correlated color temperature (CCT for short) corresponding to the minimum repeating unit, performing a weighted average on the correlated color temperatures corresponding to each minimum repeating unit to obtain the color temperature of the shooting scene.

[0120] In some exemplary embodiments, the electronic device determines the white balance parameter corresponding to the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit. That is, directly determine the white balance parameter corresponding to the shooting scene according to the spectral distribution information corresponding to each minimum repeating unit, and the white balance parameter corresponding to the shooting scene is used to perform white balance processing on the image data captured in the shooting scene.

[0121] In some exemplary embodiments, for each minimum repeating unit, the electronic device determines the white balance parameter corresponding to the minimum repeating unit based on the spectral distribution information corresponding to the minimum repeating unit. The white balance parameter corresponding to the minimum repeating unit is used to perform white balance processing on the local image data corresponding to the minimum repeating unit in the image data captured in the shooting scene. That is, determine the local white balance parameter and perform white balance processing on different regions of the image data separately.

[0122] In this embodiment, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes a plurality of filter groups, and the plurality of filter groups include a variety of color channel filters. The variety of color channel filters can filter to obtain filtered light in multiple band ranges. The pixels in the pixel array convert the filtered light in multiple band ranges into electrical signals, that is, electrical signals corresponding to multiple band ranges can be obtained. Based on the electrical signals corresponding to multiple band ranges, more comprehensive spectral distribution information is obtained, thereby improving the comprehensiveness of the spectral distribution information. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter to obtain filtered light in the same band range at different spatial positions, and then obtain electrical signals in the same band range at different spatial positions. That is, the coverage range in the spatial dimension is improved through the interval arrangement structure. Compared with only obtaining the electrical signal in this band range at one spatial position, more basic data is provided for generating more comprehensive spectral distribution information, thereby improving the accuracy of the spectral distribution information. Using the above spectral distribution information to determine the color temperature of the shooting scene, thereby improving the accuracy of the color temperature.

[0123] In some exemplary embodiments, the above color temperature determination method further includes:

[0124] Determine the white balance parameters corresponding to the shooting scene based on the color temperature of the shooting scene; perform white balance processing on the image data captured in the shooting scene based on the white balance parameters corresponding to the shooting scene.

[0125] Among them, the white balance parameter refers to the parameter used to correct the color deviation of the image, and can be understood as the parameter that makes the area that should be "white" in the image present true white. White balance processing refers to the process of correcting the color deviation of the image caused by the different color temperatures of the light sources in the shooting scene.

[0126] Exemplarily, the electronic device determines the white balance parameters corresponding to the shooting scene according to the color temperature of the shooting scene, and uses the white balance parameters corresponding to the shooting scene to perform white balance processing on the image data captured in the shooting scene to obtain the target data corresponding to the image data. The target data refers to the data obtained after performing white balance processing on the image data.

[0127] In some exemplary embodiments, the electronic device acquires the image data of the shooting scene through an image sensor, determines the white balance parameters corresponding to the shooting scene according to the color temperature of the shooting scene, and uses the white balance parameters corresponding to the shooting scene to perform white balance processing on the image data captured in the shooting scene to obtain the target data corresponding to the image data. The image data refers to the data set of the color image collected by the image sensor.

[0128] In this embodiment, the white balance parameters corresponding to the shooting scene are determined according to the color temperature of the shooting scene, and the white balance parameters corresponding to the shooting scene are used to perform white balance processing on the image data captured in the shooting scene, thereby reducing the color deviation of the image data caused by different color temperatures and improving the quality of the image data.

[0129] In some exemplary embodiments, a spectral sensor is provided. The spectral sensor includes a filter array, a pixel array, and a signal processing circuit. The filter array includes a minimum repeating unit. The minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal; the signal processing circuit is used to merge the electrical signals of the multiple pixels corresponding to the same color channel filter in the filter group to obtain the merged signal corresponding to the color channel filter in the filter group.

[0130] The above spectral sensor, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes a plurality of filter groups. The plurality of filter groups include various color channel filters. The various color channel filters can filter out filtered light in multiple wavelength ranges. The pixels in the pixel array convert the filtered light in multiple wavelength ranges into electrical signals, that is, electrical signals corresponding to multiple wavelength ranges can be obtained. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter out filtered light in the same wavelength range at different spatial positions, and then obtain electrical signals in the same wavelength range at different spatial positions. That is, the above spectral sensor can collect electrical signals in more wavelength ranges at different positions. The signal processing circuit of the spectral sensor combines the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group, reducing the data volume output by the spectral sensor, reducing the power consumption of the electronic device, and improving the signal-to-noise ratio of the data output by the spectral sensor by combining the electrical signals.

[0131] In some exemplary embodiments, a color temperature determination method is provided, which is applied to the spectral sensor in the above embodiments. The spectral sensor includes a filter array, a pixel array, and a signal processing circuit. The filter array includes minimum repeating units. Each minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals. Each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal. The signal processing circuit is used to combine the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group. The color temperature determination method includes:

[0132] The electronic device obtains the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit, determines the spectral distribution information corresponding to the minimum repeating unit according to the combined information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit, and determines the color temperature of the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit.

[0133] In the above method for determining color temperature, the filter array in the spectral sensor is composed of minimum repeating units. Each minimum repeating unit includes multiple filter groups, and the multiple filter groups include various color channel filters. The various color channel filters can filter to obtain filtered light in multiple wavelength ranges. The pixels in the pixel array convert the filtered light in the multiple wavelength ranges into electrical signals, that is, electrical signals corresponding to multiple wavelength ranges can be obtained. Based on the electrical signals corresponding to the multiple wavelength ranges, more comprehensive spectral distribution information is obtained, thereby improving the comprehensiveness of the spectral distribution information. Moreover, the same color channel filters in the filter group are arranged at intervals. The same color channel filters arranged at intervals can filter to obtain filtered light in the same wavelength range at different spatial positions, and then obtain electrical signals in the same wavelength range at different spatial positions. That is, the coverage range in the spatial dimension is improved through the interval arrangement structure. Compared with only obtaining the electrical signal in this wavelength range at one spatial position, more basic data is provided for generating more comprehensive spectral distribution information, thereby improving the accuracy of the spectral distribution information. The color temperature of the shooting scene is determined using the above spectral distribution information, thereby improving the accuracy of the color temperature.

[0134] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown in the direction of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least a part of other steps or steps or stages in other steps.

[0135] Based on the same inventive concept, an embodiment of the present application also provides a color temperature determination device for implementing the above-mentioned color temperature determination method. The solution provided by this device for solving problems is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the color temperature determination device provided below can refer to the limitations on the color temperature determination method in the above text, and will not be repeated here.

[0136] In some exemplary embodiments, such as Figure 10As shown, a color temperature determination device is provided, which is applied to a spectral sensor. It is characterized in that the spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit, and the minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal; the color temperature determination includes: a merging module 1002, a curve determination module 1004, and a color temperature determination module 1006, where:

[0137] The merging module 1002 is configured to merge the electrical signals of multiple pixels corresponding to the same color channel filter in the filter group to obtain a merged signal corresponding to the color channel filter in the filter group;

[0138] The curve determination module 1004 is configured to determine the spectral distribution information corresponding to the minimum repeating unit based on the merged information corresponding to each color channel filter in the multiple filter groups in the minimum repeating unit;

[0139] The color temperature determination module 1006 is configured to determine the color temperature of the shooting scene based on the spectral distribution information corresponding to each minimum repeating unit.

[0140] In some exemplary embodiments, the color temperature determination device further includes a processing module, and the processing module is configured to: determine the white balance parameter corresponding to the shooting scene based on the color temperature of the shooting scene; perform white balance processing on the image data captured in the shooting scene based on the white balance parameter corresponding to the shooting scene.

[0141] Each module in the above color temperature determination device can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in or independent of the processor in the electronic device in the form of hardware, or stored in the memory in the electronic device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0142] In an exemplary embodiment, an electronic device is provided. The electronic device can be a terminal, and its internal structure diagram can be as Figure 11As shown in the figure. The electronic device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the electronic device is used to exchange information between the processor and external devices. The communication interface of the electronic device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC), or other technologies. The computer program, when executed by the processor, implements an image processing method. The display unit of the electronic device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the electronic device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the electronic device, or an external keyboard, touchpad, or mouse, etc.

[0143] Those skilled in the art can understand that Figure 11 the structure shown in the figure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0144] In one embodiment, an electronic device is provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0145] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0146] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0147] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of the relevant data need to comply with the relevant regulations.

[0148] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in this application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in this application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., without limitation.

[0149] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this application.

[0150] The above-described embodiments merely represent several implementation manners of this application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of this application. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can still be made, and these all belong to the protection scope of this application. Therefore, the protection scope of this application should be subject to the appended claims.

Claims

1. A spectral sensor, characterized in that, The spectral sensor includes a filter array and a pixel array. The filter array includes a minimum repeating unit, and the minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal.

2. The spectral sensor according to claim 1, characterized in that, The spectral sensor further includes a signal processing circuit, and the signal processing circuit is configured to combine the electrical signals of a plurality of pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group.

3. The spectral sensor according to claim 1, characterized in that, The same color channel filters in the filter group are arranged at intervals, including: the same color channel filters in the same row of the filter group are arranged at intervals, and the same color channel filters in the same column of the filter group are arranged at intervals.

4. The spectral sensor according to claim 1, characterized in that, The same color channel filters in the filter group are arranged at intervals, including: the filter group includes a first channel filter and a second channel filter. The first channel filter is located on the first diagonal line in the first direction and on the diagonal lines parallel to the first diagonal line. The second channel filter is located on the second diagonal line in the second direction and on the diagonal lines parallel to the second diagonal line. There is an included angle between the first direction and the second direction.

5. The spectral sensor according to claim 4, characterized in that, In the first combination mode, the signal processing circuit is configured to combine the electrical signals of all pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group.

6. The spectral sensor according to claim 4, characterized in that, In the second combination mode, for each sub-region in the filter group, the signal processing circuit is configured to combine the electrical signals of all pixels corresponding to the same color channel filter in the sub-region to obtain a combined signal corresponding to the color channel filter in the sub-region.

7. The spectral sensor according to claim 4, characterized in that, In the third combination mode, the signal processing circuit is configured to combine the electrical signals of the pixels corresponding to the same color channel filter at the same position in each sub-region of the filter group to obtain a combined signal corresponding to the color channel filter at the position.

8. The spectral sensor according to claim 1, characterized in that, The number of different color channel filters in the filter group is the same.

9. The spectral sensor according to claim 1, wherein The minimum repeating unit includes N filter groups, the N filter groups include M different color channel filters, and each filter group includes M divided by N different color channel filters. Both M and N are positive integers.

10. The spectral sensor according to claim 9, characterized in that, The N is 4, the M is 16, and the arrangement of the minimum repeating unit is: Ch1 Ch2 Ch1 Ch2 Ch5 Ch6 Ch5 Ch6 Ch3 Ch4 Ch3 Ch4 Ch7 Ch8 Ch7 Ch8 Ch1 Ch2 Ch1 Ch2 Ch5 Ch6 Ch5 Ch6 Ch3 Ch4 Ch3 Ch4 Ch7 Ch8 Ch7 Ch8 Ch9 Ch10 Ch9 Ch10 Ch13 Ch14 Ch13 Ch14 Ch11 Ch12 Ch11 Ch12 Ch15 Ch16 Ch15 Ch16 Ch9 Ch10 Ch9 Ch10 Ch13 Ch14 Ch13 Ch14 Ch11 Ch12 Ch11 Ch12 Ch15 Ch16 Ch15 Ch16 Wherein, the Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11, Ch12, Ch13, Ch14, Ch15 and Ch16 represent different color channel filters.

11. The spectral sensor according to claim 9, characterized in that, characterized in that, The N is 4, the M is 8, and the arrangement of the minimum repeating unit is: Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4 Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3 Ch1 Ch2 Ch1 Ch2 Ch3 Ch4 Ch3 Ch4 Ch2 Ch1 Ch2 Ch1 Ch4 Ch3 Ch4 Ch3 Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8 Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7 Ch5 Ch6 Ch5 Ch6 Ch7 Ch8 Ch7 Ch8 Ch6 Ch5 Ch6 Ch5 Ch8 Ch7 Ch8 Ch7 Wherein, the Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7 and Ch8 represent different color channel filters.

12. An imaging module, characterized in that, The imaging module includes a lens and the spectral sensor according to any one of claims 1-11; the color channel filters in the filter array of the spectral sensor filter the ambient light passing through the lens, and the pixels in the pixel array of the spectral sensor convert the filtered light obtained by filtering through the color channel filters into electrical signals.

13. An electronic device, characterized in that, The electronic device includes: The imaging module according to claim 12; and A housing, and the imaging module is disposed on the housing.

14. A method for determining color temperature, applied to a spectral sensor, characterized in that, The spectral sensor includes a filter array and a pixel array, the filter array includes a minimum repeating unit, the minimum repeating unit includes a plurality of filter groups, different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to the color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal; the method includes: Combining the electrical signals of a plurality of pixels corresponding to the same color channel filter in the filter group to obtain a combined signal corresponding to the color channel filter in the filter group; Determining the spectral distribution information corresponding to the minimum repeating unit based on the combined information corresponding to each color channel filter in the plurality of filter groups in the minimum repeating unit; Determine the color temperature of the shooting scene based on the spectral distribution information corresponding to each of the minimum repeating units.

15. The method according to claim 14, wherein The method further includes: Determine the white balance parameter corresponding to the shooting scene based on the color temperature of the shooting scene; Perform white balance processing on the image data captured in the shooting scene based on the white balance parameter corresponding to the shooting scene.

16. A color temperature determination device, applied to a spectral sensor, characterized in that, The spectral sensor includes a filter array and a pixel array. The filter array includes minimum repeating units, and each minimum repeating unit includes a plurality of filter groups. Different filter groups include different color channel filters, and the same color channel filters in the filter group are arranged at intervals; each pixel in the pixel array corresponds to a color channel filter one by one, and the pixel converts the filtered light passing through the color channel filter into an electrical signal; The device includes: A merging module for merging the electrical signals of a plurality of pixels corresponding to the same color channel filter in the filter group to obtain a merged signal corresponding to the color channel filter in the filter group; A curve determination module for determining the spectral distribution information corresponding to the minimum repeating unit based on the merged information corresponding to each color channel filter in the plurality of filter groups in the minimum repeating unit; A color temperature determination module for determining the color temperature of the shooting scene based on the spectral distribution information corresponding to each of the minimum repeating units.

17. An electronic device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the method according to any one of claims 14-15 are implemented.

18. A computer-readable storage medium, having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, the steps of the method according to any one of claims 14-15 are implemented.

19. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, the steps of the method according to any one of claims 14-15 are implemented.

Images