Detection module, image acquisition device and electronic equipment
By combining depth and spectral detection pixels in the detection module, the problem that existing spectral sensors cannot adjust the camera parameters at different locations is solved, and accurate spectral recognition and image parameter adjustment of the object surface are achieved to generate a more realistic image effect.
Patent Information
- Application Number
- CN202310521579.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-12
AI Technical Summary
Existing spectral sensors cannot obtain the spectrum of light sources at different positions and angles, and cannot adjust the photography parameters of different positions of images captured by the camera module.
A detection module is designed, including a pixel array at the transmitting end and receiving end. The depth detection pixel is used to obtain the depth information of an object. The spectral detection pixel is used to detect the ambient spectral information, and the depth and spectral information are combined to adjust the photography parameters at different locations. .
It realizes more accurate spectrum recognition of the object surface, and can adjust different photo parameters for different areas of the image to generate images closer to the real object.
Smart Images

Figure CN118945493A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of imaging technology, and more specifically, to a detection module, an image acquisition device and an electronic device. Background Art
[0002] At present, electronic devices can detect the spectrum in the current shooting environment through spectral sensors during shooting, and adjust the image taken by the camera module accordingly to make it present the true color of the object. However, spectral sensors are usually used in a single way, and cannot obtain the spectrum of light sources at different positions and angles, and cannot adjust the shooting parameters of different positions of the image taken by the camera module. Summary of the invention
[0003] The embodiments of the present application provide a detection module, an image acquisition device and an electronic device, which are at least used to solve the problem that the photographing parameters of different positions of the image cannot be adjusted.
[0004] The detection module of the embodiment of the present application includes a transmitting end and a receiving end. The transmitting end is used to send a signal to an object. The receiving end is provided with a pixel array. The pixel array includes a first pixel area and a second pixel area, and depth detection pixels are distributed in the first pixel area, and the depth detection pixels are used to receive the signal sent by the transmitting end and reflected by the object back to the receiving end to obtain the depth information of the object. Spectral detection pixels are distributed in the second pixel area, and the spectral detection pixels are used to detect the spectral information of the ambient light of the current environment.
[0005] The image acquisition device of the embodiment of the present application includes a detection module and a camera module, and the detection module includes a transmitter and a receiver. The transmitter is used to send a signal to an object. The receiver is provided with a pixel array. The pixel array includes a first pixel area and a second pixel area, and depth detection pixels are distributed in the first pixel area, and the depth detection pixels are used to receive the signal sent by the transmitter and reflected by the object back to the receiver to obtain the depth information of the object. Spectral detection pixels are distributed in the second pixel area, and the spectral detection pixels are used to detect the spectral information of the ambient light of the current environment. The camera module is used to shoot and obtain image information.
[0006] The electronic device of the embodiment of the present application includes a main body and an image acquisition device. The image acquisition device includes a detection module and a camera module, and the detection module includes a transmitter and a receiver. The transmitter is used to send a signal to an object. The receiving end is provided with a pixel array. The pixel array includes a first pixel area and a second pixel area, and depth detection pixels are distributed in the first pixel area. The depth detection pixels are used to receive signals sent by the transmitter and reflected by the object back to the receiving end to obtain the depth information of the object. Spectral detection pixels are distributed in the second pixel area, and the spectral detection pixels are used to detect the spectral information of the ambient light of the current environment. The camera module is used to shoot to obtain image information. The image acquisition device is combined with the main body.
[0007] In the detection module, image acquisition device and electronic device of the present application, the depth detection pixel can collect the distance from multiple points on the object to the detection module and obtain the depth information of the object based on it. The spectral detection pixel can detect the spectral information of multiple positions on the surface of the object. When multiple light sources are irradiated on the surface of the object, the depth information obtained by the depth detection pixel can be combined with the spectral information obtained by the spectral detection pixel, and the spectral recognition of the surface of the object is more accurate. The combination of depth information and spectral information can also be used as a basis for adjusting the shooting parameters at different positions, thereby adjusting different shooting parameters for different areas of the image.
[0008] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0010] Figure 1 is a schematic diagram of the structure of a detection module of certain embodiments of the present application;
[0011] Figure 2 It is a structural diagram of the receiving end in the detection module of the present application;
[0012] Figure 3 — Fig.11 It is a schematic diagram of the planar structure of the pixel array in different implementations of the detection module of the present application;
[0013] Fig.12 is a cross-sectional schematic diagram of a spectrum detection pixel and a diffusion layer in certain embodiments of the pixel array of the present application;
[0014] Fig.13 is a schematic diagram of the structure of an image acquisition device in some embodiments of the present application;
[0015] Fig.14 It is a schematic diagram of the structure of an electronic device of certain embodiments of the present application.
[0016] Description of main component symbols:
[0017] 1000, electronic device; 100, image acquisition device; 200, main body; 10, detection module; 30, camera module; 50, processor; 11, transmitting end; 13, receiving end; 131, pixel array; 1311, first pixel area; 13111, depth detection pixel; 1313, second pixel area; 13131, spectral detection pixel; 1301, channel; 1303, diffusion layer; 15, first circuit; 17, second circuit. DETAILED DESCRIPTION
[0018] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.
[0019] In the description of the present application, it should be understood that the terms "thickness", "upper", "top", "bottom", "inside", "outside", etc. indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0020] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense. In an example, it can be a fixed connection, or a detachable connection, or an integral connection; it can be a mechanical connection, or an electrical connection, or they can communicate with each other; it can be a direct connection, or an indirect connection through an intermediate medium, and it can be the internal connection of two elements or the interaction relationship between two elements.
[0021] At present, electronic devices can detect the spectrum in the current shooting environment through spectral sensors during shooting, and adjust the image taken by the camera module accordingly to make it present the true color of the object. However, spectral sensors are usually used in a single way, and cannot obtain the spectrum of light sources at different positions and angles, and cannot adjust the shooting parameters of different positions of the image taken by the camera module.
[0022] In order to solve the above problems, the present application provides a detection module 10, an image acquisition device 100 and an electronic device 1000.
[0023] See also Figures 1 to 3 The detection module 10 of the present application includes a transmitter 11 and a receiver 13. The transmitter 11 is used to send a signal to an object. The receiver 13 is provided with a pixel array 131. The pixel array 131 includes a first pixel area 1311 and a second pixel area 1313. The first pixel area 1311 is distributed with depth detection pixels 13111. The depth detection pixels 13111 are used to receive signals sent by the transmitter 11 and reflected by the object back to the receiver 13 to obtain the depth information of the object. The second pixel area 1313 is distributed with spectrum detection pixels 13131. The spectrum detection pixels 13131 are used to detect the spectrum information of the ambient light of the current environment.
[0024] The depth information refers to the distance between each position on the object and the signal emission point. The detection module 10 can transmit the depth information to the processor 50 ( Fig.13 As shown), the processor 50 can obtain a three-dimensional image of the object based on the depth information.
[0025] The spectral information is the visible light information reflected by the object received by the spectral detection pixel 13131 in the second pixel area 1313. According to the spectral information, the processor 50 can obtain the real color information of different positions of the object, and according to the spectral information, the camera module 30 ( Fig.13 The various parameters of the two-dimensional image obtained by the camera module 30 are adjusted so that the color or shape and other parameters of the two-dimensional image obtained by the camera module 30 are closer to the real object.
[0026] In the detection module 10 of the present application, the depth detection pixel 13111 can collect the distances from multiple points on the object to the detection module 10 and derive the depth information of the object accordingly. The spectral detection pixel 13131 can detect the spectral information of multiple positions on the surface of the object. When multiple light sources are irradiated on the surface of the object, the depth information obtained by the depth detection pixel 13111 can be combined with the spectral information obtained by the spectral detection pixel 13131, and the spectral recognition of the surface of the object is more accurate. The combination of depth information and spectral information can also be used as a basis for adjusting the shooting parameters at different positions, thereby adjusting different shooting parameters for different areas of the image.
[0027] The detection module 10 is further described below with reference to the accompanying drawings.
[0028] See also Figure 1 and Figure 3 In some embodiments, the detection module 10 is a device capable of detecting depth information and spectral information of an object. The transmitting end 11 of the detection module 10 can send a signal to the object. After the signal is transmitted to the surface of the object, it can be reflected by the surface of the object. The reflected signal can enter the receiving end 13 of the detection module 10 and be received by the first pixel area 1311 ( Figure 3 Depth detection pixel 13111 (shown) Figure 3 The signal type sent by the transmitting end 11 includes but is not limited to infrared light signals, visible light signals or ultraviolet light signals. Depth detection pixel 13111 ( Figure 3 The signal type that can be received by the detection module 10 is the same as the signal type sent by the transmitting end 11. In the process of sending and receiving the signal, the detection module 10 can record the time when the signal is sent by the transmitting end 11 and the time when the signal is received by the receiving end 13, and then calculate the time difference between the signal transmission between the detection module 10 and the object, and record the distance between the position where the object reflects the signal and the detection module 10 according to the time difference.
[0029] Specifically, please combine Figure 3 In some embodiments, taking the infrared light signal emitted by the transmitting end 11 as an example, the transmitting end 11 of the detection module 10 will form a signal emission area when emitting a signal. In the signal emission area, the directions of the infrared light signals emitted by the transmitting end 11 are different. Therefore, infrared light from different directions will irradiate different positions of the object. Since the surface of the object is uneven, the time taken for infrared light from different directions to irradiate different positions of the object and be reflected back to the depth detection pixel 13111 by the object is also different. At this time, the distance between different positions of the object and the detection module 10 can be calculated according to the transmission time and transmission speed of the infrared light signals from different directions. After combining multiple distance information with position information, the depth detection pixel 13111 can obtain the depth information of the object.
[0030] Further, in some embodiments, the pixel array 131 is a component formed by arranging a plurality of pixels in a two-dimensional array in the form of an array and used to sense light signals. In some embodiments, the pixel array 131 is composed of horizontal rows (Row) and vertical columns (Column) arranged orthogonally, and each row has a plurality of pixels, and each column also has a plurality of pixels. Each pixel converts light into electric charge according to the intensity of light incident on it.
[0031] Specifically, in some embodiments, the pixel may include a depth detection pixel 13111 and a spectral detection pixel 13131. The depth detection pixel 13111 is capable of receiving a signal emitted by the transmitting end 11 and reflected to the receiving end 13 via an object. In the case where the signal emitted by the transmitting end 11 is an infrared light signal, the depth detection pixel 13111 may be an infrared (IR) pixel. For an IR pixel, only infrared light can pass through the IR pixel, and the IR pixel can only convert the infrared light into an electric charge according to the intensity of the received infrared light, and determine the moment when the infrared light reflected by the object reaches the IR pixel. The spectral detection pixel 13131 is a pixel for receiving ambient light entering the pixel array 131 and for detecting the spectral information of the ambient light in the current environment. Among them, the spectral information is used to obtain the ambient light parameters of the current environment, such as the color temperature of the ambient light and the brightness of the ambient light.
[0032] For further information, see Figure 3 In some embodiments, a plurality of pixels are distributed in the first pixel area 1311 (shaded area) and the second pixel area 1313 (light-colored area) of the pixel array 131. Among them, the pixels distributed in the first pixel area 1311 are all depth detection pixels 13111. When the signal emitted by the transmitting end 11 is an infrared light signal, the pixels distributed in the first pixel area 1311 are all IR pixels. The pixels distributed in the second pixel area 1313 are all spectral detection pixels 13131, that is, pixels A to L are all spectral detection pixels 13131. The first pixel area 1311 is complementary to the second pixel area 1313, and together they constitute a complete pixel array 131 area. In other words, the other areas of the pixel array 131 except the first pixel area 1311 are the second pixel area 1313.
[0033] Specifically, in some embodiments, the number of the first pixel area 1311 and the number of the second pixel area 1313 are both multiple, and the multiple second pixel areas 1313 are distributed at different positions of the pixel array 131. The spectrum detection pixels 13131 in the multiple second pixel areas 1313 are respectively used to detect the spectrum information of light at different positions in the current environment. The positions where the spectrum detection pixels 13131 can detect the spectrum information correspond to the positions where the spectrum detection pixels 13131 are distributed on the pixel array 131. Multiple depth detection pixels 13111 can collect depth information of more positions of an object, and multiple spectrum detection pixels 13131 can detect the spectrum information of light at more positions, and the results obtained are more accurate.
[0034] More specifically, in some embodiments, in order to make the distribution of the positions detectable by the spectrum detection pixels 13131 more uniform, at least one first pixel area 1311 is adjacent to at least one second pixel area 1313. The number of the second pixel areas 1313 may be one or more.
[0035] In the case where the number of the second pixel area 1313 is one, the second pixel area 1313 can be located at any position of the pixel array 131 and output a set of spectral data, which can be used to obtain the ambient light parameters of the current environment. In some embodiments, the second pixel area 1313 can be distributed in the middle of the pixel array 131. At this time, the spectral information of the light reflected by the object that the spectral detection pixel 13131 in the second pixel area 1313 can detect is relatively average, and the deviation is small. In an example, refer to Figure 4 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is less than the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, the second pixel area 1313 is embedded in the pixel array 131, and the second pixel area 1313 is surrounded by the depth detection pixels 13111 in the first pixel area 1311. In another example, see Figure 5 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is equal to the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, the second pixel area 1313 is arranged between the two first pixel areas 1311.
[0036] In other embodiments, the second pixel region 1313 may be distributed at the edge of the pixel array 131. In this case, the spectrum detection pixels 13131 in the second pixel region 1313 can detect the spectrum information of the light incident from the edge. When the ambient light source has different incident angles, the spectrum detection pixels 13131 distributed at the edge of the pixel array 131 can accurately detect the spectrum information of the ambient light source with different incident angles. In one example, see Figure 6 and Figure 7 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is less than the number of depth detection pixels 13111 in a single row of the first pixel area 1311. In this case, the second pixel area 1313 can be located at one of the four corners of the pixel array 131, or at the four edges of the pixel array 131. In another example, see Figure 8, the number of spectrum detection pixels 13131 in the second pixel area 1313 is equal to the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, only one side of the second pixel area 1313 is adjacent to the first pixel area 1311, and the other sides of the second pixel area 1313 are free sides that are not adjacent to the depth detection pixels 13111.
[0037] In the case where there are multiple second pixel areas 1313, the multiple second pixel areas 1313 can be distributed at any position of the pixel array 131 and can output multiple sets of spectral data, which can also be used to obtain ambient light parameters of the current environment. After obtaining multiple sets of spectral data, the processor 50 ( Fig.13 The ambient light information of different positions of the object can be obtained, and the shooting parameters of different positions can be adjusted accordingly, so that the generated image is closer to the real object. The multiple second pixel areas 1313 can be arranged adjacent to each other or spaced apart. In some embodiments, each second pixel area 1313 is adjacent to a first pixel area 1311. In one example, see Fig. 9 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is less than the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, each second pixel area 1313 is embedded in the pixel array 131, and each second pixel area 1313 is surrounded by depth detection pixels 13111 in the first pixel area 1311. In another example, see Figure 3 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is equal to the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, the edges of two opposite sides of each second pixel area 1313 are the edges of the pixel array 131 (i.e., the free sides not adjacent to the depth detection pixels 13111), and the other two opposite sides of each second pixel area 1313 are adjacent to the first pixel area 1311.
[0038] In other embodiments, at least two second pixel areas 1313 are arranged adjacent to each other, and all edges of at least two second pixel areas 1313 except adjacent edges are adjacent to the first pixel area 1311. In the case where there are two second pixel areas 1313, one side of one second pixel area 1313 is adjacent to another second pixel area 1313, and the spectrum detection pixels 13131 of the two second pixel areas 1313 are arranged adjacent to each other. The adjacently arranged second pixel areas 1313 can expand the area for receiving light, can receive more light, and the spectrum information obtained by the spectrum detection pixels 13131 is more accurate.
[0039] For an example, see Fig.10, the number of spectrum detection pixels 13131 in the second pixel area 1313 is less than the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, both non-adjacent edges of the two second pixel areas 1313 are adjacent to the depth detection pixels 13111.
[0040] In another example, see Fig.11 , the number of spectrum detection pixels 13131 in the second pixel area 1313 is equal to the number of depth detection pixels 13111 in a single row of the first pixel area 1311. At this time, the edges of two opposite sides of the two second pixel areas 1313 are the edges of the pixel array 131 (i.e., the free sides not adjacent to the depth detection pixels 13111), and one of the other opposite sides of one of the second pixel areas 1313, which is not adjacent to the other second pixel area 1313, is adjacent to the first pixel area 1311.
[0041] In some embodiments, the spectrum detection pixel 13131 is used to detect the spectrum information of light in the wavelength range of 350nm-1000nm. Since the spectrum detection pixel 13131 can detect the spectrum information of light in the wavelength range of 350nm-1000nm, the wavelength range of light that can be detected is relatively wide, covering ultraviolet light, visible light and near infrared light, so the ambient light parameters of the current environment obtained through the spectrum information are relatively accurate.
[0042] See also Figure 3 and Fig.12In some embodiments, the spectrum detection pixel 13131 includes a plurality of channels 1301, and different channels 1301 of the spectrum detection pixel 13131 receive light of different wavelengths. The number of channels 1301 may be 2, 3, 4, 5, 6, 7, 8, 9, 10 or more. The more channels 1301 there are, the wider the wavelength band of the light that can be detected is. For example, the present application takes 12 channels 1301 as an example, and each channel 1301 receives light of a different wavelength band. For example, the spectrum detection pixel 13131 of channel A 1301 receives light of a first wavelength band, the spectrum detection pixel 13131 of channel B 1301 receives light of a second wavelength band, the spectrum detection pixel 13131 of channel C 1301 receives light of a third wavelength band, the spectrum detection pixel 13131 of channel D 1301 receives light of a fourth wavelength band, the spectrum detection pixel 13131 of channel E 1301 receives light of a fifth wavelength band, the spectrum detection pixel 13131 of channel F 1301 receives light of a sixth wavelength band, and the spectrum detection pixel 13131 of channel G 1301 receives light of a sixth wavelength band. The spectral detection pixel 13131 receives light in the seventh band, the spectral detection pixel 13131 of the H channel 1301 receives light in the eighth band, the spectral detection pixel 13131 of the I channel 1301 receives light in the ninth band, the spectral detection pixel 13131 of the J channel 1301 receives light in the tenth band, the spectral detection pixel 13131 of the K channel 1301 receives light in the eleventh band, and the spectral detection pixel 13131 of the L channel 1301 receives light in the twelfth band. The first band to the twelfth band together constitute the full band range of light that can be detected by all the spectral detection pixels 13131 in the second pixel area 1313. For example, the band range constituted by the first band to the twelfth band is 350nm-1000nm. The wavelengths of light received by the spectral detection pixels 13131 of different channels 1301 are different, and the wavelengths of light received by the multi-channels 1301 together constitute the full-band range that can be detected by all the spectral detection pixels 13131 in the second pixel area 1313, which can ensure that the wavelength range of detectable light is relatively wide, covering ultraviolet light, visible light and near-infrared light. Therefore, the ambient light parameters of the current environment obtained through spectral information are more accurate.
[0043] Furthermore, in some embodiments, a diffusion layer 1303 may be provided on the spectrum detection pixel 13131, and the diffusion layer 1303 is used to diffuse the ambient light entering the spectrum detection pixel 13131. The provision of the diffusion layer 1303 allows the ambient light to enter the spectrum detection pixel 13131 uniformly, so that the spectrum detection pixel 13131 of each channel 1301 can receive substantially the same amount of light, and the spectrum detection pixel 13131 of each channel 1301 can output relatively accurate spectrum information, so that the ambient light parameters of the current environment obtained through relatively accurate spectrum information are also relatively accurate.
[0044] See also Figure 2 and Figure 3 In some embodiments, the detection module 10 ( Figure 1 131) further includes a first circuit 15 and a second circuit 17 independently provided with respect to the first circuit 15. The first circuit 15 is connected to the depth detection pixel 13111, and the first circuit 15 is used to output depth information. The second circuit 17 is connected to the spectrum detection pixel 13131, and the second circuit 17 is used to output spectrum information.
[0045] Among them, the independent setting of the first circuit 15 and the second circuit 17 means that the first circuit 15 and the second circuit 17 can be independently controlled respectively and do not interfere with each other. Specifically, in one example, when the first circuit 15 is controlled to work, the second circuit 17 is controlled not to work, that is, the first circuit 15 outputs depth information, and the second circuit 17 does not output spectral information. At this time, the detection module 10 can be simply in the depth detection mode. In another example, when the first circuit 15 is controlled not to work, the second circuit 17 is controlled to work, that is, the first circuit 15 does not output depth information, and the second circuit 17 outputs spectral information. At this time, the detection module 10 can be simply in the spectral detection mode. In another example, when the first circuit 15 is controlled to work, the second circuit 17 is also controlled to work, that is, the first circuit 15 outputs depth information, and the second circuit 17 outputs spectral information. At this time, the detection module 10 can be in a common detection mode, and the depth information output by the first circuit 15 is used to communicate with the camera module 30 ( Fig.13 The spectral information output by the second circuit 17 is combined with the image information obtained by the first circuit 15 (shown), and the spectral information output by the second circuit 17 is used to obtain the ambient light parameters of the current environment. In another example, when the first circuit 15 is controlled not to work, the second circuit 17 is also controlled not to work, that is, the first circuit 15 does not output depth information, and the second circuit 17 does not output spectral information. At this time, the detection module 10 can be in a non-detection mode.
[0046] See also Figure 1 and Fig.13 The image acquisition device 100 of the embodiment of the present application includes the detection module 10 and the camera module 30 of any of the above-mentioned embodiments, and the camera module 30 is used for shooting to obtain image information.
[0047] Please combine Figure 3In the image acquisition device 100 of the present application, the camera module 30 can obtain image information of the current environment, the depth detection pixels 13111 of the detection module 10 can obtain depth information of different positions of the object, and the spectral detection pixels 13131 of the detection module 10 can obtain spectral information of different positions of the object. The image acquisition device 100 can respectively align the depth information and the spectral information with the image information obtained by the camera module 30, and correct the color, outline or shadow of different positions of the object in the image information according to different spectral information and depth information.
[0048] Specifically, in some embodiments, the camera module 30 may be a camera with variable focus. Specifically, the camera module 30 may also include a lens, a driver connected to the lens and the processor 50, the processor 50 is used to control the driver, and the driver is used to drive the lens to move along the optical axis of the lens to achieve focus or zoom function. Of course, in other embodiments, the camera module 30 may also be a fixed focus camera.
[0049] See also Figure 3 and Fig.13 , and combined with Figure 1 In some embodiments, the image acquisition device 100 may further include a processor 50 connected to the detection module 10 and the camera module 30 respectively. The first circuit 15 connects the depth detection pixel 13111 and the processor 50, and the first circuit 15 is used to transmit the depth information to the processor 50. The processor 50 is used to process the image information and the depth information to obtain a depth image. The depth image is image data with three-dimensional coordinate information of the object in the image obtained by aligning the image information obtained by the camera module 30 with the depth information obtained by the depth detection pixel 13111.
[0050] Furthermore, in some embodiments, the image information includes a face, and the image acquisition device 100 can be used to implement a face recognition function. Before using the face recognition function, the user can store a preset image template in the processor 50, and the image acquisition device 100 can obtain preset depth information and preset image information of each angle of the face through the detection module 10 and the camera module 30, and the processor 50 can align the above depth information and image information with each other to obtain a preset image template and a preset depth template containing the user's face information.
[0051] During the face recognition process, the processor 50 is also used to match the image information and the preset image template. If the image information does not match the preset image template, the processor 50 determines that the face recognition has failed and sends a prompt signal to the user. The way of sending the prompt signal includes but is not limited to popping up a warning window on the display screen, issuing a sound warning, or issuing a light flashing reminder. If the image information and the image template match successfully, the processor 50 further matches the depth information in the depth image and the depth template preset in the processor 50. If the depth information does not match the preset depth template, the object for face recognition may be a picture or a photo. At this time, the processor 50 determines that the face recognition has failed and sends a prompt signal to the user. If the depth information matches the preset depth template successfully, the processor 50 determines that the face recognition is successful, and the processor 50 sends a signal to guide the user to perform the next operation or control the unlocking.
[0052] When the camera module 30 is in the recording mode, the processor 50 is also used to identify the face and the orientation of the face in the image information. Since the processor 50 stores preset depth templates and preset image templates of multiple angles of the face, the processor 50 can compare the detected depth information and image information with the preset depth template and the preset image template respectively to determine the orientation information of the face at this time.
[0053] After obtaining the face orientation information, the processor 50 can combine the face orientation information with the image information and determine the area of the face orientation in the image information. The processor 50 can also perform feature detection on objects in the area of the face orientation in the image information, and the feature detection data includes the depth information and image information of the object. Since the processor 50 is preset with a preset algorithm for identifying a specific object, and the preset algorithm has a feature template containing information such as the depth information and image information of the specific object, when the preset feature template of the object matches the features such as the depth information and image information of the object in the area of the face orientation in the image information, the processor 50 controls the driver of the camera module 30 to drive the lens of the camera to move along the direction of the optical axis, and uses the object as the focus area of the camera module 30.
[0054] In some embodiments, the second circuit 17 connects the spectrum detection pixel 13131 and the processor 50, and the second circuit 17 is used to transmit the spectrum information to the processor 50. The processor 50 is also used to obtain the ambient light parameters of the current environment according to the spectrum information, and adjust the shooting parameters of the camera module 30 according to the ambient light parameters. In the case where there are multiple second pixel areas 1313, each second pixel area 1313 can output a set of spectrum data to the processor 50, and the spectrum information includes multiple sets of spectrum data from multiple second pixel areas 1313. The processor 50 is used to process multiple sets of spectrum data to obtain the ambient light parameters of different positions in the current environment.
[0055] Furthermore, in some embodiments, the ambient light parameter includes an ambient light color temperature; each second pixel area 1313 at a different position corresponds to an ambient light color temperature. The processor 50 is preset with a mapping relationship between the ambient light color temperature and the white balance correction parameter. The processor 50 can adjust the white balance correction parameter of the area corresponding to the second pixel area 1313 in the image information according to each ambient light color temperature, so that the obtained image is closer to the real environment. The image after white balance correction can be directly output and displayed on the electronic device 1000 ( Fig.14 ) on the display screen of the electronic device 1000 ( Fig.14 Alternatively, the image after white balance correction may be processed by a series of other subsequent image processing methods and then directly output and displayed on the electronic device 1000 ( Fig.14 ) on a display screen of the electronic device 1000 ( Fig.14 The subsequent image processing method includes but is not limited to black level processing and shadow correction.
[0056] Specifically, when the image acquisition device 100 is in the photographing mode, each second pixel area 1313 can collect spectral data at different positions in the current environment. Since there may be multiple light sources in the current environment, the color of the object surface may deviate, and the edge contour of the object may also be blurred. The processor 50 can derive different ambient light color temperatures based on the spectral data at different positions, and then call different white balance correction parameters according to each ambient light color temperature.
[0057] For example, when the electronic device 100 takes a photo of a person, the first pixel area 1311 can obtain the depth information of the face (i.e., the three-dimensional structural information such as depressions or protrusions on the face), and the depth information is aligned with the image information obtained by the camera module 30. The appearance of the face is corrected according to the depth information of the face and the preset algorithm in the processor 50, for example, beautification is performed to smooth out the acne on the face. The second pixel area 1313 can obtain the spectral information of different positions of the face, and the depth information and spectral information can be aligned with the image information obtained by the camera module 30 respectively. Different white balance correction parameters are applied according to different spectral information at different positions of the face to achieve accurate restoration or beautification of the skin color of each part of the face.
[0058] See also Fig.14 The electronic device 1000 of the embodiment of the present application includes a main body 200 and the image acquisition device 100 of the above embodiment, and the image acquisition device 100 is combined with the main body 200.
[0059] In summary, in the electronic device 1000 of the present application, the depth detection pixel 13111 can collect the distances from multiple points on the object to the detection module 10 and obtain the depth information of the object accordingly. The spectral detection pixel 13131 can detect the spectral information of multiple positions on the surface of the object. When multiple light sources are irradiated on the surface of the object, the depth information obtained by the depth detection pixel 13111 can be combined with the spectral information obtained by the spectral detection pixel 13131, and the spectral recognition of the surface of the object is more accurate. The combination of depth information and spectral information can also be used as a basis for adjusting the shooting parameters at different positions, thereby adjusting different shooting parameters for different areas of the image.
[0060] In the description of this specification, the descriptions with reference to the terms "certain embodiments", "in an example", "exemplarily", etc., mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.
[0061] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A detection module, characterized in that: include: A transmitter, the transmitter is used to send a signal to the object; and A receiving end is provided with a pixel array, the pixel array includes a first pixel area and a second pixel area, depth detection pixels are distributed in the first pixel area, and the depth detection pixels are used to receive the signal emitted by the transmitting end and reflected by the object back to the receiving end to obtain the depth information of the object; spectrum detection pixels are distributed in the second pixel area, and the spectrum detection pixels are used to detect the spectrum information of the ambient light in the current environment.
2. The detection module according to claim 1, characterized in that: There are multiple first pixel areas and multiple second pixel areas, and the multiple second pixel areas are distributed at different positions of the pixel array. The spectral detection pixels in the multiple second pixel areas are respectively used to detect spectral information of light at different positions in the current environment.
3. The detection module according to claim 2, characterized in that: At least one of the first pixel regions is adjacent to at least one of the second pixel regions.
4. The detection module according to claim 1, characterized in that: The spectrum detection pixel includes a plurality of channels, and different channels of the spectrum detection pixel receive light with different wavelengths.
5. The detection module according to claim 4, characterized in that: The spectrum detection pixel is provided with a diffusion layer, and the diffusion layer is used to diffuse the ambient light entering different channels of the spectrum detection pixel through the diffusion layer.
6. The detection module according to claim 1, characterized in that: The spectrum detection pixel is used to detect spectrum information of light in the wavelength range of 350nm-1000nm.
7. The detection module according to claim 1, characterized in that: The detection module also includes: a first circuit, the first circuit being connected to the depth detection pixel, and the first circuit being configured to output the depth information; and The second circuit is independent of the first circuit, the second circuit is connected to the spectrum detection pixel, and the second circuit is used to output the spectrum information.
8. An image acquisition device, characterized in that: include: The detection module according to any one of claims 1 to 7; and A camera module is used for shooting to obtain image information.
9. The image acquisition device according to claim 8, characterized in that: The image acquisition device also includes: A processor is connected to the detection module and the camera module respectively, and is used to process the image information and the depth information to obtain a depth image.
10. The image acquisition device according to claim 9, characterized in that: The image information includes a face; the processor is also used to match the image information with a preset image template, and when the image information and the image template match successfully, match the depth information in the depth image with a preset depth template to perform face recognition.
11. The image acquisition device according to claim 9, characterized in that: The image information includes a human face; when the camera module is in a recording mode, the processor is further used to: Identifying a face in the image information and the orientation of the face; Performing feature detection on objects in the area in which the face of the person is facing in the image information; and When the feature information matches the feature template in the preset algorithm, the object is used as the focus area of the camera module.
12. The image acquisition device according to claim 9, characterized in that: The processor is also used to obtain ambient light parameters of the current environment according to the spectral information, and adjust the photographing parameters of the camera module according to the ambient light parameters.
13. The image acquisition device according to claim 12, characterized in that: When there are multiple second pixel areas, each second pixel area outputs a set of spectral data, and the spectral information includes multiple sets of spectral data from multiple second pixel areas; the processor is used to process the multiple sets of spectral data to obtain ambient light parameters at different positions of the current environment.
14. The image acquisition device according to claim 13, characterized in that: The ambient light parameter includes the ambient light color temperature; each of the second pixel areas at different positions corresponds to one of the ambient light parameters, and the processor is used for: The white balance correction parameter of the area corresponding to the second pixel area in the image information is adjusted according to each of the ambient light color temperatures.
15. An electronic device, characterized in that: The electronic device comprises: the entity; and The image acquisition device described in claims 8-14 is combined with the main body.
