Imaging module, electronic device, control method, device and medium

Abstract

The present application discloses an imaging module, an electronic device, a control method and a device, which belong to the field of camera technology. The imaging module includes: a housing, the housing has a light-transmitting area and an inner cavity; a reflective element, the reflective element is arranged in the inner cavity, and the reflective element includes at least two reflectors; an image sensor, the image sensor is arranged in the inner cavity; any of the at least two reflectors can move relative to the housing; a target reflective surface reflects light entering the light-transmitting area to the image sensor; the target reflective surface is composed of the reflective surfaces of at least two reflectors.

Description

Technical Field

[0001] The present application belongs to the field of camera technology, and specifically relates to an imaging module, electronic equipment, control method, device and medium. Background Art

[0002] Typically, when a user uses an electronic device to shoot a distant subject, the user can aim the telephoto camera of the electronic device at the subject, so that the telephoto camera of the electronic device can receive reflected light reflected by the subject, and output an image of the subject based on the reflected light to obtain the image required by the user.

[0003] However, since the distance between the subject and the telephoto camera is relatively far, the reflected light may be affected by environmental factors, which may cause the reflected light to change, resulting in an unclear captured image.

[0004] This results in poor photographing effect when the electronic device photographs distant objects. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an imaging module, an electronic device, a control method, a device and a medium, which can solve the problem that the electronic device has poor shooting effect when shooting objects at a long distance.

[0006] In the first aspect, the embodiment of the present application provides an imaging module, which includes a housing, the housing having a light-transmitting area and an inner cavity; a reflective element, the reflective element is arranged in the inner cavity, the reflective element includes at least two reflectors; and an image sensor, the image sensor is arranged in the inner cavity. Any of the at least two reflectors can move relative to the housing; the target reflective surface reflects the light entering the light-transmitting area to the image sensor, wherein the target reflective surface is composed of the reflective surfaces of at least two reflectors.

[0007] In a second aspect, an embodiment of the present application provides an electronic device, which includes the imaging module as described in the first aspect.

[0008] In a third aspect, an embodiment of the present application provides a control method, which is applied to the electronic device as described in the second aspect, and the method includes: acquiring image information collected by an imaging module of the electronic device; determining the wavefront distortion information of light according to the image information, the light being: light entering from the light-transmitting area of ​​the imaging module and reflected to the image sensor of the imaging module by the target reflection surface of the reflection element of the imaging module; based on the wavefront distortion information, controlling at least two reflectors of the reflection element to move to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light. Wherein, the surface shape includes at least one of a shape and a curvature.

[0009] In a fourth aspect, an embodiment of the present application provides a control device, which includes: an acquisition module and a processing module. The acquisition module is used to acquire image information collected by the imaging module of the control device. The processing module is used to determine the wavefront distortion information of the light according to the image information acquired by the acquisition module, and the light is: the light entering from the light-transmitting area of ​​the imaging module and reflected from the target reflection surface of the reflection element of the imaging module to the image sensor of the imaging module; and based on the wavefront distortion information, control at least two reflectors of the reflection element to move to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light. The surface shape includes at least one of a shape and a curvature.

[0010] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the third aspect are implemented.

[0011] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the third aspect are implemented.

[0012] In a seventh aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the third aspect.

[0013] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the third aspect.

[0014] In an embodiment of the present application, the imaging module includes a shell having a light-transmitting area and an inner cavity, a reflective element disposed in the inner cavity and including at least two reflectors, and an image sensor disposed in the inner cavity, so that the target reflective surface of the reflective element, which is composed of the reflective surfaces of at least two reflectors, can reflect the light entering the light-transmitting area to the image sensor. Among them, any of the at least two reflectors can move relative to the shell. Since any of the at least two reflectors can move relative to the shell, the target reflective surface can be adjusted by the movement of the reflector, so that the wavefront of the light entering the light-transmitting area can be corrected and reflected to the image sensor, so that the image sensor outputs a clear image. In this way, the shooting effect of shooting a distant object can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1It is one of the structural schematic diagrams of the imaging module provided in the embodiment of the present application;

[0016] Figure 2 is a cross-sectional schematic diagram of an imaging module provided in an embodiment of the present application;

[0017] Figure 3 is an exploded schematic diagram of an imaging module provided in an embodiment of the present application;

[0018] Figure 4 is a schematic diagram of the movement of the reflector provided in an embodiment of the present application;

[0019] Figure 5 This is the second structural schematic diagram of the imaging module provided in the embodiment of the present application;

[0020] Figure 6 It is one of the structural schematic diagrams of the electronic device provided in the embodiment of the present application;

[0021] Figure 7 It is one of the schematic diagrams of the control method provided in the embodiment of the present application;

[0022] Figure 8 This is the second schematic diagram of the control method provided in the embodiment of the present application;

[0023] Fig. 9 This is the third schematic diagram of the control method provided in the embodiment of the present application;

[0024] Fig.10 It is a schematic diagram of image acquisition by a control device provided in an embodiment of the present application.

[0025] Fig.11 is a schematic diagram of the structure of a control device provided in an embodiment of the present application;

[0026] Fig.12 This is the second structural diagram of the electronic device provided in the embodiment of the present application;

[0027] Fig.13 It is a hardware schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0030] The imaging module, electronic device, control method, device and medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0031] The embodiments of the present application are applied to a scenario in which a user takes an image of a distant object.

[0032] Suppose a user wants to take a picture of a distant object, then the user can adjust the phone to super telephoto mode, so that the distant object can be photographed. However, due to the long distance, it will be affected by near-ground atmospheric turbulence, that is, due to the different temperatures and densities of the air in different areas, the refractive index of the air in different areas will be different. Therefore, when the light is emitted from the object to the camera lens, it will cause the wavefront distortion of the light. In this way, when the mobile phone takes pictures of distant objects, the captured image will be unclear.

[0033] However, in the embodiment of the present application, the target reflection surface of the reflection unit in the imaging module is composed of the reflection surfaces of at least two reflection mirrors, and any one of the at least two reflection mirrors can move relative to the housing. Therefore, the target reflection surface can be adjusted by the movement of the reflection mirror, so that the wavefront of the light entering from the light-transmitting area can be corrected and then reflected to the image sensor, so that the image sensor outputs a clear image. In this way, the shooting effect of shooting a distant object can be improved.

[0034] Figure 1 A possible structural diagram of an imaging module provided in an embodiment of the present application is shown. Figure 1 As shown, the imaging module may include: a shell 10 having a light-transmitting area 101 and an inner cavity 102 ; a reflective element 11 disposed in the inner cavity 102 ; and an image sensor 12 disposed in the inner cavity 102 .

[0035] Optionally, in the embodiment of the present application, the imaging module may specifically be: a periscope imaging module.

[0036] It should be noted that in order to more clearly illustrate the imaging module provided in the embodiment of the present application, Figure 2 shows a cross-sectional schematic diagram of an imaging module, Figure 3 FIG. 2 shows an exploded schematic diagram of an imaging module. Figure 2 and Figure 3 As shown, the imaging module includes: a shell 10 , a reflective element 11 and an image sensor 12 , wherein the shell 10 has a light-transmitting area 101 and an inner cavity 102 , and the reflective element 11 and the image sensor 12 are both arranged in the inner cavity 102 .

[0037] Optionally, in the embodiment of the present application, the housing 10 may be made of metal or plastic, which is not specifically limited in the embodiment of the present application.

[0038] Optionally, in the embodiment of the present application, the light-transmitting area 101 may be: an area where a light-transmitting unit is located on the housing 10. The light-transmitting unit may be any one of the following: light-transmitting glass, light-transmitting plastic plate, window, etc.

[0039] Optionally, in the embodiment of the present application, the housing 10 may specifically include: a bracket and an upper cover, wherein the bracket includes an inner cavity 102, and the upper cover is provided with a light-transmitting area 101.

[0040] It can be understood that the various components within the housing 10 can be protected by the bracket.

[0041] In the embodiment of the present application, the reflective element 11 includes at least two reflectors, and the target reflective surface 111 of the reflective element 11 is composed of reflective surfaces of at least two reflectors. Any one of the at least two reflectors can move relative to the housing 10.

[0042] Optionally, in the embodiment of the present application, the reflective element 11 may include a base and at least two reflectors.

[0043] Optionally, in the embodiment of the present application, the target reflection surface 111 of the reflection element 11 is a reflection surface that can reflect light, and is composed of the reflection surfaces of the at least two reflection mirrors.

[0044] Further optionally, in the embodiment of the present application, each of the at least two reflectors can move relative to each other, so that the reflective element 11 can control the movement of the at least two reflectors through the base to adjust the surface shape of the target reflective surface 111. Further optionally, in the embodiment of the present application, each of the at least two reflectors can be deflected or moved in different directions under the control of the base to move.

[0045] For example, Figure 4 FIG. 1 shows a schematic diagram of the movement of the reflector of the reflective element 11. Figure 4As shown, for each of the at least two reflectors of the reflective element 11, one reflector (eg, the reflector 13) can be deflected along the X-axis direction, and / or along the Y-axis direction, and / or along the Z-axis direction.

[0046] Further optionally, in the embodiment of the present application, the reflective element 11 may specifically be: a micro-mirror array device.

[0047] Optionally, in the embodiment of the present application, the reflective element 11 may also be connected to a processing unit, wherein the processing unit may specifically be: a wavefront distortion detection and correction algorithm unit, and the processing unit may send wavefront distortion information to the reflective element 11 .

[0048] In the embodiment of the present application, the target reflective surface 111 reflects the light entering from the light-transmitting area 101 to the image sensor 12 .

[0049] Optionally, in the embodiment of the present application, the image sensor 12 may include: a telephoto lens, a telephoto imaging sensor and a sensor circuit board.

[0050] Among them, the telephoto lens and the telephoto imaging sensor are arranged opposite to each other, and the telephoto imaging sensor is electrically connected to the sensor circuit board, so that light can enter the telephoto imaging sensor from the telephoto lens to obtain an image, and the image is output through the sensor circuit board.

[0051] Optionally, in the embodiment of the present application, the image sensor 12 may also be connected to a processing unit, so that the image sensor 12 may output an image to the processing unit, so that the processing unit may obtain wavefront distortion information.

[0052] Further optionally, in the embodiment of the present application, the sensor circuit board of the image sensor 12 may be electrically connected to the processing unit.

[0053] Optionally, in the embodiment of the present application, the image sensor 12 is disposed on the inner wall of one end of the inner cavity 102 ; and the reflective element 11 is disposed at a first position at the other end of the inner cavity 102 .

[0054] In the embodiment of the present application, the first position is the position to which the light-transmitting area 101 and the image sensor 12 are both facing.

[0055] It can be seen that since the image sensor and the reflective element can be respectively arranged at the two ends of the inner cavity, so that the light can directly enter the image sensor after being reflected by the target reflective surface of the reflective element, the space utilization rate in the cavity can be improved.

[0056] Optionally, in an embodiment of the present application, the above-mentioned reflective element 11 can adjust the surface shape of the target reflective surface 111 based on the wavefront distortion information of the light; the wavefront distortion information is determined based on the image.

[0057] Optionally, in the embodiment of the present application, the wavefront distortion information is obtained by: the processing unit detecting an image output by the image sensor 12 .

[0058] Further optionally, after the processing unit obtains the wavefront distortion information, the processing unit can determine the motion parameters of each of the at least two reflectors based on the distortion information and the current surface shape of the target reflective surface 111, and generate a control signal based on the motion parameters of each reflector, so that the processing unit can send the control signal to the reflective element 11, so that the base of the reflective element 11 can control the movement of each reflector according to the control signal to adjust the surface shape of the target reflective surface 111.

[0059] In the embodiment of the present application, since the light may be affected by environmental factors (such as atmospheric turbulence) and may experience wavefront distortion, the reflective element 11 can adjust the surface shape of the target reflective surface 111 based on the wavefront distortion information of the light to compensate for the wavefront distortion of the light.

[0060] The imaging module provided in the embodiment of the present application includes a shell having a light-transmitting area and an inner cavity, a reflective element disposed in the inner cavity and including at least two reflectors, and an image sensor disposed in the inner cavity, so that the target reflective surface of the reflective element, which is composed of the reflective surfaces of at least two reflectors, can reflect the light entering the light-transmitting area to the image sensor. Among them, any of the at least two reflectors can move relative to the shell. Since any of the at least two reflectors can move relative to the shell, the target reflective surface can be adjusted by the movement of the reflector, so that the wavefront of the light entering from the light-transmitting area can be corrected and reflected to the image sensor, so that the image sensor outputs a clear image. In this way, the shooting effect of shooting a distant object can be improved.

[0061] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 5 As shown, the imaging module further includes an anti-shake element 14 , which is disposed on the inner wall of the inner cavity 102 .

[0062] Further optionally, in the embodiment of the present application, the anti-shake element 14 may specifically be: a bracket with an optical image stabilization (OIS) function.

[0063] In the embodiment of the present application, the first surface of the reflective element 11 is connected to the anti-shake element 14 ; the first surface is: a surface away from the target reflective surface 111 .

[0064] It can be understood that the reflective element 11 is fixed to the inner wall of the inner cavity 102 through the anti-shake element 14 .

[0065] Further optionally, in the embodiment of the present application, the anti-shake element 14 is fixed at a first position at the other end of the inner cavity 102 .

[0066] It can be seen that since the imaging module is also provided with an anti-shake element, and the reflective element is fixed to the inner wall of the inner cavity through the anti-shake element, it is possible to avoid the situation where the captured image is unclear due to the shaking of the user's hands. In this way, the shooting effect of shooting distant objects can be improved.

[0067] Figure 6 A possible structural diagram of an electronic device provided in an embodiment of the present application is shown. Figure 6 As shown, the electronic device 20 may include the imaging module 21 in the above embodiment.

[0068] Optionally, in an embodiment of the present application, the processor 22 of the electronic device 20 can be electrically connected to the imaging module 21, so that the image sensor 12 of the imaging module 21 can output the image to the processor 22, so that the processor 22 can obtain wavefront distortion information.

[0069] It can be understood that the processor 22 may include the processing unit in the above-mentioned embodiment.

[0070] The electronic device provided in the embodiment of the present application includes an imaging module. Since any of the at least two reflectors of the imaging module can move relative to the housing, the target reflection surface can be adjusted by the movement of the reflector, so that the wavefront of the light entering from the light-transmitting area can be corrected and then reflected to the image sensor, so that the image sensor outputs a clear image. In this way, the shooting effect of shooting a distant object can be improved.

[0071] Furthermore, since the electronic device can obtain the wavefront distortion information through the processor of the electronic device without providing a wavefront sensor, the structure of the electronic device can be simplified, thus reducing the size of the electronic device.

[0072] Figure 7 FIG. 1 is a flow chart of a control method provided by an embodiment of the present application. Figure 7 As shown, the control method provided in the embodiment of the present application may include the following steps 101 to 103.

[0073] Step 101: A control device obtains image information collected by an imaging module of the control device.

[0074] Optionally, in an embodiment of the present application, when the control device turns on the telephoto shooting mode, the control device can switch the camera module to an imaging module so that the image sensor of the imaging module is powered on, so that the control device can collect image information through the imaging module.

[0075] Optionally, in an embodiment of the present application, the above-mentioned image information is used to determine the wavefront distortion information of the light.

[0076] It can be understood that the above image information is a wavefront distortion detection image.

[0077] Optionally, in the embodiment of the present application, the above-mentioned image information may be: all continuous images, or all discontinuous images, or partially discontinuous images.

[0078] Exemplarily, assuming that the above-mentioned image information includes a first frame image, a second frame image and a third frame image, the first frame image, the second frame image and the third frame image are all continuous images.

[0079] Assuming that the above image information includes the first frame image, the third frame image and the fifth frame image, the first frame image, the third frame image and the fifth frame image are all discontinuous images.

[0080] Assuming that the above image information includes the first frame image, the third frame image and the fourth frame image, the first frame image, the third frame image and the fourth frame image are partially discontinuous images.

[0081] Further optionally, in an embodiment of the present application, when the above-mentioned image information is a completely discontinuous image (or a partially discontinuous image), the control device may first capture a portion of the images in the above-mentioned image information, and capture a portion of the images in other images, and then capture another portion of the images in the image information, and capture another portion of the images in the other images, and so on, to capture the above-mentioned image information.

[0082] Optionally, in an embodiment of the present application, the control device may adopt a high-speed downsampling mode to collect image information.

[0083] It should be noted that the above-mentioned "high-speed downsampling mode" can be understood as: a mode of capturing an image at a high frame rate (for example, a frame rate greater than or equal to a preset value) and downsampling the image. The downsampling process can be achieved by binning or interval sampling of pixels. It can be understood that by adopting the high-speed downsampling mode, the control device can capture a large number of images that occupy less storage space and can reflect the degree of wavefront distortion of light.

[0084] Step 102: The control device determines the wavefront distortion information of the light according to the image information.

[0085] In the embodiment of the present application, the above-mentioned light is: light that enters from the light-transmitting area of ​​the imaging module and is reflected by the target reflection surface of the reflection element of the imaging module to the image sensor of the imaging module.

[0086] In the embodiment of the present application, the above-mentioned wavefront distortion information is used to indicate the distortion amount of the wavefront of the light.

[0087] Optionally, in an embodiment of the present application, the control device may use an image quality evaluation function to determine the wavefront distortion information of the light according to the above-mentioned image information.

[0088] The image quality evaluation function may include at least one of the following: a genetic algorithm, a simulated annealing algorithm, and a random parallel gradient descent algorithm.

[0089] It should be noted that for the description of the above algorithm, reference may be made to the specific description in the related art, and the embodiments of the present application will not be elaborated here.

[0090] Step 103: The control device controls at least two reflectors of the reflective element to move based on the wavefront distortion information to adjust the surface shape of the target reflective surface, thereby compensating for the wavefront distortion of the light.

[0091] In the embodiment of the present application, the surface type includes at least one of a shape and a curvature.

[0092] Optionally, in an embodiment of the present application, the control device can determine the target surface shape of the target reflection surface based on the wavefront distortion information, and then determine the adjustment parameters of the target reflection surface based on the current surface shape and the target surface shape of the target reflection surface, so that the control device can control at least two mirrors of the reflection element to move according to the adjustment parameters to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light.

[0093] It can be understood that the surface shape of the adjusted target reflection surface is the target surface shape.

[0094] Further optionally, in the embodiment of the present application, when the target reflective surface includes at least two reflectors, the adjustment parameter may specifically be a motion parameter of the at least two reflectors.

[0095] The motion parameter may include at least one of the following: direction, distance, etc. of the position of the at least two reflectors before adjustment.

[0096] Optionally, in the embodiment of the present application, specifically, in combination with Figure 7 ,like Figure 8As shown, the above step 103 can be specifically implemented through the following steps 103a and 103b.

[0097] Step 103a: The control device determines the motion parameters of each of the at least two reflectors according to the wavefront distortion information.

[0098] Further optionally, in an embodiment of the present application, the control device can determine the target position information of each of the at least two reflectors based on the target surface shape of the target reflective surface, and then determine the first position information of each reflector based on the current surface shape of the target reflective surface, so that the control device can determine the motion parameters of each reflector based on the target position information and the first position information of each reflector.

[0099] Step 103b: The control device controls each reflector to move according to corresponding motion parameters through the reflective element.

[0100] Further optionally, in an embodiment of the present application, the control unit can generate a control signal based on the motion parameters of each reflector, and send the control signal to the reflective element, so that the reflective element can control each reflector to move according to the corresponding motion parameters through the base based on the control information.

[0101] It can be seen that, since the control device can determine the motion parameters of each reflector according to the wavefront distortion information, the control device can accurately control the movement of each reflector through the reflective element to accurately compensate for the wavefront distortion of the light.

[0102] In the control method provided by the embodiment of the present application, the control device can obtain the image information collected by the imaging module of the control device, and determine the wavefront distortion information of the light entering from the light-transmitting area of ​​the imaging module and reflected to the image sensor of the imaging module by the target reflection surface of the reflection element based on the image information, so that the control device can control the at least two reflection mirrors of the reflection element to move through the reflection element based on the wavefront distortion information to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light. Since the control device can first obtain at least one frame of image collected by the imaging module, and determine the wavefront distortion information of the light based on the at least one frame of image, then the control device can control the at least two reflection mirrors of the reflection element to move through the reflection element based on the wavefront distortion information to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light, that is, the light reflected by the adjusted target reflection surface will not change, so the situation that the obtained captured image is not clear can be avoided, so that the shooting effect of the control device shooting a distant object can be improved.

[0103] Furthermore, since the control device can directly obtain the wavefront distortion information without setting up a wavefront sensor, the structure of the control device can be simplified, thus reducing the size of the control device.

[0104] Of course, the imaging module of the control device can also collect other images while collecting image information, and display the other images in the shooting preview interface so that the user is unaware of the process of compensating the wavefront distortion of the light. Specific examples will be given below to illustrate this.

[0105] Optionally, in the embodiment of the present application, combined with Figure 7 ,like Fig. 9 As shown, before the above step 101, the control method provided in the embodiment of the present application may further include the following step 201, and the above step 101 may be specifically implemented by the following step 101a.

[0106] Step 201: When displaying the shooting preview interface, the control device collects M frames of images through the imaging module.

[0107] In the embodiment of the present application, the above-mentioned M frames of images include image information, and M is a positive integer.

[0108] Further optionally, in an embodiment of the present application, when the control device displays the desktop, the control device can open the target application based on the user's click input of the identifier (such as an icon) of the target application in the desktop to display a shooting preview interface, so that the control device can capture M frames of images.

[0109] Specifically, the target application can be any of the following: shooting applications, image processing applications, social applications, short video interaction applications, etc.

[0110] In the embodiment of the present application, the M frames of images include: image information and other images (such as the target image in the following embodiment). The other images may include at least one frame of image.

[0111] Further optionally, in an embodiment of the present application, the control device may configure the image sensor according to the zoom ratio set by the control device to capture other images through the image sensor, and adopt a high-speed downsampling mode to capture image information through the image sensor.

[0112] It can be understood that the control device can alternately collect image information and other images through the image sensor.

[0113] For example, assume that the other images include two frames of other images. Fig.10 FIG. 4 shows a schematic diagram of M frames of images collected by the control device. Fig.10As shown, the control device can configure the image sensor according to the set zoom ratio to collect a frame of other image f(n) through the image sensor, and adopt a high-speed downsampling mode to collect image information (i.e., F(1)~F(N)) through the image sensor. Then the control device can configure the image sensor according to the set zoom ratio again to collect another frame of other image f(n+1) through the image sensor, so as to collect M frames of images.

[0114] Step 101a: The control device determines image information from M frames of images to obtain image information.

[0115] Further optionally, in an embodiment of the present application, when the control device captures M frames of images, it can add an identifier (such as a frame header) to each frame of the M frames of images, so that the control device can determine the image information based on the identifier of the M frames of images.

[0116] Specifically, the control device may determine, from the M frames of images, image information whose identifier matches (eg is the same as) a preset identifier.

[0117] It can be seen that since the control device compensates for the wavefront distortion of light only when it is necessary to capture an image, it is possible to avoid high power consumption caused by the control device compensating for the wavefront distortion of light when it is not necessary to capture an image. In this way, the power consumption of the control device can be reduced.

[0118] Optionally, in the embodiment of the present application, after the above step 201, the control method provided in the embodiment of the present application may further include the following step 301.

[0119] Step 301: The control device displays a target image in a shooting preview interface.

[0120] In the embodiment of the present application, the target image is: the image other than the image information in the M frames of images.

[0121] It should be noted that the execution order of the above steps 101a and 301 is not limited in the embodiment of the present application.

[0122] In one possible implementation, the control device may first execute step 101a and then execute step 301; in another possible implementation, the control device may first execute step 301 and then execute step 101a; in yet another possible implementation, the control device may execute step 301 while executing step 101a.

[0123] Further optionally, in the embodiment of the present application, the target image may include at least one frame of image, wherein the at least one frame of image may be: a completely continuous image, a completely discontinuous image, or a partially discontinuous image.

[0124] Further optionally, in an embodiment of the present application, the control device can first display the target image (i.e., the preview image) in the shooting preview interface, so that the user can view the target image and adjust the framing range of the control device. At the same time, the control device can determine the image information to compensate for the wavefront distortion of the light. That is, while the user adjusts the framing range of the control device, the control device can compensate for the wavefront distortion of the light. Therefore, after the user has adjusted the framing range and needs to shoot an image, the image displayed in the shooting preview interface will not be unclear due to the wavefront distortion of the light, that is, the user can directly trigger the control device to shoot the image.

[0125] It can be seen that since the control device can directly display the image other than the image information in the M frame image in the shooting preview interface, it can avoid the situation where it takes a long time to display the preview image in the shooting preview interface due to the wavefront distortion of the compensation light. In this way, the efficiency of the control device in shooting images can be improved.

[0126] Fig.11 A possible structural diagram of the control device involved in the embodiment of the present application is shown. Fig.11 As shown, the control device 60 may include: an acquisition module 61 and a processing module 62 .

[0127] The acquisition module 61 is used to acquire the image information collected by the imaging module of the control device. The processing module 62 is used to determine the wavefront distortion information of the light according to the image information acquired by the acquisition module, and the light is: the light entering from the light-transmitting area of ​​the imaging module and reflected to the image sensor of the imaging module by the target reflection surface of the reflection element of the imaging module; and based on the wavefront distortion information, at least two reflectors of the reflection element are controlled to move through the reflection element to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light. The surface shape includes at least one of a shape and a curvature.

[0128] The control device provided in the embodiment of the present application can first obtain at least one frame of image captured by the imaging module, and determine the wavefront distortion information of the light according to the at least one frame of image. Then, based on the wavefront distortion information, the control device can control the movement of at least two reflectors of the reflective element through the reflective element to adjust the surface shape of the target reflective surface, thereby compensating for the wavefront distortion of the light. That is, the light reflected by the adjusted target reflective surface does not change. Therefore, the situation in which the captured image is unclear can be avoided. In this way, the shooting effect of the control device for shooting distant objects can be improved.

[0129] In a possible implementation, the processing module 62 is specifically configured to determine the motion parameters of each of the at least two reflectors according to the wavefront distortion information; and control each reflector to move according to the corresponding motion parameters.

[0130] It can be seen that, since the control device can determine the motion parameters of each reflector according to the wavefront distortion information, the control device can accurately control the movement of each reflector through the reflective element to accurately compensate for the wavefront distortion of the light.

[0131] In a possible implementation, the acquisition module 61 is further used to acquire M frames of images through the imaging module when displaying the shooting preview interface, where the M frames of images include image information, and M is a positive integer. The processing module 62 is specifically used to determine the image information from the M frames of images acquired by the acquisition module to obtain the image information.

[0132] It can be seen that since the control device compensates for the wavefront distortion of light only when it is necessary to capture an image, it is possible to avoid high power consumption caused by the control device compensating for the wavefront distortion of light when it is not necessary to capture an image. In this way, the power consumption of the control device can be reduced.

[0133] In a possible implementation, the control device further includes: a display module 63, wherein the display module 63 is configured to display the target image in the shooting preview interface.

[0134] It can be seen that since the control device can directly display the image other than the image information in the M frame image in the shooting preview interface, it can avoid the situation where it takes a long time to display the preview image in the shooting preview interface due to the wavefront distortion of the compensation light. In this way, the efficiency of the control device in shooting images can be improved.

[0135] The control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0136] The control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0137] The control device provided in the embodiment of the present application can achieve Figures 1 to 11 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0138] Optionally, in the embodiment of the present application, Fig.12 As shown, an embodiment of the present application also provides an electronic device 70, including a processor 71, a memory 72, and a program or instruction stored in the memory 72 and executable on the processor 71. When the program or instruction is executed by the processor 71, each process of the above-mentioned control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0139] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0140] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application is provided, wherein the electronic device includes a target display chip.

[0141] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0142] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0143] The input unit 104 is used for collecting image information through an imaging module of the electronic device.

[0144] The processor 110 is used to determine the wavefront distortion information of the light according to the image information, where the light is: the light that enters from the light-transmitting area of ​​the imaging module and is reflected by the target reflection surface of the reflection element of the imaging module to the image sensor of the imaging module; and is used to control the at least two reflection mirrors of the reflection element to move based on the wavefront distortion information to adjust the surface shape of the target reflection surface, thereby compensating the wavefront distortion of the light. The surface shape includes at least one of a shape and a curvature.

[0145] The electronic device provided in the embodiment of the present application can first obtain at least one frame of image captured by the imaging module, and determine the wavefront distortion information of the light according to the at least one frame of image. Then, based on the wavefront distortion information, the electronic device can control the movement of at least two reflectors of the reflective element through the reflective element to adjust the surface shape of the target reflective surface, thereby compensating for the wavefront distortion of the light. That is, the light reflected by the adjusted target reflective surface does not change. Therefore, the situation in which the captured image is unclear can be avoided. In this way, the shooting effect of the electronic device for shooting distant objects can be improved.

[0146] Optionally, in the embodiment of the present application, the processor 110 is specifically configured to determine the motion parameters of each of the at least two reflectors according to the wavefront distortion information, and is specifically configured to control each reflector to move according to the corresponding motion parameters.

[0147] It can be seen that, since the electronic device can determine the motion parameters of each reflector according to the wavefront distortion information, the electronic device can accurately control the movement of each reflector through the reflective element to accurately compensate for the wavefront distortion of the light.

[0148] Optionally, in the embodiment of the present application, the input unit 104 is further used to capture M frames of images through the imaging module when displaying the shooting preview interface, where the M frames of images include image information, and M is a positive integer.

[0149] The processor 110 is specifically configured to determine image information from the M frames of images to obtain image information.

[0150] It can be seen that since the electronic device only compensates for the wavefront distortion of light when it is necessary to capture an image, it is possible to avoid high power consumption caused by the electronic device compensating for the wavefront distortion of light when it is not necessary to capture an image. In this way, the power consumption of the electronic device can be reduced.

[0151] Optionally, in the embodiment of the present application, the display unit 106 is used to display the target image in the shooting preview interface.

[0152] It can be seen that since the electronic device can directly display the image other than the image information in the M frame image in the shooting preview interface, it can avoid the situation where it takes a long time to display the preview image in the shooting preview interface due to the wavefront distortion of the compensation light. In this way, the efficiency of the electronic device in capturing images can be improved.

[0153] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0154] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0155] The processor 110 may include one or more processing units; optionally, in the embodiment of the present application, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0156] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0157] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0158] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0159] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0160] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0161] It should be noted that, in this article, the term "comprises", "includes" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0162] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0163] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An imaging module, characterized in that: The imaging module comprises: A housing having a light-transmitting area and an inner cavity; A reflective element, the reflective element is disposed in the inner cavity, the reflective element comprises at least two reflectors, and the reflective surfaces of the at least two reflectors constitute a target reflective surface of the reflective element; an image sensor, the image sensor being disposed in the inner cavity; Wherein, any one of the at least two reflectors can move relative to the housing based on wavefront distortion information, the wavefront distortion information is used to indicate the distortion amount of the wavefront of the light, and the movement of any one of the reflectors relative to the housing is used to adjust the surface shape of the target reflection surface; The target reflective surface reflects the light entering the light-transmitting area to the image sensor; The image sensor is used to collect a wavefront distortion detection image through the imaging module, and after determining the wavefront distortion information based on the wavefront distortion detection image, display the collected image after adjusting the surface shape of the target reflection surface based on the wavefront distortion information in the image preview interface of the image sensor.

2. The imaging module according to claim 1, characterized in that: The image sensor is arranged on the inner wall at one end of the inner cavity; The reflective element is disposed at a first position at the other end of the inner cavity; The first position is a position to which both the light-transmitting area and the image sensor are facing.

3. The imaging module according to claim 1, characterized in that: The imaging module also includes: An anti-shake element, the anti-shake element being arranged on the inner wall of the inner cavity; Wherein, the first surface of the reflective element is connected to the anti-shake element; the first surface is: a surface away from the target reflective surface.

4. An electronic device, characterized in that: The electronic device comprises the imaging module as claimed in any one of claims 1 to 3.

5. A control method, characterized in that: Applied to the electronic device as claimed in claim 4, the method comprises: Acquire a wavefront distortion detection image collected by an imaging module of the electronic device; Determine the wavefront distortion information of the light according to the wavefront distortion detection image, wherein the wavefront distortion information is used to indicate the distortion amount of the wavefront of the light, wherein the light is: the light that enters from the light-transmitting area of ​​the imaging module and is reflected to the image sensor of the imaging module by the target reflection surface of the reflection element of the imaging module, wherein the target reflection surface of the reflection element is formed by the reflection surfaces of at least two reflection mirrors of the reflection element; Based on the wavefront distortion information, controlling at least two reflectors of the reflective element to move to adjust the surface shape of the target reflective surface, thereby compensating for the wavefront distortion of the light; Displaying, in an image preview interface of the image sensor, an image acquired after adjusting the surface shape of the target reflective surface based on the wavefront distortion information; Wherein, the surface type includes at least one of a shape and a curvature.

6. The method according to claim 5, characterized in that The step of controlling at least two reflectors of the reflective element to move based on the wavefront distortion information comprises: Determining motion parameters of each of the at least two reflectors respectively according to the wavefront distortion information; Through the reflective element, each of the reflective mirrors is controlled to move according to the corresponding motion parameters.

7. The method according to claim 5, characterized in that Before acquiring the wavefront distortion detection image collected by the imaging module of the electronic device, the method further includes: When the shooting preview interface is displayed, M frames of images are collected by the imaging module, the M frames of images include the wavefront distortion detection image, and M is a positive integer; The step of acquiring the wavefront distortion detection image collected by the imaging module of the electronic device comprises: The wavefront distortion detection image is determined from the M frames of images.

8. The method according to claim 7, characterized in that After acquiring M frames of images by the imaging module, the method further includes: Displaying the target image in the shooting preview interface; Wherein, the target image is: the image in the M frames of images except the wavefront distortion detection image.

9. A control device, characterized in that: The control device comprises: an acquisition module and a processing module; The acquisition module is used to acquire the wavefront distortion detection image collected by the imaging module of the control device; The processing module is used to determine the wavefront distortion information of the light according to the wavefront distortion detection image acquired by the acquisition module, wherein the wavefront distortion information is used to indicate the distortion amount of the wavefront of the light, wherein the light is: the light entering from the light-transmitting area of ​​the imaging module and reflected to the image sensor of the imaging module by the target reflection surface of the reflection element of the imaging module, wherein the target reflection surface of the reflection element is composed of the reflection surfaces of at least two reflection mirrors of the reflection element; and based on the wavefront distortion information, controlling the at least two reflection mirrors of the reflection element to move so as to adjust the surface shape of the target reflection surface, thereby compensating for the wavefront distortion of the light; and displaying the image collected after adjusting the surface shape of the target reflection surface based on the wavefront distortion information in the image preview interface of the image sensor; Wherein, the surface type includes at least one of a shape and a curvature.

10. The control device according to claim 9, characterized in that: The processing module is specifically used to determine the motion parameters of each of the at least two reflectors according to the wavefront distortion information; and control each reflector to move according to the corresponding motion parameters.

11. The control device according to claim 9, characterized in that: The control device further comprises: a collection module; The acquisition module is used to acquire M frames of images through the imaging module when displaying the shooting preview interface, wherein the M frames of images include the wavefront distortion detection image, and M is a positive integer; The processing module is specifically used to determine the wavefront distortion detection image from the M frames of images acquired by the acquisition module.

12. The control device according to claim 11, characterized in that: The control device further includes: a display module; The display module is used to display the target image in the shooting preview interface; Wherein, the target image is: the image in the M frames of images except the wavefront distortion detection image.

13. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the control method according to any one of claims 5 to 8 are implemented.

14. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the control method according to any one of claims 5 to 8 are implemented.

Images