Light processing device, camera module and electronic equipment

Abstract

The present disclosure relates to a light processing device, a camera module, an electronic device, a shooting method and a storage medium. The light processing device includes: a rotating shaft structure; a light deflection component, the light deflection component is installed on the rotating shaft structure, and the rotation angle of the light deflection component is different to form different light conduction paths; a plurality of light sensors are arranged around the light deflection component to receive the outgoing light transmitted through different light conduction paths. In this way, by making a plurality of light sensors revolve around the rotatable light deflection component, each light sensor can share the incident optical system such as the light deflection component installed on the rotating shaft structure, which can reduce the number of hardware structures that need to be set in the light processing system, thereby reducing the volume of the light processing device.

Description

Technical Field

[0001] The present disclosure relates to camera optical path processing technology, and in particular to a light processing device, a camera module, an electronic device, a shooting method and a storage medium. Background Art

[0002] At present, in order to realize the optical zoom or image fusion of the camera, multiple independent camera modules are set in the camera module, and the optical zoom or image fusion function is realized by switching between the multiple camera modules. For example, switching from the main camera lens to the telephoto lens, or switching from the color camera module to the black and white camera module. This will result in too many camera modules in the camera module, increasing the size of the camera module. Summary of the invention

[0003] The present disclosure provides a light processing device, a camera module, an electronic device, a shooting method and a storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a light processing device, the device comprising:

[0005] Rotating shaft structure;

[0006] A light deflection assembly, wherein the light deflection assembly is mounted on the shaft structure, and different light conduction paths are formed at different rotation angles of the light deflection assembly;

[0007] A plurality of light sensors are arranged around the light deflection component and are used to receive the outgoing light conducted through different light conduction paths.

[0008] Optionally, the device further comprises:

[0009] A plurality of lens assemblies; wherein one of the lens assemblies is located between one of the light sensors and the light deflection assembly, and is used to transmit the outgoing light transmitted by the light transmission path to the corresponding light sensor.

[0010] Optionally, the device further comprises:

[0011] A driving assembly is connected to the shaft structure and is used to drive the shaft structure to rotate so as to drive the light deflection assembly to rotate around at least one rotation axis; the rotation axis is perpendicular to the lens optical axis of the lens assembly.

[0012] Optionally, the maximum focal lengths of different lens assemblies are different.

[0013] Optionally, the intersection of the lens optical axes of each of the lens assemblies coincides with the center of the light deflection assembly.

[0014] Optionally, the difference between the lengths of each light conduction path from the light emitting surface of the light deflection component to the light incident surface of each light sensor is smaller than a set length value.

[0015] Optionally, the light deflection component is a prism.

[0016] According to a second aspect of an embodiment of the present disclosure, a camera module is provided, the camera module comprising:

[0017] a light collecting component, used for collecting reflected light of a photographed object, and transmitting the reflected light as incident light to the light processing device according to any one of the first aspects above;

[0018] The light processing device is used to receive the incident light output by the light collection component and form an image based on the incident light.

[0019] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, in which the camera module as described in the second aspect is installed.

[0020] According to a fourth aspect of an embodiment of the present disclosure, there is provided an image capturing method, which is applied to the electronic device according to the third aspect, and the method includes:

[0021] receiving a first input;

[0022] determining a target light sensor in response to the first input;

[0023] Based on the target light sensor, a target image of the photographed object is generated.

[0024] Optionally, the target light sensor includes at least: a first light sensor and a second light sensor, and the light sampling categories of the first light sensor and the second light sensor are different;

[0025] The step of generating a target image of the photographed object based on the target light sensor includes:

[0026] receiving a second input;

[0027] In response to the second input, acquiring a first image formed by the first light sensor and a second image formed by the second light sensor;

[0028] The first image and the second image are fused to obtain a fused image of the photographed object.

[0029] Optionally, determining a target light sensor in response to the first input includes:

[0030] In response to the first input, determining desired acquisition parameters of the image to be acquired;

[0031] Determine a light sensor corresponding to a target lens assembly having the desired acquisition parameters as the target light sensor; the target lens assembly is at least one of the plurality of lens assemblies;

[0032] The desired acquisition parameters include: acquisition focal length.

[0033] Optionally, the method further includes:

[0034] The light deflection component is driven to rotate to a preset angle, so as to drive the light deflection component to transmit incident light to the target light sensor.

[0035] According to a fifth aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0036] processor;

[0037] a memory configured to store processor-executable instructions;

[0038] Wherein, the processor is configured to: implement the steps of any one of the image capturing methods in the fourth aspect when executed.

[0039] According to the sixth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the steps of any one of the image capture methods in the fourth aspect above.

[0040] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0041] It can be seen from the above embodiments that a rotating shaft structure is provided in the light processing device of the present disclosure, and a light deflection assembly is installed on the rotating shaft structure. During the image shooting process, the rotating shaft structure can be controlled to rotate to drive the light deflection assembly to rotate, and when the rotation angle of the light deflection assembly is different, the light conduction path formed will also be different. Since multiple light sensors are arranged around the light deflection assembly, different light sensors can receive the outgoing light transmitted through different light conduction paths.

[0042] In this way, by making multiple light sensors revolve around a rotatable light deflection component, each light sensor can share the incident optical system such as the light deflection component installed on the shaft structure, which can reduce the number of hardware structures required to be set up in the light processing system and thus reduce the volume of the light processing device.

[0043] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0045] Figure 1 is a schematic diagram of a light processing device according to an exemplary embodiment. Figure 1 .

[0046] Figure 2 is a schematic diagram of a cross-sectional structure of a prism according to an exemplary embodiment.

[0047] Figure 3 is a schematic diagram of a light processing device according to an exemplary embodiment. Figure 2 .

[0048] Figure 4 FIG. 4 is a schematic diagram of a three-dimensional structure of a light processing device according to an exemplary embodiment.

[0049] Figure 5 The figure is a schematic diagram of the composition structure of a camera module according to an exemplary embodiment.

[0050] Figure 6 The figure is a schematic diagram showing the composition structure of another camera module according to an exemplary embodiment.

[0051] Figure 7 The figure is a flowchart of a method for taking an image according to an exemplary embodiment.

[0052] Figure 8 It is a hardware structure block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0053] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0054] Figure 1 is a schematic diagram of a light processing device according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the light processing device may include: a rotating shaft structure 101 , a light deflection component 102 and a plurality of light sensors 103 .

[0055] The light deflection assembly 102 is mounted on the shaft structure 101 , and different rotation angles of the light deflection assembly 102 form different light conduction paths; a plurality of light sensors 103 are disposed around the light deflection assembly 102 to receive the outgoing light conducted through the different light conduction paths.

[0056] Here, the shaft structure is a structural device that can rotate. Since the light deflection assembly is installed on the shaft structure, during the implementation process, the rotation of the shaft structure will drive the light deflection assembly to rotate, thereby having different rotation angles, so that the light deflection assembly can form different light conduction paths with different light sensors. In some embodiments, the shaft structure may include a shaft, and during the implementation process, it can rotate in a single rotation plane based on the shaft. In other embodiments, the shaft structure may include: a first shaft and a second shaft, and the rotation plane of the first shaft is perpendicular to the rotation plane of the second shaft. By setting the first shaft and the second shaft perpendicular to each other, the light deflection assembly can be driven to rotate in a three-dimensional space. In some embodiments, the first shaft can pass through the second shaft. In some embodiments, the shaft structure may include: a straight shaft structure, or a spherical shaft structure.

[0057] In this embodiment, the light deflection assembly can be used to receive incident light and change the transmission direction of the incident light, and then output outgoing light. Here, the incident light can refer to the light transmitted to the light deflection assembly, and the outgoing light can refer to the light output after the incident light is deflected by the light deflection assembly. In the embodiment of the present disclosure, the light deflection assembly can include at least one light transmission surface.

[0058] In one example, based on the light incident and outgoing modes, at least one light transmission surface may include: a light incident surface for receiving incident light and a light outgoing surface for outputting outgoing light. In this way, the incident light can be received through the light incident surface, and after the incident light is received based on the light incident surface, the transmission direction of the incident light can be changed based on the light deflection component, and then the light with the changed transmission direction, i.e., outgoing light, is output through the light outgoing surface.

[0059] For example, in some optional embodiments, the light deflection component may be a prism, or other devices that change the propagation direction of the incident light. For example, in some embodiments, the light deflection component may include: a prism. Here, a prism is a transparent body with a triangular cross section in optics, and is an optical instrument made of transparent material with a triangular cross section.

[0060] Figure 2 is a schematic diagram of a cross-sectional structure of a prism according to an exemplary embodiment. Figure 2As shown, the prism may include a light incident surface 201, a light reflecting surface 202, and a light emitting surface 203. In the implementation process, the incident light may be received based on the light incident surface of the prism, and after receiving the incident light, the incident light may be reflected based on the light reflecting surface to change the transmission direction of the incident light, and then the light with the changed transmission direction, i.e., the output light, may be output based on the light emitting surface. In some optional embodiments, the light incident surface of the prism may be perpendicular to the light emitting surface, so that when the prism receives the incident light perpendicular to the light incident surface, the transmission direction of the incident light may be changed to be perpendicular to the light incident surface of the light sensor after the incident light is reflected by the light reflecting surface of the prism, and at this time, the output light may be transmitted to the light sensor.

[0061] In another example, based on the principle of light transmission, at least one light transmission surface may include: a light-transmitting surface for transmitting light, and / or a light-reflecting surface for reflecting light. In the case where at least one light transmission surface includes a light-transmitting surface and a light-reflecting surface, incident light may be transmitted to the light-reflecting surface based on the light-transmitting surface, and the transmission direction of the incident light may be changed based on the light-reflecting surface, and light with a changed transmission direction, i.e., outgoing light, may be output. In the case where at least one light transmission surface only includes a light-reflecting surface for reflecting light, incident light may be received through the light-reflecting surface, and the transmission direction of the incident light may be changed based on the light-reflecting surface, and light with a changed transmission direction, i.e., outgoing light, may be output.

[0062] For example, at least one light transmission surface may include: a reflective surface for reflecting light, so that the incident light can be directly received based on the reflective surface, and the transmission direction of the incident light can be changed based on the reflective surface, and then the light with the changed transmission direction, i.e., the outgoing light, can be output. For example, the light deflection component can be a reflector; in this example, a reflector can be installed on the shaft structure, and when the shaft structure rotates to different angles, light is incident from the same light inlet, and the incident angle on the reflector at different rotation angles changes, so that the reflection angle of the light also changes. On the one hand, the deflection of the light transmission angle is achieved through the reflection of the light, and on the other hand, through the change of the deflection angle, different light sensors can be selected to receive the light; where, for example, the multiple light sensors can include at least two image sensors, and different image sensors can be selected for imaging.

[0063] In the disclosed embodiment, the rotation of the shaft structure can be controlled, and the rotation of the light deflection assembly can be driven by the shaft structure to rotate, so that the position of the light emitting surface of the light deflection assembly will change. For example, the shaft structure can be controlled to rotate around a rotation axis parallel to the light emitting surface of the light deflection assembly, so that the position of the light emitting surface of the light deflection assembly can be changed, so that different light conduction paths can be formed between light emitting surfaces at different positions and light sensors at different positions. For example, when the light emitting surface of the light deflection assembly is at a first position, the light emitting surface of the light deflection assembly is aligned with the first light sensor; when the light emitting surface of the light deflection assembly changes from the first position to the second position, the light emitting surface of the light deflection assembly can be aligned with the second light sensor.

[0064] In the disclosed embodiment, by making multiple light sensors revolve around a rotatable light deflection component, each light sensor can share an incident optical system such as a light deflection component installed on a rotating shaft structure, thereby reducing the number of hardware structures required to be set up in the light processing system and thereby reducing the volume of the light processing device.

[0065] In some embodiments, the difference between the lengths of each light conduction path from the light emitting surface of the light deflection component to the light incident surface of each light sensor is less than a first set length value.

[0066] Here, by making the difference in the length of each light conduction path from the light emitting surface of the light deflection component to the light incident surface of each of the light sensors smaller than the first set length value, the transmission medium and the transmission path through which the outgoing light passes can be made completely equivalent, that is, approximately equal. In this way, the possibility of different losses of the outgoing light in the transmission process due to the differences in the transmission medium and the transmission path can be reduced. Due to the different losses, the brightness and color of the formed image will also be affected differently. When the light sensor is used to form an image based on the outgoing light, the technical solution in the embodiment of the present disclosure can reduce the deviation problem of the brightness and / or color of the image formed by each light sensor.

[0067] In some embodiments, the device may further include: a plurality of lens assemblies; wherein one of the lens assemblies is located between one of the light sensors and the light deflection assembly, and is used to transmit the outgoing light transmitted by the light transmission path to the corresponding light sensor.

[0068] Optionally, in some embodiments, the plurality of light sensors 103 may include at least two image sensors, and the number of the plurality of lens assemblies may be the same as the number of the plurality of light sensors, that is, one lens assembly corresponds to one light sensor 103. For example, Figure 3 is a schematic diagram of a light processing device according to an exemplary embodiment. Figure 2 ,like Figure 3As shown, taking the light processing device including four light sensors and four lens assemblies as an example, the first lens assembly 301, the second lens assembly 302, the third lens assembly 303 and the fourth lens assembly 304 are arranged adjacent to the light deflection assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305, and is used to transmit the outgoing light transmitted by the first light transmission path to the first light sensor 305; the second lens assembly 302 is located between the light deflection assembly 102 and the second light sensor 306, and is used to transmit the outgoing light transmitted by the second light transmission path to the second light sensor 306; the third lens assembly 303 is located between the light deflection assembly 102 and the third light sensor 307, and is used to transmit the outgoing light transmitted by the third light transmission path to the third light sensor 307; the fourth lens assembly 304 is located between the light deflection assembly 102 and the fourth light sensor 308, and is used to transmit the outgoing light transmitted by the fourth light transmission path to the fourth light sensor 308.

[0069] Figure 4 is a schematic diagram of a three-dimensional structure of a light processing device according to an exemplary embodiment. Figure 4 As shown, the first lens assembly 301, the second lens assembly 302, the third lens assembly 303 and the fourth lens assembly 304 are disposed adjacent to the light deflection assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305, and is used to transmit the light output from the first light conduction path to the first light sensor 305; the second lens assembly 302 is located between the light deflection assembly 102 and the second light sensor 306, and is used to transmit the light output from the second light conduction path to the second light sensor 306; the third lens assembly 303 is located between the light deflection assembly 102 and the third light sensor 307, and is used to transmit the light output from the third light conduction path to the third light sensor 307; the fourth lens assembly 304 is located between the light deflection assembly 102 and the fourth light sensor 308, and is used to transmit the light output from the fourth light conduction path to the fourth light sensor 308.

[0070] Since multiple independent camera modules are set in the camera module and the function of optical zoom or image fusion is realized by switching between the multiple camera modules, it is also necessary to set multiple openings for each camera module on the shell of the electronic device; and since each camera module is relatively independent, there will be large deviations when realizing optical zoom or image fusion, which will affect the image quality.

[0071] In the disclosed embodiment, multiple lens modules and light sensors can share a light deflection component. In this way, only one opening for light input needs to be opened on the electronic device, and the outgoing light received by each lens module and light sensor is input through one light deflection component. In this way, the possibility of deviation in optical zoom or image fusion due to the different outgoing light received by each lens module and light sensor can be reduced, thereby improving image quality.

[0072] Optionally, in some embodiments, the multiple light sensors 103 may include at least one image sensor and at least one photoelectric sensor, and the photoelectric sensor may include an ambient light sensor and / or a distance sensor. In this embodiment scenario, the number of multiple lens assemblies is the same as the number of image sensors, that is, one lens assembly corresponds to one image sensor. It can be understood that when a photoelectric sensor is required, the light deflection assembly deflects the light to a corresponding rotation angle to obtain a corresponding light conduction path, and the incident light is conducted through the corresponding light conduction path to output the outgoing light, which can be directly transmitted to the photoelectric sensor without passing through the lens assembly.

[0073] In some embodiments, different lens assemblies have different maximum focal lengths. Here, since different lens assemblies have different maximum focal lengths in the embodiments of the present disclosure, during the image capture process, optical zoom can be achieved by rotating the rotation angle of the light deflection assembly. Compared with zooming by switching between multiple independent camera modules, in the embodiments of the present disclosure, since the emitted light received by each lens assembly is the same, the deviation caused by the difference in properties between the external environment or hardware can be reduced to achieve smooth zoom.

[0074] In some embodiments, the intersection of the lens optical axes of each lens assembly coincides with the center of the light deflection assembly. In this way, the rotatable light deflection assembly can be set at the center of multiple light sensors. In the disclosed embodiment, by making the intersection of the lens optical axes of each lens assembly coincide with the center of the light deflection assembly, it can be ensured that each lens assembly and the light deflection assembly are located on the same horizontal plane, so that the possibility of poor quality of the final captured image due to positional offset of the light deflection assembly or the lens assembly can be reduced.

[0075] In some embodiments, the difference between the intersection coordinate value of the intersection point of the lens optical axis of the lens assembly and the center coordinate value of the center of the light deflection assembly is less than a set threshold. Here, the set threshold may be 2 mm, 1 mm, etc. In the disclosed embodiment, as long as the difference between the intersection coordinate value and the center coordinate value is less than the set threshold, it can be determined that the intersection point of the lens optical axis of the lens assembly coincides with the center of the light deflection assembly.

[0076] In some embodiments, the difference in length of each light conduction path from the light exit surface of the light deflection assembly to the light entrance surface of each lens assembly is less than the second set length value. For example, the lengths of each light conduction path from the light exit surface of the light deflection assembly to the light entrance surface of each lens assembly are equal. In some embodiments, the second set length value can be obtained based on empirical values ​​or experiments, for example, the second set length value can be less than or equal to 0.8 mm. For another example, the second set length value can be 0.5 mm, 0.01 mm, etc.

[0077] In some embodiments, the device may further include: a driving assembly connected to the shaft structure, used to drive the shaft structure to rotate and drive the light deflection assembly to rotate around at least one rotation axis; the rotation axis is perpendicular to the lens optical axis of the lens assembly.

[0078] In some optional embodiments, the driving assembly may be an assembly having a rotor, wherein the rotor is a rotating body capable of driving the light deflection assembly to rotate. In some embodiments, the driving assembly may be composed of a driving motor, for example, a linear motor, a rotor motor, or the like.

[0079] In some embodiments, the light deflection assembly can be driven to rotate around at least two rotation axes based on the driving assembly. In order to enable the driving assembly to drive the light deflection assembly to rotate around at least two rotation axes, at least two rotors with different rotation directions can be arranged inside the driving assembly. For example, if the light deflection assembly is to be driven to rotate around a first rotation axis and a second rotation axis that are perpendicular to each other, a first rotor and a second rotor that are perpendicular to each other can be arranged. In the case where at least two rotors with different rotation directions are arranged inside the driving assembly, the light deflection assembly further includes at least two rotating shaft structures for carrying the rotors, which are respectively fixedly connected to the at least two rotors.

[0080] In some optional embodiments, the driving assembly can also be a driving device formed by a magnetic attraction structure, which includes a carrier, a base, a reed and a circuit board. The carrier is used to carry the light deflection assembly and is rotatably connected to the base through the reed. The circuit board is installed on the base and is provided with a bottom coil and a side coil. The bottom of the carrier is provided with a bottom magnet corresponding to the bottom coil, and the side of the carrier is provided with a side magnet corresponding to the side coil. The bottom coil cooperates with the bottom magnet and the side coil cooperates with the side magnet, and drives the light deflection assembly to rotate relative to the base around two rotation axes, for example, drives the light deflection assembly to rotate around two rotation axes perpendicular to each other.

[0081] It can be understood that in some optional embodiments, the driving component can be composed of different forms of driving devices or structural combinations. For example, in one implementation, the driving component can include a first component and a second component, and the first component and the second component can respectively drive the light deflection component to rotate around at least one rotation axis, and in order to suppress the mutual interference between the first component and the second component, the first component and the second component are driven to rotate around different rotation axes. The first component can be a component including a rotor, and the second component can be a driving device formed by a magnetic attraction structure.

[0082] In the disclosed embodiment, a driving component connected to the rotating shaft structure is provided in the light processing device. During the light collection process, the driving component can drive the rotating structure to rotate, thereby driving the light deflection component to rotate. In this way, the light emitting surface of the light deflection component can form different light conduction paths with each light sensor at different rotation angles, and the emitted light can be transmitted to different light sensors through different light conduction paths without the need for additional hardware support.

[0083] Figure 5 is a schematic diagram of a camera module according to an exemplary embodiment. Figure 5 As shown, the camera module of the embodiment of the present disclosure may include:

[0084] A light collecting component 401 is used to collect reflected light of a photographed object and transmit the reflected light as incident light to the light processing device 402 described in any of the above embodiments;

[0085] The light processing device 402 is used to receive the incident light output by the light collection component and form an image based on the incident light.

[0086] In some embodiments, the camera module includes a light collecting component for directing the received light vertically toward the light incident surface of the light deflection component. Here, the light collecting component may be a transmission mirror with a light collecting function. Figure 6 is a schematic diagram of the composition structure of another camera module according to an exemplary embodiment. Figure 6 As shown, the light emitting surface of the light collecting component 401 is opposite to the light incident surface of the light deflecting component of the light processing device 402, and the light emitting surface of the light collecting component 401 is parallel to the light incident surface of the light deflecting component.

[0087] In some embodiments, the light deflection component may also have an optical image stabilization function, that is, when focusing on the subject, the optical image stabilization function is activated to avoid unstable light input caused by shaking when collecting the reflected light of the subject.

[0088] In some embodiments, the electronic device includes the camera module described in any of the above embodiments.

[0089] In the embodiments of the present disclosure, the camera module may be provided in an electronic device, wherein the electronic device may include a mobile terminal and a fixed terminal. The mobile terminal may include a mobile phone, a laptop computer, a tablet computer, a wearable electronic device, etc., and the fixed terminal may include a personal computer device, a monitoring device, or a medical device, etc. The electronic device involved in the embodiments of the present disclosure includes a display module, wherein the display module may be a display screen of the electronic device. For example, a setting interface may be displayed based on the display screen of the electronic device.

[0090] Figure 7 is a flow chart of an image capturing method according to an exemplary embodiment. Figure 7 As shown, the method is applied to the electronic device provided in the above embodiment, and mainly includes the following steps:

[0091] In step 701, a first input is received;

[0092] In step 702, in response to the first input, a target light sensor is determined;

[0093] In step 703, a target image of the object is generated based on the target light sensor.

[0094] In one embodiment, the first input may be a focus operation for the electronic device, such as a click or press operation on a shooting button of the electronic device, and the first input is generated in response to the focus operation. For example, the first input may be a touch input input by a user in a viewfinder on a display interface of the electronic device, and here, the touch input may be input based on a touch module of the electronic device. For example, the touch input may include: click input, slide selection input, etc., wherein the click input may include: single click input, double click input, press input, etc.

[0095] In the disclosed embodiment, a target light sensor can be determined based on the first input, and a target image of the photographed object can be generated based on the target light sensor. Here, the target light sensor is at least one of the multiple light sensors. When the target light sensor is one of the multiple light sensors, the image formed by the target light sensor can be directly determined as the target image. When the target light sensor is at least two of the multiple light sensors, at least two images captured by the at least two light sensors can be fused to obtain the target image.

[0096] In one embodiment, the first input may also be a user input for determining the acquisition object. The electronic device may estimate the desired focal length for image acquisition of the acquisition object based on the current focal length and the currently previewed image. Then, based on the acquisition focal length that the light sensor can provide, a light sensor that can provide the desired focal length is selected as the target light sensor.

[0097] In some embodiments, the target light sensor includes at least: a first light sensor and a second light sensor, the first light sensor and the second light sensor having different light sampling categories;

[0098] The generating a target image of the photographed object based on the target light sensor may include:

[0099] receiving a second input;

[0100] In response to the second input, acquiring a first image formed by the first light sensor and a second image formed by the second light sensor;

[0101] The first image and the second image are fused to obtain a fused image of the photographed object.

[0102] Here, the second input may be an image capture operation for the electronic device, such as a click or press operation on a capture button of the electronic device, and the second input is generated in response to the image capture operation. For example, the second input may be a touch input input by a user in a viewfinder on a display interface of the electronic device, and here, the touch input may be input based on a touch module of the electronic device. For example, the touch input may include: click input, slide selection input, etc., wherein the click input may include: single click input, double click input, press input, etc.

[0103] In some embodiments, the light sensor may include: a color image sensor and a black and white image sensor.

[0104] In the disclosed embodiments, by combining different light sensors, it is possible to implement fusion processing of images formed by different types of light sensors. For example, images formed by a color image sensor and a black-and-white image sensor can be fused. In this way, the image quality is improved while the fusion accuracy is guaranteed. By sharing the front-end optical system, pixel-level alignment is achieved, thereby providing a guarantee for the accuracy of the fusion algorithm.

[0105] In some embodiments, the first image and the second image may be fused by a preset image processing algorithm. For example, the average value of the pixel values ​​at corresponding positions in the first image and the second image may be taken to obtain the target pixel value, and based on the target pixel value, the target image may be obtained. In other embodiments, the pixel values ​​at corresponding positions in the first image and the second image may be weighted and summed to obtain the target pixel value, and based on the target pixel value, the target image may be obtained.

[0106] In some embodiments, determining the target light sensor in response to the first input may include:

[0107] In response to the first input, determining desired acquisition parameters of the image to be acquired;

[0108] A light sensor corresponding to a target lens assembly having the desired acquisition parameters is determined as the target light sensor; the target lens assembly is at least one of a plurality of lens assemblies; and the desired acquisition parameters may include: acquisition focal length.

[0109] In the embodiment of the present disclosure, by combining different lens groups, sharing the front-end incident optical system, and collecting the focal length to determine the target light sensor for setting the focal length, smooth optical zoom can be achieved, eliminating the optical axis deviation of multi-camera module switching and the problem of multi-module assembly alignment.

[0110] In some embodiments, the acquisition parameters may also include an acquisition viewing angle.

[0111] In some embodiments, the electronic device can estimate the expected capture angle of view for capturing the image of the capture object based on the current capture angle of view and the currently previewed image. Then, based on the angle of view that the light sensor can provide, the light sensor that can provide the expected capture angle of view is selected as the target light sensor. In this way, not only can smooth zooming between the various lens assemblies be achieved, but also switching of angles of view can be achieved, for example, switching from a non-wide-angle lens assembly to a wide-angle lens assembly, etc.

[0112] In some embodiments, the method may further include: driving the light deflection assembly to rotate to a preset angle, driving the light deflection assembly to transmit the incident light to the target light sensor. In some embodiments, the target light sensor may include at least one image sensor and at least one photoelectric sensor, and the photoelectric sensor may include an ambient light sensor and / or a distance sensor. In this embodiment scenario, the number of multiple lens assemblies is the same as the number of image sensors, that is, one lens assembly corresponds to one image sensor. It can be understood that when a photoelectric sensor is required, the light deflection assembly is deflected to a corresponding rotation angle to obtain a corresponding light conduction path, and the incident light is conducted through the corresponding light conduction path to output the outgoing light, which can be directly transmitted to the photoelectric sensor without passing through the lens assembly.

[0113] In some embodiments, the incident light is incident vertically onto the light deflection component (e.g., prism, reflector) via the light collecting mirror; the light is incident onto the lens component (lens group) via the prism, and the driving component (motor) drives the prism to rotate. For example, the prism is located at position 1, the light is reflected onto the lens group 1 via the prism, and finally incident onto the light sensor 1 corresponding to the lens group 1; the prism is located at position 2, the light is reflected onto the lens group 2 via the prism, and finally incident onto the light sensor 2 corresponding to the lens group 2; the prism is located at position 3, the light is reflected onto the lens group 3 via the prism, and finally incident onto the light sensor 3 corresponding to the lens group 3; the prism is located at position 4, the light is reflected onto the lens group 4 via the prism, and finally incident onto the light sensor 4 corresponding to the lens group 4. In this way, the roulette imaging system is switched in real time by rotating the prism. In some embodiments, the focus and anti-shake functions can be designed according to the requirements, for example, the focus and anti-shake functions can be designed in the light collecting mirror part, or the focus and anti-shake functions can be designed in the lens group part.

[0114] In the disclosed embodiment, by combining different lens groups and sharing the front-end incident optical system, smooth optical zoom can be achieved, and the optical axis deviation of multi-camera module switching and the alignment problem of multi-module assembly can be eliminated; by combining different light sensors, the fusion processing of images formed by different types of light sensors can be achieved. For example, the images formed by the color image sensor and the black-and-white image sensor can be fused. In this way, the image quality is improved while the fusion accuracy is guaranteed, and by sharing the front-end optical system, pixel-level alignment is achieved, which provides a guarantee for the accuracy of the fusion algorithm; by combining the same type of light sensors and controlling the rapid rotation of the prism, lossless multi-frame fusion of the image can be achieved; by combining the same light sensors and the rapid rotation of the prism, super-resolution can be achieved to improve image resolution.

[0115] In the disclosed embodiments, through the design of a common-incident optical system, smooth zoom and pixel-level aligned image fusion can be achieved; through the rapid rotation of the prism (mirror), functions such as lossless multi-frame fusion and super resolution of the image can be achieved; according to usage requirements, the focus and anti-shake functions can be achieved in the light collecting mirror part, or in the lens group part; the matching between the lens group part and the light sensor can be adjusted according to needs, with flexible methods and diverse functions, and due to the design of the common-incident optical system, the matching effect of the back end is far better than the conventional multi-module switching solution.

[0116] In some embodiments, the number of lens assemblies and light sensors can be increased as needed, such as setting 6 groups of lens assemblies and light sensors or 8 groups of lens assemblies and light sensors.

[0117] The image capturing method of the disclosed embodiment can also be understood by referring to the related description of the aforementioned light processing device and camera module.

[0118] Figure 8 5 is a hardware structure block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0119] Reference Figure 8 , the electronic device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .

[0120] The processing component 502 generally controls the overall operation of the electronic device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 502 may include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.

[0121] The memory 504 is configured to store various types of data to support operations on the electronic device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0122] The power component 506 provides power to the various components of the electronic device 500. The power component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 500.

[0123] The multimedia component 508 includes a screen that provides an output interface between the electronic device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the electronic device 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0124] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), and when the electronic device 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 504 or sent via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.

[0125] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0126] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the electronic device 500. For example, the sensor assembly 514 can detect the open / closed state of the electronic device 500, the relative positioning of components, such as the display and keypad of the electronic device 500, and the sensor assembly 514 can also detect the position change of the electronic device 500 or a component of the electronic device 500, the presence or absence of user contact with the electronic device 500, the orientation or acceleration / deceleration of the electronic device 500, and the temperature change of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0127] The communication component 516 is configured to facilitate wired or wireless communication between the electronic device 500 and other devices. The electronic device 500 can access a wireless network based on a communication standard, such as WI-FI, 2G or 6G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0128] In an exemplary embodiment, the electronic device 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0129] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, and the instructions can be executed by a processor 520 of an electronic device 500 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0130] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform an image capturing method, which may include:

[0131] receiving a first input;

[0132] determining a target light sensor in response to the first input;

[0133] Based on the target light sensor, a target image of the photographed object is generated.

[0134] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0135] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A light processing device, characterized in that: The device comprises: A rotating shaft structure; wherein the rotating shaft structure comprises: a first rotating shaft and a second rotating shaft, wherein the rotating plane of the first rotating shaft and the rotating plane of the second rotating shaft are perpendicular to each other; A light deflection assembly, wherein the light deflection assembly is mounted on the shaft structure, and different light conduction paths are formed at different rotation angles of the light deflection assembly; A plurality of light sensors are arranged around the light deflection component and are used to receive the outgoing light conducted through different light conduction paths.

2. The optical processing device according to claim 1, characterized in that: The device also includes: A plurality of lens assemblies; wherein one of the lens assemblies is located between one of the light sensors and the light deflection assembly, and is used to transmit the outgoing light transmitted by the light transmission path to the corresponding light sensor.

3. The optical processing device according to claim 2, characterized in that: The device also includes: A driving assembly is connected to the shaft structure and is used to drive the shaft structure to rotate, thereby driving the light deflection assembly to rotate around at least one rotation axis; the rotation axis is perpendicular to the lens optical axis of the lens assembly.

4. The optical processing device according to claim 2, characterized in that: The maximum focal lengths of different lens assemblies are different.

5. The light processing device according to claim 2, characterized in that: The intersection of the lens optical axes of each of the lens assemblies coincides with the center of the light deflection assembly.

6. The device according to claim 1, characterized in that The difference in length of each light conduction path from the light emitting surface of the light deflection component to the light incident surface of each light sensor is less than a set length value.

7. The device according to claim 1, characterized in that The light deflection component is a prism.

8. A camera module, characterized in that: The camera module comprises: A light collecting component, used for collecting reflected light of a photographed object and transmitting the reflected light as incident light to the light processing device according to any one of claims 1 to 7; The light processing device is used to receive the incident light output by the light collection component and form an image based on the incident light.

9. An electronic device, characterized in that: The electronic device is installed with the camera module as claimed in claim 8.

Images