Camera module, imaging method, electronic device, readable storage medium and chip
By introducing electromagnetic drivers that can move along two vertical lines to each other in the camera module, controlling the position of the image sensor, the problem of increasing cost and power consumption when improving the photography effect in the prior art is solved, and the image resolution, dynamic range and color loyalty is improved.
Patent Information
- Application Number
- JP2023530584
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-11-30
- Filing Date
- 2021-11-23
- Publication Date
- 2025-04-09
- Estimated Expiration
- 2041-11-23
AI Technical Summary
The prior art increases costs, increases power consumption and extends image processing time when improving photography effects.
By introducing electromagnetic drivers that can move along two straight lines perpendicular to each other in the camera module, the position of the image sensor is controlled, thereby achieving multi-frame fusion of images and improving image quality.
Effectively improve the resolution, dynamic range and color loyalty of the image, reduce noise, and avoid the problems of increased costs and power consumption.
Smart Images

Figure 0007659631000018 
Figure 0007659631000019 
Figure 0007659631000020
Abstract
Description
[Technical field]
[0001] The present application relates to the technical field of communications, and in particular to a camera module, an imaging method and an electronic device. [Background technology]
[0002] Currently, the solutions for improving the shooting effect in mobile terminal products mainly include using large pixels to improve sensitivity, and processing images by platform-side algorithms (e.g., multi-frame fusion). However, both of the above solutions have drawbacks: in the former, when the pixel size is increased for the same physical size, the resolution decreases, and when the physical size is increased, the cost increases; in the latter, when the image is processed by the platform-side algorithm, the power consumption of the image processing increases and the time to complete the image processing increases. Summary of the Invention [Problem to be solved by the invention]
[0003] The embodiments of the present application aim to provide a camera module, an imaging method, and an electronic device that can solve the problems of increased costs, increased power consumption in image processing, and increased time required to complete image processing when improving shooting effects in conventional technologies. [Means for solving the problem]
[0004] In order to solve the above technical problems, the present application is realized as follows.
[0005] In a first aspect, embodiments of the present application include The lens includes a lens fixing component, a circuit board, an image sensor, and a driving component. The lens fixing component is provided on one side of the circuit board, and a mounting groove is provided on the lens fixing component, and the lens is mounted in the mounting groove; an accommodating cavity is formed so as to be surrounded by the lens, the lens fixing component, and the circuit board; the image sensor is provided in the accommodating cavity facing the lens; and the image sensor is electrically connected to the circuit board; A camera module is provided, wherein the drive component is located between the image sensor and the circuit board and is for driving the image sensor to move along a first line and a second line in a plane perpendicular to an optical axis of the lens, the first line and the second line being perpendicular to each other.
[0006] Optionally, the drive component includes at least one first comb-type electrostatic actuator and at least one second comb-type electrostatic actuator, the first comb-type electrostatic actuator for driving the image sensor to move along a first straight line in a plane perpendicular to the optical axis of the lens, and the second comb-type electrostatic actuator for driving the image sensor to move along a second straight line in a plane perpendicular to the optical axis of the lens.
[0007] Optionally, the first comb-tooth electrostatic actuator includes a first movable tooth and a first fixed tooth, the second comb-tooth electrostatic actuator includes a second movable tooth and a second fixed tooth, the first fixed tooth and the second fixed tooth are connected to the circuit board, and the first movable tooth and the second movable tooth are connected to the image sensor, and when a driving voltage is applied to the first comb-tooth electrostatic actuator, the first movable tooth can move along the first straight line, and when a driving voltage is applied to the second comb-tooth electrostatic actuator, the second movable tooth can move along the second straight line.
[0008] Alternatively, the number of the first comb-tooth electrostatic actuators and the number of the second comb-tooth electrostatic actuators are both two, the two first comb-tooth electrostatic actuators and the two second comb-tooth electrostatic actuators are arranged in a cross-shaped configuration, the two first comb-tooth electrostatic actuators are centrally symmetrical when projected onto the circuit board, and the two second comb-tooth electrostatic actuators are centrally symmetrical when projected onto the circuit board.
[0009] Optionally, the driving component further includes a driving chip, the driving chip being mounted on the circuit board, the driving chip being connected to the first comb-type electrostatic actuator and the second comb-type electrostatic actuator respectively, and the driving chip being for driving the operation of the first comb-type electrostatic actuator and the second comb-type electrostatic actuator.
[0010] Optionally, the lens fixing component includes a base and a drive motor, the base is fixed to one side of the circuit board, the drive motor is mounted on the base, the lens is connected to the drive motor, and the drive motor is for driving the lens to move on the optical axis of the lens.
[0011] Optionally, a filter is provided between the lens and the image sensor, the filter being perpendicular to the optical axis of the lens.
[0012] In a second aspect, an embodiment of the present application provides an imaging method applied to a camera module according to the first aspect, comprising: acquiring a first frame image by the camera module, and driving the image sensor by the driving component to move in sequence a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and a third predetermined distance in a third direction along the first straight line in the plane perpendicular to the optical axis of the lens, thereby acquiring a second frame image, a third frame image, and a fourth frame image, wherein the third direction is opposite to the first direction; generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image.
[0013] Optionally, the image of the first frame includes a number of square pixel units, and the first predetermined distance, the second predetermined distance and the third predetermined distance are all positive integer multiples of a side length of a single pixel unit.
[0014] Optionally, the step of generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image further comprises: acquiring single-channel data of each color in the first frame image, the second frame image, the third frame image, and the fourth frame image, respectively; rearrange single-channel data of the same color in the first frame image, the second frame image, the third frame image, and the fourth frame image to obtain several rearranged images; and fusing the reordered images to generate a final image.
[0015] In a third aspect, an embodiment of the present application provides an electronic device including the camera module according to the first aspect.
[0016] In a fourth aspect, an embodiment of the present application provides an electronic device comprising a processor, a memory and a program or command stored in the memory and executable on the processor, the program or command being executed by the processor to achieve steps of the imaging method described in the second aspect.
[0017] In a fifth aspect, an embodiment of the present application provides a readable storage medium having stored thereon a program or commands which, when executed by a processor, result in the steps of the imaging method according to the second aspect.
[0018] In a sixth aspect, an embodiment of the present application provides a chip comprising a processor and a communication interface, the communication interface being coupled to the processor, the processor being adapted to execute programs or commands to implement steps of the imaging method described in the second aspect.
[0019] In a seventh aspect, an embodiment of the present application provides a computer program product stored on a non-volatile storage medium and configured to, when executed by at least one processor, implement the steps of the imaging method according to the second aspect. Effect of the Invention
[0020] In the embodiments of the present application, the image sensor is controlled to achieve pixel-size level displacement, which can effectively improve the shooting effect, for example, improve the resolution, dynamic range, and color fidelity, and reduce noise, without causing any adverse effects. [Brief description of the drawings]
[0021] [Figure 1] FIG. 1 is a schematic diagram showing how the size of a pixel unit is increased while maintaining the same physical size in the prior art. [Diagram 2] 1 is a schematic flowchart of a processing algorithm for improving a shooting effect in the prior art; [Diagram 3]FIG. 2 is a structural schematic diagram of a camera module according to an embodiment of the present application. [Figure 4] 1 is a structural schematic diagram of a comb-type electrostatic actuator according to an embodiment of the present application. [Diagram 5] FIG. 1 is a schematic diagram of a force analysis of a comb-type electrostatic actuator according to an embodiment of the present application. [Figure 6] FIG. 2 is a schematic diagram of the location of drive components according to an embodiment of the present application. [Figure 7] 1 is a schematic flow chart of an imaging method according to an embodiment of the present application. [Figure 8] FIG. 2 is a schematic diagram of an RGB pixel array of an image sensor according to an embodiment of the present application. [Figure 9] FIG. 2 is a schematic diagram of image capture by moving an image sensor provided by an embodiment of the present application; [Figure 10] 1 is a flowchart for processing a captured image in the prior art. [Figure 11] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application; [Figure 12] FIG. 2 is a schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] The technical solutions in the embodiments of the present application will be described below clearly and completely with reference to the drawings in the embodiments of the present application, and it is to be understood that the described embodiments are only a part of the embodiments of the present application, and are not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without any creative efforts belong to the protection scope of the present application.
[0023] The terms "first", "second", etc. in the specification and claims of the present application are not intended to describe a particular order or sequence, but are intended to distinguish between similar objects. It should be understood that the terms used in this manner may be substituted for each other where appropriate, so that the embodiments of the present application may be performed in an order other than that shown or described herein, and the objects distinguished by "first" and "second" are generally of one type, and the number of objects is not limited, for example, the first object may be one or more. In the specification and claims, "and / or" indicates at least one of the objects connected, and the symbol " / " generally indicates that the related objects before and after are in an "or" relationship.
[0024] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a camera module, an imaging method, and an electronic device according to embodiments of the present application will be described in detail with reference to the drawings through specific embodiments and application scenarios.
[0025] Fig. 1 is a schematic diagram of increasing the size of a pixel unit with the same physical size in the prior art. As shown in Fig. 1, in the prior art, as one of the solutions to improve the shooting effect of a camera, the size of a pixel unit is increased on the premise that the physical size is not changed, and the sensitivity can be improved by increasing the size of the pixel unit, but the resolution of the image sensor is accordingly reduced, and if a high resolution is to be maintained, the physical size of the camera needs to be increased, which increases the cost and the volume occupied by the camera.
[0026] Fig. 2 is a schematic flow chart of a processing algorithm for improving the shooting effect in the prior art. As shown in Fig. 2, in the prior art, another solution for improving the shooting effect of a camera is to add an effect algorithm (e.g., a multi-frame fusion algorithm) on the platform side after the image sensor captures multiple consecutive frames of images to further process the images to improve the shooting effect, but this increases the power consumption of the image processing system and lengthens the image processing time due to the addition of the algorithm.
[0027] 3 is a structural schematic diagram of a camera module according to an embodiment of the present application. As shown in FIG. 3, an embodiment according to one aspect of the present application provides a camera module, which may include a lens 11, a lens fixing component 12, a circuit board 13, an image sensor 14 and a driving component 15, in which the lens fixing component 12 is disposed on one side of the circuit board 13, a mounting groove is provided on the lens fixing component 12, the lens 11 is mounted in the mounting groove, a receiving cavity is formed by being surrounded by the lens 11, the lens fixing component 12 and the circuit board 13, and the image sensor 14 is disposed in the receiving cavity opposite to the lens 11, that is, the optical axis of the lens 11 is perpendicular to the photosensitive surface of the image sensor 14, and the image sensor 14 is driven by the received optical signal. and further electrically connected to the circuit board 13 for converting the reflected light into an electric signal and then transmitting it to the circuit board 13; the driving component 15 is located between the image sensor 14 and the circuit board 13, and the driving component 15 can drive the image sensor 14 to move along a first straight line and a second straight line in a plane perpendicular to the optical axis of the lens 11, the first straight line and the second straight line being perpendicular to each other; that is, the driving component 15 can drive the pixel-size level displacement of the image sensor 14 on the circuit board 13, so that the image sensor 14 can sense light at different positions during shooting; and by obtaining a final image based on the multiple sensing data, the shooting effect can be effectively improved and no other adverse effects will occur.
[0028] 4 is a structural schematic diagram of a comb-tooth electrostatic actuator according to an embodiment of the present application. As shown in FIG. 4, the comb-tooth electrostatic actuator includes fixed teeth 41, movable teeth 42, and elastic beam 43, among which the fixed teeth 41 are comb-shaped, the movable teeth 42 are "non-" shaped, and both the fixed teeth 41 and the movable teeth 42 are provided with several comb teeth, and the comb teeth of the fixed teeth 41 and the movable teeth 42 are offset from each other. When a DC driving voltage is applied between the fixed teeth 41 and the movable teeth 42 of the comb-tooth electrostatic actuator, an electrostatic force is generated between the movable teeth 42 and the fixed teeth 41, which drives the movable teeth 42 to move, and the moving direction of the movable teeth 42 is as shown by the arrow in FIG. 4. It should be noted that the comb-tooth electrostatic actuator in the embodiment of the present application refers to a Micro Electro Mechanical System (MEMS) comb-tooth electrostatic actuator, so as to meet the high-precision displacement of the image sensor 14.
[0029] In an embodiment of the present application, optionally, the driving component 15 includes at least one first comb-type electrostatic actuator 151 and at least one second comb-type electrostatic actuator 152, where the first comb-type electrostatic actuator 151 can be used to drive the image sensor 14 to move along a first straight line in a plane perpendicular to the optical axis of the lens 11, and the second comb-type electrostatic actuator 152 is used to drive the image sensor 14 to move along a second straight line in a plane perpendicular to the optical axis of the lens 11, thereby allowing the image sensor 14 to move in different directions.
[0030] In an embodiment of the present application, optionally, the first comb-tooth electrostatic actuator 151 includes a first movable tooth 1512 and a first fixed tooth 1511, and the second comb-tooth electrostatic actuator 152 includes a second movable tooth 1522 and a second fixed tooth 1521, the first fixed tooth 1511 and the second fixed tooth 1521 are connected to the circuit board 13, and the first movable tooth 1512 and the second movable tooth 1522 are connected to the image sensor 14, and optionally, the first movable tooth 1512 and the second movable tooth 1522 may be adhesively fixed to the image sensor 14 by an adhesive, and when a driving voltage is applied to the first comb-tooth electrostatic actuator 151, the first movable tooth 1512 can move in the first straight line due to the action of electrostatic force, and when a driving voltage is applied to the second comb-tooth electrostatic actuator 152, the second movable tooth 1522 can move in the second straight line due to the action of electrostatic force.
[0031] 5 is a schematic diagram of the force analysis of the comb-type electrostatic actuator according to the embodiment of the present application. As shown in FIG. 5, after applying a DC driving voltage U to the fixed teeth 41 and the movable teeth 42, a force analysis is performed on a single comb tooth, the principle of which is as follows.
[0032] (1) Based on the equation for the potential energy of a capacitor.
[0033]
number
[0034]
number
[0035] (2) According to the following formula.
[0036]
number
[0037]
number
[0038] (3) Assuming that the change in potential energy is equal to the work done by the electrostatic force, the electrostatic force is given by:
[0039]
number
[0040] (4) According to the capacity formula.
[0041]
number
[0042]
number
[0043]
number
[0044] JPEG0007659631000016.jpg46152
[0045]
number
[0046] 6 is a schematic diagram of the arrangement position of the driving component 15 according to the embodiment of the present application. As shown in FIG. 6, in some embodiments of the present application, the number of the first comb-tooth electrostatic actuator 151 and the second comb-tooth electrostatic actuator 152 are both two, the two first comb-tooth electrostatic actuators 151 and the two second comb-tooth electrostatic actuators 152 are arranged in a cross-shaped configuration, the two first comb-tooth electrostatic actuators 151 are centrally symmetrical in the orthogonal projection onto the circuit board 13, and the two second comb-tooth electrostatic actuators 152 are centrally symmetrical in the orthogonal projection onto the circuit board 13. Exemplarily, the image sensor 14 is rectangular (including a square), in which case the two first comb-tooth electrostatic actuators 151 may be arranged along one diagonal of the image sensor 14, and the two second comb-tooth electrostatic actuators 152 are arranged along the other diagonal of the image sensor 14 so as to be distributed in a cross-shaped configuration, and such an arrangement can improve the stability during the driving of the image sensor 14 by the driving component 15, and further improve the imaging effect. Naturally, the number of the first comb-teeth type electrostatic actuators 151 and the second comb-teeth type electrostatic actuators 152 may be greater, and they may be arranged symmetrically (for example, centrally symmetrically).
[0047] Continuing to refer to FIG. 6, in an embodiment of the present application, optionally, the driving component 15 further includes a driving chip 17, where the driving chip 17 is mounted on the circuit board 13, and the driving chip 17 is respectively connected to the first comb-tooth electrostatic actuator 151 and the second comb-tooth electrostatic actuator 152, and the driving chip 17 is for driving the operation of the first comb-tooth electrostatic actuator 151 and the second comb-tooth electrostatic actuator 152, that is, the driving chip 17 can control the direction and magnitude of the DC driving voltage supplied to the first comb-tooth electrostatic actuator 151 and the second comb-tooth electrostatic actuator 152, thereby controlling the displacement and displacement direction of the image sensor 14.
[0048] 3, in some other embodiments of the present application, optionally, the lens fixing component 12 includes a base 123 and a driving motor 122, the base 123 is fixed to one side of the circuit board 13, for example, the base 123 may be cylindrical, the driving motor 122 is provided on the base 123, a mounting groove is provided on the driving motor 122, the lens 11 is provided in the mounting groove and connected to the driving motor 122, and the driving motor 122 can be used to drive the lens 11 to move on the optical axis of the lens 11 to realize the adjustment of the focal length. Optionally, the driving motor 122 can be a voice coil motor.
[0049] Continuing to refer to FIG. 3, in an embodiment of the present application, a filter 16 is further provided between the lens 11 and the image sensor 14, and the filter 16 may be fixed to the base 123, and the filter 16 is perpendicular to the optical axis of the lens 11 so as to filter the light passing through the lens 11.
[0050] In the embodiment of the present application, the image sensor 14 is controlled to achieve pixel-size level displacement, which can effectively improve the shooting effect, for example, improve the resolution, dynamic range, and color fidelity, and reduce noise, without causing any adverse effects.
[0051] An embodiment according to another aspect of the present application further provides an electronic device, which includes the camera module described in the above embodiment, and the camera module in the above embodiment can effectively improve the shooting effect, for example, improve the resolution, dynamic range, and color fidelity and reduce noise, without causing any adverse effects, by controlling the image sensor 14 to realize pixel-size level displacement, so that the electronic device in the embodiment of the present application accordingly has the above beneficial effects, which will not be described in detail here to avoid repetition.
[0052] 7 is a schematic flow chart of an imaging method according to an embodiment of the present application. As shown in FIG. 7, an embodiment of the present application further provides an imaging method applied to the camera module described in the above embodiment, and the imaging method may include the following steps 71 and 72:
[0053] In step 71, a first frame image is acquired by the camera module, and the driving component drives the image sensor to sequentially move a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, move a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and move a third predetermined distance in a third direction along the first straight line in the plane perpendicular to the optical axis of the lens, thereby acquiring a second frame image, a third frame image, and a fourth frame image, wherein the third direction is opposite to the first direction.
[0054] 8 and 9, Fig. 8 is a schematic diagram of an RGB pixel array of an image sensor according to an embodiment of the present application, and Fig. 9 is a schematic diagram of an image capture by moving an image sensor provided by an embodiment of the present application. As shown in Fig. 8 and Fig. 9, taking the normal case where RGB pixels are arranged in a Bayer array arrangement as an example, in this step, first, a first frame of image is obtained by a camera module, then, a driving component of the camera module drives the image sensor to move a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, to obtain a second frame of image, and then, a driving component drives the image sensor to move a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, to obtain a third frame of image, and then, a driving component drives the image sensor to move a third predetermined distance in a third direction along the first straight line in a plane perpendicular to the optical axis of the lens, to obtain a fourth frame of image, where the third direction is opposite to the first direction.
[0055] In an embodiment of the present application, optionally, the first frame image includes several square pixel units, and the first predetermined distance, the second predetermined distance and the third predetermined distance are all positive integer multiples of a side length of a single pixel unit.
[0056] In step 72, a final image is generated based on the first frame image, the second frame image, the third frame image, and the fourth frame image.
[0057] By driving the pixel size displacement of the image sensor to obtain four frames of images, a final image can be generated based on the four frames of images. Optionally, the step of generating a final image based on the first frame of images, the second frame of images, the third frame of images, and the fourth frame of images can be acquiring single-channel data of each color in the first frame image, the second frame image, the third frame image, and the fourth frame image, respectively; rearrange single-channel data of the same color in the first frame image, the second frame image, the third frame image, and the fourth frame image to obtain several rearranged images; and fusing the reordered images to generate a final image.
[0058] For example, in the above step, R channel data, G channel data and B channel data in the first frame image, the second frame image, the third frame image and the fourth frame image are first obtained, and then the R channel data, G channel data and B channel data in the first frame image, the second frame image, the third frame image and the fourth frame image are rearranged to obtain several rearranged images. Here, it should be noted that since the arrangement form is a Bayer arrangement, two frames of rearranged images are obtained after the G channel data is rearranged. Finally, all the rearranged images are fused to obtain a final image.
[0059] FIG. 10 is a flow chart of processing a captured image in the prior art. As shown in FIG. 10, in normal shooting, when restoring an image, a mosaic removal algorithm (De-mosaic algorithm) is used to obtain one frame of R, G, B images by difference, and then fused to obtain a final image. The De-mosaic algorithm realizes the filling of signal information that is not acquired in a single channel by digital interpolation method (for example, the R channel is next to the G channel, and if the image sensor is not moved, the red R channel component information is missing at the position where the G channel is located), and it belongs to digital amplification, so the final imaging effect is not good. In the embodiment of the present application, the single channel data of each position is acquired by directly moving the image sensor, so that the resolution, dynamic range can be improved, noise can be reduced, and the fidelity of color reproduction can be improved, and thus the shooting effect can be improved.
[0060] It should be noted that in the imaging method according to the embodiment of the present application, the execution entity may be an imaging device or a control module for executing the imaging method in the imaging. In the embodiment of the present application, the imaging device according to the embodiment of the present application will be described taking the case where the imaging module executes the imaging method as an example.
[0061] An imaging device according to an embodiment of the present application comprises: an acquisition module for acquiring a first frame image by the camera module, and driving the image sensor by the driving component to sequentially move a first predetermined distance in a first direction along a first straight line in a plane perpendicular to an optical axis of the lens, a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and a third predetermined distance in a third direction along the first straight line in a plane perpendicular to the optical axis of the lens, and acquiring a second frame image, a third frame image, and a fourth frame image accordingly, wherein the third direction is opposite to the first direction; and a generation module for generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image.
[0062] In the embodiments of the present application, the image sensor is controlled to achieve pixel-size level displacement, which can effectively improve the shooting effect, for example, improve the resolution, dynamic range, and color fidelity, and reduce noise, without causing any adverse effects.
[0063] The imaging device in the embodiment of the present application may be a device, or may be a component, integrated circuit, or chip in a terminal. The device may be a portable electronic device or a non-portable electronic device. For example, the portable electronic device may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and the non-portable electronic device may be a personal computer (PC), a television (TV), an automated teller machine, or a kiosk, etc., and is not specifically limited in the embodiment of the present invention.
[0064] The imaging device in the embodiment of the present invention may be a device having an operating system, which may be the Android operating system, the ios operating system, or other possible operating systems, and is not specifically limited in the embodiment of the present invention.
[0065] The imaging apparatus according to the embodiments of the present application can implement each process implemented in the method embodiments of FIGS. 7 to 9, and will not be described in detail here to avoid repetition of description.
[0066] Optionally, as shown in FIG. 11, an embodiment of the present application further provides an electronic device 1100, which includes a processor 1101, a memory 1102, and a program or command stored in the memory 1102 and executable in the processor 1101, and when the program or command is executed by the processor 1101, each process of the embodiment of the above imaging method is realized and the same technical effect can be achieved, which will not be described in detail here to avoid repetition of description.
[0067] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned portable electronic devices and non-portable electronic devices.
[0068] FIG. 12 is a schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application.
[0069] The electronic device 1200 includes components such as, but not limited to, a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1206, a memory 1209, and a processor 1210.
[0070] Those skilled in the art can understand that the electronic device 1200 may further include a power source (e.g., a battery) for powering each component, and the power source may be logically connected to the processor 1210 by a power management system, which may further realize functions such as charge / discharge management and power consumption management. The structure of the electronic device shown in Fig. 12 is not intended to limit the electronic device, and the electronic device may include more or fewer components than those shown, or a combination of some components, or a different component arrangement.
[0071] Here, the sensor 1205 is for acquiring an image of a first frame, driving the image sensor by the driving component in sequence to move a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, then to move a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and then to move a third predetermined distance in a third direction along the first straight line in a plane perpendicular to the optical axis of the lens, to correspondingly acquire an image of a second frame, an image of a third frame, and an image of a fourth frame, respectively, wherein the third direction is opposite to the first direction.
[0072] The processor 1210 is for generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image.
[0073] In the embodiments of the present application, the image sensor is controlled to achieve pixel-size level displacement, thereby effectively improving the shooting effect, such as improving the resolution, dynamic range, and color fidelity and reducing noise, without causing any adverse effects.
[0074] Optionally, the processor 1210 further comprises the steps of: acquiring single-channel data of each color in the first frame image, the second frame image, the third frame image, and the fourth frame image, respectively; rearrange single-channel data of the same color in the first frame image, the second frame image, the third frame image, and the fourth frame image to obtain several rearranged images; fusing the reordered images to generate a final image.
[0075] It should be understood that in the embodiment of the present application, the input unit 1204 may include a graphics processing unit (GPU) 12041 for processing image data of static or video images acquired by an image acquisition device (e.g., a camera) in a video acquisition mode or an image acquisition mode, and a microphone 12042. The display unit 1206 may include a display panel 12061, which may be arranged in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 12507 includes a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. The other input devices 12072 may include, but are not limited to, a physical keyboard, a function button (e.g., a volume control button, a switch button, etc.), a trackball, a mouse, and an operation lever, and detailed description thereof is omitted here. The memory 1209 can be used to store software programs and various data, including but not limited to application programs and an operating system. The processor 1210 can be integrated with an application processor that mainly processes the operating system, user interface, applications, etc., and a modem processor that mainly processes wireless communications. It can be understood that the modem processor does not have to be integrated with the processor 1210.
[0076] An embodiment of the present application further provides a readable storage medium, in which a program or command is stored, and when the program or command is executed by a processor, each process of the embodiment of the imaging method described above is realized and the same technical effect can be achieved, and will not be described in detail here to avoid repetition of description.
[0077] Here, the processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0078] An embodiment of the present application further provides a chip, the chip including a processor and a communication interface, the communication interface is coupled to the processor, and the processor is for executing a program or command to implement each process of the embodiment of the above imaging method, which can achieve the same technical effects, and will not be described in detail here to avoid repetition of description.
[0079] It should be understood that the chip described in the embodiments of the present application may be referred to as a system level chip, a system chip, a chip system, a system on a chip, or the like.
[0080] An embodiment of the present application further provides a computer program product, which is stored in a non-volatile storage medium and executed by at least one processor to implement each process of the embodiment of the above imaging method, and can achieve the same technical effects, and will not be described in detail here to avoid repetition of description.
[0081] It should be noted that in this specification, the terms "comprise", "consist of" or any other variations are intended to include a non-exclusive inclusion, whereby a process, method, article, or apparatus that includes a set of elements includes not only those elements, but also other elements not expressly stated or inherent to such process, method, article, or apparatus. Unless otherwise specified, an element limited by the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element. It should also be noted that the scope of the method and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may include performing functions substantially simultaneously or in the reverse order depending on such functions, for example, the described method may be performed in a different order than described, and various steps may be added, omitted, or combined. Also, features described with reference to any example may be combined in other examples.
[0082] From the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be realized in the form of a combination of software and a necessary common hardware platform, and of course, they can be realized by hardware, but in many cases the former is a more preferred embodiment. Based on this view, the technical solution of the present invention can be substantially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes a number of commands that cause a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the embodiments of the present application.
[0083] Although the embodiments of the present application have been described above with reference to the drawings, the present application is not limited to the specific embodiment forms described above, and the specific embodiments described above are merely illustrative and not limiting. A person skilled in the art can, by reading the suggestions of the present application, realize various forms without departing from the spirit and scope of the claims of the present application, and all of these are intended to be included in the scope of protection of the present application.
[0084] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to Chinese Patent Application No. 202011378465.2, filed in China on November 30, 2020, the entire contents of which are incorporated herein by reference.
Claims
1. The lens includes a lens fixing component, a circuit board, an image sensor, and a driving component. The lens fixing component is provided on one side of the circuit board, and a mounting groove is provided on the lens fixing component, and the lens is mounted in the mounting groove; an accommodating cavity is formed so as to be surrounded by the lens, the lens fixing component, and the circuit board, the image sensor is provided in the accommodating cavity facing the lens, and the image sensor is electrically connected to the circuit board; the driving component is located between the image sensor and the circuit board, and is for driving the image sensor to move along a first straight line and a second straight line in a plane perpendicular to an optical axis of the lens, the first straight line and the second straight line being perpendicular to each other; the lens fixing component includes a base and a driving motor, the base is fixed to one side of the circuit board, the driving motor is mounted on the base, the lens is connected to the driving motor, the driving motor is for driving the lens to move on the optical axis of the lens, the driving motor is provided with a mounting groove, the lens is mounted in the mounting groove and connected to the driving motor, and the driving motor is a voice coil motor; the driving component includes at least one first comb-tooth electrostatic actuator and at least one second comb-tooth electrostatic actuator, the first comb-tooth electrostatic actuator includes a first movable tooth and a first fixed tooth, the second comb-tooth electrostatic actuator includes a second movable tooth and a second fixed tooth, the first fixed tooth and the second fixed tooth are connected to the circuit board, and the first movable tooth and the second movable tooth are connected to the image sensor, when a driving voltage is applied to the first comb-tooth electrostatic actuator, the first movable tooth can move along the first straight line, and when a driving voltage is applied to the second comb-tooth electrostatic actuator, the second movable tooth can move along the second straight line; Camera module.
2. 2. The camera module of claim 1, wherein the first comb-type electrostatic actuator is for driving the image sensor to move along a first straight line in a plane perpendicular to an optical axis of the lens, and the second comb-type electrostatic actuator is for driving the image sensor to move along a second straight line in a plane perpendicular to the optical axis of the lens.
3. The number of the first comb-teeth type electrostatic actuators and the number of the second comb-teeth type electrostatic actuators are each two.
3. The camera module according to claim 2, wherein the electrostatic actuators are arranged in a cross-shaped configuration, the two first comb-type electrostatic actuators are centrally symmetrical when orthogonally projected onto the circuit board, and the two second comb-type electrostatic actuators are centrally symmetrical when orthogonally projected onto the circuit board.
4. 3. The camera module of claim 2, wherein the driving components further include a driving chip, the driving chip being mounted on the circuit board, the driving chip being connected to the first comb-type electrostatic actuator and the second comb-type electrostatic actuator, respectively, and the driving chip being for driving the operation of the first comb-type electrostatic actuator and the second comb-type electrostatic actuator.
5. The camera module of claim 1 , further comprising a filter disposed between the lens and the image sensor, the filter being perpendicular to an optical axis of the lens.
6. An imaging method applied to a camera module according to any one of claims 1 to 5, comprising the steps of: acquiring a first frame image by the camera module, and driving the image sensor by the driving component to move in sequence a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and a third predetermined distance in a third direction along the first straight line in the plane perpendicular to the optical axis of the lens, thereby acquiring a second frame image, a third frame image, and a fourth frame image, wherein the third direction is opposite to the first direction; generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image; The step of generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image includes: acquiring single-channel data of each color in the first frame image, the second frame image, the third frame image, and the fourth frame image, respectively; rearrange single-channel data of the same color in the first frame image, the second frame image, the third frame image, and the fourth frame image to obtain several rearranged images; and fusing the reordered images to generate a final image. Imaging method.
7. 7. The imaging method of claim 6, wherein the first frame image includes a number of square pixel units, and the first predetermined distance, the second predetermined distance and the third predetermined distance are all positive integer multiples of a side length of a single pixel unit.
8. An electronic device comprising the camera module according to any one of claims 1 to 5.
9. 8. An electronic device comprising a processor, a memory and programs or commands stored in the memory and executable on the processor, the programs or commands being executed by the processor to implement the steps of the imaging method according to claim 6 or 7.
10. A readable storage medium having stored thereon a program or command, the program or command being executed by a processor to implement the steps of the imaging method according to claim 6 or 7.
11. A chip, a processor and a communication interface, the communication interface being coupled to the processor, the processor executing a program or command; When the processor executes the program or the command, acquiring a first frame image by the camera module according to any one of claims 1 to 5, driving the image sensor by the driving component to move in sequence a first predetermined distance in a first direction along a first straight line in a plane perpendicular to the optical axis of the lens, a second predetermined distance in a second direction along a second straight line in a plane perpendicular to the optical axis of the lens, and a third predetermined distance in a third direction along the first straight line in the plane perpendicular to the optical axis of the lens, thereby acquiring a second frame image, a third frame image, and a fourth frame image, wherein the third direction is opposite to the first direction; generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image; The step of generating a final image based on the first frame image, the second frame image, the third frame image, and the fourth frame image includes: acquiring single-channel data of each color in the first frame image, the second frame image, the third frame image, and the fourth frame image, respectively; rearrange single-channel data of the same color in the first frame image, the second frame image, the third frame image, and the fourth frame image to obtain several rearranged images; and fusing the reordered images to generate a final image. Tips.
Citation Information
Patent Citations
Electrostatic driving device and optical device
CN109343293A
Sensor device and imaging apparatus
JP2008203402A
Imaging apparatus
JP2014052438A
mems actuator package architecture
JP2018535844A
Image processing apparatus, image processing method, image processing program, and electronic equipment
JP2019106183A