Imaging system, imaging method, and computer program product

Abstract

The invention is suitable for the technical field of sensors, and provides an imaging system, an imaging method and a computer program product. The imaging system comprises an image sensor which can move along an optical axis direction; the control module is used for performing phase detection on the image of the image sensor to obtain a first displacement amount of the image sensor and controlling the image sensor to move by the first displacement amount along the direction of the optical axis; and after the image sensor moves the first displacement amount, based on an image acquired by the image sensor, determining a motion classification of a shooting object, based on the motion classification, determining a second displacement amount of the image sensor, and controlling the image sensor to move the second displacement amount along the optical axis direction. According to the embodiment of the invention, the automatic focusing operation can be adaptively carried out based on the motion condition of the shot object, and the imaging effect of the imaging system can be improved.

Description

Technical Field

[0001] This application belongs to the field of sensor technology, and in particular relates to an imaging system, imaging method and computer program product. Background Technology

[0002] Traditional imaging systems use manual lenses and lack automatic focus (AF) functionality, relying on the user to manually adjust the focus ring, resulting in slow focusing speed and low accuracy. Some related technologies achieve autofocus by using an internal focusing motor to drive lens groups, but their focusing performance is unsatisfactory in dynamic shooting scenarios. Summary of the Invention

[0003] This application provides an imaging system, imaging method, and computer program product that can adaptively perform autofocus based on the movement of the subject being photographed, thereby helping to improve the imaging effect of the imaging system.

[0004] A first aspect of this application provides an imaging system, comprising: an image sensor capable of moving along an optical axis; a control module configured to perform phase detection on the image sensor to obtain a first displacement of the image sensor, and control the image sensor to move along the optical axis by the first displacement; after the image sensor moves by the first displacement, determining the motion classification of the object to be photographed based on the image acquired by the image sensor, determining a second displacement of the image sensor based on the motion classification, and controlling the image sensor to move along the optical axis by the second displacement.

[0005] In some embodiments of the first aspect, the imaging system further includes: a guide rail disposed along the optical axis, the image sensor disposed on the guide rail; and a motor for driving the image sensor to move along the guide rail.

[0006] In some embodiments of the first aspect, the imaging system further includes: a substrate disposed on a piezoelectric ceramic plate, the piezoelectric ceramic plate being configured to push the substrate to move along an optical axis direction when a voltage is received, and an image sensor disposed on the substrate.

[0007] In some embodiments of the first aspect, magnetic components are provided on both sides of the substrate along the direction perpendicular to the optical axis, and the magnetic components are used to levitate the substrate.

[0008] In some embodiments of the first aspect, the imaging system includes a beam splitting module for enabling the image sensor to acquire image data of two beams of light after the incident light has been split; the control module performs phase detection on the imaging of the image sensor to obtain a first displacement of the image sensor, including: determining a phase difference based on the image data of the two beams of light, and determining the first displacement based on the phase difference.

[0009] In some embodiments of the first aspect, after the image sensor moves the first displacement amount, and / or after the image sensor moves the second displacement amount, the control module is further configured to: determine the imaging contrast of the image sensor, determine a third displacement amount based on the imaging contrast of the image sensor, and control the image sensor to move the third displacement amount along the optical axis direction.

[0010] In some embodiments of the first aspect, after the image sensor moves the second displacement and controls the image sensor to move the third displacement, the control module is further configured to: perform phase detection on the image sensor again to obtain the phase difference of the image sensor; if the phase difference is greater than a preset threshold, redetermine the imaging contrast of the image sensor to control the image sensor to move along the optical axis until the phase difference is less than or equal to the preset threshold.

[0011] In some embodiments of the first aspect, determining a second displacement of the image sensor based on the motion classification and controlling the image sensor to move the second displacement along the optical axis includes: if the motion classification indicates that the subject is stationary, then stopping the movement control of the image sensor; if the motion classification indicates that the subject is in motion, then determining the second displacement and controlling the image sensor to move the second displacement along the optical axis.

[0012] A second aspect of this application provides an imaging method comprising: performing phase detection on an image sensor to obtain a first displacement of the image sensor; controlling the image sensor to move the first displacement along the optical axis; after the image sensor moves the first displacement, determining the motion classification of the subject based on the image acquired by the image sensor; determining a second displacement of the image sensor based on the motion classification, and controlling the image sensor to move the second displacement along the optical axis.

[0013] A third aspect of this application provides a computer-readable storage medium storing a computer program that, when executed, implements the steps of the imaging method described above.

[0014] The fourth aspect of this application provides a computer program product that, when run, causes the imaging method described above to be executed.

[0015] In the embodiments of this application, phase detection is performed on the image sensor to obtain a first displacement of the image sensor, and the image sensor is controlled to move along the optical axis by the first displacement. After the image sensor moves by the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor. Based on the motion classification, a second displacement of the image sensor is determined, and the image sensor is controlled to move along the optical axis by the second displacement. This enables adaptive autofocus based on the motion of the subject, which helps to improve the imaging effect of the imaging system. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram of the imaging system provided in an embodiment of this application;

[0018] Figure 2 This is a first specific structural schematic diagram of the imaging system provided in the embodiments of this application;

[0019] Figure 3 This is a second specific structural schematic diagram of the imaging system provided in the embodiments of this application;

[0020] Figure 4 This is a schematic diagram illustrating the specific implementation process of the imaging system provided in this application embodiment;

[0021] Figure 5 This is a schematic diagram illustrating the implementation process of an imaging method provided in an embodiment of this application;

[0022] The labels for each attached figure are as follows:

[0023] 1-Imaging system; 10-Image sensor; 20-Control module; 30-Lens; 40-Guide rail;

[0024] 50-Motor; 60-Baseboard; 70-Piezoelectric ceramic plate; 80-Magnetic component; 90-Optical module. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are protected by this application.

[0026] Traditional imaging systems use manual lenses and lack autofocus functionality, relying on users to manually adjust the focus ring, resulting in slow focusing speed and low accuracy. Some related technologies achieve autofocus by using an internal focusing motor to drive lens groups, but their focusing performance is unsatisfactory in dynamic shooting scenarios.

[0027] In view of this, this application proposes an imaging system and imaging method that can adaptively perform autofocus operation based on the movement of the subject being photographed, which helps to improve the imaging effect of the imaging system.

[0028] To illustrate the technical solution of this application, specific embodiments are described below.

[0029] Please refer to Figure 1 , Figure 1 A schematic diagram of the imaging system 1 provided in this application is shown. The imaging system 1 may include:

[0030] Image sensor 10 is capable of moving along the optical axis;

[0031] The control module 20 is used to perform phase detection on the image sensor 10 to obtain the first displacement of the image sensor 10, and control the image sensor 10 to move the first displacement along the optical axis. After the image sensor 10 moves the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor 10. Based on the motion classification, the second displacement of the image sensor 10 is determined, and the image sensor 10 is controlled to move the second displacement along the optical axis.

[0032] The image sensor 10 is used for photoelectric conversion and image output, and may include, but is not limited to, the following components: a substrate, a pixel array, a transistor, and a readout circuit. The pixel array consists of several photosensitive units (pixels) arranged in rows and columns. Each photosensitive unit may include, but is not limited to, a filter and a photodiode. The filter is used to ensure that each pixel can only sense the intensity information of a specific color (such as red, green, or blue). The photodiode utilizes the photoelectric effect of silicon to convert photons into photoelectrons (generating electrical charge). The transistor is used for reset, transferring the charge accumulated in the photodiode to the readout circuit, and amplifying the weak charge signal into a voltage signal. The readout circuit is used for analog-to-digital conversion and signal processing.

[0033] The control module 20 performs phase detection on the real-time imaging of the image sensor 10 to determine the first displacement required for the imaging system 1 to adjust to the focusing state. After the image sensor 10 moves by the first displacement, the image acquired by the image sensor 10 can better present the information of the subject being photographed. Based on the image acquired by the image sensor 10, the motion classification of the subject can be determined. This motion classification can reflect whether the subject is in motion. Based on the motion classification, a second displacement of the image sensor 10 can be determined, and the image sensor 10 can be controlled to move by the second displacement along the optical axis.

[0034] In the embodiments of this application, by performing phase detection on the image sensor 10, a first displacement of the image sensor 10 is obtained, and the image sensor 10 is controlled to move along the optical axis by the first displacement. After the image sensor 10 moves by the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor 10. Based on the motion classification, a second displacement of the image sensor 10 is determined, and the image sensor 10 is controlled to move along the optical axis by the second displacement. This enables adaptive autofocus based on the motion of the subject, which helps to improve the imaging effect of the imaging system 1.

[0035] Furthermore, the autofocus scheme of the conventional imaging system 1 usually involves moving the lens. This application adopts the method of moving the image sensor 10, which can reduce the need for lens structure (i.e., there is no need for confidential components on the lens to drive the lens), which helps to be compatible with lenses of different structures and reduce lens costs.

[0036] In order to enable the image sensor 10 to move along the optical axis, this application provides various specific structures of the imaging system 1.

[0037] In some embodiments of this application, such as Figure 2 As shown, the imaging system 1 may include:

[0038] The guide rail 40 is set along the optical axis, and the image sensor 10 is set on the guide rail 40;

[0039] Motor 50 is used to drive image sensor 10 to move along guide rail 40.

[0040] Thus, the imaging system 1 can drive the image sensor 10 to move along the guide rail 40 via the motor 50, enabling the image sensor 10 to move along the optical axis.

[0041] In some implementations, the guide rail 40 may employ ball bearings or a flexible hinge structure to reduce friction and vibration.

[0042] It should be noted that the displacement range of the image sensor 10 can be set according to actual conditions, for example, ±1mm. Furthermore, based on the focusing speed requirements, motors with different drive capabilities can be configured for the motor 50.

[0043] In other embodiments of this application, such as Figure 3 As shown, the imaging system 1 may include:

[0044] A substrate 60 is disposed on a piezoelectric ceramic plate 70. The piezoelectric ceramic plate 70 is used to push the substrate 60 to move along the optical axis when a voltage is received. An image sensor 10 is disposed on the substrate 60.

[0045] The piezoelectric ceramic plate 70 utilizes the piezoelectric effect to convert electrical energy into mechanical energy that propels the substrate 60 to move along the optical axis when it receives voltage, thus enabling the image sensor 10 mounted on the substrate 60 to move along the optical axis. The displacement accuracy of the piezoelectric ceramic microplate can reach the micrometer level, facilitating rapid and accurate micro-displacement.

[0046] In some embodiments of this application, such as Figure 3 As shown, the substrate 60 and the piezoelectric ceramic microplate can be flexibly connected.

[0047] In some embodiments of this application, such as Figure 3 As shown, magnetic components 80 are provided on both sides of the substrate 60 along the direction perpendicular to the optical axis. The magnetic components 80 can be used to levitate the substrate 60.

[0048] Specifically, a magnetic levitation rail can be set between the support platform and the base of the image sensor 10. The repulsive force generated by the magnetic components 80 on both sides of the substrate 60 can achieve contactless levitation of the substrate 60, which helps to reduce friction when the substrate 60 moves and reduce the jitter of the image sensor 10.

[0049] In addition to the two methods mentioned above, other imaging system structures that enable the image sensor 10 to move along the optical axis are also applicable to this application, and this application does not limit them.

[0050] In some embodiments of this application, the imaging system 1 may include a beam splitting module 90, which enables the image sensor 10 to obtain image data of the two beams of light after the incident light has been split.

[0051] Correspondingly, the control module 20 performs phase detection on the image sensor 10 to obtain the first displacement of the image sensor 10, which may include: determining the phase difference based on the image data of the two beams of light, and determining the first displacement based on the phase difference.

[0052] Specifically, the imaging system 1 may further include a lens 30, which is equipped with a beam splitting module 90 for splitting the incident light entering the lens 30. In the out-of-focus state, the two beams of light have different positions on the image sensor 10. In the focused state, the two beams of light converge to the same position on the image sensor 10. Based on the image data of the two beams of light, the phase difference is determined, and the imaging system 1 can determine the adjustment direction and a first displacement amount to drive the image sensor 10 to move to the focused position along the optical axis.

[0053] The correspondence between phase difference and displacement can be pre-defined. After phase detection, based on the pre-defined correspondence and phase difference, the first displacement corresponding to the phase difference can be directly determined.

[0054] When imaging system 1 adopts Figure 2 In the configuration of the motor 50 and guide rail 40 shown, the motor 50 can be driven according to the first displacement.

[0055] When imaging system 1 adopts Figure 3 In the embodiment of the piezoelectric ceramic plate 70 shown, the imaging system 1 can further determine the output voltage based on the first displacement and output an output voltage corresponding to the first displacement to the piezoelectric ceramic plate 70. The relationship between the displacement and the output voltage can also be pre-calibrated. In some specific embodiments, during the calibration process, the movement stroke of the image sensor 10 can be divided into several equal parts. The output voltage output to the piezoelectric ceramic plate also needs to be mapped to these equal parts. By fitting a linear relationship between the phase difference and the stroke, a mapping model for the displacement is obtained. Based on the calculated first displacement, the imaging system 1 controls the voltage output to the piezoelectric ceramic plate 70, thereby achieving the goal of moving to the target position in one go.

[0056] In some embodiments of this application, the lens 30 may also include, but is not limited to, the following components: a lens barrel, optical lenses, an aperture, and a focusing assembly. The lens barrel serves to house and secure all internal optical lenses, isolating them from dust, moisture, and physical impact. Optical lenses refract and converge light, and correct aberrations. The number of optical lenses can be one or more, and their shape and material can be selected according to specific needs; for example, their shape can be a convex lens, concave lens, or plane mirror, and their material can be optical glass, fluorite, or special resin. The aperture controls the amount of light entering the lens 30. The focusing assembly changes the optical focal point of the lens 30, enabling subjects at different distances to be clearly imaged on the sensor.

[0057] In some embodiments of this application, determining a second displacement of the image sensor 10 based on motion classification and controlling the image sensor 10 to move the second displacement along the optical axis may include: if the motion classification indicates that the subject is stationary, then stopping the movement control of the image sensor 10; if the motion classification indicates that the subject is in motion, then determining the second displacement and controlling the image sensor 10 to move the second displacement along the optical axis.

[0058] Specifically, since the image sensor 10 is in focus after the first displacement, when the subject is stationary, its position remains unchanged, and the image sensor 10 remains in focus. Therefore, movement control of the image sensor 10 can be stopped, maintaining its position along the optical axis. When the subject is moving, its position changes, and the image sensor 10 will become out of focus. In this case, a second displacement needs to be determined, and the image sensor 10 needs to be moved along the optical axis by the second displacement to move to the new position along with the subject.

[0059] When imaging system 1 adopts Figure 2 When the motor 50 and guide rail 40 are configured as shown, the motor 50 can be driven according to the second displacement. When the imaging system 1 adopts... Figure 3 When the piezoelectric ceramic plate 70 shown is used, the imaging system 1 can further determine the output voltage based on the second displacement and output the output voltage corresponding to the second displacement to the piezoelectric ceramic plate 70. The specific implementation can refer to the aforementioned method of outputting the output voltage corresponding to the first displacement to the piezoelectric ceramic plate 70, which will not be described in detail in this application.

[0060] This application does not limit the method of determining motion classification. In some embodiments, since moving objects have specific postures, such as when a person raises their leg, the corresponding image is usually taken while the person is in motion. Therefore, the imaging system 1 can determine the motion classification through posture recognition. In other embodiments, the imaging system 1 can also perform motion analysis based on the current frame image and historical frame images to obtain the motion classification of the photographed object.

[0061] In some embodiments of this application, the second displacement is positively correlated with the speed of the object being photographed.

[0062] Furthermore, the motion speed can be divided into multiple speed ranges, and a corresponding second displacement can be associated with each speed range. Based on the target speed range in which the motion speed of the subject is located, the image sensor 10 is controlled to move along the optical axis to the second displacement associated with the target speed range.

[0063] Taking two speed ranges as an example, when the speed of the object being photographed is greater than the speed threshold, the object is confirmed to be a high-speed moving object, and the image sensor 10 can be controlled to move a higher second displacement. When the speed of the object being photographed is less than or equal to the speed threshold, the object is confirmed to be a slow-moving object, and the image sensor 10 can be controlled to move a lower second displacement.

[0064] In order to improve the focusing effect, in some embodiments of this application, after the image sensor 10 moves the first displacement amount, and / or after the image sensor 10 moves the second displacement amount, the control module 20 may also be used to: determine the imaging contrast of the image sensor 10, determine a third displacement amount based on the imaging contrast of the image sensor 10, and control the image sensor 10 to move the third displacement amount along the optical axis.

[0065] Specifically, calibration can be performed in advance. Through real-time imaging by the image sensor 10, the contrast within the focus frame can be calculated. By moving the image sensor 10 to the position where this contrast reaches its peak, the displacement between this position and the original position is recorded, thus obtaining the correspondence between contrast and displacement. The position where the contrast reaches its peak is the position when the image is in focus. At this point, based on the imaging contrast of the image sensor 10 and the corresponding relationship, a third displacement corresponding to the current imaging contrast can be calculated, and the image sensor 10 can be moved along the optical axis by this third displacement, allowing the image sensor 10 to approach the position where the contrast reaches its peak.

[0066] Furthermore, in some embodiments of this application, after the image sensor 10 moves by a second displacement and controls the image sensor 10 to move by a third displacement, the method may further include: performing phase detection on the image sensor 10 again to obtain the phase difference of the image sensor 10; if the phase difference is greater than a preset threshold, then redetermining the imaging contrast of the image sensor 10 to control the image sensor 10 to move along the optical axis until the phase difference is less than or equal to the preset threshold.

[0067] In other words, the position adjustment of the image sensor 10 based on phase detection and the position adjustment of the image sensor 10 based on imaging contrast can be performed iteratively until the phase difference of the image sensor 10 obtained during phase detection is less than or equal to a preset threshold, indicating that the image sensor 10 is in focus. The preset threshold can be set according to the actual situation, for example, 0.

[0068] For easier understanding, please refer to Figure 4After the imaging system 1 is started, it can perform phase detection, and then complete a large-range displacement based on the calculated first displacement amount, followed by fine adjustments based on the image contrast. Subsequently, the Artificial Intelligence (AI) module is activated. The AI ​​module can determine the motion classification of the object being photographed. If the object is a stationary object, no processing is performed; if the object is a moving object (including fast-moving or slow-moving objects), a second displacement amount is estimated, and then the image sensor 10 is moved according to the second displacement amount. As the object moves to a new position, fine adjustments are made again based on the image contrast. At the same time, phase detection is activated to analyze the deviation of the displacement amount provided by the AI ​​module. If the phase difference is 0, it means that the displacement amount provided by the AI ​​module is correct; otherwise, the deviation amount is returned for algorithm training.

[0069] In some embodiments of this application, the imaging system 1 described above may also support in-body image stabilization (IBIS).

[0070] Figure 5 An imaging method provided in this application is illustrated and applied to the imaging system 1 described above. The imaging method may include steps S501 to S504.

[0071] Step S501: Phase detection is performed on the image sensor to obtain the first displacement of the image sensor.

[0072] Step S502: Control the image sensor to move a first displacement along the optical axis.

[0073] Step S503: After the image sensor moves by a first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor.

[0074] Step S504: Based on motion classification, determine the second displacement of the image sensor and control the image sensor to move the second displacement along the optical axis.

[0075] In the embodiments of this application, by performing phase detection on the image sensor 10, a first displacement of the image sensor 10 is obtained, and the image sensor 10 is controlled to move along the optical axis by the first displacement. After the image sensor 10 moves by the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor 10. Based on the motion classification, a second displacement of the image sensor 10 is determined, and the image sensor 10 is controlled to move along the optical axis by the second displacement. This enables adaptive autofocus based on the motion of the subject, which helps to improve the imaging effect of the imaging system 1.

[0076] In some embodiments of this application, after the image sensor 10 moves by a first displacement amount, and / or after the image sensor 10 moves by a second displacement amount, the imaging method may further include: determining the imaging contrast of the image sensor 10, determining a third displacement amount based on the imaging contrast of the image sensor 10, and controlling the image sensor 10 to move by the third displacement amount along the optical axis.

[0077] In some embodiments of this application, after the image sensor 10 moves by a second displacement and is controlled to move by a third displacement, the imaging method may further include: performing phase detection on the image sensor 10 again to obtain the phase difference of the image sensor 10; if the phase difference is greater than a preset threshold, redetermining the imaging contrast of the image sensor 10 to control the image sensor 10 to move along the optical axis until the phase difference is less than or equal to the preset threshold.

[0078] In some embodiments of this application, determining a second displacement of the image sensor 10 based on motion classification and controlling the image sensor 10 to move the second displacement along the optical axis direction may include: if the motion classification indicates that the subject is stationary, then stopping the movement control of the image sensor 10; if the motion classification indicates that the subject is in motion, then determining the second displacement and controlling the image sensor 10 to move the second displacement along the optical axis direction.

[0079] It should be noted that, for the sake of simplicity, the aforementioned method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders.

[0080] For ease of description and brevity, the specific implementation process of the above imaging method can be found in [reference needed]. Figures 1 to 4 The corresponding functions of the imaging system 1 will not be described in detail here.

[0081] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the imaging system can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0082] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0083] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for various specific applications, but such implementations should not be considered beyond the scope of this application.

[0084] In the embodiments provided in this application, it should be understood that the disclosed imaging system / electronic device and method can be implemented in other ways. For example, the imaging system / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings or direct couplings or communication connections may be through some interfaces, and the indirect couplings or communication connections between imaging systems or units may be electrical, mechanical, or other forms.

[0085] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0086] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0087] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0088] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An imaging system, characterized in that, include: An image sensor is capable of moving along the optical axis. The control module is used to perform phase detection on the image sensor to obtain a first displacement of the image sensor, and control the image sensor to move the first displacement along the optical axis. After the image sensor moves by the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor. Based on the motion classification, the second displacement of the image sensor is determined, and the image sensor is controlled to move by the second displacement along the optical axis.

2. The imaging system as described in claim 1, characterized in that, The imaging system also includes: A guide rail is provided along the optical axis, and the image sensor is mounted on the guide rail; A motor is used to drive the image sensor to move along the guide rail.

3. The imaging system as described in claim 1, characterized in that, The imaging system also includes: A substrate is disposed on a piezoelectric ceramic plate, the piezoelectric ceramic plate being used to push the substrate to move along the optical axis direction when a voltage is received, and the image sensor is disposed on the substrate.

4. The imaging system as described in claim 3, characterized in that, Magnetic components are provided on both sides of the substrate along the direction perpendicular to the optical axis, and the magnetic components are used to levitate the substrate.

5. The imaging system according to any one of claims 1-4, characterized in that, The imaging system includes a beam splitting module, which enables the image sensor to obtain image data of the two beams of light after the incident light has been split. The control module performs phase detection on the image sensor to obtain a first displacement of the image sensor, including: determining the phase difference based on the image data of the two beams of light, and determining the first displacement based on the phase difference.

6. The imaging system according to any one of claims 1-4, characterized in that, After the image sensor moves by the first displacement, and / or after the image sensor moves by the second displacement, the control module is further configured to: determine the imaging contrast of the image sensor, determine a third displacement based on the imaging contrast of the image sensor, and control the image sensor to move by the third displacement along the optical axis.

7. The imaging system as described in claim 6, characterized in that, After the image sensor moves by the second displacement and controls the image sensor to move by the third displacement, the control module is further configured to: perform phase detection on the image sensor again to obtain the phase difference of the image sensor; if the phase difference is greater than a preset threshold, redetermine the imaging contrast of the image sensor to control the image sensor to move along the optical axis until the phase difference is less than or equal to the preset threshold.

8. The imaging system according to any one of claims 1-4, characterized in that, The step of determining a second displacement of the image sensor based on the motion classification and controlling the image sensor to move the second displacement along the optical axis includes: If the motion classification indicates that the subject is stationary, then the movement control of the image sensor is stopped. If the motion classification indicates that the subject being photographed is in motion, then the second displacement amount is determined, and the image sensor is controlled to move along the optical axis by the second displacement amount.

9. An imaging method, characterized in that, include: Phase detection is performed on the image sensor to obtain the first displacement of the image sensor; Control the image sensor to move the first displacement along the optical axis; After the image sensor moves by the first displacement, the motion classification of the subject is determined based on the image acquired by the image sensor. Based on the motion classification, a second displacement of the image sensor is determined, and the image sensor is controlled to move along the optical axis by the second displacement.

10. A computer program product, characterized in that, Includes a computer program, which, when run, causes the imaging method of claim 9 to be performed.

Images