Target image acquisition method and related device

Abstract

The present application discloses a method for acquiring a target image and a related device. The method for acquiring a target image is applied to a camera, and the camera includes a lens, an image sensor, and a phase compensator. The method for acquiring a target image includes: using the lens and the phase compensator to perform focus compensation on a target object in multiple acquisition sub-areas of an acquisition area, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor; based on multiple images to be processed, a target image containing the target object is obtained. The above scheme can reduce the resource consumption of acquiring a high-definition target image with a large depth of field.

Description

Technical Field

[0001] The present application relates to the field of camera technology, and in particular to a target image acquisition method and related devices. Background Art

[0002] With the rapid development of intelligent technology, cameras, as a key visual data entry point, have increasing requirements for the quality of all-weather data collection. In low-light environments, if full-color effects need to be achieved, the aperture of the lens used will become larger and larger, resulting in the industry pain point of shallower depth of field of the camera. At present, the solution of the existing technology is usually to add an optical encoder or use multi-camera linkage to obtain an image with a large depth of field, but these methods often make the camera larger in size and the equipment cost expensive, resulting in a large resource consumption in obtaining high-definition images with a large depth of field. Therefore, how to reduce the resource consumption of obtaining high-definition target images with a large depth of field has become an urgent problem to be solved. Summary of the invention

[0003] The main technical problem solved by the present application is to provide a target image acquisition method and related devices, which can reduce the resource consumption of acquiring high-definition and large-depth-of-field target images.

[0004] To solve the above technical problems, the first aspect of the present application provides a target image acquisition method, which is applied to a camera, wherein the camera includes a lens, an image sensor and a phase compensator. The method includes: using the lens and the phase compensator to perform focus compensation on a target object in a plurality of acquisition sub-areas of an acquisition area, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor; and based on the plurality of images to be processed, a target image containing the target object is obtained.

[0005] To solve the above technical problem, the second aspect of the present application provides an electronic device, comprising a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the method described in the first aspect.

[0006] In order to solve the above technical problem, the third aspect of the present application provides a computer-readable storage medium on which program data is stored. When the program data is executed by a processor, the method described in the first aspect is implemented.

[0007] To solve the above technical problems, the fourth aspect of the present application provides a camera, comprising a lens, an image sensor and a phase compensator, and an electronic device as described in the second aspect above, and the electronic device is coupled to the image sensor and the phase compensator.

[0008] In the above scheme, the acquisition area includes multiple acquisition sub-areas, and the lens and the phase compensator are used to perform focus compensation on the target objects in the multiple acquisition sub-areas respectively, so that multiple images to be processed that match the acquisition sub-areas are formed on the image sensor, and the multiple images to be processed are processed to obtain a target image containing the target object. The full depth of field of the image is achieved by adopting a single lens and a single image sensor, which has a small size and good compatibility, thereby reducing the resource consumption of obtaining a high-definition target image with a large depth of field. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0010] Figure 1 It is a flowchart of an implementation method of a target image acquisition method of the present application;

[0011] Figure 2 It is a flowchart of another implementation method of the target image acquisition method of the present application;

[0012] Figure 3 It is a structural schematic diagram of an embodiment of the electronic device of the present application;

[0013] Figure 4 This is a schematic diagram of the structure of an embodiment of a computer-readable storage medium of the present application;

[0014] Figure 5 It is a structural schematic diagram of an embodiment of a camera of the present application. DETAILED DESCRIPTION

[0015] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments, and different implementation methods can be adaptively combined. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0016] See also Figure 1 , Figure 1 The figure is a flow chart of an embodiment of a method for acquiring a target image of the present application. The method is applied to a camera, the camera includes a lens, an image sensor and a phase compensator, wherein the method for acquiring a target image includes:

[0017] S101: performing focus compensation on target objects in multiple acquisition sub-areas of an acquisition area by using a lens and a phase compensator, so that an image to be processed matching the acquisition sub-areas is formed on an image sensor.

[0018] Specifically, the acquisition area includes multiple acquisition sub-areas, and the focus compensation is performed on the target objects in the multiple acquisition sub-areas respectively by using a lens and a phase compensator, so that multiple images to be processed that match the acquisition sub-areas are formed on the image sensor.

[0019] It can be understood that each acquisition sub-area corresponds to a best focus point.

[0020] In one application, the camera is equipped with an autofocus system, which automatically adjusts the lens to the optimal focus point corresponding to each acquisition sub-area to achieve optimal focus, and uses a phase compensator to perform focus compensation on the target object in each acquisition sub-area, so that multiple images to be processed that match the acquisition sub-area are formed on the image sensor, thereby achieving the best imaging effect.

[0021] In another application mode, the camera provides a manual focus option, and the user can manually adjust the lens to the optimal focus point corresponding to each acquisition sub-area through the manual focus option to achieve the best focus, and use the phase compensator to perform focus compensation on the target object in each acquisition sub-area, so that multiple images to be processed that match the acquisition sub-area are formed on the image sensor, thereby achieving the best imaging effect.

[0022] In some implementation scenarios, the phase compensator may be an imaging compensation group or a phase compensation wheel device.

[0023] S102: Based on a plurality of images to be processed, a target image including a target object is obtained.

[0024] Specifically, a plurality of images to be processed are processed to obtain a target image containing a target object.

[0025] In one application, multiple images to be processed are stitched together to obtain a target image containing a target object.

[0026] In another application mode, a plurality of images to be processed are fused to obtain a target image containing the target object.

[0027] In yet another application, a plurality of images to be processed are fused and spliced ​​to obtain a target image containing a target object.

[0028] In the above scheme, the acquisition area includes multiple acquisition sub-areas, and the lens and the phase compensator are used to perform focus compensation on the target objects in the multiple acquisition sub-areas respectively, so that multiple images to be processed that match the acquisition sub-areas are formed on the image sensor, and the multiple images to be processed are processed to obtain a target image containing the target object. The full depth of field of the image is achieved by adopting a single lens and a single image sensor, which has a small size and good compatibility, thereby reducing the resource consumption of obtaining a high-definition target image with a large depth of field.

[0029] See also Figure 2 , Figure 2 1 is a flow chart of another embodiment of the target image acquisition method of the present application. The method is applied to a camera, the camera includes a lens, an image sensor and a phase compensator, wherein the target image acquisition method includes:

[0030] S201: Performing focus compensation on target objects in multiple acquisition sub-areas of an acquisition area by using a lens and a phase compensator, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor.

[0031] Specifically, the acquisition area includes multiple acquisition sub-areas, and the focus compensation is performed on the target objects in the multiple acquisition sub-areas respectively by using a lens and a phase compensator, so that multiple images to be processed that match the acquisition sub-areas are formed on the image sensor.

[0032] In one embodiment, the acquisition sub-region is obtained based on the following steps: pre-dividing the image plane on the image sensor into a plurality of imaging sub-regions; based on the imaging sub-regions, determining the acquisition sub-region on the object plane of the acquisition region that has a mapping relationship with the imaging sub-region.

[0033] Specifically, the image plane is divided into a plurality of imaging sub-areas on the image sensor in advance, and according to each imaging sub-area, a collection sub-area on the object plane of the collection area that has a mapping relationship with the imaging sub-area is determined. Among them, all collection sub-areas constitute a complete collection area. By dividing the image plane into a plurality of imaging sub-areas, each imaging sub-area can be focused on capturing detail information in a smaller range, so that when light is projected onto the image sensor through the lens, the image data of each imaging sub-area can more accurately reflect its corresponding collection sub-area, and can significantly reduce image blur and distortion, thereby improving the resolution and clarity of the target image obtained subsequently.

[0034] In one implementation scenario, the number of divisions of the acquisition sub-area is at least two.

[0035] In a specific implementation scenario, the number of imaging sub-areas is four, namely A, B, C and D. Correspondingly, the number of acquisition sub-areas is also four, namely A1, B1, C1 and D1, and the best focus points corresponding to each acquisition sub-area are A', B', C' and D'. The acquisition distance of each acquisition sub-area is similar. In other specific implementation scenarios, the number of acquisition sub-areas and the acquisition distance of each acquisition sub-area are set according to actual conditions, and this application does not impose specific restrictions on this.

[0036] In one implementation scenario, the target object is a moving target, and the target image acquisition method also includes: acquiring the speed of the moving target and acquiring the acquisition time corresponding to the acquisition area; determining the acquisition sub-time corresponding to a single acquisition sub-area based on the acquisition time and the number of acquisition sub-areas divided; and adjusting the acquisition distance of the corresponding acquisition sub-area where the moving target is located based on the speed and the acquisition sub-time.

[0037] Specifically, when the target object to be photographed is moving, it is necessary to estimate the speed of the moving target and the acquisition time corresponding to the acquisition area, determine the acquisition sub-time corresponding to a single acquisition sub-area based on the acquisition time and the number of acquisition sub-areas, and readjust the acquisition distance of the acquisition sub-area based on the speed of the moving target and the acquisition sub-time, wherein the acquisition distance of the acquisition sub-area where the adjusted moving target is located needs to be greater than the distance moved by the moving target within the acquisition sub-time corresponding to the acquisition sub-area, thereby ensuring that the moving target is always within the corresponding acquisition sub-area.

[0038] In a specific implementation scenario, the speed of the moving target is V, the number of acquisition sub-areas is Q, the acquisition time corresponding to the acquisition area is T, and the acquisition sub-time corresponding to a single acquisition sub-area is t=T / Q, so the acquisition distance L of the adjusted acquisition sub-area is greater than V*t.

[0039] It should be noted that when the target object to be photographed is a moving target, step S101 needs to be repeated to ensure the clarity of the acquired image to be processed.

[0040] In one application, when the phase compensator is an imaging compensation group, the lens includes a compensation lens group, and step S201 specifically includes: using the imaging compensation group and the compensation lens group to perform focus compensation on the target objects in multiple acquisition sub-areas, so that a processed image matching the acquisition sub-area is formed on the image sensor.

[0041] Specifically, the imaging compensation group and the compensation lens group are used to perform focus compensation on the target objects in the multiple acquisition sub-areas, so that the image to be processed that matches the acquisition sub-area is formed on the image sensor. Through accurate focus compensation, it can be ensured that the target object in each acquisition sub-area is in the best position, thereby improving the stability and clarity of the image to be processed.

[0042] In one application scenario, the imaging compensation group and the compensation lens group are used to adjust the position of the focus to perform focus compensation on target objects in multiple acquisition sub-areas.

[0043] Specifically, the imaging compensation group and the compensation lens group work together to adjust the position of the focus, thereby performing focus compensation on target objects in multiple acquisition sub-areas to ensure that the image remains clear during the zooming process.

[0044] In a specific application scenario, the compensation lens group includes multiple lens elements. The multiple lenses in the compensation lens group are moved by using the imaging compensation group. The position of the focal point is adjusted by changing the distance between the lens and the image plane, thereby achieving focus compensation.

[0045] Optionally, when the target object is a moving target, the light from the moving target is focused onto a preset point through the imaging compensation group. This point can be pre-adjusted to an ideal clear position when the moving target is in a stationary state. The position change of the moving target is measured by the autofocus system in combination with an electronic algorithm. When the position change of the moving target is detected, the position of the compensation lens group is moved to adjust the position of the focus, thereby achieving focus compensation for the moving target.

[0046] In another application mode, when the phase compensator is a phase compensation wheel device, the phase compensation device includes a plurality of phase compensation plates and a phase high-speed wheel, and the number of the phase compensation plates matches the number of the acquisition sub-areas. Step S201 specifically includes: using the phase high-speed wheel to switch to the phase compensation plate corresponding to the acquisition sub-area to be photographed, and using the lens and the phase compensation plate to perform focus compensation on the target object in the acquisition sub-area, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor.

[0047] Specifically, the phase compensation plate is switched by the phase high-speed wheel, and the focus compensation is performed on the target object in the acquisition sub-area by using the lens and the phase compensation plate, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor. Through precise focus compensation, it can be ensured that the target object in each acquisition sub-area is in the best position, thereby improving the stability and clarity of the image to be processed.

[0048] Optionally, when the target object is a moving target, an autofocus system is designed in combination with a lens and a phase compensation film. The position of the moving target is identified and detected through the system and real-time tracking technology. When the position of the moving target changes, the focal length of the lens is automatically adjusted and the position of the phase compensation film is switched. An image processing algorithm is used to evaluate the imaging quality, and the parameters of the lens and the phase compensation film are adjusted according to the evaluation results, thereby ensuring that the image is clear and stable.

[0049] S202: Extracting features to be fused of the target object in the image to be processed.

[0050] Specifically, after the image to be processed is formed in the image sensor, the features to be fused of the target object in the image to be processed are extracted.

[0051] S203: splicing at least partial regions of a plurality of images to be processed based on the features to be fused to obtain a target image containing the target object.

[0052] Specifically, at least partial areas of multiple images to be processed are spliced ​​according to the features to be fused to obtain a target image containing the target object. The information of multiple images to be processed is integrated into the target image through image fusion and image splicing techniques, thereby improving the integrity of the image information of the generated target image and enhancing the visual effect of the target image.

[0053] In one implementation scenario, when multiple images to be processed contain overlapping areas, a weighted averaging method is used in the overlapping areas to assign different weights according to pixel positions, and smoothly transition the pixel values ​​of the images to be processed containing the overlapping areas, thereby eliminating the stitching seams during subsequent stitching and achieving high-quality image stitching.

[0054] In another implementation scenario, when the multiple images to be processed do not contain overlapping areas, the edges of the multiple images to be processed are directly connected, and a smooth transition method is used to reduce the edge effect caused by direct splicing, thereby achieving a seamless splicing effect.

[0055] In a specific implementation scenario, after preprocessing such as correction and denoising on multiple images to be processed, features to be fused of the target object, such as edges, textures, and colors, are extracted from the multiple images to be processed, and appropriate features to be fused are selected to splice the multiple images to be processed, thereby obtaining a target image containing the target object.

[0056] Optionally, the stitched images may be optimized to improve the quality and accuracy of the obtained target image.

[0057] Optionally, if it is necessary to shoot multiple target objects in multiple directions, the camera may also include multiple lenses.

[0058] See also Figure 3 , Figure 3 : is a structural schematic diagram of an embodiment of an electronic device of the present application, the electronic device 30 comprises a memory 300 and a processor 302 coupled to each other, wherein the memory 300 stores program instructions (not shown), and the processor 302 is used to execute the program instructions to implement the target image acquisition method in any of the above embodiments. For the description of the relevant content, please refer to the detailed description of the above method embodiment, which will not be repeated here. In addition, the processor 302 can also be called a CPU (Center Processing Unit). The processor 302 may be an integrated circuit chip with signal processing capabilities. The processor 302 can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. In addition, the processor 302 can be implemented by an integrated circuit chip.

[0059] See also Figure 4 , Figure 4 It is a structural diagram of an embodiment of a computer-readable storage medium of the present application. The computer-readable storage medium 40 stores program data 400. When the program data 400 is executed by a processor, the target image acquisition method in any of the above embodiments is implemented. For descriptions of related contents, please refer to the detailed description of the above method embodiments, which will not be repeated here.

[0060] See also Figure 5 , Figure 5 It is a structural diagram of an embodiment of a camera of the present application. The camera 50 includes a lens 500, an image sensor 501 and a phase compensator 502, and the electronic device 30 mentioned above, and the electronic device 30 is coupled to the image sensor 501 and the phase compensator 502.

[0061] It should be noted that the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present implementation scheme.

[0062] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0063] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of each implementation method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., and other media that can store program codes.

[0064] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A target image acquisition method, characterized in that: Applied to a camera, the camera includes a lens, an image sensor and a phase compensator, the method includes: Using the lens and the phase compensator to perform focus compensation on target objects in multiple acquisition sub-areas of an acquisition area, so that an image to be processed matching the acquisition sub-areas is formed on the image sensor; Based on the plurality of images to be processed, obtaining a target image including the target object; The acquisition sub-region is obtained based on the following steps: pre-dividing the image plane on the image sensor into a plurality of imaging sub-regions; based on the imaging sub-regions, determining the acquisition sub-region on the object plane of the acquisition region that has a mapping relationship with the imaging sub-region; Wherein, the target object is a moving target, and the method further includes: obtaining the speed of the moving target and obtaining the acquisition time corresponding to the acquisition area; determining the acquisition sub-time corresponding to a single acquisition sub-area based on the acquisition time and the number of divisions of the acquisition sub-area; and adjusting the acquisition distance of the acquisition sub-area corresponding to the moving target based on the speed and the acquisition sub-time, wherein the adjusted acquisition distance of the acquisition sub-area where the moving target is located is greater than the distance moved by the moving target within the acquisition sub-time corresponding to the acquisition sub-area.

2. The method according to claim 1, characterized in that: When the phase compensator is an imaging compensation group, the lens includes a compensation lens group; The method of using the lens and the phase compensator to perform focus compensation on target objects in multiple acquisition sub-areas of an acquisition area so as to form an image to be processed that matches the acquisition sub-areas on the image sensor includes: The imaging compensation group and the compensation lens group are used to perform focus compensation on the target objects in the plurality of acquisition sub-areas, so that an image to be processed that matches the acquisition sub-areas is formed on the image sensor.

3. The method according to claim 2, characterized in that The using the imaging compensation group and the compensation lens group to perform focus compensation on the target objects in the plurality of acquisition sub-areas comprises: The imaging compensation group and the compensation lens group are used to adjust the position of the focus to perform focus compensation on the target objects in the plurality of acquisition sub-areas.

4. The method according to claim 1, characterized in that When the phase compensator is a phase compensation wheel device, the phase compensation wheel device comprises a plurality of phase compensation plates and a phase high-speed wheel, and the number of the phase compensation plates matches the number of the acquisition sub-areas; The method of using the lens and the phase compensator to perform focus compensation on target objects in multiple acquisition sub-areas of an acquisition area so as to form an image to be processed that matches the acquisition sub-areas on the image sensor includes: The phase high-speed wheel is used to switch to the phase compensation plate corresponding to the acquisition sub-area to be photographed, and the lens and the phase compensation plate are used to perform focus compensation on the target object in the acquisition sub-area, so that an image to be processed that matches the acquisition sub-area is formed on the image sensor.

5. The method according to claim 1, characterized in that: The step of obtaining a target image containing the target object based on the plurality of images to be processed comprises: Extracting the features to be fused of the target object in the image to be processed; Based on the features to be fused, at least partial regions of a plurality of the images to be processed are spliced ​​to obtain the target image containing the target object.

6. An electronic device, characterized in that: The method comprises a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the method according to any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that: Program instructions that can be executed by a processor are stored, and the program instructions are used to implement the method described in any one of claims 1 to 5.

8. A camera, characterized in that: The invention comprises a lens, an image sensor and a phase compensator, and an electronic device as claimed in claim 6, wherein the electronic device is coupled to the image sensor and the phase compensator.

Images