Lens effect evaluation method and device based on image vision, equipment and medium

Abstract

The invention relates to the technical field of lenses, and provides a lens effect evaluation method and device based on image vision, equipment and a medium. Acquiring images respectively shot by a plurality of lenses in the camera device for the target object; splicing the images to generate a panoramic image; based on image parameters corresponding to the image and the panoramic image, detecting the synchronization degree of exposure states between the lenses to generate exposure parameters; detecting whether a coverage range corresponding to the panoramic image completely generates a panoramic parameter; generating color parameters among the lenses based on the color distribution condition in the image; and generating a lens effect evaluation report according to the exposure parameter, the panorama parameter and the color parameter. According to the method, the exposure synchronization degree, panoramic integrity and color consistency of each lens can be accurately and comprehensively evaluated in a multi-lens application scene, a comprehensive quantitative index is provided for multi-lens effect evaluation, the comprehensiveness and accuracy of image information generated under the multi-lens condition are ensured, and the visual effect of a product and the user experience are improved.

Description

Technical Field

[0001] The present application relates to the field of lens technology, and in particular to a lens effect evaluation method, device, equipment and medium based on image vision. Background Art

[0002] With the rapid development of digital media technology, images and videos have become an indispensable part of people's daily lives. Whether it is photo sharing on social media, short video creation, or professional film and television production and security monitoring, high-quality images and videos are indispensable. Therefore, the evaluation of lens imaging effects has become particularly important, which is directly related to the visual quality and information transmission effect of images and videos.

[0003] The current camera lens evaluation method is to use the lens to capture a single image and evaluate the image display quality to provide feedback on the lens effect. However, this method cannot be replicated in the case of multiple camera lenses. Its evaluation method is rather one-sided and cannot comprehensively evaluate the overall effect of multiple camera lenses. Summary of the invention

[0004] The embodiments of the present application provide a lens effect evaluation method, device, equipment and medium based on image vision, which can at least to a certain extent solve the problem of incomplete evaluation of the shooting effects of multiple camera lenses.

[0005] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0006] According to one aspect of the present application, a lens effect evaluation method based on image vision is provided, including: synchronously sending a photo command to multiple lenses in a camera device, obtaining images respectively taken by the lenses for a target object, stitching the images, and generating a panoramic image; based on the image and the image parameters corresponding to the panoramic image, detecting the degree of synchronization of the exposure states between the lenses, and generating exposure parameters; detecting whether the coverage range corresponding to the panoramic image is complete, and generating panoramic parameters; based on the color distribution in the image, generating color parameters between the lenses; and generating a lens effect evaluation report according to the exposure parameters, the panoramic parameters, and the color parameters.

[0007] In the present application, based on the aforementioned scheme, the image parameters corresponding to the image and the panoramic image are used to detect the degree of synchronization of the exposure states between the lenses and generate exposure parameters, including: generating a histogram corresponding to the image and the panoramic image; determining a first exposure parameter between the images according to the histogram corresponding to the image; setting a probability of simultaneous occurrence of brightness levels in each area in the histogram corresponding to the panoramic image, and determining a second exposure parameter corresponding to the panoramic image; and indicating the degree of synchronization of the exposure states between the lenses according to the first exposure parameter and the second exposure parameter.

[0008] In the present application, based on the aforementioned scheme, the detection of whether the coverage range corresponding to the panoramic image is complete and the generation of panoramic parameters includes: identifying the target object in the panoramic image; segmenting the panoramic image according to the area corresponding to the target object to generate a segmented image; performing a geometric transformation on the segmented image, comparing the generated transformed image with a preset object area, and generating panoramic parameters based on the comparison result.

[0009] In the present application, based on the aforementioned scheme, the color parameters between the lenses are generated based on the color distribution in the image, including: determining the color distribution function of the image based on the pixels of the image captured by each lens; and determining the color parameters between the lenses according to the color distribution function of the image.

[0010] In the present application, based on the aforementioned scheme, the images are stitched together to generate a panoramic image, including: detecting feature points in the image and matching the feature points; generating a transformation matrix based on the matched feature points, so as to transform the coordinates of the images and stitch them together through the transformation matrix to generate a panoramic image.

[0011] In the present application, based on the aforementioned scheme, a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters, including: obtaining a template for the evaluation report; inputting the exposure parameters, the panoramic parameters and the color parameters into the template to generate a lens effect evaluation report.

[0012] In the present application, based on the aforementioned solution, after generating the lens effect evaluation report according to the exposure parameters, the panoramic parameters and the color parameters, it also includes: adjusting the angle of each lens.

[0013] According to one aspect of the present application, a lens effect evaluation device based on image vision is provided, comprising: An image unit is used to synchronously send a shooting instruction to multiple lenses in the camera device, obtain images respectively taken by the lenses for the target object, and stitch the images to generate a panoramic image; an exposure unit, configured to detect the degree of synchronization of exposure states between the lenses based on image parameters corresponding to the image and the panoramic image, and generate exposure parameters; A panoramic unit, used to detect whether the coverage area corresponding to the panoramic image is complete and generate panoramic parameters; A color unit, used to generate color parameters between each lens based on the color distribution in the image; A reporting unit is used to generate a lens effect evaluation report according to the exposure parameter, the panoramic parameter and the color parameter.

[0014] In the present application, based on the aforementioned scheme, the image parameters corresponding to the image and the panoramic image are used to detect the degree of synchronization of the exposure states between the lenses and generate exposure parameters, including: generating a histogram corresponding to the image and the panoramic image; determining a first exposure parameter between the images according to the histogram corresponding to the image; setting a probability of simultaneous occurrence of brightness levels in each area in the histogram corresponding to the panoramic image, and determining a second exposure parameter corresponding to the panoramic image; and indicating the degree of synchronization of the exposure states between the lenses according to the first exposure parameter and the second exposure parameter.

[0015] In the present application, based on the aforementioned scheme, the detection of whether the coverage range corresponding to the panoramic image is complete and the generation of panoramic parameters includes: identifying the target object in the panoramic image; segmenting the panoramic image according to the area corresponding to the target object to generate a segmented image; performing a geometric transformation on the segmented image, comparing the generated transformed image with a preset object area, and generating panoramic parameters based on the comparison result.

[0016] In the present application, based on the aforementioned scheme, the color parameters between the lenses are generated based on the color distribution in the image, including: determining the color distribution function of the image based on the pixels of the image captured by each lens; and determining the color parameters between the lenses according to the color distribution function of the image.

[0017] In the present application, based on the aforementioned scheme, the images are stitched together to generate a panoramic image, including: detecting feature points in the image and matching the feature points; generating a transformation matrix based on the matched feature points, so as to transform the coordinates of the images and stitch them together through the transformation matrix to generate a panoramic image.

[0018] In the present application, based on the aforementioned scheme, a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters, including: obtaining a template for the evaluation report; inputting the exposure parameters, the panoramic parameters and the color parameters into the template to generate a lens effect evaluation report.

[0019] In the present application, based on the aforementioned solution, after generating the lens effect evaluation report according to the exposure parameters, the panoramic parameters and the color parameters, it also includes: adjusting the angle of each lens.

[0020] According to one aspect of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the lens effect evaluation method based on image vision as described in the above embodiment is implemented.

[0021] According to one aspect of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the lens effect evaluation method based on image vision as described in the above-mentioned embodiments.

[0022] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the lens effect evaluation method based on image vision provided in the above-mentioned various optional implementations.

[0023] In the technical solution of the present application, a shooting command is synchronously sent to multiple lenses in a camera device to obtain images respectively taken by the lenses for a target object; the images are stitched to generate a panoramic image; based on the image and the image parameters corresponding to the panoramic image, the degree of synchronization of the exposure states between the lenses is detected to generate exposure parameters; whether the coverage range corresponding to the panoramic image is complete is detected to generate panoramic parameters; based on the color distribution in the image, the color parameters between the lenses are generated; and a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters. Through multi-lens synchronous shooting and image stitching, based on the comprehensive analysis of image parameters, panoramic coverage and color distribution, the exposure synchronization, panoramic integrity and color consistency of each lens in the application scenario of multiple lenses can be accurately and comprehensively evaluated, providing comprehensive quantitative indicators for multi-lens effect evaluation, helping to optimize shooting strategies, improve shooting quality, ensure the comprehensiveness and accuracy of image information, and improve the visual effects and user experience of the final product.

[0024] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 The flowchart of a lens effect evaluation method based on image vision in one embodiment of the present application is schematically shown.

[0027] Figure 2 The flowchart for generating exposure parameters in one embodiment of the present application is schematically shown.

[0028] Figure 3 A schematic diagram of a lens effect evaluation device based on image vision in an embodiment of the present application is schematically shown.

[0029] Figure 4 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0030] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of example embodiments to those skilled in the art.

[0031] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0032] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0033] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0034] The implementation details of the technical solution of this application are described in detail below: Figure 1 FIG. 1 is a flowchart of a lens effect evaluation method based on image vision according to an embodiment of the present application. Figure 1 As shown, the lens effect evaluation method based on image vision at least includes steps S110 to S150, which are described in detail as follows: In step S110, a shooting instruction is synchronously sent to multiple lenses in the camera device to obtain images respectively captured by the lenses for the target object, and the images are stitched together to generate a panoramic image.

[0035] In one embodiment of the present application, the camera device is equipped with multiple lenses for synchronously acquiring high-definition images or videos in multiple directions through a single shot, and the high-definition image is used as the image for stitching in step S110, and the image frame in the video is used as the image for stitching in step S110.

[0036] First, connect the camera device through the network or other communication interface. Use the device driver interface to identify and initialize each lens in the camera device, including setting parameters such as resolution, frame rate, exposure, etc. After receiving the photo command, the synchronization control module generates a global synchronization signal. This signal is sent to each lens in the camera device simultaneously through a high-speed communication channel. After receiving the synchronization signal, each lens immediately activates the shutter mechanism to take a photo.

[0037] After taking a photo, each lens transmits the captured image to the computer through the communication interface. The computer receives and stores these images to ensure the integrity and accuracy of the data.

[0038] In one embodiment of the present application, stitching the images to generate a panoramic image includes: Detect feature points in the image and perform feature point matching; A transformation matrix is ​​generated according to the matched feature points, so as to perform coordinate transformation and splicing on the images through the transformation matrix to generate a panoramic image.

[0039] In one embodiment of the present application, feature points in each image are extracted by feature point detection. Then, corresponding feature points between different images are found by feature point matching. These matched feature points will be used as reference points for image stitching.

[0040] Based on the coordinates of the matched feature points in the images, a transformation matrix between the images is generated. The transformation matrix describes how to transform one image into the coordinate system of another image to achieve seamless stitching.

[0041] After obtaining the transformation matrix, each image is transformed so that they are aligned in the same coordinate system. Then, image fusion is used to merge the transformed images into a panoramic image.

[0042] In step S120, based on the image parameters corresponding to the image and the panoramic image, the degree of synchronization of the exposure states between the lenses is detected to generate exposure parameters.

[0043] like Figure 2 As shown, in one embodiment of the present application, based on the image parameters corresponding to the image and the panoramic image, the degree of synchronization of the exposure states between the lenses is detected, and the exposure parameters are generated, including: S210, generating histograms corresponding to the image and the panoramic image; S220, determining a first exposure parameter between the images according to a histogram corresponding to the image; S230, setting the probability of simultaneous occurrence of brightness levels in various regions according to a histogram corresponding to the panoramic image, and determining a second exposure parameter corresponding to the panoramic image; S240: Indicate the degree of synchronization of exposure states between lenses according to the first exposure parameter and the second exposure parameter.

[0044] In one embodiment of the present application, a histogram of the images captured by each lens and a histogram corresponding to the panoramic image generated by stitching are generated. According to the number of pixels in the histogram, the first exposure parameter between the images captured by the two lenses is first evaluated. for: in, Represents the brightness levels of the two images i The number of pixels below N Indicates the total number of pixels in the image. In this embodiment, the larger the first exposure parameter calculated, the more consistent the exposure of the two images.

[0045] Afterwards, based on the histogram of the panoramic image, the second exposure parameter between all the shots is determined. for: in, is the brightness level in the histogram of the panoramic image i and j Probability of simultaneous occurrence; They are the brightness levels in the histograms of the two images respectively i and j The probability of occurrence is calculated in this embodiment. Higher values ​​indicate that the exposures of the two images are more similar because they are more dependent on each other.

[0046] The above process uses the first exposure parameter to measure the exposure synchronization between two lenses separately, and then uses the second exposure parameter to measure the exposure synchronization of the panoramic image corresponding to all lenses. This can not only understand the exposure synchronization between each lens, but also comprehensively and globally evaluate the exposure between all lenses, thereby improving the accuracy and comprehensiveness of exposure synchronization detection and evaluation.

[0047] In step S130, it is detected whether the coverage area corresponding to the panoramic image is complete, and panoramic parameters are generated.

[0048] In one embodiment of the present application, detecting whether the coverage area corresponding to the panoramic image is complete and generating panoramic parameters includes: Identifying a target object in the panoramic image; Segmenting the panoramic image according to the area corresponding to the target object to generate a segmented image; The segmented image is geometrically transformed, the generated transformed image is compared with a preset object area, and panoramic parameters are generated according to the comparison result.

[0049] In one embodiment of the present application, the input panoramic image is analyzed to identify a specific target object in the image. The target object can be any predefined object, such as a precision device, an operating table, etc.

[0050] Furthermore, deep convolutional neural networks can be used to extract features from panoramic images. Through multi-layer convolution and pooling operations, rich feature information can be extracted from the image to form a feature map. After the target objects are identified, the panoramic image is segmented according to the position and boundaries of these objects. A high-precision semantic segmentation network can be used to divide the image into different regions, each corresponding to one or more target objects. The segmented image will show the position and shape of each target object more clearly.

[0051] Afterwards, the segmented image is geometrically transformed, specifically rotating, scaling, translating or more complex transformations of the image to change its shape, size or orientation, so as to align or match the target object in the segmented image with the preset object area, thereby making it easier to compare and analyze.

[0052] After the geometric transformation, the transformed image is compared with the preset object area. The preset object area can be defined based on prior knowledge or standards and is used to represent the position and shape of the target object under ideal or standard conditions. The purpose of the comparison is to evaluate the similarity or difference between the transformed image and the preset area. Based on the comparison results, a panoramic parameter is generated. The panoramic parameter in this embodiment is used to represent the difference in image content between the segmented image and the preset object area.

[0053] In step S140, color parameters between the lenses are generated based on the color distribution in the image.

[0054] In one embodiment of the present application, based on the color distribution in the image, generating color parameters between the lenses includes: Determining a color distribution function of the image based on pixels of the image captured by each lens; According to the color distribution function of the image, the color parameters between the shots are determined.

[0055] In one embodiment of the present application, the pixel set of the image is assumed to be , where each pixel It can be expressed as a three-dimensional vector in space. The color distribution function of the image in this embodiment is for: in, is the indicator function, c Indicates the color value, N Indicates the number of pixels, i In this embodiment, the color distribution function is defined , which can accurately describe the frequency of each color in the image. It not only considers the existence of color, but also quantifies the distribution of color in the image by discretizing the color space and calculating the frequency.

[0056] Assume that the images taken by the two lenses are and , and their color distributions are and , then the color parameters between the two lenses for: log is a logarithmic function.

[0057] The above process measures the information loss from one color distribution to another. When the two distributions are exactly the same, the color parameter is 0. The above process can effectively evaluate the color consistency difference between images taken by different lenses, and provides an intuitive numerical indicator to quantify the quality of color consistency, so as to quickly identify which lenses have different images in color, and provide guidance for subsequent adjustments and optimizations.

[0058] In step S150, a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters.

[0059] In one embodiment of the present application, generating a lens effect evaluation report according to the exposure parameter, the panoramic parameter, and the color parameter includes: Get a template for the assessment report; The exposure parameter, the panoramic parameter and the color parameter are input into the template to generate a lens effect evaluation report.

[0060] In one embodiment of the present application, a flexible template is pre-designed, which can receive and process multiple types of lens effect evaluation parameters. The template uses an extensible markup language (such as XML or JSON) so that new parameter types can be easily added in the future. Through the extensible template structure, it is convenient to add new parameter types and evaluation indicators in the future. XML is an extensible markup language. JSON is JavaScript Object Notation, JavaScript object representation.

[0061] Map the collected parameters to the corresponding fields in the template. Specifically, for exposure parameters, map to the "Exposure Settings" section in the template. For panorama parameters, map to the "Panoramic Shooting Configuration" section. For color parameters, map to the "Color Management" section. Based on the output of the evaluation algorithm, fill in the pre-designed report template. The report template contains a detailed analysis of the lens effect, scoring, and improvement suggestions.

[0062] It can also generate intuitive visualization charts, such as curve charts, color balance comparison charts, etc., so that users can understand the lens effect more intuitively. The generated report is output in PDF (Portable Document Format), HTML (Hyper Text Mark-up Language) or other formats for users to view and save. Through intuitive visualization charts, users can better understand the lens effect.

[0063] Through the above steps, the system can efficiently generate lens effect evaluation reports, which not only improves the accuracy and efficiency of the evaluation, but also realizes the full automation from data collection to report generation, reduces manual intervention and errors, and provides users with intuitive and easy-to-understand analysis results.

[0064] After generating the lens effect evaluation report according to the exposure parameters, the panoramic parameters and the color parameters, the method further includes: adjusting the angles of each lens and then adjusting the overlapping areas between pictures to improve the shooting effect of the camera lens.

[0065] In the technical solution of the present application, a shooting command is synchronously sent to multiple lenses in a camera device to obtain images respectively taken by the lenses for a target object; the images are stitched to generate a panoramic image; based on the image and the image parameters corresponding to the panoramic image, the degree of synchronization of the exposure states between the lenses is detected to generate exposure parameters; whether the coverage range corresponding to the panoramic image is complete is detected to generate panoramic parameters; based on the color distribution in the image, the color parameters between the lenses are generated; and a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters. Through multi-lens synchronous shooting and image stitching, based on the comprehensive analysis of image parameters, panoramic coverage and color distribution, the exposure synchronization, panoramic integrity and color consistency of each lens in the application scenario of multiple lenses can be accurately and comprehensively evaluated, providing comprehensive quantitative indicators for multi-lens effect evaluation, helping to optimize shooting strategies, improve shooting quality, ensure the comprehensiveness and accuracy of image information, and improve the visual effects and user experience of the final product.

[0066] The following describes an embodiment of the device of the present application, which can be used to execute the lens effect evaluation method based on image vision in the above-mentioned embodiment of the present application. It can be understood that the device can be a computer program (including program code) running in a computer device, for example, the device is an application software; the device can be used to execute the corresponding steps in the method provided in the embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the lens effect evaluation method based on image vision in the above-mentioned embodiment of the present application.

[0067] Figure 3 A block diagram of a lens effect evaluation device based on image vision according to an embodiment of the present application is shown.

[0068] Reference Figure 3 As shown, according to an embodiment of the present application, a lens effect evaluation device based on image vision includes: An image unit 310 is used to synchronously send a shooting instruction to multiple lenses in a camera device, obtain images respectively captured by the lenses for a target object, and stitch the images to generate a panoramic image; an exposure unit 320, configured to detect the degree of synchronization of exposure states between the lenses based on image parameters corresponding to the image and the panoramic image, and generate exposure parameters; A panoramic unit 330 is used to detect whether the coverage area corresponding to the panoramic image is complete and generate panoramic parameters; A color unit 340, configured to generate color parameters between each lens based on the color distribution in the image; The reporting unit 350 is used to generate a lens effect evaluation report according to the exposure parameter, the panoramic parameter and the color parameter.

[0069] In the present application, based on the aforementioned scheme, the image parameters corresponding to the image and the panoramic image are used to detect the degree of synchronization of the exposure states between the lenses and generate exposure parameters, including: generating a histogram corresponding to the image and the panoramic image; determining a first exposure parameter between the images according to the histogram corresponding to the image; setting a probability of simultaneous occurrence of brightness levels in each area in the histogram corresponding to the panoramic image, and determining a second exposure parameter corresponding to the panoramic image; and indicating the degree of synchronization of the exposure states between the lenses according to the first exposure parameter and the second exposure parameter.

[0070] In the present application, based on the aforementioned scheme, the detection of whether the coverage range corresponding to the panoramic image is complete and the generation of panoramic parameters includes: identifying the target object in the panoramic image; segmenting the panoramic image according to the area corresponding to the target object to generate a segmented image; performing a geometric transformation on the segmented image, comparing the generated transformed image with a preset object area, and generating panoramic parameters based on the comparison result.

[0071] In the present application, based on the aforementioned scheme, the color parameters between the lenses are generated based on the color distribution in the image, including: determining the color distribution function of the image based on the pixels of the image captured by each lens; and determining the color parameters between the lenses according to the color distribution function of the image.

[0072] In the present application, based on the aforementioned scheme, the images are stitched together to generate a panoramic image, including: detecting feature points in the image and matching the feature points; generating a transformation matrix based on the matched feature points, so as to transform the coordinates of the images and stitch them together through the transformation matrix to generate a panoramic image.

[0073] In the present application, based on the aforementioned scheme, a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters, including: obtaining a template for the evaluation report; inputting the exposure parameters, the panoramic parameters and the color parameters into the template to generate a lens effect evaluation report.

[0074] In the present application, based on the aforementioned solution, after generating the lens effect evaluation report according to the exposure parameters, the panoramic parameters and the color parameters, it also includes: adjusting the angle of each lens.

[0075] In the technical solution of the present application, a shooting command is synchronously sent to multiple lenses in a camera device to obtain images respectively taken by the lenses for a target object; the images are stitched to generate a panoramic image; based on the image and the image parameters corresponding to the panoramic image, the degree of synchronization of the exposure states between the lenses is detected to generate exposure parameters; whether the coverage range corresponding to the panoramic image is complete is detected to generate panoramic parameters; based on the color distribution in the image, the color parameters between the lenses are generated; and a lens effect evaluation report is generated according to the exposure parameters, the panoramic parameters and the color parameters. Through multi-lens synchronous shooting and image stitching, based on the comprehensive analysis of image parameters, panoramic coverage and color distribution, the exposure synchronization, panoramic integrity and color consistency of each lens in the application scenario of multiple lenses can be accurately and comprehensively evaluated, providing comprehensive quantitative indicators for multi-lens effect evaluation, helping to optimize shooting strategies, improve shooting quality, ensure the comprehensiveness and accuracy of image information, and improve the visual effects and user experience of the final product.

[0076] Figure 4 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.

[0077] It should be noted that the computer system of the electronic device in this embodiment is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0078] In this embodiment, the computer system includes a central processing unit 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory 402 or the program loaded from the storage part 408 to the random access memory 403, such as executing the method described in the above embodiment. Various programs and data required for system operation are also stored in the random access memory 403. The central processing unit 401, the read-only memory 402 and the random access memory 403 are connected to each other through a bus 404. The input / output interface 405 is also connected to the bus 404.

[0079] The following components are connected to the input / output interface 405: an input section 406 including a keyboard, a mouse, etc.; an output section 407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the input / output interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed so that a computer program read therefrom is installed into the storage section 408 as needed.

[0080] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 409, and / or installed from a removable medium 411. When the computer program is executed by the central processing unit 401, various functions defined in the system of the present application are executed.

[0081] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable computer program. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0082] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0083] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0084] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations.

[0085] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.

[0086] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0087] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation method of the present application.

[0088] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0089] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A lens effect evaluation method based on image vision, characterized in that: include: Synchronously sending a shooting command to multiple lenses in a camera device, obtaining images respectively captured by the lenses for a target object, and stitching the images to generate a panoramic image; Based on the image parameters corresponding to the image and the panoramic image, detecting the degree of synchronization of the exposure states between the lenses, and generating exposure parameters; Detecting whether the coverage area corresponding to the panoramic image is complete, and generating panoramic parameters; Based on the color distribution in the image, generating color parameters between the lenses; A lens effect evaluation report is generated according to the exposure parameter, the panoramic parameter and the color parameter.

2. The lens effect evaluation method based on image vision according to claim 1, characterized in that: The detecting the degree of synchronization of the exposure states between the lenses based on the image parameters corresponding to the image and the panoramic image, and generating the exposure parameters, comprises: Generating histograms corresponding to the image and the panoramic image; Determining a first exposure parameter between the images according to a histogram corresponding to the image; According to the histogram corresponding to the panoramic image, the probability of the brightness level appearing simultaneously in each area is set to determine the second exposure parameter corresponding to the panoramic image; The synchronization degree of the exposure states between the lenses is indicated according to the first exposure parameter and the second exposure parameter.

3. The lens effect evaluation method based on image vision according to claim 1, characterized in that: The detecting whether the coverage area corresponding to the panoramic image is complete and generating panoramic parameters includes: Identifying a target object in the panoramic image; Segmenting the panoramic image according to the area corresponding to the target object to generate a segmented image; The segmented image is geometrically transformed, the generated transformed image is compared with a preset object area, and panoramic parameters are generated according to the comparison result.

4. The lens effect evaluation method based on image vision according to claim 1, characterized in that: The step of generating color parameters between the lenses based on the color distribution in the image includes: Determining a color distribution function of the image based on pixels of the image captured by each lens; According to the color distribution function of the image, the color parameters between the shots are determined.

5. The lens effect evaluation method based on image vision according to claim 1, characterized in that: The step of stitching the images to generate a panoramic image includes: Detect feature points in the image and perform feature point matching; A transformation matrix is ​​generated according to the matched feature points, so as to perform coordinate transformation and splicing on the images through the transformation matrix to generate a panoramic image.

6. The lens effect evaluation method based on image vision according to claim 1, characterized in that: Generating a lens effect evaluation report according to the exposure parameter, the panoramic parameter, and the color parameter includes: Get a template for the assessment report; The exposure parameter, the panoramic parameter and the color parameter are input into the template to generate a lens effect evaluation report.

7. The lens effect evaluation method based on image vision according to claim 1, characterized in that: After generating a lens effect evaluation report according to the exposure parameter, the panoramic parameter and the color parameter, the method further includes: Adjust the angle of each lens.

8. A lens effect evaluation device based on image vision, characterized in that: include: An image unit is used to synchronously send a shooting instruction to multiple lenses in the camera device, obtain images respectively taken by the lenses for the target object, and stitch the images to generate a panoramic image; an exposure unit, configured to detect the degree of synchronization of exposure states between the lenses based on image parameters corresponding to the image and the panoramic image, and generate exposure parameters; A panoramic unit, used to detect whether the coverage area corresponding to the panoramic image is complete and generate panoramic parameters; A color unit, used to generate color parameters between each lens based on the color distribution in the image; A reporting unit is used to generate a lens effect evaluation report according to the exposure parameter, the panoramic parameter and the color parameter.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the lens effect evaluation method based on image vision as described in any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the lens effect evaluation method based on image vision as described in any one of claims 1 to 7.

Images