A photographing detection method and device and a storage medium

Abstract

The present disclosure relates to a photographing detection method, device and storage medium. The photographing detection method comprises: acquiring a picture photographed by a camera during zooming, the picture comprising N frames of images of a same photographed object, the photographed object having different colors displayed at predefined positions, N being a positive integer greater than 1; determining a quality parameter of each frame of image in the N frames of images based on a display position area of the different colors in the image; and obtaining a quality consistency detection result of the N frames of images based on the quality parameter of each frame of image. The present disclosure efficiently detects the quality consistency of the picture photographed by the camera during zooming.

Description

Technical Field

[0001] This disclosure relates to the field of camera technology, and in particular to a shooting detection method, apparatus and storage medium. Background Technology

[0002] With the development of photography technology, it has become a common strategy for various brands and products to have multiple cameras with different focal lengths on a single device. Switching between different focal length cameras can lead to inconsistencies in image quality across various dimensions, and these inconsistencies are particularly noticeable when switching between different cameras. Therefore, the consistency of image quality in the footage captured by the device is tested before it leaves the factory. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this disclosure provides a method, apparatus and storage medium for image detection.

[0004] According to a first aspect of the present disclosure, a shooting detection method is provided, the method comprising: acquiring a frame captured by a camera during zooming, the frame comprising N frames of images of the same subject, the subject having different colors displayed at predefined positions, the N being a positive integer greater than 1; determining image quality parameters of each frame of the N frames based on the display position regions of the different colors in the images; and obtaining an image quality consistency detection result of the N frames based on the image quality parameters of each frame.

[0005] In one embodiment, determining the image quality parameters of each frame in the N frames of images based on the display position regions of different colors in the image includes: identifying the display position regions of the same color in each frame of the image to obtain multiple regions of interest for the same color; for each of the different colors, determining the average value of each color component in the three primary colors within the multiple regions of interest, and performing linearization correction and color space transformation on the average value of each color component in the three primary colors to obtain the Lab color space value.

[0006] In one embodiment, the image quality includes exposure brightness, and the color includes gray. Obtaining the image quality consistency detection result of the N frames based on the image quality parameters of each frame includes: determining the difference between the brightness value in the Lab color space of each frame corresponding to gray in the N frames and the brightness value in the Lab color space of adjacent frames; if there are frame images with a difference greater than a first threshold, and the number of frame images with a difference greater than the threshold is greater than a second threshold, then it is determined that the images captured by the camera during zooming have a jump in exposure brightness, and the exposure brightness changes are inconsistent; if there are no frame images with a difference greater than the first threshold, then it is determined that the images captured by the camera during zooming have consistent exposure brightness.

[0007] In one implementation, the image quality includes white balance, and the color includes gray. Obtaining the image quality consistency detection result of the N frames based on the image quality parameters of each frame includes: acquiring a first color difference change between every two adjacent frames corresponding to gray in the N frames, the first color difference change being determined based on the mean of the Lab color space color values ​​corresponding to gray; determining that the white balance of the images captured by the camera during zoom is inconsistent in response to the maximum color difference change in the first color difference change being greater than a third threshold; and determining that the white balance of the images captured by the camera during zoom is consistent in response to the maximum color difference change in the first color difference change being less than or equal to the third threshold.

[0008] In one implementation, the image quality includes color reproduction, and the colors include red, green, and blue. Obtaining the image quality consistency detection result of the N frames based on the image quality parameters of each frame includes: acquiring the second color difference change between each pair of adjacent frames corresponding to red, the third color difference change between each pair of adjacent frames corresponding to green, and the fourth color difference change between each pair of adjacent frames corresponding to blue in the N frames; in response to the mean value of the second color difference change being less than or equal to a fourth threshold, the mean value of the third color difference change being less than or equal to the fourth threshold, and the mean value of the fourth color difference change being less than or equal to the fourth threshold, determining that the color reproduction of the images captured by the camera during zoom is consistent; in response to the presence of a color difference change mean value greater than the fourth threshold among the mean values ​​of the second, third, and fourth color difference changes, determining that the color reproduction of the images captured by the camera during zoom is inconsistent.

[0009] In one embodiment, acquiring the image captured by the camera during zooming includes: controlling the camera to zoom at a constant speed, and maintaining the preview image captured during zooming to display the target area of ​​the subject, wherein the target area includes the location areas of all colors among the different colors; and recording the preview image captured by the camera during zooming.

[0010] In one embodiment, the subject of the photograph is a preset color chart, which includes red, green, blue, and gray color blocks displayed at predefined positions.

[0011] According to a second aspect of the present disclosure, a shooting detection apparatus is provided, the apparatus comprising: an acquisition unit, configured to acquire images captured by a camera during zooming, the images comprising N frames of images of the same subject, the subject having different colors displayed at predefined positions, the N being a positive integer greater than 1; a determination unit, configured to determine image quality parameters of each frame of the N frames based on the display position regions of the different colors in the images; and an execution unit, configured to obtain an image quality consistency detection result of the N frames based on the image quality parameters of each frame.

[0012] In one embodiment, the determining unit determines the image quality parameters of each frame of the N frames of images based on the display position regions of the different colors in the image as follows: identifying the display position regions of the same color in each frame of the image to obtain multiple regions of interest for the same color; for each of the different colors, determining the average value of each color component of the three primary colors in the multiple regions of interest, and performing linearization correction and color space transformation on the average value of each color component of the three primary colors to obtain the Lab space color value.

[0013] In one implementation, the image quality includes exposure brightness, and the color includes gray. The execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: determining the difference between the brightness value in the Lab space color value of each frame corresponding to gray in the N frames of images and the brightness value in the Lab space color value of the adjacent frame; if there are frame images with a difference greater than a first threshold, and the number of frame images with a difference greater than the threshold is greater than a second threshold, then it is determined that the image captured by the camera during the zoom process has an exposure brightness jump and inconsistent exposure brightness changes; if there are no frame images with a difference greater than the first threshold, then it is determined that the image captured by the camera during the zoom process has consistent exposure brightness.

[0014] In one implementation, the image quality includes white balance, and the color includes gray. The execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: obtaining the first color difference change between each two adjacent frames corresponding to gray in the N frames of images, wherein the first color difference change is determined based on the mean value of the Lab color space color value corresponding to gray; in response to the maximum color difference change in the first color difference change being greater than a third threshold, determining that the white balance of the images captured by the camera during zoom is inconsistent; in response to the maximum color difference change in the first color difference change being less than or equal to the third threshold, determining that the white balance of the images captured by the camera during zoom is consistent.

[0015] In one implementation, the image quality includes color reproduction, and the colors include red, green, and blue. The execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: acquiring the second color difference change between each two adjacent frames corresponding to red, the third color difference change between each two adjacent frames corresponding to green, and the fourth color difference change between each two adjacent frames corresponding to blue in the N frames of images; in response to the mean value of the second color difference change being less than or equal to a fourth threshold, the mean value of the third color difference change being less than or equal to the fourth threshold, and the mean value of the fourth color difference change being less than or equal to the fourth threshold, determining that the color reproduction of the images captured by the camera during zoom is consistent; in response to the presence of a color difference change mean value greater than the fourth threshold among the mean values ​​of the second color difference change, the third color difference change, and the fourth color difference change, determining that the color reproduction of the images captured by the camera during zoom is inconsistent.

[0016] In one embodiment, the acquisition unit acquires the image captured by the camera during zooming in the following manner: controlling the camera to zoom at a constant speed, and maintaining the preview image captured during zooming to display the target area of ​​the subject, the target area including the location areas of all the different colors; recording the preview image captured by the camera during zooming.

[0017] In one embodiment, the subject of the photograph is a preset color chart, which includes red, green, blue, and gray color blocks displayed at predefined positions.

[0018] According to a third aspect of the present disclosure, a camera detection apparatus is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the camera detection method described in the first aspect or any embodiment of the first aspect.

[0019] According to a fourth aspect of the present disclosure, a storage medium is provided, the storage medium storing instructions that, when executed by a processor of a terminal, enable the terminal to perform the shooting detection method described in the first aspect or any one of the embodiments of the first aspect.

[0020] The technical solutions provided by the embodiments of this disclosure can include the following beneficial effects: Image quality consistency detection is performed based on the image quality parameters of each frame in N frames of images captured by the camera during zooming, thereby achieving image quality consistency detection during zooming. Furthermore, by determining the image quality parameters of each frame in the N frames based on the display position regions of different colors in the images, image quality consistency detection can be performed more efficiently.

[0021] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0023] Figure 1 This is a flowchart illustrating an image detection method according to an exemplary embodiment.

[0024] Figure 2 This is a flowchart illustrating an image detection method according to an exemplary embodiment.

[0025] Figure 3 This is a flowchart illustrating an exposure consistency detection according to an exemplary embodiment.

[0026] Figure 4 This is a schematic diagram illustrating the trend of exposure brightness variation in preview video quality according to an exemplary embodiment.

[0027] Figure 5 This is a flowchart illustrating a method for detecting white balance consistency according to an exemplary embodiment.

[0028] Figure 6 This is a flowchart illustrating a method for detecting color reproduction consistency according to an exemplary embodiment.

[0029] Figure 7 This is a schematic diagram illustrating the trend of white balance consistency and smoothness changes in a preview video according to an exemplary embodiment.

[0030] Figure 8 This is a schematic diagram illustrating the trend of blue, red, and green color reproduction consistency and smoothness changes in a preview video according to an exemplary embodiment.

[0031] Figure 9 This is a schematic diagram illustrating the display effect of a full-size color card according to an exemplary embodiment.

[0032] Figure 10 This is a schematic diagram illustrating the enlarged display effect of a color chart according to an exemplary embodiment.

[0033] Figure 11 This is a schematic diagram illustrating the design of numbers 1-9 in the central area of ​​a color chart according to an exemplary embodiment.

[0034] Figure 12 This is a schematic diagram illustrating the correspondence between numbers and colors in each frame of an image, according to an exemplary embodiment.

[0035] Figure 13 This is a block diagram illustrating a photographic detection device according to an exemplary embodiment.

[0036] Figure 14 This is a block diagram illustrating a photographic detection device according to an exemplary embodiment.

[0037] Figure 15 This is a block diagram illustrating a photographic detection device according to an exemplary embodiment. Detailed Implementation

[0038] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure.

[0039] With the development of photography technology, a device may have multiple cameras with different focal lengths. However, due to differences in modules and sensors, different focal length cameras may cause inconsistent image quality across various dimensions. Therefore, devices with multiple cameras with different focal lengths need to undergo image quality consistency testing before leaving the factory.

[0040] Based on this, the present disclosure provides a shooting detection method to detect the consistency of image quality of images captured by cameras with different focal lengths.

[0041] Figure 1 This is a flowchart illustrating an image detection method according to an exemplary embodiment, such as... Figure 1 As shown, it includes the following steps.

[0042] In step S101, the image captured by the camera during the zoom process is obtained.

[0043] In this embodiment of the disclosure, the screen includes N frames of images of the same subject, the subject having different colors displayed at predefined positions, and N being a positive integer greater than 1.

[0044] Among them, the camera is not limited to multiple cameras on one device, cameras on multiple devices, or single cameras with different focal lengths.

[0045] This disclosure uses multiple cameras with different focal lengths for illustration.

[0046] For example, when shooting with cameras with different focal lengths, first keep the entire content of the image filling the FOV of the preview screen, zoom in at a constant speed, record the changes in the screen preview, and obtain N frames of screen recording images, where each frame includes different colors and spatial positions preset in advance.

[0047] In step S102, the image quality parameters of each frame in the N frames are determined based on the display location regions of different colors in the image.

[0048] In this embodiment of the disclosure, the image quality parameters of each frame in N frames are determined based on the different colors and spatial positions of the subject being photographed.

[0049] In step S103, the image quality consistency detection result of N frames of images is obtained based on the image quality parameters of each frame.

[0050] In this embodiment of the disclosure, based on the image quality parameters of each frame, the consistency of images captured by multiple cameras with different focal lengths during zooming is detected, such as image quality exposure, white balance, and color reproduction.

[0051] In this embodiment, image quality consistency detection is performed based on the image quality parameters of each frame in N frames captured by the camera during zooming, thus achieving image quality consistency detection during zooming. Furthermore, by determining the image quality parameters of each frame in the N frames based on the display location regions of different colors in the images, image quality consistency detection can be performed more efficiently, resulting in more refined image quality consistency detection and providing users with a good experience of image quality consistency and smoothness.

[0052] Figure 2 This is a flowchart illustrating an image detection method according to an exemplary embodiment, such as... Figure 2 As shown, it includes the following steps.

[0053] In step S201, the display location areas of the same color in each frame of the image are identified to obtain multiple regions of interest of the same color.

[0054] In this embodiment of the disclosure, the shooting object has different colors and spatial positions preset, and the regions with the same color in each frame of the image are identified as regions of interest, that is, any color in N frames of the image has N regions of interest.

[0055] In step S202, for each color in different colors, the average value of each color component in the three primary colors in multiple regions of interest is determined, and the average value of each color component in the three primary colors is linearized and the color space value is obtained by color space transformation.

[0056] In this embodiment of the disclosure, the RGB mean value of the same color in each frame of the image is determined, and the RGB mean value is linearized and corrected, as well as the Lab color value obtained by color gamut space transformation.

[0057] In this embodiment of the disclosure, by identifying regions of interest of the same color in each frame, different colors are accurately divided, thereby more accurately determining the average value of each color component in the three primary colors of different colors in each frame image.

[0058] For example, calculate the average RGB values ​​of the four color ROI regions in each frame.

[0059]

[0060]

[0061]

[0062] Where x=1 represents a blue patch, x=2 represents a red patch, x=3 represents a green patch, and x=4 represents a gray patch. n represents the number of corresponding color patches identified in the current frame.

[0063] Based on formula (4), the RGB mean values ​​of the four colors obtained in the above steps are linearized and corrected to obtain R. linear G linear B linear .

[0064]

[0065] Based on formula (5), the RGB mean values ​​of the four colors are linearized and corrected.

[0066]

[0067] in,

[0068]

[0069] Based on formula (4), convert the X, Y, and Z values ​​to the L*a*b* color space:

[0070]

[0071] in,

[0072] X0=95.05, Y0=100, Z0=108.90

[0073]

[0074] Finally, we obtain the L*a*b* values ​​for the four colors blue, red, green, and gray in the current frame.

[0075]

[0076] Figure 3 This is a flowchart illustrating the detection of exposure consistency according to an exemplary embodiment, such as... Figure 3 As shown, it includes the following steps.

[0077] In step S301, the difference between the luminance value in the Lab color space of each frame corresponding to gray in the N frames is determined and the luminance value in the Lab color space of the adjacent frame.

[0078] In this embodiment of the disclosure, the brightness value L in the Lab value of each frame corresponding to gray in N frames is determined, and the image quality exposure consistency is detected based on the difference between the brightness values ​​of two adjacent frames.

[0079] In step S302, if there are frame images with a difference greater than the first threshold, and the number of frame images with a difference greater than the first threshold is greater than the second threshold, then it is determined that the images captured by the camera during the zoom process have a jump in exposure brightness and inconsistent exposure brightness changes.

[0080] In this embodiment of the disclosure, if the difference in brightness between two adjacent frames corresponding to gray in each of the N frames is greater than a first threshold, that is, the difference in brightness between two adjacent frames is large and there is a brightness jump, and the number of frames with a value greater than the threshold is greater than a second threshold, that is, the number of brightness jumps is large, then it is determined that the images captured by multiple cameras with different focal lengths during the zoom process have exposure brightness jumps and inconsistent exposure brightness changes.

[0081] In step S303, if there is no frame image with a difference greater than the first threshold, it is determined that the exposure brightness of the images captured by the camera during the zoom process is consistent.

[0082] In this embodiment of the disclosure, if the difference in brightness value between adjacent frames corresponding to gray in N frames is small, that is, there is no brightness jump or the brightness jump is small between adjacent frames, then it is determined that the exposure brightness of the images captured by multiple cameras with different focal lengths is consistent during the zoom process.

[0083] In this embodiment of the disclosure, the image quality exposure consistency of the camera during zooming is accurately detected based on the relationship between the inter-frame brightness change corresponding to gray and the corresponding threshold.

[0084] For example, recording each frame of the complete preview video as a gray block. The changes in brightness and exposure are used to determine the consistency and smoothness of the changes in the preview image quality. For example... Figure 4As shown, the curves can be used to visually identify multiple brightness jumps, thus enabling more efficient identification of inconsistent exposure brightness, i.e., uneven exposure brightness changes.

[0085] Figure 5 This is a flowchart illustrating an image detection method according to an exemplary embodiment, such as... Figure 5 As shown, it includes the following steps.

[0086] In step S401, the first color difference change between each two adjacent frames corresponding to gray in the N frames of images is obtained. The first color difference change is determined based on the mean value of the Lab color space corresponding to gray.

[0087] In this embodiment of the disclosure, the Lab difference between each two adjacent frames corresponding to gray in N frames of images is obtained, that is, the first color difference change.

[0088] In step S402, in response to the maximum color difference change in the first color difference change being greater than the third threshold, it is determined that the white balance of the image captured by the camera during zooming is inconsistent.

[0089] In this embodiment of the disclosure, if the maximum difference in the Lab difference between each two adjacent frames corresponding to gray in N frames of images is greater than the difference threshold for white balance inconsistency, i.e. the third threshold, it is determined that the white balance of the images captured by the camera during zooming is inconsistent.

[0090] In step S403, in response to the maximum color difference change in the first color difference change being less than or equal to the third threshold, it is determined that the white balance of the image captured by the camera during zooming is consistent.

[0091] In this embodiment of the disclosure, if the maximum difference in the Lab difference between each two adjacent frames corresponding to gray in N frames is less than or equal to the difference threshold for white balance inconsistency, i.e. the third threshold, it is determined that the white balance of the images captured by multiple cameras with different focal lengths is consistent during the zoom process.

[0092] In this embodiment of the disclosure, the consistency of image quality white balance of the camera during zooming is accurately detected based on the relationship between the inter-frame color difference corresponding to gray and the difference threshold at which white balance inconsistency occurs.

[0093] Figure 6 This is a flowchart illustrating an image detection method according to an exemplary embodiment, such as... Figure 6 As shown, it includes the following steps.

[0094] In step S501, the second color difference change between each pair of adjacent frames corresponding to red, the third color difference change between each pair of adjacent frames corresponding to green, and the fourth color difference change between each pair of adjacent frames corresponding to blue are obtained in the N frames of images.

[0095] In this embodiment of the disclosure, the Lab difference between each two adjacent frames corresponding to red in N frames of images is obtained, which is the second color difference change; the Lab difference between each two adjacent frames corresponding to green in N frames of images is obtained, which is the third color difference change; and the Lab difference between each two adjacent frames corresponding to blue in N frames of images is obtained, which is the fourth color difference change.

[0096] Calculate the average L*a*b* color difference ΔE between every two frames of the preview video, representing blue, red, green, and gray. 00 The calculation formula is as follows:

[0097]

[0098] Taking red as an example, through two consecutive frames corresponding to and The lightness difference ΔL and chroma difference ΔC were calculated. ab Hue difference ΔH ab The calculation formula is as follows:

[0099]

[0100]

[0101]

[0102] Color difference ΔE 00 The calculation formula is as follows:

[0103]

[0104] Some of the weighting parameters are calculated using the following formulas, where:

[0105]

[0106]

[0107]

[0108] The formulas for calculating the parameters are as follows:

[0109]

[0110]

[0111]

[0112] R T = -sin(2Δθ)*R C (17)

[0113] in, It represents the arithmetic mean of the values ​​measured at two different magnifications.

[0114] The DeltaE values ​​of the three colors (blue, red, and green) are calculated from the mean values ​​of L*a*b* for consecutive frames of the preview video to obtain the changes in the DeltaE values ​​of all three colors between frames, and recorded as DeltaE. blue DeltaE red DeltaE green DeltaE gray Preview video DeltaE gray Changes as follows Figure 7 As shown.

[0115] via DeltaE blue DeltaE red DeltaE green The changes resulted in conclusions regarding the consistency of color reproduction and smoothness of the preview video's image quality. (Preview video DeltaE) blue DeltaE red DeltaE green Changes as follows Figure 8 As shown.

[0116] In step S502, in response to the mean value of the second color difference change being less than or equal to the fourth threshold, the mean value of the third color difference change being less than or equal to the fourth threshold, and the mean value of the fourth color difference change being less than or equal to the fourth threshold, it is determined that the colors of the images captured by the camera during the zoom process are consistent.

[0117] In this embodiment of the disclosure, if the average Lab difference between each adjacent pair of red frames in N frames is less than or equal to a fourth threshold, and the average Lab difference between each adjacent pair of green frames in N frames is less than or equal to a fourth threshold, and the average Lab difference between each adjacent pair of blue frames in N frames is less than or equal to a fourth threshold, it is determined that the colors of the images captured by multiple cameras with different focal lengths are consistent during the zoom process.

[0118] The fourth threshold is the difference threshold for color reproduction inconsistencies.

[0119] For example, the preview or video zoom exposure consistency requirement is the maximum brightness difference DeltaL between gray patches in different frames. gray Value not greater than 10. Preview or video zoom white balance consistency requires inter-frame DeltaE. gray The maximum value is no greater than 5. Preview or video zoom color reproduction consistency requirements: average value of green patches between frames, maximum color difference DeltaE. green Not greater than 7, the maximum color difference DeltaE of the average red color block between frames. red It should not exceed 7, and the inter-frame blue DeltaE blueThe maximum color difference of the average color block is no more than 7.

[0120] In step S503, in response to the mean values ​​of the second color difference change, the third color difference change, and the fourth color difference change, it is determined that the color reproduction of the image captured by the camera during the zoom process is inconsistent.

[0121] In this embodiment of the disclosure, if the average Lab difference between each pair of adjacent frames corresponding to red in N frames, the average Lab difference between each pair of adjacent frames corresponding to green in N frames, and the average Lab difference between each pair of adjacent frames corresponding to blue in N frames contain a color difference change greater than a fourth threshold, it is determined that the colors of the images captured by multiple cameras with different focal lengths are consistent during the zoom process.

[0122] In this embodiment of the disclosure, the relationship between the color difference changes corresponding to the three colors of red, green and blue and the difference threshold of the color reproduction inconsistency corresponding to the three colors is used to more accurately detect the consistency of image quality color reproduction of the camera during the zoom process.

[0123] In this embodiment of the disclosure, the camera is controlled to zoom at a constant speed, and during the zooming process, the preview image of the captured object is kept showing the target area of ​​the object. The target area includes the location area of ​​all colors among the different colors.

[0124] In this embodiment of the disclosure, the camera is controlled to zoom in at a constant speed, and during the zooming process, the captured image remains the target area of ​​the object being captured, that is, the target area has all the colors corresponding to the target object.

[0125] In this embodiment of the disclosure, controlling the camera to zoom in at a constant speed can make the image change continuously throughout the zoom process.

[0126] In this embodiment of the disclosure, a preview image captured during the camera zoom process is recorded.

[0127] In this embodiment of the disclosure, based on the images captured by the recording camera during zooming, data of N frames of images are obtained, that is, images with predefined colors of the captured images and spatial positions corresponding to different colors.

[0128] For example, such as Figure 9 and Figure 10 As shown, this illustrates the color chart display effects at different magnifications. The chart contains 45 color blocks with numbers, arranged from the four corners towards the center as shown in the image above.

[0129] From top left to center: 91, 81, 71, 61, 51, 41, 31, 21, 11 (blue)

[0130] From top right to center: 93, 83, 73, 63, 53, 43, 33, 23, 13 (red)

[0131] Bottom left to center: 96, 86, 76, 66, 56, 46, 36, 26, 16 (green)

[0132] Bottom right to center: 98, 88, 78, 68, 58, 48, 38, 28, 18 (gray)

[0133] The specific plan for the numbers 1-9 in the central area is as follows: Figure 11 As shown.

[0134] The color standard reference values ​​for the zoom color chart are shown in the table below. The sRGB values ​​are based on D65 lighting conditions, and the CIEL*a*b* values ​​are measured under D50 lighting conditions at a 2-degree observation angle.

[0135]

[0136] For example, the coordinates of numbers in each frame of the image are identified. Based on the correspondence between numbers and colors, the identified numbers can be classified by color. The identified ROIs for blue numbers are denoted as ROI 1-n, for red numbers as ROI 2-n, for green numbers as ROI 3-n, and for gray blocks as ROI 4-n, and so on. Figure 12 As shown.

[0137] In this embodiment of the disclosure, the subject of the photograph is a preset color chart, which includes red, green, blue and gray color blocks displayed at predefined positions.

[0138] In this embodiment of the disclosure, the camera is controlled to capture images of objects with predefined colors and spatial positions, making the detection results more accurate.

[0139] For example, during shooting, the entire content of the image card fills the FOV of the preview screen, the zoom is increased at a constant speed, the screen preview changes are recorded, and the screen recording data is obtained and analyzed and calculated frame by frame.

[0140] This disclosure primarily addresses the issue of image quality consistency and smoothness detection during camera zoom, including white balance color reproduction and exposure. It conducts closed-loop testing on image quality consistency and smoothness, and optimizes debugging parameters based on the test results.

[0141] Based on the same concept, embodiments of this disclosure also provide an image detection device.

[0142] It is understood that the imaging and detection device provided in this disclosure includes hardware structures and / or software modules corresponding to each function in order to achieve the above-mentioned functions. In conjunction with the units and algorithm steps of the various examples disclosed in this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solution of this disclosure.

[0143] Figure 13 This is a block diagram illustrating an image detection device according to an exemplary embodiment. (Refer to...) Figure 13 The device 100 includes an acquisition unit 101, a determination unit 102, and an execution unit 103.

[0144] The acquisition unit 101 is used to acquire the images captured by the camera during zooming. The images include N frames of images of the same subject. The subject has different colors displayed at predefined positions, and N is a positive integer greater than 1. The determination unit 102 is used to determine the image quality parameters of each frame of the N frames based on the display position areas of different colors in the images. The execution unit 103 is used to obtain the image quality consistency detection result of the N frames based on the image quality parameters of each frame.

[0145] In one embodiment, the determining unit 102 determines the image quality parameters of each frame of N frames of images based on the display position regions of different colors in the image as follows: identifying the display position regions of the same color in each frame of the image to obtain multiple regions of interest for the same color; for each color, determining the average value of each color component in the three primary colors in the multiple regions of interest, and performing linearization correction and color space transformation on the average value of each color component in the three primary colors to obtain the Lab space color value.

[0146] In one implementation, image quality includes exposure brightness, and color includes gray. The execution unit 103 obtains the image quality consistency detection result of N frames of images based on the image quality parameters of each frame of images in the following manner: determining the difference between the brightness value in the Lab space color value of each frame corresponding to gray in the N frames of images and the brightness value in the Lab space color value of adjacent frames; if there are frame images with a difference greater than a first threshold, and the number of frame images with a difference greater than the threshold is greater than a second threshold, then it is determined that the image captured by the camera during the zoom process has an exposure brightness jump and inconsistent exposure brightness changes; if there are no frame images with a difference greater than the first threshold, then it is determined that the image captured by the camera during the zoom process has consistent exposure brightness.

[0147] In one implementation, image quality includes white balance, and color includes gray. The execution unit 103 obtains the image quality consistency detection result of N frames of images based on the image quality parameters of each frame of the image in the following manner: obtaining the first color difference change between each two adjacent frames corresponding to gray in the N frames of the image, the first color difference change being determined based on the mean value of the Lab color space corresponding to gray; in response to the maximum color difference change in the first color difference change being greater than a third threshold, determining that the white balance of the images captured by the camera during zoom is inconsistent; in response to the maximum color difference change in the first color difference change being less than or equal to the third threshold, determining that the white balance of the images captured by the camera during zoom is consistent.

[0148] In one implementation, image quality includes color reproduction, and the colors include red, green, and blue. The execution unit 103 obtains the image quality consistency detection result of N frames of images based on the image quality parameters of each frame as follows: It acquires the second color difference change between each pair of adjacent frames corresponding to red, the third color difference change between each pair of adjacent frames corresponding to green, and the fourth color difference change between each pair of adjacent frames corresponding to blue in the N frames of images; in response to the mean value of the second color difference change being less than or equal to a fourth threshold, the mean value of the third color difference change being less than or equal to the fourth threshold, and the mean value of the fourth color difference change being less than or equal to the fourth threshold, it determines that the color reproduction of the images captured by the camera during zooming is consistent; in response to the presence of a color difference change mean value greater than the fourth threshold among the mean values ​​of the second, third, and fourth color difference changes, it determines that the color reproduction of the images captured by the camera during zooming is inconsistent.

[0149] In one embodiment, the acquisition unit 101 acquires the image captured by the camera during zooming in the following manner: controlling the camera to zoom at a constant speed, and maintaining the preview image captured during zooming to display the target area of ​​the subject, the target area including the location areas of all colors among the different colors; recording the preview image captured by the camera during zooming.

[0150] In one embodiment, the subject of the photograph is a preset color chart, which includes red, green, blue, and gray color blocks displayed at predefined locations.

[0151] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0152] Figure 14This is a block diagram illustrating an apparatus 200 for image detection according to an exemplary embodiment. The apparatus 200 can be provided as a terminal. For example, the apparatus 200 can be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0153] Reference Figure 14 The device 200 may include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, input / output (I / O) interface 212, sensor component 214, and communication component 216.

[0154] Processing component 202 typically controls the overall operation of device 200, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 202 may include one or more modules to facilitate interaction between processing component 202 and other components. For example, processing component 202 may include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.

[0155] Memory 204 is configured to store various types of data to support the operation of device 200. Examples of such data include instructions for any application or method operating on device 200, contact data, phonebook data, messages, pictures, videos, etc. Memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0156] The power supply component 206 provides power to the various components of the device 200. The power supply component 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 200.

[0157] Multimedia component 208 includes a screen that provides an output interface between device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 208 includes a front-facing camera and / or a rear-facing camera. When device 200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0158] Audio component 210 is configured to output and / or input audio signals. For example, audio component 210 includes a microphone (MIC) configured to receive external audio signals when device 200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 204 or transmitted via communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.

[0159] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0160] Sensor assembly 214 includes one or more sensors for providing state assessments of various aspects of device 200. For example, sensor assembly 214 may detect the on / off state of device 200, the relative positioning of components such as the display and keypad of device 200, changes in the position of device 200 or a component of device 200, the presence or absence of user contact with device 200, the orientation or acceleration / deceleration of device 200, and temperature changes of device 200. Sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 214 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0161] Communication component 216 is configured to facilitate wired or wireless communication between device 200 and other devices. Device 200 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 216 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0162] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0163] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, which can be executed by a processor 220 of the device 200 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0164] Figure 15 This is a block diagram illustrating an apparatus 300 for image detection according to an exemplary embodiment. For example, apparatus 300 may be provided as a server. (Refer to...) Figure 15 The device 300 includes a processing component 322, which further includes one or more processors, and memory resources represented by memory 332 for storing instructions, such as application programs, that can be executed by the processing component 322. The application programs stored in memory 332 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 322 is configured to execute instructions to perform the methods described above.

[0165] Device 300 may also include a power supply component 326 configured to perform power management of device 300, a wired or wireless network interface 350 configured to connect device 300 to a network, and an input / output (I / O) interface 358. Device 300 may operate on an operating system stored in memory 332, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0166] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 332 including instructions, which can be executed by the processing component 322 of the apparatus 300 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0167] It is understood that in this disclosure, "multiple" refers to two or more, and other quantifiers are similar. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship. The singular forms "a," "," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0168] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0169] It is further understood that the terms “center,” “longitudinal,” “lateral,” “front,” “rear,” “up,” “down,” “left,” “right,” “vertical,” “horizontal,” “top,” “bottom,” “inner,” and “outer,” etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation.

[0170] It can be further understood that, unless otherwise specified, "connection" includes both direct connections where no other components exist between the two parties and indirect connections where other components exist between them.

[0171] It is further understood that although operations are described in a specific order in the accompanying drawings in the embodiments of this disclosure, this should not be construed as requiring these operations to be performed in the specific order or serial order shown, or requiring all of the shown operations to be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous.

[0172] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0173] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for detecting images, characterized in that, include: Acquire images captured by the camera during zooming, the images including N frames of images of the same subject, the subject having different colors displayed at predefined positions, and N being a positive integer greater than 1; Based on the display location area of ​​the different colors in the image, the image quality parameters of each frame in the N frames are determined; Based on the difference between the image quality parameters of each frame and the image quality parameters of adjacent frames, the image quality consistency detection result of the N frames is obtained. The acquisition of images captured by the camera during zooming includes: The camera is controlled to zoom in at a constant speed, and during the zooming process, the preview image of the captured object is kept showing the target area of ​​the captured object. The target area includes the location areas of all the different colors. Record the preview footage captured during the zoom process of the camera.

2. The imaging and detection method according to claim 1, characterized in that, The process of determining the image quality parameters of each frame in the N frames based on the display location regions of different colors in the image includes: Identify the display locations of the same color in each frame of the image to obtain multiple regions of interest of the same color; For each of the different colors, the average value of each color component in the three primary colors within the multiple regions of interest is determined, and the average value of each color component in the three primary colors is linearized and transformed into a Lab color space value.

3. The imaging detection method according to claim 1 or 2, characterized in that, The image quality includes exposure brightness, and the color includes gray. The process of obtaining the image quality consistency detection result of the N frames based on the difference between the image quality parameters of each frame and the image quality parameters of adjacent frames includes: Determine the difference between the brightness value in the Lab color space of each frame corresponding to gray in N frames and the brightness value in the Lab color space of the adjacent frame; If there are frame images with a difference greater than the first threshold, and the number of frame images with a difference greater than the first threshold is greater than the second threshold, then it is determined that the images captured by the camera during the zoom process have a jump in exposure brightness and inconsistent exposure brightness changes. If there are no frame images with a difference greater than the first threshold, it is determined that the exposure brightness of the images captured by the camera during the zoom process is consistent.

4. The imaging detection method according to claim 1 or 2, characterized in that, The image quality includes white balance, and the color includes gray. The process of obtaining the image quality consistency detection result of the N frames based on the difference between the image quality parameters of each frame and the image quality parameters of adjacent frames includes: Obtain the first color difference change between each two adjacent frames corresponding to gray in N frames of images. The first color difference change is determined based on the mean value of the Lab space color value corresponding to the gray. In response to the maximum color difference change in the first color difference change being greater than a third threshold, it is determined that the white balance of the images captured by the camera during zooming is inconsistent. In response to the maximum color difference change in the first color difference change being less than or equal to a third threshold, it is determined that the white balance of the images captured by the camera during zooming is consistent.

5. The imaging detection method according to claim 1 or 2, characterized in that, The image quality includes color reproduction, and the colors include red, green, and blue; The process of obtaining the image quality consistency detection result of the N frames based on the difference between the image quality parameters of each frame and the image quality parameters of adjacent frames includes: Obtain the second color difference change between each pair of adjacent frames corresponding to red, the third color difference change between each pair of adjacent frames corresponding to green, and the fourth color difference change between each pair of adjacent frames corresponding to blue in N frames of images. In response to the fact that the mean value of the second color difference change is less than or equal to the fourth threshold, the mean value of the third color difference change is less than or equal to the fourth threshold, and the mean value of the fourth color difference change is less than or equal to the fourth threshold, it is determined that the colors of the images captured by the camera during the zoom process are consistent. If, in response to the presence of a color difference change average greater than a fourth threshold among the average values ​​of the second, third, and fourth color difference changes, it is determined that the color reproduction of the images captured by the camera during zooming is inconsistent.

6. The imaging detection method according to claim 1, characterized in that, The subject of the photograph is a preset color chart, which includes red, green, blue, and gray color blocks displayed at predefined positions.

7. A photographic detection device, characterized in that, include: The acquisition unit is used to acquire images captured by the camera during zooming. The images include N frames of images of the same subject, the subject having different colors displayed at predefined positions, and N being a positive integer greater than 1. The determining unit is used to determine the image quality parameters of each frame in the N frames of images based on the display position area of ​​the different colors in the image; An execution unit is used to obtain the image quality consistency detection result of the N frames of images based on the difference between the image quality parameters of each frame and the image quality parameters of adjacent frames. The acquisition unit acquires the images captured by the camera during zooming using the following method: The camera is controlled to zoom in at a constant speed, and during the zooming process, the preview image of the captured object is kept showing the target area of ​​the captured object. The target area includes the location areas of all the different colors. Record the preview footage captured during the zoom process of the camera.

8. A photographic detection device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the image detection method according to any one of claims 1-6.

9. A storage medium, characterized in that, The storage medium stores instructions that, when executed by the terminal's processor, enable the terminal to perform the shooting detection method according to any one of claims 1-6.

Images