Shooting detection method and device and storage medium

Abstract

The invention relates to a shooting detection method and device and a storage medium, and the method comprises the steps: obtaining a picture shot by a camera in a zooming process, the picture comprises N frames of images of the same shooting object, the shooting object has different colors displayed at a predefined position, and N is a positive integer greater than 1; based on display position areas of the different colors in the image, determining image quality parameters of each frame of image in the N frames of images; and based on the image quality parameter of each frame of image, obtaining an image quality consistency detection result of the N frames of images. According to the invention, the image quality consistency of the image shot by the camera in the zooming process is efficiently detected.

Description

Technical Field

[0001] The present disclosure relates to the field of camera technology, and in particular to a shooting detection method, device and storage medium. Background Art

[0002] With the development of photography technology, it has become a common strategy for various brands and products to have multiple cameras with different focal lengths on one device. Switching between cameras with different focal lengths will lead to the problem of inconsistency in various image quality dimensions, and the inconsistency is particularly obvious during the switching process between different cameras. Therefore, the image quality consistency of the device's captured images will be tested before the device leaves the factory. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a shooting detection method, device and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a shooting detection method is provided, the method comprising: obtaining a picture taken by a camera during a zooming process, the picture comprising N frames of images of the same shooting object, the shooting object having different colors displayed at a predefined position, and N being a positive integer greater than 1; determining image quality parameters of each frame of the N frames of images based on the display position area of ​​the different colors in the image; and obtaining image quality consistency detection results of the N frames of images based on the image quality parameters of each frame of the image.

[0005] In one embodiment, the image quality parameters of each frame of the N frames of images are determined based on the display position areas of different colors in the image, including: identifying the display position areas of the same color in each frame of the image in the picture, and obtaining multiple regions of interest of the same color; for each of the different colors, respectively determining the average value of each color component of the three primary colors in the multiple regions of interest, and performing linear correction on the average value of each color component of the three primary colors and color gamut space transformation to obtain a Lab space color value.

[0006] In one embodiment, the image quality includes exposure brightness, and the color includes gray; the image quality consistency detection result of the N frames of images is obtained based on the image quality parameters of each frame of the image, including: determining the difference between the brightness value in the Lab space color value of each frame of the N frames of images corresponding to the gray and the brightness value in the Lab space color value of the adjacent frame; if there is a frame image with a difference greater than a first threshold, and the number of frame images greater than the threshold is greater than a second threshold, it is determined that the picture taken by the camera during the zoom process has an exposure brightness jump, and the exposure brightness change is inconsistent; if there is no frame image with a difference greater than the first threshold, it is determined that the exposure brightness of the picture taken by the camera during the zoom process is consistent.

[0007] In one embodiment, the image quality includes white balance, and the color includes gray; the image quality consistency detection result of the N frames of images is obtained based on the image quality parameters of each frame of the image, including: obtaining a first color difference change between each adjacent two frames corresponding to gray in the N frames of the image, the first color difference change is determined based on the mean of the Lab space color value corresponding to the gray; in response to the maximum color difference change in the first color difference change being greater than a third threshold, determining that the white balance of the picture taken by the camera during the zoom process is inconsistent; in response to the maximum color difference change in the first color difference change being less than or equal to a third threshold, determining that the white balance of the picture taken by the camera during the zoom process is consistent.

[0008] In one embodiment, the image quality includes color restoration, and the colors include red, green and blue; the image quality consistency detection result of the N frames of images is obtained based on the image quality parameters of each frame of the image, including: obtaining the second color difference change between each adjacent frames corresponding to red, the third color difference change between each adjacent frames corresponding to green, and the fourth color difference change between each adjacent frames corresponding to blue in the N frames of the image; in response to the mean of the second color difference change being less than or equal to a fourth threshold, the mean of the third color difference change being less than or equal to the fourth threshold, and the mean of the fourth color difference change being less than or equal to the fourth threshold, determining that the color restoration of the picture taken by the camera during the zoom process is consistent; in response to the presence of a color difference change mean greater than the fourth threshold among the mean of the second color difference change, the mean of the third color difference change, and the mean of the fourth color difference change, determining that the color restoration of the picture taken by the camera during the zoom process is inconsistent.

[0009] In one embodiment, obtaining the picture taken by the camera during the zooming process includes: controlling the camera to zoom at a uniform speed and a zoom ratio, and keeping the captured preview picture showing the target area of ​​the photographed object during the zooming process, wherein the target area includes the location area where all colors among the different colors are located; and recording the preview picture taken by the camera during the zooming process.

[0010] In one embodiment, the photographed object is a preset color card, and the preset color card includes a red color block, a green color block, a blue color block, and a gray color block displayed at a predefined position.

[0011] According to a second aspect of an embodiment of the present disclosure, a shooting detection device is provided, the device comprising: an acquisition unit, used to acquire a picture taken by a camera during a zooming process, the picture comprising N frames of images of the same shooting object, the shooting object having different colors displayed at a predefined position, and N being a positive integer greater than 1; a determination unit, used to determine the image quality parameters of each frame of the N frames of images based on the display position area of ​​the different colors in the image; and an execution unit, used to obtain the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image.

[0012] In one embodiment, the determination unit determines the image quality parameters of each frame of the N frames of images based on the display position areas of the different colors in the image in the following manner: identifying the display position areas of the same color in each frame of the image in the picture to obtain multiple regions of interest of the same color; for each of the different colors, respectively determining the average value of each color component of the three primary colors in the multiple regions of interest, and performing linear correction and color gamut space transformation on the average value of each color component of the three primary colors to obtain a Lab space color value.

[0013] In one embodiment, the image quality includes exposure brightness, and the color includes gray; the execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: determine the difference between the brightness value in the Lab space color value of each frame image corresponding to the gray in the N frames of the image and the brightness value in the Lab space color value of the adjacent frame; if there is a frame image with a difference greater than a first threshold, and the number of frame images greater than the threshold is greater than a second threshold, it is determined that the picture taken by the camera during the zoom process has an exposure brightness jump, and the exposure brightness change is inconsistent; if there is no frame image with a difference greater than the first threshold, it is determined that the exposure brightness of the picture taken by the camera during the zoom process is consistent.

[0014] In one embodiment, the image quality includes white balance, and the color includes gray; the execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: obtaining a first color difference change between each two adjacent frames corresponding to gray in the N frames of the image, and the first color difference change is determined based on the mean of the Lab space color value corresponding to the gray; in response to the maximum color difference change in the first color difference change being greater than a third threshold, determining that the white balance of the picture taken by the camera during the zoom process is inconsistent; in response to the maximum color difference change in the first color difference change being less than or equal to a third threshold, determining that the white balance of the picture taken by the camera during the zoom process is consistent.

[0015] In one embodiment, the image quality includes color restoration, and the colors include red, green and blue; the execution unit obtains the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image in the following manner: obtain the second color difference change between each adjacent frames corresponding to red, the third color difference change between each adjacent frames corresponding to green, and the fourth color difference change between each adjacent frames corresponding to blue in the N frames of the image; in response to the mean of the second color difference change being less than or equal to a fourth threshold, the mean of the third color difference change being less than or equal to the fourth threshold, and the mean of the fourth color difference change being less than or equal to the fourth threshold, determining that the color restoration of the picture taken by the camera during the zoom process is consistent; in response to the presence of a color difference change mean greater than the fourth threshold among the mean of the second color difference change, the mean of the third color difference change, and the mean of the fourth color difference change, determining that the color restoration of the picture taken by the camera during the zoom process is inconsistent.

[0016] In one embodiment, the acquisition unit acquires the picture taken by the camera during the zooming process in the following manner: controlling the camera to uniformly magnify the zoom ratio for zooming, and keeping the captured preview picture showing the target area of ​​the photographed object during the zooming process, wherein the target area includes the location area where all colors among the different colors are located; and recording the preview picture taken by the camera during the zooming process.

[0017] In one embodiment, the photographed object is a preset color card, and the preset color card includes a red color block, a green color block, a blue color block, and a gray color block displayed at a predefined position.

[0018] According to a third aspect of an embodiment of the present disclosure, a shooting detection device is provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: execute the shooting detection method described in the first aspect or any one of the embodiments of the first aspect.

[0019] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the shooting detection method described in the first aspect or any one of the embodiments of the first aspect.

[0020] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: based on the image quality parameters of each frame of the N frames of images captured by the camera during the zooming process, image quality consistency detection is performed to achieve the detection of image quality consistency of the images during the zooming process. In addition, based on the display position area of ​​different colors in the image, the image quality parameters of each frame of the N frames are determined, so that image quality consistency detection can be performed more efficiently.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] Figure 1 The figure is a flow chart of a shooting detection method according to an exemplary embodiment.

[0024] Figure 2 The figure is a flow chart of a shooting detection method according to an exemplary embodiment.

[0025] Figure 3 The figure is a flow chart showing a method for detecting exposure consistency according to an exemplary embodiment.

[0026] Figure 4 The figure is a schematic diagram of a preview video quality exposure brightness change trend according to an exemplary embodiment.

[0027] Figure 5 The figure is a flow chart showing a method for detecting white balance consistency according to an exemplary embodiment.

[0028] Figure 6 The present invention is a flow chart showing a method for detecting color reproduction consistency according to an exemplary embodiment.

[0029] Figure 7 The figure is a schematic diagram showing a change trend of white balance consistency and smoothness of a preview video according to an exemplary embodiment.

[0030] Figure 8 The figure is a schematic diagram showing a change trend of the consistency and smoothness of the blue, red and green color restoration of a preview video according to an exemplary embodiment.

[0031] Fig. 9 The figure is a schematic diagram of a full-size color card display effect according to an exemplary embodiment.

[0032] Fig.10 The figure is a schematic diagram showing the display effect of a magnified color card according to an exemplary embodiment.

[0033] Fig.11 The figure is a schematic diagram of the digital design of the center area 1-9 of a color card according to an exemplary embodiment.

[0034] Fig.12 The figure is a schematic diagram showing the correspondence between numbers and colors in each frame of an image according to an exemplary embodiment.

[0035] Fig.13 is a block diagram of a shooting detection device according to an exemplary embodiment.

[0036] Fig.14 is a block diagram of a shooting detection device according to an exemplary embodiment.

[0037] Fig.15 is a block diagram of a shooting detection device according to an exemplary embodiment. DETAILED DESCRIPTION

[0038] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0039] With the development of photography technology, a device may have multiple cameras with different focal lengths at the same time. However, cameras with different focal lengths will have problems with consistency in image quality due to differences in modules and sensors. Therefore, devices with multiple cameras with different focal lengths need to be tested for image quality consistency before leaving the factory.

[0040] Based on this, an embodiment of the present disclosure provides a shooting detection method for detecting the consistency of image quality of images taken by cameras with different focal lengths.

[0041] Figure 1 is a flow chart of a shooting detection method according to an exemplary embodiment. Figure 1 As shown, the following steps are included.

[0042] In step S101, the picture taken by the camera during the zooming process is obtained.

[0043] In an embodiment of the present disclosure, the picture includes N frames of images of the same photographed object, the photographed object has different colors displayed at predefined positions, and N is a positive integer greater than 1.

[0044] The camera is not limited to multiple cameras of one device, cameras of multiple devices, or a single camera with multiple different focal lengths.

[0045] In the embodiments of the present disclosure, multiple cameras with different focal lengths are used for illustration.

[0046] Exemplarily, when shooting with cameras with different focal lengths, first make sure that all the content of the picture fills the FOV of the preview screen, zoom in at a uniform speed, record the screen preview changes, and obtain N frames of recorded screen images, where each frame includes pre-set different colors and spatial positions.

[0047] In step S102, the image quality parameters of each frame of the N frames of images are determined based on the display position areas of different colors in the image.

[0048] In the embodiment of the present disclosure, based on the fact that the photographed object has different preset colors and spatial positions, the image quality parameters of each frame of the N frames of images are determined.

[0049] In step S103, based on the image quality parameters of each frame of image, the image quality consistency detection results of N frames of image are obtained.

[0050] In the disclosed embodiments, based on the image quality parameters of each frame of the image, the images captured by multiple cameras with different focal lengths during the zooming process are tested for consistency such as image quality exposure, white balance, and color restoration.

[0051] In the disclosed embodiment, the image quality consistency detection is performed based on the image quality parameters of each frame of the N frames of the image captured by the camera during the zoom process, so as to realize the detection of the image quality consistency of the image during the zoom process. In addition, based on the display position area of ​​different colors in the image, the image quality parameters of each frame of the N frames are determined, so that the image quality consistency detection can be performed more efficiently, thereby further refining the detection of image quality consistency, so that users can have a good experience of image quality consistency and smoothness.

[0052] Figure 2 is a flow chart of a shooting detection method according to an exemplary embodiment. Figure 2 As shown, the following steps are included.

[0053] In step S201, the display position area of ​​the same color in each frame of the picture is identified to obtain a plurality of regions of interest of the same color.

[0054] In the disclosed embodiment, the photographed objects have different preset colors and spatial positions, and the areas with the same color in each frame of the image are identified and determined as the regions of interest, that is, any area with the same color in N frames of the image has N regions of interest.

[0055] In step S202, for each of the different colors, the average value of each color component in the three primary colors in multiple regions of interest is determined respectively, and the average value of each color component in the three primary colors is linearly corrected and the color gamut space is transformed to obtain a Lab space color value.

[0056] In the embodiment of the present disclosure, the RGB mean value of the same color in each frame of the image is determined, and the RGB mean value is linearly corrected, as well as the Lab space color value obtained by color gamut space transformation.

[0057] In the embodiment of the present disclosure, by identifying the region of interest of the same color in each frame, different colors are accurately divided, and then the average value of each color component of the three primary colors of different colors in each frame of the image is more accurately determined.

[0058] For example, the average RGB value of the four color ROI areas of each frame is calculated

[0059]

[0060]

[0061]

[0062] Wherein, x=1 represents a blue color block, x=2 represents a red color block, x=3 represents a green color block, and x=4 represents a gray color block. n represents the number of corresponding color blocks identified in the current frame.

[0063] Based on formula (4), the RGB mean values ​​of the four colors obtained in the above steps are linearly corrected to obtain R linear , G linear , B linear .

[0064]

[0065] Based on formula (5), the obtained RGB mean values ​​of the four colors are linearly corrected

[0066]

[0067] in,

[0068]

[0069] Convert the X, Y, and Z values ​​to the L*a*b* color space based on formula (4):

[0070]

[0071] in,

[0072] X0=95.05, Y0=100, Z0=108.90

[0073]

[0074] Finally, we get the L*a*b* values ​​of the four colors of blue, red, green and gray in the current frame.

[0075]

[0076] Figure 3 is a flow chart showing a method of detecting exposure consistency according to an exemplary embodiment. Figure 3 As shown, the following steps are included.

[0077] In step S301, the difference between the brightness value in the Lab space color value of each frame image corresponding to the gray in N frames of images and the brightness value in the Lab space color value of the adjacent frame is determined.

[0078] In the embodiment of the present disclosure, the brightness value L in the Lab value of each frame image corresponding to the gray in N frames of images is determined, and the consistency of image quality exposure is detected based on the difference between the brightness values ​​between two adjacent frames.

[0079] In step S302, if there are frame images with a difference greater than the first threshold, and the number of frame images greater than the threshold is greater than the second threshold, it is determined that the picture taken by the camera during the zoom process has an exposure brightness jump and the exposure brightness change is inconsistent.

[0080] In the embodiment of the present disclosure, if the brightness value difference between two adjacent frames of each frame image corresponding to gray in N frames of images is greater than a first threshold, that is, the brightness difference between two adjacent frames is large, there is a brightness jump, and the number of frame images greater than the threshold is greater than a second threshold, that is, the number of brightness jumps is large, then it is determined that the pictures taken by multiple cameras with different focal lengths during the zoom process have exposure brightness jumps, and the exposure brightness changes are inconsistent.

[0081] In step S303, if there is no frame image whose difference is greater than the first threshold, it is determined that the exposure brightness of the images captured by the camera during the zooming process is consistent.

[0082] In an embodiment of the present disclosure, if the difference in brightness value between two adjacent frames of each image corresponding to gray in N frames of images changes little, that is, there is no brightness jump between two adjacent frames or the degree of brightness jump is small, then it is determined that the exposure brightness of the pictures taken by multiple cameras with different focal lengths during the zoom process is consistent.

[0083] In the disclosed embodiment, based on the relationship between the inter-frame brightness change corresponding to the gray color and the corresponding threshold value, the exposure consistency of the picture quality of the camera during the zoom process is accurately detected.

[0084] Exemplarily, record the gray blocks of each frame of the complete preview video , so as to judge the consistency and smoothness of the exposure brightness of the preview image. Figure 4As shown, the presence of multiple brightness jumps can be intuitively determined through the curve, so that the inconsistency of exposure brightness can be determined more efficiently, that is, the exposure brightness changes are not smooth.

[0085] Figure 5 is a flow chart of a shooting detection method according to an exemplary embodiment. Figure 5 As shown, the following steps are included.

[0086] In step S401, a first color difference change between every two adjacent frames corresponding to gray in N frames of images is obtained, and the first color difference change is determined based on the mean value of the Lab space color value corresponding to gray.

[0087] In the embodiment of the present disclosure, the Lab difference between each two adjacent frames corresponding to gray in N frames of images is obtained, that is, the first color difference change.

[0088] In step S402, in response to the maximum color difference change in the first color difference changes being greater than a third threshold, it is determined that the white balance of the picture captured by the camera during the zooming process is inconsistent.

[0089] In the disclosed embodiment, if the maximum difference in the Lab difference between each two adjacent frames corresponding to gray in N frames of images is greater than the difference threshold for white balance inconsistency, that is, the third threshold, it is determined that the white balance of the picture taken by the camera during the zoom process is inconsistent.

[0090] In step S403, in response to the maximum color difference change in the first color difference changes being less than or equal to a third threshold, it is determined that the white balance of the images captured by the camera during the zooming process is consistent.

[0091] In an embodiment of the present disclosure, if the maximum difference in the Lab difference between each two adjacent frames corresponding to gray in N frames of images is less than or equal to the difference threshold for white balance inconsistency, that is, the third threshold, it is determined that the white balance of the images captured by multiple cameras with different focal lengths during the zoom process is consistent.

[0092] In the disclosed embodiment, based on the relationship between the inter-frame color difference corresponding to gray and the difference threshold at which white balance inconsistency occurs, the white balance consistency of the image quality of the camera during the zoom process is accurately detected.

[0093] Figure 6 is a flow chart of a shooting detection method according to an exemplary embodiment. Figure 6 As shown, the following steps are included.

[0094] In step S501, the second color difference change between each two adjacent frames corresponding to red, the third color difference change between each two adjacent frames corresponding to green, and the fourth color difference change between each two adjacent frames corresponding to blue in N frames of images are obtained.

[0095] In an embodiment of the present disclosure, the Lab difference between each two adjacent frames corresponding to red in N frames of images is obtained, that is, the second color difference change, the Lab difference between each two adjacent frames corresponding to green in N frames of images is obtained, that is, the third color difference change, and the Lab difference between each two adjacent frames corresponding to blue in N frames of images is obtained, that is, the fourth color difference change.

[0096] Calculate the color difference ΔE of the average L*a*b* of blue, red, green and gray between every two frames of the preview video 00 , the calculation formula is as follows:

[0097]

[0098] Among them, taking red as an example, through the corresponding two consecutive frames and Calculate the brightness difference ΔL and chroma difference ΔC ab , Hue difference ΔH ab The calculation formula is as follows:

[0099]

[0100]

[0101]

[0102] Color difference ΔE 00 The calculation formula is as follows:

[0103]

[0104] Some of the weight parameter calculation formulas are as follows, where:

[0105]

[0106]

[0107]

[0108] The calculation parameter formula is as follows:

[0109]

[0110]

[0111]

[0112] R T =-sin(2Δθ)*R C (17)

[0113] in, It represents the arithmetic mean of the values ​​at two magnifications.

[0114] The mean L*a*b* values ​​of blue, red, and green between consecutive frames of the preview video are calculated to obtain the DeltaE value changes of the three colors between all frames and recorded as DeltaE blue , DeltaE red , DeltaE green , DeltaE gray . Preview video DeltaE gray Changes such as Figure 7 shown.

[0115] By DeltaE blue , DeltaE red , DeltaE green The changes in the preview video quality can be used to determine the consistency and smoothness of the color restoration. blue , DeltaE red , DeltaE green Changes such as Figure 8 shown.

[0116] In step S502, in response to the mean of the second color difference change being less than or equal to the fourth threshold, the mean of the third color difference change being less than or equal to the fourth threshold, and the mean of the fourth color difference change being less than or equal to the fourth threshold, it is determined that the color restoration of the picture taken by the camera during the zoom process is consistent.

[0117] In an embodiment of the present disclosure, if the average Lab difference between each two adjacent frames corresponding to red in N frames of images is less than or equal to the fourth threshold, and the average Lab difference between each two adjacent frames corresponding to green in N frames of images is less than or equal to the fourth threshold, and the average Lab difference between each two adjacent frames corresponding to blue in N frames of images is less than or equal to the fourth threshold, it is determined that the color restoration of the pictures taken by multiple cameras with different focal lengths during the zoom process is consistent.

[0118] The fourth threshold is a difference threshold at which color restoration inconsistency occurs.

[0119] For example, preview or video zoom exposure consistency requires the maximum brightness difference of gray blocks between frames to be DeltaL gray The value should not be greater than 10. Preview or video zoom white balance consistency requires DeltaE between frames gray The maximum value is not greater than 5. Preview or video zoom color restoration consistency requires the average value of the green color block between frames and the maximum color difference DeltaE green No more than 7, the maximum color difference DeltaE of the average value of red blocks between frames red Should not be greater than 7, blue DeltaE between frames blueThe maximum color difference of the color block average value is no more than 7.

[0120] In step S503, in response to the average value of the second color difference change, the average value of the third color difference change, and the average value of the fourth color difference change, it is determined that the color restoration of the picture taken by the camera during the zooming process is inconsistent.

[0121] In an embodiment of the present disclosure, if the mean value of the Lab difference between each two adjacent frames corresponding to red in N frames of images, the mean value of the Lab difference between each two adjacent frames corresponding to green in N frames of images, and the mean value of the Lab difference between each two adjacent frames corresponding to blue in N frames of images have a color difference change mean value greater than a fourth threshold, it is determined that the color restoration of images captured by multiple cameras with different focal lengths during the zoom process is consistent.

[0122] In the embodiment of the present disclosure, based on the relationship between the color difference changes corresponding to the three colors red, green and blue and the difference thresholds of inconsistent color restoration corresponding to the three colors, the consistency of color restoration of the camera's picture quality during zooming can be more accurately detected.

[0123] In the disclosed embodiment, the camera is controlled to zoom at a constant speed and a zoom ratio, and during the zooming process, the captured preview image is kept showing a target area of ​​the photographed object, where the target area includes a location area where all colors of different colors are located.

[0124] In the disclosed embodiment, the camera is controlled to uniformly magnify the zoom ratio, and the captured image is kept as the target area of ​​the captured object during the zooming process, that is, the target area has all colors corresponding to the target object.

[0125] In the disclosed embodiment, the camera is controlled to uniformly magnify the zoom ratio so that the image changes continuously during the entire zooming process.

[0126] In the disclosed embodiment, a preview image captured during the zooming process of the camera is recorded.

[0127] In the embodiment of the present disclosure, based on the picture captured by the recording camera during the zooming process, data of N frames of images are obtained, that is, images with predefined colors of the captured picture and spatial positions corresponding to different colors.

[0128] For example, Fig. 9 and Fig.10 As shown in the figure, the color card display effect at different magnifications. The card contains a total of 45 color blocks with numbers, arranged from the four corners to the center in the above figure.

[0129] Top left to center: 91,81,71,61,51,41,31,21,11 (blue)

[0130] Top right to center: 93,83,73,63,53,43,33,23,13 (red)

[0131] Bottom left to center: 96, 86, 76, 66, 56, 46, 36, 26, 16 (green)

[0132] Bottom right to center: 98,88,78,68,58,48,38,28,18 (gray)

[0133] The specific plan for the central area 1-9 numbers is as follows Fig.11 shown.

[0134] The standard reference values ​​of the zoom color card are shown in the following table. Among them, the sRGB value is the value under D65 lighting conditions, and the CIEL*a*b* value is the value measured under D50 lighting conditions at a 2-degree observation angle.

[0135]

[0136] For example, the coordinate position of the number in each frame of the image is identified, and the identified numbers can be classified by color according to the correspondence between numbers and colors. The identified blue number ROI is recorded as ROI 1-n, the red number ROI is recorded as ROI 2-n, the green number ROI is recorded as ROI 3-n, and the gray color block is recorded as ROI 4-n, such as Fig.12 shown.

[0137] In the embodiment of the present disclosure, the photographed object is a preset color card, which includes a red color block, a green color block, a blue color block, and a gray color block displayed at a predefined position.

[0138] In the disclosed embodiment, the camera is controlled to shoot an object with a predefined color and spatial position, so that the detection result is more accurate.

[0139] For example, when shooting, first keep the entire content of the picture card to occupy the FOV of the preview screen, enlarge the zoom ratio at a uniform speed, record the screen preview changes, obtain the screen recording data, and perform analysis and calculation frame by frame.

[0140] This disclosure mainly solves the problem of consistency and smoothness detection of image quality, such as white balance, color restoration, and exposure, during the zoom process of the camera, conducts a closed-loop test on the image quality consistency and smoothness effect, and optimizes the debugging parameters through the test results.

[0141] Based on the same concept, an embodiment of the present disclosure also provides a shooting detection device.

[0142] It is understandable that the shooting detection device provided in the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0143] Fig.13 is a block diagram of a shooting detection device according to an exemplary embodiment. Fig.13 The device 100 includes an acquisition unit 101, a determination unit 102 and an execution unit 103.

[0144] The acquisition unit 101 is used to acquire a picture taken by the camera during a zoom process, where the picture includes N frames of images of the same object, where the object has different colors displayed at a predefined position, and N is a positive integer greater than 1; the determination unit 102 is used to determine the image quality parameters of each frame of the N frames based on the display position area of ​​different colors in the image; the execution unit 103 is used to obtain the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image.

[0145] In one embodiment, the determination unit 102 determines the image quality parameters of each frame of N frames of images based on the display position areas of different colors in the image in the following manner: identifying the display position areas of the same color in each frame of the image in the picture, and obtaining multiple regions of interest of the same color; for each color in the different colors, respectively determining the average value of each color component of the three primary colors in the multiple regions of interest, and performing linear correction on the average value of each color component of the three primary colors and color gamut space transformation to obtain the Lab space color value.

[0146] In one embodiment, image quality includes exposure brightness, and color includes gray; the execution unit 103 obtains image quality consistency detection results of N frames of images based on the image quality parameters of each frame image in the following manner: determine the difference between the brightness value in the Lab space color value of each frame image corresponding to the gray in the N frames of images and the brightness value in the Lab space color value of the adjacent frame; if there are frame images with a difference greater than a first threshold, and the number of frame images greater than the threshold is greater than a second threshold, it is determined that the picture taken by the camera during the zoom process has an exposure brightness jump, and the exposure brightness change is inconsistent; if there is no frame image with a difference greater than the first threshold, it is determined that the exposure brightness of the picture taken by the camera during the zoom process is consistent.

[0147] In one embodiment, image quality includes white balance, and color includes gray; the execution unit 103 obtains image quality consistency detection results of N frames of images based on the image quality parameters of each frame of the image in the following manner: obtain a first color difference change between each two adjacent frames corresponding to gray in the N frames of the image, and the first color difference change is determined based on the mean of the Lab space color value corresponding to gray; in response to the maximum color difference change in the first color difference change being greater than a third threshold, determine that the white balance of the picture taken by the camera during the zoom process is inconsistent; in response to the maximum color difference change in the first color difference change being less than or equal to the third threshold, determine that the white balance of the picture taken by the camera during the zoom process is consistent.

[0148] In one embodiment, the image quality includes color restoration, and the colors include red, green and blue; the execution unit 103 obtains the image quality consistency detection result of N frames of images based on the image quality parameters of each frame of the image in the following manner: obtain the second color difference change between each adjacent frames corresponding to red, the third color difference change between each adjacent frames corresponding to green, and the fourth color difference change between each adjacent frames corresponding to blue in the N frames of the image; in response to the mean of the second color difference change being less than or equal to the fourth threshold, the mean of the third color difference change being less than or equal to the fourth threshold, and the mean of the fourth color difference change being less than or equal to the fourth threshold, it is determined that the color restoration of the picture taken by the camera during the zooming process is consistent; in response to the existence of a color difference change mean greater than the fourth threshold among the mean of the second color difference change, the mean of the third color difference change, and the mean of the fourth color difference change, it is determined that the color restoration of the picture taken by the camera during the zooming process is inconsistent.

[0149] In one embodiment, the acquisition unit 101 acquires the picture taken by the camera during the zooming process in the following manner: control the camera to zoom at a uniform speed and change the zoom ratio, and keep the captured preview picture showing the target area of ​​the photographed object during the zooming process, and the target area includes the location area where all colors of different colors are located; record the preview picture taken during the zooming process of the camera.

[0150] In one implementation, the photographed object is a preset color card, which includes a red color block, a green color block, a blue color block, and a gray color block displayed at predefined positions.

[0151] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0152] Fig.142 is a block diagram of an apparatus 200 for shooting detection according to an exemplary embodiment. The apparatus 200 may be provided as a terminal. For example, the apparatus 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0153] Reference Fig.14 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0154] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0155] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0156] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0157] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0158] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0159] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0160] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0161] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0162] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0163] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0164] Fig.15 is a block diagram of a device 300 for shooting detection according to an exemplary embodiment. For example, the device 300 may be provided as a server. Fig.15 , the apparatus 300 includes a processing component 322, which further includes one or more processors, and a memory resource represented by a memory 332 for storing instructions, such as an application, that can be executed by the processing component 322. The application stored in the memory 332 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 322 is configured to execute the instructions to perform the above method.

[0165] The device 300 may also include a power supply component 326 configured to perform power management of the device 300, a wired or wireless network interface 350 configured to connect the device 300 to a network, and an input / output (I / O) interface 358. The device 300 may operate based on an operating system stored in the memory 332, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0166] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 332 including instructions, which can be executed by the processing component 322 of the device 300 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0167] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar thereto. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0168] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0169] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0170] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0171] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0172] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0173] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A shooting detection method, characterized in that: include: Acquire a picture captured by the camera during zooming, wherein the picture includes N frames of images of the same photographed object, the photographed object has different colors displayed at predefined positions, and N is a positive integer greater than 1; Determining the image quality parameters of each frame of the N frames of images based on the display position areas of the different colors in the image; Based on the image quality parameters of each frame of the image, the image quality consistency detection results of the N frames of images are obtained.

2. The shooting detection method according to claim 1, characterized in that: The determining of the image quality parameter of each frame of the N frames of images based on the display position areas of different colors in the images includes: Identify the display position area of ​​the same color in each frame of the image in the picture to obtain multiple regions of interest of the same color; For each of the different colors, the average value of each color component in the three primary colors in the multiple regions of interest is determined respectively, and the average value of each color component in the three primary colors is linearly corrected and the color gamut space is transformed to obtain a Lab space color value.

3. The shooting detection method according to claim 1 or 2, characterized in that: The image quality includes exposure brightness, and the color includes gray; The obtaining the image quality consistency detection result of the N frames of images based on the image quality parameter of each frame of image includes: Determine the difference between the brightness value in the Lab space color value of each frame image corresponding to the gray in the N frames image and the brightness value in the Lab space color value of the adjacent frame; If there are frame images whose difference is greater than the first threshold, and the number of frame images whose difference is greater than the threshold is greater than the second threshold, it is determined that the picture taken by the camera during the zooming process has an exposure brightness jump, and the exposure brightness change is inconsistent; If there is no frame image whose difference is greater than the first threshold, it is determined that the exposure brightness of the images taken by the camera during the zooming process is consistent.

4. The shooting detection method according to claim 1 or 2, characterized in that: The image quality includes white balance, and the color includes gray; The obtaining the image quality consistency detection result of the N frames of images based on the image quality parameter of each frame of image includes: Obtaining a first color difference change between each two adjacent frames corresponding to gray in N frames of images, where the first color difference change is determined based on a mean value of a Lab space color value corresponding to the gray; In response to a maximum color difference change in the first color difference changes being greater than a third threshold, determining that the white balance of the picture captured by the camera during the zooming process is inconsistent; In response to a maximum color difference change in the first color difference changes being less than or equal to a third threshold, it is determined that the white balance of the images captured by the camera during the zooming process is consistent.

5. The shooting detection method according to claim 1 or 2, characterized in that: The image quality includes color reproduction, and the colors include red, green and blue; The obtaining the image quality consistency detection result of the N frames of images based on the image quality parameter of each frame of image includes: Obtain a second color difference change between each two adjacent frames corresponding to red, a third color difference change between each two adjacent frames corresponding to green, and a fourth color difference change between each two adjacent frames corresponding to blue in N frames of images; In response to the average of the second color difference change being less than or equal to a fourth threshold, the average of the third color difference change being less than or equal to the fourth threshold, and the average of the fourth color difference change being less than or equal to the fourth threshold, determining that the color restoration of the picture captured by the camera during the zooming process is consistent; In response to the presence of a color difference change mean value greater than a fourth threshold value among the mean value of the second color difference change, the mean value of the third color difference change, and the mean value of the fourth color difference change, it is determined that color restoration of the picture taken by the camera during the zooming process is inconsistent.

6. The shooting detection method according to claim 1, characterized in that: The step of obtaining the image captured by the camera during the zooming process includes: Control the camera to zoom at a constant speed and a zoom ratio, and keep the captured preview image showing the target area of ​​the photographed object during the zooming process, wherein the target area includes the location area where all the different colors are located; Record the preview image captured during the zooming process of the camera.

7. The shooting detection method according to claim 6, characterized in that: The photographed object is a preset color card, which includes a red color block, a green color block, a blue color block and a gray color block displayed at a predefined position.

8. A shooting detection device, characterized in that: include: An acquisition unit, configured to acquire a picture captured by the camera during zooming, wherein the picture includes N frames of images of the same photographed object, the photographed object has different colors displayed at a predefined position, and N is a positive integer greater than 1; A determination unit, configured to determine the image quality parameter of each frame of the N frames of images based on the display position area of ​​the different colors in the image; An execution unit is used to obtain the image quality consistency detection result of the N frames of images based on the image quality parameters of each frame of the image.

9. A shooting detection device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the shooting detection method described in any one of claims 1-7.

10. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the terminal, the terminal is enabled to execute the shooting detection method described in any one of claims 1 to 7.

Images