Method for determining screen evaluation criteria, screen evaluation method, device, equipment and medium
By obtaining the historical conditions of virtual shooting scenes and determining and optimizing screen evaluation standards, the problem of lack of virtual shooting LED screen evaluation indicators in the prior art is solved, and efficient evaluation of screen adaptability and simplifying the evaluation process.
Patent Information
- Application Number
- CN202510012761.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-03
- Publication Date
- 2025-07-08
- Estimated Expiration
- 2045-01-03
AI Technical Summary
The prior art lacks evaluation indicators and evaluation standards for LED screens for virtual shooting, which makes it impossible to accurately evaluate its adaptation to virtual shooting scenes.
By obtaining the historical shooting conditions of the virtual shooting scene, the initial evaluation criteria are determined, and the target evaluation criteria are obtained through simulation defect display effects and data acquisition verification and optimization, to evaluate whether the screen is suitable for the virtual shooting scene.
It realizes efficient and accurate evaluation of whether the screen is suitable for virtual shooting scenes, simplifies the evaluation process and provides an evaluation system suitable for virtual shooting.
Smart Images

Figure CN119814943B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of virtual shooting, and particularly to a method for determining a screen evaluation standard, a screen evaluation method, a device, a device and a medium. Background Art
[0002] Virtual shooting technology realizes the effect of placing actors in a virtual environment by rendering a virtual scene in real time on an LED screen and simultaneously shooting actors and backgrounds with an actual camera. This technology combines real-time rendering and actor performance, bringing a new experience to film and television creation.
[0003] Currently, there is no evaluation system specifically for the evaluation index, evaluation standard, and evaluation tool chain of the LED screen for virtual shooting. Most evaluations are to verify the indicators provided by LED screen manufacturers, and the evaluation criteria for these indicators may not necessarily be applicable to virtual shooting, that is, it is impossible to determine an LED screen suitable for virtual shooting. Summary of the Invention
[0004] In view of this, the present disclosure proposes a method for determining a screen evaluation standard, a screen evaluation method, a device, a device and a medium, which can obtain a target evaluation standard adapted to the virtual shooting scene, and use the target evaluation standard to efficiently and accurately determine whether the screen to be evaluated is suitable for the virtual shooting scene.
[0005] According to an aspect of the present disclosure, there is provided a method for determining a screen evaluation standard, including: obtaining multiple groups of historical shooting conditions of a virtual shooting scene, where a single group of historical shooting conditions includes at least one of camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scene; based on the multiple groups of historical shooting conditions, determining an initial evaluation standard for at least one screen evaluation index adapted to the virtual shooting scene, where the screen evaluation index is used to evaluate the display effect of the screen, and the initial evaluation standard is used to indicate the passing conditions of the screen evaluation index; by verifying and optimizing the initial evaluation standard for the at least one screen evaluation index, obtaining a target evaluation standard for the at least one screen evaluation index, where the target evaluation standard is used to indicate the target passing conditions of the screen evaluation index, so as to use the target evaluation standard for the at least one screen evaluation index to evaluate whether the screen is suitable for the virtual shooting scene.
[0006] In a possible implementation manner, the determining an initial evaluation standard for at least one screen evaluation index adapted to the virtual shooting scene based on the multiple groups of historical shooting conditions includes: determining the respective distribution ranges corresponding to various screen evaluation indexes based on the multiple groups of historical shooting conditions; determining the respective initial evaluation standards corresponding to various screen evaluation indexes based on the respective distribution ranges corresponding to various screen evaluation indexes.
[0007] In a possible implementation, obtaining the target evaluation criteria corresponding to the at least one screen evaluation criterion by validating and optimizing the initial evaluation criteria of the at least one screen evaluation criterion includes:
[0008] For any one of the screen evaluation criteria, simulate various defect display effects of the screen defects indicated by the screen evaluation criterion, and synthesize the various defect display effects onto a preset screen to obtain various defect screens. The severity of the screen defects characterized by different defect display effects is different; display various defect screens on a reference screen, and use a data acquisition device to collect the screen data and screen images when the reference screen displays various defect screens. The screen data includes at least one of color and brightness. The environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene; based on the screen data and screen images corresponding to the various defect screens, verify whether the screen display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation criterion conforms to the specified screen requirements of the virtual shooting scene; in the case where the screen display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria does not conform to the specified screen requirements, optimize the initial evaluation criteria of the screen evaluation criterion to obtain the target evaluation criteria corresponding to the screen evaluation criterion.
[0009] In a possible implementation, obtaining the target evaluation criteria corresponding to the at least one screen evaluation criterion by validating and optimizing the initial evaluation criteria of the at least one screen evaluation criterion includes: For any one of the screen evaluation criteria, simulate various defect display effects of the screen defects indicated by the screen evaluation criterion, and synthesize the various defect display effects onto a preset screen to obtain various defect screens. The severity of the screen defects characterized by different defect display effects is different; display various defect screens on a reference screen, and use a data acquisition device to collect the screen data and screen images when the reference screen displays various defect screens. The screen data includes at least one of color and brightness. The environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene; based on the screen data and screen images corresponding to the various defect screens, verify whether the screen display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation criterion conforms to the specified screen requirements of the virtual shooting scene; in the case where the screen display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria does not conform to the specified screen requirements, optimize the initial evaluation criteria of the screen evaluation criterion to obtain the target evaluation criteria corresponding to the screen evaluation criterion.
[0010] In a possible implementation, the screen evaluation metrics include at least one of the following: screen brightness range metric, screen uniformity metric, screen brightness continuity metric, screen color gamut range metric, and screen color accuracy metric.
[0011] According to another aspect of the present disclosure, there is provided a screen evaluation method, including: controlling a target screen to be evaluated to reach a preset screen configuration information, and controlling the target screen to display a reference picture, the reference picture including pictures of multiple colors; using a data acquisition device to collect screen data when the target screen displays the reference picture, the screen data including at least one of color and brightness; according to the screen data, determining whether the display effect of the target screen meets the target evaluation criteria of at least one screen evaluation metric, obtaining an evaluation result of the target screen, the evaluation result being used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation metrics, and the target evaluation criteria corresponding to the at least one screen evaluation metric being determined by the above-mentioned determination method.
[0012] In a possible implementation, the evaluation method further includes: according to the evaluation result of the target screen, determining the availability degree of the target screen for virtual shooting, the availability degree being used to indicate whether the target screen is suitable for a virtual shooting scenario.
[0013] According to another aspect of the present disclosure, there is provided a device for determining screen evaluation criteria, including: an acquisition module, configured to acquire multiple sets of historical shooting conditions of a virtual shooting scenario, each set of historical shooting conditions including at least one of camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scenario; a determination module, configured to determine, based on the multiple sets of historical shooting conditions, an initial evaluation criterion of at least one screen evaluation metric adapted to the virtual shooting scenario, the screen evaluation metric being used to evaluate the display effect of a screen, and the initial evaluation criterion being used to indicate the passing conditions of the screen evaluation metric; a verification and optimization module, configured to obtain the target evaluation criterion of the at least one screen evaluation metric by verifying and optimizing the initial evaluation criterion of the at least one screen evaluation metric, the target evaluation criterion being used to indicate the target passing conditions of the screen evaluation metric, so as to use the target evaluation criterion of the at least one screen evaluation metric to evaluate whether a screen is suitable for a virtual shooting scenario.
[0014] According to another aspect of the present disclosure, there is provided a screen evaluation device, including: a control module, configured to control a target screen to be evaluated to reach a preset screen configuration information, and control the target screen to display a reference picture, where the reference picture includes pictures of multiple colors; a collection module, configured to collect screen data of the target screen when the target screen displays the reference picture by using a data collection device, where the screen data includes at least one of color and brightness; a judgment module, configured to judge whether the display effect of the target screen meets a target evaluation criterion of at least one screen evaluation index according to the screen data, so as to obtain an evaluation result of the target screen, where the evaluation result is used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation indexes, and the target evaluation criteria corresponding to the at least one screen evaluation index are determined by using the above-mentioned determination method.
[0015] According to another aspect of the present disclosure, there is provided an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to implement the above method when executing the instructions stored in the memory.
[0016] According to another aspect of the present disclosure, there is provided a non-volatile computer-readable storage medium, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.
[0017] According to another aspect of the present disclosure, there is provided a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code, when the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.
[0018] According to various aspects of the present disclosure, by obtaining multiple groups of historical shooting conditions of a virtual shooting scene, determining an initial evaluation criterion of a screen evaluation index adapted to the virtual shooting scene, and then validating and optimizing the initial evaluation criterion, a more accurate target evaluation criterion adapted to the virtual shooting scene can be obtained, so as to be able to efficiently and accurately determine whether a screen to be evaluated is suitable for virtual shooting by using the target evaluation criterion.
[0019] According to the following detailed description of exemplary embodiments with reference to the accompanying drawings, other features and aspects of the present disclosure will become apparent. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings, which are included in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the present disclosure together with the specification, and are used to explain the principles of the present disclosure.
[0021] Figure 1A flowchart showing a method for determining screen evaluation criteria according to an embodiment of the present disclosure.
[0022] Figure 2 A flowchart showing a screen evaluation method according to an embodiment of the present disclosure.
[0023] Figure 3 A schematic diagram showing a screen evaluation system according to an embodiment of the present disclosure.
[0024] Figure 4 A block diagram showing a device for determining screen evaluation criteria according to an embodiment of the present disclosure.
[0025] Figure 5 A block diagram showing an electronic device 1900 according to an embodiment of the present disclosure. Detailed implementation manners
[0026] Hereinafter, various exemplary embodiments, features and aspects of the present disclosure will be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements having the same or similar functions. Although various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise specified.
[0027] The special term "exemplary" herein means "serving as an example, embodiment or illustration". Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.
[0028] The term "and / or" herein is merely a description of the associated relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality. For example, including at least one of A, B, and C can represent any one or more elements selected from the set composed of A, B, and C. In the description of the present disclosure, "a plurality" means two or more unless otherwise specifically defined.
[0029] It should be understood that the terms "comprising" and "including" used in the specification and claims of the present disclosure indicate the presence of the described features, wholes, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or their combinations.
[0030] In addition, for better illustration of the present disclosure, numerous specific details are given in the following detailed implementation manners. Those skilled in the art should understand that the present disclosure can also be implemented without certain specific details. In some instances, methods, means, elements, and circuits well-known to those skilled in the art are not described in detail so as to highlight the gist of the present disclosure.
[0031] The evaluation criterion determination method and the evaluation method of the embodiments of the present disclosure can be deployed on various terminal devices through software or hardware transformation. The terminal devices involved in the embodiments of the present disclosure may refer to devices with wireless connection functions and / or wired connection functions. The wireless connection function means that the device can be connected to other devices through wireless connection methods such as Wi-Fi and Bluetooth. The terminal devices involved in the embodiments of the present disclosure can also communicate with other devices through the wired connection function. The terminal devices involved in the embodiments of the present disclosure can be touch-screen, non-touch-screen, or without a screen. Touch-screen devices can be controlled by clicking, swiping, etc. on the display screen with fingers, styli, etc. Non-touch-screen devices can be connected to input devices such as mice, keyboards, and touch panels to control the terminal devices. Devices without a screen can be, for example, Bluetooth speakers without a screen. For example, the terminal devices of the present application may include, but are not limited to, user equipment (UE), mobile devices, mobile terminals, handheld devices, tablet computers, laptop computers, palmtop computers, computing devices, etc.
[0032] The evaluation criterion determination method and the evaluation method of the embodiments of the present disclosure can also be deployed on a server. The server can be located in the cloud or locally, and can be a physical device or a virtual device such as a virtual machine or a container, and has a wireless communication function. Among them, the wireless communication function can be set in the chip (system) or other components or assemblies of the server. It may refer to a device with a wireless connection function. The wireless connection function means that the device can be connected to other servers or terminal devices through wireless connection methods such as Wi-Fi and Bluetooth. The servers involved in the embodiments of the present disclosure can also have the function of communicating through wired connections. For example, the server of the embodiments of the present disclosure can be located in the cloud, communicate with the terminal device, receive multiple groups of historical shooting conditions of the virtual shooting scene sent by the terminal device, and use the evaluation criterion determination method deployed on the server to obtain the target evaluation criterion of at least one screen evaluation index based on the multiple groups of historical shooting conditions, and return it to the terminal device to display the target evaluation criterion of at least one screen evaluation index to the user in the terminal device.
[0033] Figure 1 The flowchart showing the screen evaluation criterion determination method according to an embodiment of the present disclosure is as follows. As Figure 1 shown, the method includes: step S11 to step S13.
[0034] In step S11, multiple groups of historical shooting conditions of the virtual shooting scene are obtained, and a single group of historical shooting conditions includes at least one of camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scene.
[0035] In practical applications, multiple groups of historical shooting conditions can be obtained by manually recording the camera configuration information, screen configuration information, and lighting configuration information used in different virtual shooting scenes. Among them, the camera configuration information can at least include: at least one of the aperture, shutter, lens, focal length, and white balance of the camera used in the virtual shooting scene; the screen configuration information can at least include: at least one of the brightness, color gamut, and refresh rate of the screen used in the virtual shooting scene. Among them, the screen used in the virtual shooting scene can be an LED screen, and the present disclosure embodiment does not limit the shape, size, type, etc. of the screen; the lighting configuration information can at least include: at least one of the light source information of the virtual light source and the physical light source in the virtual assets used in the virtual shooting scene; the light source information includes the arrangement and brightness of the light source. Among them, the arrangement of the light source can include the position and orientation of the light source. The virtual asset can be understood as the virtual scene to be displayed on the screen in virtual shooting. Virtual light sources (such as virtual light sources for simulating sunlight, virtual light sources for simulating lights, candles, etc.) can be set in the virtual scene. The physical light source can be understood as the light source set in the real shooting site of the virtual shooting scene. Generally speaking, the lighting directions of the virtual light source and the physical light source are aligned, that is, the physical light source cooperates with the lighting direction of the virtual light source to better complete virtual shooting.
[0036] Considering that some parts of the configuration information may not be completely recorded, while the virtual assets used in the virtual shooting scene and the real scene images captured (i.e., the images obtained by the camera shooting the actor in front of the screen and the virtual assets displayed on the screen) are usually completely retained. Therefore, in a possible implementation, obtaining multiple sets of historical shooting conditions of the virtual shooting scene may include: obtaining multiple virtual assets historically used in the virtual shooting scene and multiple real scene images captured, and determining multiple historical shooting conditions of the virtual shooting scene by analyzing the multiple virtual assets and multiple real scene images. Among them, for any pair of virtual assets and real scene images (i.e., the virtual assets displayed on the screen and the real scene images simultaneously captured by the camera when the virtual assets are displayed on the screen), the lighting configuration information can be obtained by analyzing the virtual assets (for example, the light source information of the virtual light source can be obtained from the virtual assets, and then the light source information of the physical light source can be deduced using the light source information of the virtual light source). By analyzing the brightness, color, and frame rate of the background in the real scene image, etc., the brightness, color gamut (i.e., the range area composed of the number of colors that the screen can express) and refresh rate of the screen can be calculated. By analyzing the projection relationship between the virtual asset and the real scene image, the camera parameters such as the aperture, shutter speed, focal length, and white balance of the camera can be calculated.
[0037] Among them, for any pair of virtual assets and real scene images, for example, the screen, camera, and lighting in the virtual shooting scene at that time can be simulated and emulated using the virtual assets and real scene images, and by continuously adjusting the configuration information of the screen, camera, and lighting respectively, to achieve the effect that the virtual assets are displayed on the screen and the image captured by the camera is consistent with the real scene image, and obtain the screen configuration information, camera configuration information, and lighting configuration information under this effect; for example, an artificial intelligence model can also be used to analyze the virtual assets and real scene images to obtain historical shooting conditions. The artificial intelligence model can be trained using a data set. The data set can include, for example, sample data (i.e., virtual assets and real scene images as samples) and annotation data (i.e., the corresponding real shooting conditions). The artificial intelligence model outputs a prediction result (i.e., the predicted shooting conditions) based on the sample data, and then the difference between the prediction result output by the model and the annotation data is used to train the artificial intelligence model. The embodiments of the present disclosure do not limit this. The embodiments of the present disclosure do not limit the method for obtaining historical shooting conditions.
[0038] In step S12, based on multiple sets of historical shooting conditions, an initial evaluation criterion for at least one screen evaluation index adapted to the virtual shooting scene is determined. The screen evaluation index is used to evaluate the display effect of the screen, and the initial evaluation criterion is used to indicate the compliance conditions of the screen evaluation index.
[0039] Among them, the screen evaluation indicators may include at least one of the following: screen brightness range indicator, screen uniformity indicator, screen brightness continuity indicator, screen color gamut range indicator, and screen color accuracy indicator. Among them, the screen brightness range indicator can measure the brightness range of the screen. In a virtual shooting scenario, a larger brightness range can provide a larger shooting space. The screen uniformity indicator can measure the brightness difference and color difference in different areas of the screen, that is, the screen uniformity can be expressed as the brightness difference and color difference. For example, since the screen (such as an LED screen) in virtual shooting is assembled by multiple boxes, when the screen displays the same color picture, there may be differences in the brightness and color displayed by different boxes when they display the same color picture. Therefore, the mean square error of brightness in different areas of the screen (such as the brightness displayed by different boxes) can be used to indicate the brightness difference, and the average color error in different areas of the screen (such as the color displayed by different boxes) can be used to indicate the color difference. The screen brightness continuity indicator can measure the continuity and smoothness of the brightness change during the screen display. If the brightness change is continuous and smooth, then the screen display will be more natural and comfortable. Among them, the continuity of the screen brightness change can be evaluated by measuring the brightness values at different time and space positions on the screen and analyzing these data. The screen color gamut range indicator can measure the color performance ability of the screen, that is, it can measure the color range that the screen can display. In a virtual shooting scenario, the larger the color gamut range, the larger the shooting space provided. The screen color accuracy indicator can measure the degree of closeness between the color displayed on the screen and the original color, that is, it can measure the color difference (i.e., color deviation) of the screen. Among them, the color accuracy can be expressed as the color deviation between the color displayed on the screen and the original color.
[0040] It should be understood that the above various screen evaluation indicators are some possible indicators proposed in the embodiments of the present disclosure. These indicators can be the indicators provided by the screen manufacturer, or some indicators suitable for the virtual shooting scenario can be selected from the various indicators provided by the screen manufacturer. For example, some indicators suitable for the virtual shooting scenario can be selected from the various indicators provided by the screen manufacturer based on obtaining virtual assets and real scene pictures as reference guidelines; of course, the screen evaluation indicators can also be selected based on manual experience, and the embodiments of the present disclosure do not limit this.
[0041] In a possible implementation, determining an initial evaluation criterion for at least one screen evaluation index adapted to a virtual shooting scene based on multiple sets of historical shooting conditions may include: determining the respective distribution ranges corresponding to various screen evaluation indexes based on multiple sets of historical shooting conditions; and determining the respective initial evaluation criteria corresponding to various screen evaluation indexes based on the respective distribution ranges corresponding to various screen evaluation indexes. Among them, the index values corresponding to each screen evaluation index under different historical shooting conditions can be determined by simulating and emulating the virtual shooting scenes under different historical shooting conditions (that is, restoring the virtual shooting scenes under different historical shooting conditions). For example, the screen brightness value, screen uniformity, brightness continuity, screen color gamut value, color accuracy, etc. can be determined. Thus, based on the index values corresponding to each screen evaluation index under multiple historical shooting conditions, the distribution ranges corresponding to different screen evaluation indexes can be obtained. For example, the brightness range corresponding to the screen brightness range index, the uniformity range corresponding to the screen uniformity index, the continuity range corresponding to the screen brightness continuity index, the color gamut range corresponding to the screen color gamut range index, and the accuracy range corresponding to the screen color accuracy. Alternatively, the distribution ranges corresponding to various screen evaluation indexes can also be determined based on multiple sets of historical shooting conditions by training an artificial intelligence model. The artificial intelligence model can be trained using a data set. The data set may include, for example, sample shooting conditions and annotation data (that is, the true distribution ranges corresponding to various screen evaluation indexes). The artificial intelligence model outputs the distribution range based on the sample shooting conditions, and then the artificial intelligence model is trained using the difference between the distribution range output by the model and the annotation data. The embodiments of the present disclosure do not limit this.
[0042] Furthermore, based on the distribution ranges corresponding to various screen evaluation metrics, the initial evaluation criteria corresponding to various screen evaluation metrics can be determined, that is, the initial compliance conditions corresponding to various screen evaluation metrics (or the initial thresholds corresponding to various screen evaluation metrics) can be determined. For example, based on the highest brightness in the brightness range corresponding to the screen brightness range metric determined under various historical shooting conditions, the initial evaluation criteria corresponding to the screen brightness range metric can be determined; based on the smallest screen uniformity (i.e., the smallest brightness difference and color difference) in the uniformity range corresponding to the screen uniformity metric, the initial evaluation criteria corresponding to the screen uniformity metric can be determined; based on the largest screen continuity in the continuity range corresponding to the screen brightness continuity metric, the initial evaluation criteria corresponding to the screen brightness continuity metric can be determined; taking the color gamut range corresponding to the screen color gamut range metric as the initial evaluation criteria corresponding to the screen color gamut range metric; based on the highest color accuracy (i.e., the smallest color deviation) in the accuracy range corresponding to the screen color accuracy, the initial evaluation criteria corresponding to the screen color accuracy can be determined. Exemplarily, the initial evaluation criteria corresponding to the screen brightness range metric may include that the screen brightness is greater than the highest brightness in the brightness range corresponding to the screen brightness range metric, the initial evaluation criteria corresponding to the screen uniformity metric may include that the screen uniformity is less than the smallest screen uniformity in the uniformity range, the initial evaluation criteria corresponding to the screen brightness continuity metric may include that the screen brightness continuity is greater than the largest screen continuity in the continuity range, and the initial evaluation criteria corresponding to the screen color accuracy may include that the color accuracy is greater than the highest color accuracy in the accuracy range (i.e., the color deviation is less than the smallest color deviation in the accuracy range). The embodiments of the present disclosure do not limit this. It should be understood that the above-mentioned implementation manners for determining the initial evaluation criteria are some possible implementation manners provided by the embodiments of the present disclosure. In fact, those skilled in the art can customize the determination manner of the initial evaluation criteria according to actual needs. For example, the initial evaluation criteria corresponding to the screen brightness continuity metric can also be determined based on the average value corresponding to the continuity range, and the initial evaluation criteria corresponding to the screen brightness range metric can be determined based on the ratio between the highest brightness and the lowest brightness in the brightness range. The embodiments of the present disclosure do not limit this.
[0043] In practical applications, one initial evaluation criterion can be determined for the same screen evaluation index, or multiple initial evaluation criteria can also be determined. The requirements of different initial evaluation criteria are different. For example, one initial evaluation criterion corresponding to the screen brightness range index can include that the screen brightness is greater than the highest brightness in the brightness range corresponding to the screen brightness range index, and another initial evaluation criterion can include that the screen brightness is greater than the average brightness in the brightness range corresponding to the screen brightness range index. Then, through step S13, one or more target evaluation criteria can be determined for the same screen evaluation index to meet the different requirements of different virtual shooting scenarios for the screen display performance. For example, for some virtual shooting scenarios with high requirements for the screen display performance, a target evaluation criterion with a higher standard can be used, and for some virtual shooting scenarios with low requirements for the screen display performance, a target evaluation criterion with a lower standard can be used.
[0044] In step S13, by verifying and optimizing the initial evaluation criteria of at least one screen evaluation index, target evaluation criteria for at least one screen evaluation index are obtained. The target evaluation criteria are used to indicate the target compliance conditions of the screen evaluation index, so as to evaluate whether the screen is suitable for the virtual shooting scenario by using the target evaluation criteria of at least one screen evaluation index.
[0045] Considering that the virtual assets used in historical virtual shooting scenarios may change. Even if the virtual assets are exactly the same as those used at the shooting site at that time, it is difficult to obtain accurate data for variables such as the screen configuration used at the shooting site and the camera configuration used during actual shooting. Moreover, the shooting effect at the virtual shooting site is not necessarily the most ideal effect. For example, the highest brightness of the screen used in a historical virtual shooting scenario is only 2200 nits, but in this scenario, it is more desirable for the screen to provide a brightness of 4000 nits. Therefore, the initial evaluation criteria obtained through step S12 are not necessarily evaluation criteria that are precisely adapted to the virtual shooting scenario. So, by verifying and optimizing the initial evaluation criteria of at least one screen evaluation index, more precisely adapted target evaluation criteria for at least one screen evaluation index to the virtual shooting scenario can be obtained, that is, the target compliance conditions (or the target thresholds corresponding to various screen evaluation indexes) corresponding to at least one screen evaluation index are obtained.
[0046] Specifically, in one possible implementation, step S13, by verifying and optimizing the initial evaluation criteria of at least one screen evaluation index to obtain the target evaluation criteria corresponding to at least one screen evaluation index, may include:
[0047] Step S131: For any screen evaluation index, simulate various defect display effects of the screen defects indicated by the screen evaluation index, and synthesize the various defect display effects onto a preset screen to obtain various defect screens, where the severity of the screen defects represented by different defect display effects is different;
[0048] Step S132: Display various defect screens on a reference screen, and use a data acquisition device to collect the screen data and screen images when the reference screen displays various defect screens. The screen data includes at least one of color and brightness. The environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene;
[0049] Step S133: Based on the screen data and screen images corresponding to the various defect screens, verify whether the display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation index conforms to the specified screen requirements of the virtual shooting scene;
[0050] Step S134: In the case where the display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria does not conform to the specified screen requirements, optimize the initial evaluation criteria of the screen evaluation index to obtain the target evaluation criteria corresponding to the screen evaluation index.
[0051] It should be understood that screen defects can have different severities. For example, the degrees of uneven brightness and color display on the screen are different, the degrees of color deviation in the screen display are different, the maximum brightness that the screen can display is different, and the color gamut ranges that the screen can display are different. Therefore, for the same screen evaluation index, multiple defect display effects can be simulated, and various defect display effects can be synthesized onto a preset screen to obtain multiple defect screens. Among them, the preset screen can be the screen of a virtual scene (i.e., virtual asset) to be projected onto a reference screen. The virtual scene included in the preset screen can be some virtual scenes with high contrast between light and dark and rich colors, and the embodiments of the present disclosure do not limit this. For example, both defect screens A and B have the defect of color deviation, and the degree of color deviation of defect screen A is more severe than that of defect screen B. Defect screen C has the defect of low maximum brightness. Or, the same defect screen can also include multiple severities of one type of defect. For example, defect screen D has the defect of color deviation, and the degree of color deviation in the left area of defect screen D is more severe than that in the right area. Of course, the same defect screen D can also be evenly divided into three parts or more regions based on the number of severity levels of color deviation. Or, the same defect screen can also include multiple types of defects. For example, in defect screen E, the left area has a color deviation defect, and the right area has a brightness unevenness defect. Multiple defect screens E can be used, and the severities of the two types of defects in each defect screen E are different. Of course, each defect screen E can also include three or more types of defects, and then defect screen E can be divided into multiple parts or more regions. The embodiments of the present disclosure do not limit this.
[0052] Among them, displaying various defect screens on the reference screen is equivalent to simulating various screen defects with different severities on the reference screen. Then, the data acquisition device can be controlled to collect the screen data and screen images when the reference screen displays various defect screens. For example, the data acquisition device can include a color analyzer and a camera. The color analyzer is used to collect the color and brightness of the screen when the reference screen displays various defect screens, and the camera is used to collect the screen images when the reference screen displays various defect screens. Or, the data acquisition device can also only include a camera. After collecting the screen images with the camera, the screen data can be extracted from the screen images.
[0053] Among them, in order to accurately verify the initial evaluation criteria, the environment where the reference screen is located can be the same as the actual shooting environment of the virtual shooting scene. The reference screen can have the screen configuration information specified by the virtual shooting scene, and the camera used to collect the screen image can also have the camera configuration information specified by the virtual shooting scene. At this time, the screen configuration information and camera configuration information used can be general default configuration information, or they can also be custom configuration information according to the actual needs of the user. That is, the scene setting, lighting, etc. of the scene where the reference screen is located can be set to simulate the actual shooting site of the virtual shooting scene, and devices such as the reference screen and the camera can be configured according to the requirements of virtual shooting (such as: the brightness and color gamut of the reference screen, the switch of the picture quality engine for screen rendering, the shutter of the camera, the pixel data bit depth of the camera, the gamma value of the camera, etc. are configured according to the specified configuration parameters) to verify and optimize the initial evaluation criteria of the screen evaluation indicators by simulating the screen defects in the actual shooting site.
[0054] Among them, the screen data can include the brightness values and color values of multiple regions (or multiple points) of the reference screen. Thus, given the screen data when the reference screen displays various defective pictures, the index values corresponding to the screen evaluation indicators can be calculated. For example, based on the brightness values in the screen data collected when the screen displays multiple defective pictures, the maximum brightness corresponding to each defective picture can be determined. Based on the brightness values and color values in the screen data collected when the screen displays each defective picture, the screen uniformity corresponding to each defective picture can be calculated. Based on the color values in the screen data collected when the screen displays each defective picture, the color gamut range and / or color accuracy corresponding to each defective picture can be determined. Then, for each screen evaluation indicator, the calculated index values corresponding to each defective picture can be compared with the corresponding initial evaluation criteria to obtain the screen data that meets the initial evaluation criteria of the screen evaluation indicator, that is, the screen image of the screen data that meets the initial evaluation criteria of the screen evaluation indicator.
[0055] Among them, the specified picture requirements of the virtual shooting scene can indicate the quality requirements for the real scene pictures captured in the virtual shooting scene. For example, the picture quality reaches a certain standard, the clarity reaches a certain standard, there is no obvious color difference, there are no obvious defects (such as no scan lines), the brightness is uniform, etc. In practical applications, corresponding verification algorithms can be designed for the specified picture requirements to verify whether the display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation indicator conforms to the specified picture requirements of the virtual shooting scene, or subjective verification can be carried out by professional evaluators, or the artificial intelligence model can also be trained to verify whether the display effect of the screen image conforms to the specified picture requirements of the virtual shooting scene. The embodiments of the present disclosure do not limit this.
[0056] If it is verified that the screen display effect of the screen image corresponding to the screen data meeting the initial evaluation criteria does not meet the specified screen requirements, it means that the current initial evaluation criteria do not meet the requirements of the virtual shooting scenario. Therefore, the initial evaluation criteria for the screen evaluation indicators can be optimized. For example, the initial evaluation criteria corresponding to the screen brightness range indicator can be increased, the initial evaluation criteria corresponding to the screen uniformity indicator can be decreased, the initial evaluation criteria corresponding to the screen brightness continuity indicator can be increased, the initial evaluation criteria corresponding to the screen color accuracy can be increased, etc., to obtain the target evaluation criteria corresponding to various screen evaluation indicators. It should be understood that those skilled in the art can use the optimization algorithms known in the art to optimize the initial evaluation criteria for the screen evaluation indicators, and the embodiments of the present disclosure do not limit this.
[0057] For example, for the defective images A, B, and C exemplified above, the defective images A, B, and C can be displayed on the reference screen, and the screen data collected respectively. After determining the color deviations corresponding to the defective images A and B and the maximum brightness corresponding to the defective image C according to the screen data, and comparing them with the initial evaluation criteria, it is determined that the color deviation corresponding to the defective image A reaches the initial evaluation criteria, the color deviation corresponding to the defective image B does not reach the initial evaluation criteria, and the maximum brightness corresponding to the defective image C reaches the initial evaluation criteria. Then, continue to verify whether the screen display effects of the screen images corresponding to the screen data of the defective images A and C meet the specified screen requirements of the virtual shooting scenario. If the defective image A does not meet, the initial evaluation criteria value of the color deviation can be optimized, for example, reducing the initial evaluation criteria value as the color deviation threshold. If the defective image C meets, the initial evaluation criteria value of the maximum brightness can be used as the target evaluation criteria.
[0058] For another example, in the defect screen D exemplified above, the color deviations in the left and right regions are different. There can be multiple defect screens D, and the color deviations in the two regions of different defect screens have different severities. Each defect screen can be divided into two partial screens according to the division boundary of the regions corresponding to different color deviations in each defect screen D. Based on the partial screen data corresponding to each of the two partial screens after each defect screen D is displayed on the reference screen, the color deviations corresponding to the two partial screens are determined respectively, and then compared with the initial evaluation criteria respectively to find a partial screen in a certain defect screen D that meets the initial evaluation criteria. Then, it is verified whether the partial screen on the screen corresponding to the partial screen in the defect screen D that meets the initial evaluation criteria conforms to the specified screen requirements of the virtual shooting scene. If it does not conform, the initial evaluation criteria are optimized. If it conforms, the initial evaluation criteria can be used as the target evaluation criteria. Correspondingly, the defect screen E exemplified above can refer to the implementation manner of the defect screen D. There can be multiple defect screens E, and the severities of the two defect types displayed in the two regions of different defect screens E can be different. Each defect screen E can be divided into two partial screens based on the division boundary of different defect types in each defect screen E. Based on the partial screen data corresponding to each of the two partial screens after each defect screen E is displayed on the reference screen, the initial evaluation criteria corresponding to the two defect types are verified and optimized respectively to obtain the corresponding target evaluation criteria.
[0059] It should be understood that the process of optimizing the initial evaluation criteria for the screen evaluation index can be iteratively executed for multiple rounds, that is, based on the screen data and screen images corresponding to various defective images, it is possible to iteratively verify whether the display effect of the screen image corresponding to the screen data that meets the optimized initial evaluation criteria meets the specified image requirements of the virtual shooting scene until the display effect of the screen image corresponding to the screen data of the optimized initial evaluation criteria meets the specified image requirements of the virtual shooting scene, and the target evaluation criteria corresponding to the screen evaluation index are obtained. Exemplarily, assuming that for a certain type of defect (such as color deviation), among the corresponding 5 defective images (1, 2, 3, 4, 5), the severity of the defect increases in sequence. In the first round of optimization, if it is determined that the screen data corresponding to the defective images (1, 2, 3) meet the corresponding initial evaluation criteria, then it can be seen whether the screen image corresponding to the defective image 3 with the highest defect severity among the defective images (1, 2, 3) meets the specified image requirements of the virtual shooting scene. This is because if the defective image 3 with the most severe defect already meets the specified image requirements, then the less severe defective images 1 and 2 will meet the specified image requirements. If the screen image corresponding to the defective image 3 does not meet the specified image requirements of the virtual shooting scene, then the initial evaluation criteria are optimized to make the optimized initial evaluation criteria higher. In this way, in the second round of optimization, based on the optimized initial evaluation criteria, it may be determined that the screen data corresponding to the defective images 1 and 2 meet the optimized initial evaluation criteria, then it can be seen whether the screen image corresponding to the defective image 2 with the highest defect severity among the defective images 1 and 2 meets the specified image requirements of the virtual shooting scene. If the screen image corresponding to the defective image 2 meets the specified image requirements of the virtual shooting scene, then the iterative optimization can be stopped, and the initial evaluation criteria optimized in the first round above are determined as the corresponding target evaluation criteria. If the screen image corresponding to the defective image 2 still does not meet the specified image requirements of the virtual shooting scene, then the initial evaluation criteria optimized in the first round above are continued to be optimized to obtain the initial evaluation criteria optimized in the second round until the screen image corresponding to the defective image that meets the optimized initial evaluation criteria determined according to the initial evaluation criteria optimized in a certain round meets the specified image requirements, and the target evaluation criteria are obtained.
[0060] As described above, one or more initial evaluation criteria can be determined from the same screen evaluation metric. When multiple initial evaluation criteria are determined from the same screen evaluation metric, multiple specified screen requirements for the virtual shooting scenario can be set. Multiple specified screen requirements can be set according to the user's requirements for the quality of the screen image (i.e., the requirements for the screen display performance). Based on this, in step S133 above, different specified screen requirements can be used to verify different initial evaluation criteria of the same screen evaluation metric respectively (i.e., verify whether the screen display effects of the screen images corresponding to the screen data that meet different initial evaluation criteria of the screen evaluation metric conform to the corresponding different specified screen requirements). It should be understood that higher specified screen requirements can verify higher-standard initial evaluation criteria, and lower specified screen requirements can verify lower-standard initial evaluation criteria. The embodiments of the present disclosure do not limit this. In this way, multiple target evaluation criteria corresponding to the same screen evaluation metric can be obtained to meet the different requirements of the user for the screen display performance used in the virtual shooting scenario.
[0061] According to the method for determining the screen evaluation criteria of the embodiments of the present disclosure, by obtaining multiple sets of historical shooting conditions of the virtual shooting scenario, determining the initial evaluation criteria for the screen evaluation metric adapted to the virtual shooting scenario, and then verifying and optimizing the initial evaluation criteria, more accurate target evaluation criteria adapted to the virtual shooting scenario can be obtained, so as to be able to efficiently and accurately determine whether the screen to be evaluated is suitable for virtual shooting using the target evaluation criteria.
[0062] Based on the method for determining the screen evaluation criteria proposed in the above embodiments of the present disclosure, the embodiments of the present disclosure also provide a Figure 2 screen evaluation method shown, and the screen test method may include:
[0063] Step S21, controlling the target screen to be evaluated to reach the preset screen configuration information, and controlling the target screen to display a reference screen, where the reference screen includes screens of multiple colors;
[0064] Step S22, using a data acquisition device to collect screen data when the target screen displays the reference screen, where the screen data includes at least one of color and brightness;
[0065] Step S23, according to the screen data, determining whether the display effect of the target screen meets the target evaluation criteria of at least one screen evaluation metric, and obtaining an evaluation result of the target screen, where the evaluation result is used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation metrics, and the target evaluation criteria corresponding to the at least one screen evaluation metric are determined by using the method for determining the screen evaluation criteria.
[0066] In step S21, the screen configuration information reached by the target screen can be the screen configuration information set by the user according to actual shooting requirements. For example, the target screen is controlled to reach a preset brightness, color gamut, and refresh rate. Then, the target screen is controlled to display a reference screen, which can be a screen with multiple colors. Among them, the user can customize the color type of the reference screen. For example, the reference screen can include a red screen, a green screen, a blue screen, a white screen, etc., and the embodiments of the present disclosure do not limit this.
[0067] In step S22, the data acquisition device can include a color analyzer, and the color analyzer can effectively acquire the screen data when the target screen displays the reference screen. Alternatively, the data acquisition device can also include a camera. The camera can be kept as much as possible in accordance with the requirements of the specified shooting standard, that is, parameters such as the aperture, shutter, frame size, frame rate, and shutter angle of the camera can be set according to the specified shooting standard. The camera can be used to acquire the screen image, and then the screen data can be extracted from the screen image. Among them, the serial digital interface (SDI) can be used to obtain the screen image captured by the camera, and the embodiments of the present disclosure do not limit this.
[0068] In step S23, by analyzing the screen data, the index values of various screen evaluation indexes can be obtained (such as determining at least one of the screen brightness value, screen uniformity, brightness continuity, screen color gamut value, and color accuracy), and then it is judged whether the index values of various screen evaluation indexes meet the target evaluation criteria of various screen evaluation indexes, so as to obtain the evaluation results of the target screen under various screen evaluation indexes. Furthermore, based on the evaluation results of the target screen under various screen evaluation indexes, it can be judged whether the target screen is suitable for virtual shooting. For example, when the evaluation results indicate that the display effect of the target screen meets the target evaluation criteria of various screen evaluation indexes, or the evaluation results indicate that the display effect of the target screen meets the target evaluation criteria of at least 4 screen evaluation indexes, etc., it is confirmed that the target screen is suitable for virtual shooting, and the embodiments of the present disclosure do not limit this.
[0069] In a possible implementation manner, the method may further include: determining the availability of the target screen for virtual shooting according to the evaluation result of the target screen, where the availability is used to indicate whether the target screen is suitable for the virtual shooting scenario. Among them, according to the evaluation result of the target screen, the target screen can be scored, and the score is used to indicate the availability of the target screen for virtual shooting. For example, a scoring standard of 1-5 points can be given, with 1 point being the lowest score and 5 points being the highest score.
[0070] In practical applications, a mapping relationship between the evaluation results of multiple screen evaluation indicators and the availability can be established in advance to use this mapping relationship to determine the availability of the target screen for virtual shooting according to the evaluation results of the target screen. For example, when the display effect of the target screen meets the target evaluation criteria of all screen evaluation indicators, the availability can be 5 points; when it meets the target evaluation criteria of at least 4 screen evaluation indicators, the availability can be 4 points; when it meets the target evaluation criteria of less than 1 screen evaluation indicator, the availability can be 1 point, etc. Or, the importance of different screen evaluation indicators can also be combined, weights can be set for different screen evaluation indicators, and the initial scores of the screen evaluation indicators satisfied by the display effect of the target screen can be weighted and summed using the weights of different screen evaluation indicators and the initial scores of different screen evaluation indicators to obtain the availability of the target screen for virtual shooting, etc. It should be understood that those skilled in the art can customize and design relevant algorithms according to actual needs to implement determining the availability of the target screen for virtual shooting according to the evaluation results of the target screen, and the embodiments of the present disclosure do not limit this.
[0071] In practical applications, based on the above evaluation results of the target screen and the availability determined based on the evaluation results, an evaluation report can be generated and sent to the user (such as sent to the user by email, etc.). The embodiments of the present disclosure do not limit the style, content, format, sending method, etc. of the evaluation report.
[0072] According to the evaluation method of the embodiments of the present disclosure, it is possible to efficiently and accurately determine whether the target screen to be evaluated is suitable for virtual shooting by using the target evaluation criteria of at least one screen evaluation indicator.
[0073] Based on the screen evaluation standard determination method and the screen evaluation method provided by the above embodiments of the present disclosure, the embodiments of the present disclosure also provide Figure 3 A screen evaluation system shown, such as Figure 3As shown in the figure, the screen evaluation system includes: a data acquisition module, a screening index module, an index verification and threshold determination module, an evaluation tool, and an evaluation report module. Among them, the data acquisition module can be used to control the color analyzer to collect screen data and control the camera to collect screen images; the screening index module can be used to execute the above-mentioned step S12 to determine the initial evaluation criteria for various screen evaluation indexes, that is, it can use the indexes provided by the manufacturer, collect past on-site assets to analyze historical shooting conditions as a guide for the initial evaluation criteria, simulate and statistically analyze historical shooting conditions to analyze the distribution range of screen evaluation indexes, and initially formulate the initial evaluation criteria based on this distribution range; the index verification and threshold determination module can be used to execute the above-mentioned step S13 to determine the target evaluation criteria for each screen evaluation index, that is, it can simulate potential screen defects in virtual shooting through algorithms, set the scene layout, lighting, etc. to simulate the real shooting scene, and set the LED screen, camera and other devices according to requirements (such as: brightness setting, picture quality engine switch, shutter adaptation, etc.), and then determine the indexes and thresholds (that is, determine the target evaluation criteria for screen evaluation indexes) by screening and verifying the UE project (that is, virtual assets), which is equivalent to determining the target evaluation criteria for screen evaluation indexes by judging the threshold feedback of each index on the virtual asset on the screen; the evaluation tool can be used to execute the above-mentioned screen evaluation method, that is, it can set the LED screen to be evaluated and display the content on the screen according to the corresponding screen configuration information, then collect colors through instruments such as color analysis, and finally generate an evaluation report through data analysis to inform the user of the evaluation results of the LED screen (that is, the index conditions of various screen evaluation indexes) and whether it is suitable for virtual shooting; the evaluation report module can give a score value from 1 to 5 based on the description of the collection and data analysis of each index by the evaluation tool, with 1 being the lowest score and 5 being the highest score, so as to indicate the availability of the currently evaluated LED screen for virtual shooting by using the score value.
[0074] In practical applications, in the above-mentioned index verification and threshold determination module, corresponding test procedures (or test cases) can be designed for different screen evaluation indexes, and the target evaluation criteria for different screen evaluation indexes can be determined by combining the results of subjective evaluation by humans. For example, different screen defects can be simulated on a reference screen (i.e., a screen that is suitable for virtual shooting scenarios and has no screen defects), and then it is initially judged whether the screen images obtained according to the test procedure are consistent with the subjective feelings to determine whether the test procedure is effective. Then, a subjective evaluation plan can be formulated by communicating with relevant personnel. After the test procedure is confirmed to be effective, virtual assets can be simulated on the reference screen and professional personnel can be invited for subjective evaluation to determine two sets of target evaluation criteria. One set can be the criteria for high-end screens, and the main evaluation criterion is subjective indifference; the other set can be the criteria for low-end screens, and the main evaluation criterion is subjective acceptability. Based on the results of subjective evaluation, evaluation criteria can be formulated, the test procedure can be integrated and improved, and an automated test script can be released to implement the automated designation of the test procedure. Exemplarily, algorithms and test procedures are developed to calculate the screen uniformity by analyzing the screen grayscale images collected by the camera; by simulating the non-uniformity between the LED boxes of the LED screen, various non-uniform defect display effects with different intensities and different types are displayed on a uniform reference screen and the developed test procedure is initially verified; the simulated non-uniform defect display effects with different intensities are applied to actual virtual assets, the virtual assets with the defect display effects are put on the screen, and the camera is used to collect the screen image data; after the captured screen image data is processed, the MOS (Mean opinion score) and FCPC (Force Choice Paired Comparison) methods are used to collect the evaluation results of professional personnel; the highest target evaluation criteria and the lowest target evaluation criteria applicable to virtual shooting scenarios are analyzed based on the evaluation data; then, the algorithms, test scripts, and evaluation criteria can be integrated into the evaluation tool to use the evaluation tool to execute the screen evaluation method to evaluate whether the screen is suitable for virtual shooting.
[0075] In the prior art, verification can only be carried out through the indicators provided by the LED screen manufacturers, and the relevant experienced personnel can conduct on-screen verification through the shooting assets accumulated historically. However, by using the above-mentioned evaluation system provided by the embodiments of the present disclosure, analysis and verification can be carried out through shooting experience, historical virtual assets, evaluation indicators provided by the screen manufacturers, etc. After data collection through corresponding tools, it is analyzed and judged whether the screen meets the requirements of virtual shooting, and an evaluation report is generated. Based on the business needs of virtual shooting, a set of screen evaluation systems for virtual shooting is realized by determining indicators, evaluation criteria, a complete tool chain, etc. A method for selecting, verifying, and finally determining the evaluation criteria for virtual shooting LED indicators is formed through on-site shooting experience, asset accumulation, and indicators provided by screen manufacturers. By using the evaluation tool to connect the upstream and downstream tool chains such as LED settings and data collection, the complete data collection and analysis process is realized, and finally the corresponding evaluation report is generated, which greatly simplifies the evaluation process and usability.
[0076] Figure 4 The block diagram of a device for determining a screen evaluation criterion according to an embodiment of the present disclosure is shown, as Figure 4 shown, the device includes:
[0077] An acquisition module 401, configured to acquire multiple groups of historical shooting conditions of a virtual shooting scene, and a single group of historical shooting conditions includes at least one of camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scene;
[0078] A determination module 402, configured to determine an initial evaluation criterion for at least one screen evaluation indicator adapted to the virtual shooting scene based on the multiple groups of historical shooting conditions, where the screen evaluation indicator is used to evaluate the display effect of the screen, and the initial evaluation criterion is used to indicate the passing condition of the screen evaluation indicator;
[0079] A verification and optimization module 403, configured to verify and optimize the initial evaluation criterion of the at least one screen evaluation indicator to obtain a target evaluation criterion of the at least one screen evaluation indicator, where the target evaluation criterion is used to indicate the target passing condition of the screen evaluation indicator, so as to evaluate whether the screen is suitable for the virtual shooting scene by using the target evaluation criterion of the at least one screen evaluation indicator.
[0080] In a possible implementation manner, the determining an initial evaluation criterion for at least one screen evaluation indicator adapted to the virtual shooting scene based on the multiple groups of historical shooting conditions includes: determining the respective distribution ranges corresponding to various screen evaluation indicators based on the multiple groups of historical shooting conditions; and determining the respective initial evaluation criteria corresponding to various screen evaluation indicators based on the respective distribution ranges corresponding to various screen evaluation indicators.
[0081] In a possible implementation, obtaining the target evaluation criteria corresponding to the at least one screen evaluation criterion by validating and optimizing the initial evaluation criteria of the at least one screen evaluation criterion includes: for any one of the screen evaluation criteria, simulating various defect display effects of the screen defects indicated by the screen evaluation criterion, and synthesizing the various defect display effects onto a preset picture to obtain a plurality of defect pictures, where the severity of the screen defects represented by different defect display effects is different; displaying the various defect pictures on a reference screen, and using a data acquisition device to collect the screen data and screen pictures when the reference screen displays the various defect pictures, where the screen data includes at least one of color and brightness, the environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene; based on the screen data and screen pictures corresponding to the various defect pictures, verifying whether the picture display effect of the screen picture corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation criterion conforms to the specified picture requirements of the virtual shooting scene; in the case where the picture display effect of the screen picture corresponding to the screen data that meets the initial evaluation criteria does not conform to the specified picture requirements, optimizing the initial evaluation criteria of the screen evaluation criterion to obtain the target evaluation criteria corresponding to the screen evaluation criterion.
[0082] In a possible implementation, obtaining multiple sets of historical shooting conditions of the virtual shooting scene includes: obtaining multiple virtual assets and multiple real scene pictures used in the virtual shooting scene in history, and determining multiple sets of historical shooting conditions of the virtual shooting scene by analyzing the multiple virtual assets and the multiple real scene pictures; where the camera configuration information includes at least one of the aperture, shutter, focal length, and white balance of the camera used in the virtual shooting scene; the screen configuration information includes at least one of the brightness, color gamut, and refresh rate of the screen used in the virtual shooting scene; the lighting configuration information includes at least one of the light source information of the virtual light source and the light source information of the physical light source in the virtual assets used in the virtual shooting scene; the light source information includes the arrangement and brightness of the light source.
[0083] In a possible implementation, the screen evaluation criterion includes at least one of the following: screen brightness range criterion, screen uniformity criterion, screen brightness continuity criterion, screen color gamut range criterion, screen color accuracy criterion.
[0084] The device for determining evaluation criteria according to an embodiment of the present disclosure obtains multiple groups of historical shooting conditions of a virtual shooting scene, determines an initial evaluation criterion for a screen evaluation index adapted to the virtual shooting scene, and then validates and optimizes the initial evaluation criterion to obtain a more accurate target evaluation criterion adapted to the virtual shooting scene, so as to efficiently and accurately determine whether a screen to be evaluated is suitable for virtual shooting by using the target evaluation criterion.
[0085] Based on the above evaluation method, an embodiment of the present disclosure further provides a screen evaluation device, which includes: a control module for controlling a target screen to be evaluated to reach preset screen configuration information and controlling the target screen to display a reference picture, where the reference picture includes pictures of multiple colors;
[0086] An acquisition module for acquiring screen data when the target screen displays the reference picture by using a data acquisition device, where the screen data includes at least one of color and brightness;
[0087] A judgment module for judging, according to the screen data, whether the display effect of the target screen meets the target evaluation criteria of at least one screen evaluation index, obtaining an evaluation result of the target screen, where the evaluation result is used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation indexes, and the target evaluation criteria corresponding to the at least one screen evaluation index are determined by using the above determination method.
[0088] In a possible implementation manner, the device further includes: an availability determination module for determining the availability of the target screen for virtual shooting according to the evaluation result of the target screen, where the availability is used to indicate whether the target screen is suitable for the virtual shooting scene.
[0089] According to the evaluation device of the embodiment of the present disclosure, it can be efficiently and accurately determined whether a target screen to be evaluated is suitable for virtual shooting by using the target evaluation criteria of at least one screen evaluation index.
[0090] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments, and their specific implementations can refer to the descriptions of the above method embodiments. For the sake of brevity, they are not described here again.
[0091] The embodiments of the present disclosure further propose a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above methods are implemented. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.
[0092] Embodiments of the present disclosure also propose an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein, the processor is configured to implement the above method when executing the instructions stored in the memory.
[0093] Embodiments of the present disclosure also provide a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in the processor of an electronic device, the processor in the electronic device executes the above method.
[0094] Figure 5 The block diagram of an electronic device 1900 according to an embodiment of the present disclosure is shown. For example, the electronic device 1900 may be provided as a server or a terminal device. Referring to Figure 5 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by a memory 1932 for storing instructions executable by the processing component 1922, such as application programs. The application programs stored in the memory 1932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.
[0095] The electronic device 1900 may further include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output interface 1958 (I / O interface). The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM or the like.
[0096] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as the memory 1932 including computer program instructions. The above computer program instructions can be executed by the processing component 1922 of the electronic device 1900 to complete the above method.
[0097] The present disclosure may be a system, a method, and / or a computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions thereon for causing a processor to implement various aspects of the present disclosure.
[0098] A computer-readable storage medium can be a tangible device that can hold and store instructions for use by an instruction execution device. The computer-readable storage medium can be, for example—but not limited to—an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanically encoded device, such as a punched card or raised structures in grooves having instructions stored thereon, and any suitable combination of the foregoing. The computer-readable storage medium as used herein is not to be construed as a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated through a waveguide or other transmission medium (e.g., an optical pulse through an optical fiber cable), or an electrical signal transmitted through a wire.
[0099] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to respective computing / processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include a copper transmission cable, an optical fiber transmission, a wireless transmission, a router, a firewall, a switch, a gateway computer, and / or an edge server. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.
[0100] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state-setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, by using the state information of the computer-readable program instructions to customize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit can execute the computer-readable program instructions to implement various aspects of the present disclosure.
[0101] Aspects of the present disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0102] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, when executed by the processor of the computer or other programmable data processing apparatus, create a means for implementing the functions / acts specified in one or more blocks of the flowchart illustrations and / or block diagrams. These computer-readable program instructions can also be stored in a computer-readable storage medium, which instructions cause a computer, a programmable data processing apparatus, and / or other devices to operate in a particular manner, such that the computer-readable medium storing the instructions comprises a manufacture including instructions for implementing various aspects of the functions / acts specified in one or more blocks of the flowchart illustrations and / or block diagrams.
[0103] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, causing a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more boxes of the flowchart and / or block diagram.
[0104] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of code, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or act, or by a combination of dedicated hardware and computer instructions.
[0105] The embodiments of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable other ordinary skilled artisans in the art to understand the embodiments disclosed herein.
Claims
1. A method for determining a screen evaluation criterion, characterized in that, Including: Obtaining multiple groups of historical shooting conditions for a virtual shooting scene, where a single group of historical shooting conditions includes at least one of camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scene; Based on the multiple groups of historical shooting conditions, determining an initial evaluation criterion for at least one screen evaluation index adapted to the virtual shooting scene, where the screen evaluation index is used to evaluate the display effect of the screen, and the initial evaluation criterion is used to indicate the passing conditions of the screen evaluation index; Through validating and optimizing the initial evaluation criterion for the at least one screen evaluation index, obtaining the target evaluation criterion for the at least one screen evaluation index, where the target evaluation criterion is used to indicate the target passing conditions of the screen evaluation index, so as to use the target evaluation criterion for the at least one screen evaluation index to evaluate whether the screen is suitable for the virtual shooting scene; Wherein, the step of obtaining the target evaluation criterion corresponding to the at least one screen evaluation index by validating and optimizing the initial evaluation criterion for the at least one screen evaluation index includes: For any screen evaluation index, simulating multiple defect display effects of the screen defects indicated by the screen evaluation index, and synthesizing the multiple defect display effects onto a preset picture to obtain multiple defect pictures, where the severity of the screen defects characterized by different defect display effects is different; Displaying various defect pictures on a reference screen, and using a data acquisition device to collect the screen data and screen pictures when the reference screen displays various defect pictures, where the screen data includes at least one of color and brightness, the environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene; Based on the screen data and screen pictures corresponding to the various defect pictures, validating whether the picture display effect of the screen picture corresponding to the screen data that meets the initial evaluation criterion of the screen evaluation index conforms to the specified picture requirements of the virtual shooting scene; In the case where the picture display effect of the screen picture corresponding to the screen data that meets the initial evaluation criterion does not conform to the specified picture requirements, optimizing the initial evaluation criterion of the screen evaluation index to obtain the target evaluation criterion corresponding to the screen evaluation index.
2. The method according to claim 1, wherein The step of determining the initial evaluation criterion for at least one screen evaluation index adapted to the virtual shooting scene based on the multiple groups of historical shooting conditions includes: Based on the multiple groups of historical shooting conditions, determining the respective distribution ranges corresponding to various screen evaluation indexes; Based on the respective distribution ranges corresponding to various screen evaluation indexes, determining the respective initial evaluation criteria corresponding to various screen evaluation indexes.
3. The method according to claim 1, characterized in that, The step of obtaining multiple groups of historical shooting conditions for the virtual shooting scene includes: Obtaining multiple virtual assets and multiple real-scene pictures historically used in the virtual shooting scene, and determining the multiple groups of historical shooting conditions for the virtual shooting scene by analyzing the multiple virtual assets and the multiple real-scene pictures; Wherein, the camera configuration information includes at least one of the aperture, shutter, focal length, and white balance of the camera used in the virtual shooting scene; The screen configuration information includes at least one of the brightness, color gamut, and refresh rate of the screen used in the virtual shooting scene; The lighting configuration information includes at least one of the light source information of the virtual light source and the light source information of the physical light source in the virtual assets used in the virtual shooting scene; the light source information includes the arrangement and brightness of the light source.
4. The method according to any one of claims 1 to 3, characterized in that The screen evaluation indicators include at least one of the following: screen brightness range indicator, screen uniformity indicator, screen brightness continuity indicator, screen color gamut range indicator, and screen color accuracy indicator.
5. A screen evaluation method, characterized in that, It includes: Controlling the target screen to be evaluated to reach the preset screen configuration information, and controlling the target screen to display a reference picture, the reference picture including pictures of various colors; Using a data acquisition device to collect screen data when the target screen displays the reference picture, the screen data including at least one of color and brightness; According to the screen data, judging whether the display effect of the target screen meets the target evaluation criteria of at least one screen evaluation indicator, and obtaining the evaluation result of the target screen, the evaluation result being used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation indicators, and the target evaluation criteria corresponding to the at least one screen evaluation indicator being determined by the determination method described in any one of claims 1 to 4.
6. The evaluation method according to claim 5, characterized in that, The method further includes: According to the evaluation result of the target screen, determining the available degree of the target screen for virtual shooting, the available degree being used to indicate whether the target screen is suitable for the virtual shooting scene.
7. A device for determining a screen evaluation criterion, characterized in that It includes: An acquisition module, configured to acquire multiple sets of historical shooting conditions of the virtual shooting scene, and a single set of historical shooting conditions includes at least one of the camera configuration information, screen configuration information, and lighting configuration information used in the virtual shooting scene; A determination module, configured to determine, based on the multiple sets of historical shooting conditions, an initial evaluation criterion for at least one screen evaluation indicator adapted to the virtual shooting scene, the screen evaluation indicator being used to evaluate the display effect of the screen, and the initial evaluation criterion being used to indicate the passing conditions of the screen evaluation indicator; A verification and optimization module, configured to obtain the target evaluation criterion for the at least one screen evaluation indicator by verifying and optimizing the initial evaluation criterion for the at least one screen evaluation indicator, the target evaluation criterion being used to indicate the target passing conditions of the screen evaluation indicator, so as to evaluate whether the screen is suitable for the virtual shooting scene by using the target evaluation criterion for the at least one screen evaluation indicator; Wherein, obtaining the target evaluation criterion corresponding to the at least one screen evaluation indicator by verifying and optimizing the initial evaluation criterion for the at least one screen evaluation indicator includes: For any one screen evaluation indicator, simulating various defect display effects of the screen defects indicated by the screen evaluation indicator, and synthesizing the various defect display effects onto a preset picture to obtain multiple defect pictures, and the severity of the screen defects characterized by different defect display effects is different; Display various defect screens on the reference screen, and use a data acquisition device to collect the screen data and screen images when the reference screen displays various defect screens. The screen data includes at least one of color and brightness. The environment where the reference screen is located is the same as the real shooting environment of the virtual shooting scene, and the reference screen has the screen configuration information specified by the virtual shooting scene; Based on the screen data and screen images corresponding to the various defect screens, verify whether the display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria of the screen evaluation index meets the specified screen requirements of the virtual shooting scene; In the case where the display effect of the screen image corresponding to the screen data that meets the initial evaluation criteria does not meet the specified screen requirements, optimize the initial evaluation criteria of the screen evaluation index to obtain the target evaluation criteria corresponding to the screen evaluation index.
8. A screen evaluation device, characterized in that, Comprising: A control module for controlling the target screen to be evaluated to reach the preset screen configuration information and controlling the target screen to display a reference image, the reference image including images of multiple colors; An acquisition module for using a data acquisition device to collect the screen data when the target screen displays the reference image, the screen data including at least one of color and brightness; A judgment module for judging, according to the screen data, whether the display effect of the target screen meets the target evaluation criteria of at least one screen evaluation index, and obtaining the evaluation result of the target screen. The evaluation result is used to indicate whether the display effect of the target screen meets the target evaluation criteria of various screen evaluation indexes. The target evaluation criteria corresponding to the at least one screen evaluation index are determined by using the determination method described in any one of claims 1 to 4.
9. An electronic device, characterized in that, Comprising: A processor; A memory for storing instructions executable by the processor; Wherein, the processor is configured to implement the method described in any one of claims 1 to 6 when executing the instructions stored in the memory.
10. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that, The computer program instructions, when executed by the processor, implement the method described in any one of claims 1 to 6.
Citation Information
Patent Citations
Live video quality evaluation method, video quality adjustment method and related device
CN114513655A
Display screen detection method and device
CN116468693A