A method for intelligent control of program shooting parameters based on multi-source sensing

By identifying the driving source of brightness changes in the main area through multi-source sensing data, determining the illumination state and extracting visual indices, and coordinating and verifying imaging parameters, the problem of insufficient visual stability in program shooting is solved, and the stability of the main image and the accuracy of visual features are achieved.

CN123123701APending Publication Date: 2026-11-17BEIJING GOLDEN POND MEDIA CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202611279244.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-08-21
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

In existing technologies, the methods for adjusting program shooting parameters fail to effectively distinguish between the different effects of changes in the subject's position and changes in ambient light, leading to errors in adjusting parameters such as exposure. Furthermore, they lack a comprehensive analysis of the subject's visual characteristics, making it difficult to maintain visual stability in complex scenes.

Method used

By obtaining the driving source of brightness changes in the subject area through multi-source sensing data, determining the illumination state and extracting visual indices, and coordinating and verifying imaging parameters, the visual state of the subject is ensured to meet the requirements.

Benefits of technology

It improves the visual stability of the main image during program shooting, avoids parameter misadjustment caused by misjudgment of the driving source due to brightness changes, and ensures the accuracy and stability of visual features.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123123701A_ABST
    Figure CN123123701A_ABST
Patent Text Reader

Abstract

This invention relates to the field of camera technology, and more particularly to an intelligent adjustment method for program shooting parameters based on multi-source perception. The method includes: acquiring multi-source perception data during program shooting to determine the cause of changes in brightness in the subject area; extracting subject visual features based on illumination conditions, determining a visual index corresponding to the illumination conditions, and generating a subject visual state evaluation result based on the visual index; determining the corresponding visual degradation type based on the subject visual state evaluation result, and coordinating parameter adjustment; re-acquiring the subject visual features after parameter adjustment, and verifying the subject visual state based on the subject visual features; and correcting the adjustment method of the corresponding imaging parameters based on the changes in subject visual features before and after parameter adjustment when the verification result does not meet the requirements. This invention improves the visual stability of the subject image during program shooting.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of camera technology, and in particular to an intelligent control method for program shooting parameters based on multi-source perception. Background Technology

[0002] In existing technologies, program shooting parameter control typically adjusts parameters such as exposure and white balance directly based on the brightness of the subject area or the average brightness of the image. This makes it difficult to distinguish different sources of brightness change, such as the subject crossing different lighting areas, independent changes in ambient light, and the combined effect of subject movement and ambient light. This can easily lead to misjudgment of the source of lighting changes. At the same time, existing control methods mostly use a single brightness index as the basis for parameter adjustment, lacking a comprehensive analysis of visual quality characteristics such as subject texture clarity, local contrast, color consistency, edge integrity, and the brightness relationship between the subject and the background. This makes it difficult to accurately identify specific types of visual degradation. In addition, parameters such as exposure, white balance, dynamic range compression, tone mapping, sharpening, texture enhancement, and noise suppression are usually adjusted independently, lacking synergistic constraints between parameters and feedback correction of adjustment results. This can easily lead to problems such as exposure jumps, color shifts, noise amplification, edge halos, and flickering in consecutive frames.

[0003] Chinese Patent Publication No. CN121151672A discloses an exposure adjustment method and apparatus. The method includes: obtaining exposure parameters corresponding to the current value output by a photosensitive device under current ambient light conditions by looking up a preset exposure parameter table; acquiring an image according to the exposure parameters and determining the current image brightness; if the current image brightness is not within a preset target brightness range, updating the exposure parameters corresponding to the current value in the exposure parameter table.

[0004] Therefore, the shooting parameter adjustment method has the problem of insufficient targeting of parameter adjustment and insufficient stability of subject visuals in complex program shooting scenarios because it mainly adjusts the exposure parameters based on the ambient light brightness and the current image brightness, without distinguishing the different effects of changes in subject position and ambient light on the brightness of the subject area, and without combining the subject's visual characteristics to coordinate the control of multiple imaging parameters. Summary of the Invention

[0005] To address this, the present invention provides an intelligent control method for program shooting parameters based on multi-source perception, which overcomes the problems in the prior art where the exposure parameters are adjusted mainly based on ambient light brightness and current image brightness, without distinguishing the different effects of changes in subject position and ambient light on the brightness of the subject area, and without combining subject visual characteristics to coordinate the control of multiple imaging parameters, resulting in insufficient targeting of parameter adjustment and subject visual stability in complex program shooting scenarios.

[0006] To achieve the above objectives, this invention provides a method for intelligent control of program shooting parameters based on multi-source sensing, comprising: Acquire multi-source sensing data during program shooting. When a change in brightness is detected in the main area, determine the cause of the change in brightness in the main area based on the time of change in the main position and the time of change in illumination, and generate the corresponding illumination state. Based on the illumination state, the visual features of the subject are extracted, the visual index corresponding to the illumination state is determined, and the visual state evaluation result of the subject is generated based on the visual index. The visual index includes the subject visual stability index, the environmental visual impact index, and the comprehensive visual disturbance index. Based on the subject's visual state assessment results, the corresponding visual degradation type is determined, and the parameters are adjusted accordingly. The subject's visual features after parameter adjustment are reacquired, and the subject's visual state is verified based on these features. If the verification results do not meet the requirements, the adjustment method of the corresponding imaging parameters is corrected according to the changes in the subject's visual characteristics before and after parameter adjustment.

[0007] Furthermore, when the change in the subject's position occurs earlier than the change in illumination, it is determined that the subject has moved into a new illumination area, and a subject illumination area migration state is generated. When the moment of change in illumination is earlier than the moment of change in the subject's position, it is determined that the ambient light changes independently, and a dynamic change state of the ambient light is generated; When the moment of change of the subject's position coincides with the moment of change of the illumination, it is determined that the subject's movement and the change of ambient light work together to generate a composite illumination change state.

[0008] Furthermore, when generating the subject illumination area migration state, the impact of illumination migration on the subject's recognizability is analyzed based on the corresponding subject visual characteristics to determine the subject visual stability index; When generating the dynamic change state of ambient light, the influence of ambient light changes on the subject's visual state is analyzed based on the corresponding subject's visual characteristics to determine the environmental visual influence index.

[0009] Furthermore, when generating the composite illumination change state, the visual change caused by the subject's motion contribution and the visual change caused by the ambient light contribution are determined according to the corresponding subject's visual characteristics. Based on the visual changes caused by the subject's motion and the visual changes caused by ambient light, a visual influence coupling relationship is established for the direction and magnitude of changes in the visual features of the same subject. A comprehensive visual disturbance index is then determined based on the visual changes and the visual influence coupling relationship.

[0010] Furthermore, the subject's visual state is determined to meet the requirements based on the subject's visual stability index, and when the subject's visual state does not meet the requirements, the subject's visual feature with the greatest impact on the subject's visual stability index is identified. The subject's visual degradation type is determined based on the identified subject's visual characteristics, and the corresponding imaging parameter adjustment method is determined based on the subject's visual degradation type.

[0011] Furthermore, the system determines whether the subject's visual state meets the requirements based on the environmental visual impact index, and when the subject's visual state does not meet the requirements, it identifies the subject's visual feature that has the greatest impact on the environmental visual impact index. The type of environmental visual degradation is determined based on the identified subject visual characteristics, and the corresponding imaging parameter adjustment method is determined based on the type of environmental visual degradation.

[0012] Furthermore, the visual state of the subject is determined to meet the requirements based on the comprehensive visual disturbance index, and when the visual state of the subject does not meet the requirements, the amount of visual change caused by the contribution of the subject's motion is compared with the amount of visual change caused by the contribution of the ambient light. The dominant adjustment direction of the imaging parameters is determined based on the relationship between the visual changes caused by the subject's motion and the visual changes caused by the ambient light. The primary and secondary adjustment relationships of each imaging parameter are determined based on the visual influence coupling relationship, so as to jointly adjust each imaging parameter.

[0013] Furthermore, when the visual change caused by the subject motion is greater than the visual change caused by the ambient light, the exposure time parameter, image sharpening parameter, texture enhancement parameter, and noise suppression parameter are determined as the dominant adjustment parameters. When the visual change caused by the ambient light contribution is greater than or equal to the visual change caused by the subject motion contribution, the exposure response parameter, white balance parameter, local dynamic range compression parameter, and area tone mapping parameter are determined as the dominant adjustment parameters.

[0014] Furthermore, based on the aforementioned visual influence coupling relationship, the moderating effect of each imaging parameter on the visual changes caused by the subject's motion and the visual changes caused by the ambient light is determined, and the primary and secondary relationship of the imaging parameters' moderating effects is determined based on the magnitude of the moderating effects of each imaging parameter. Based on the degree of visual disturbance represented by the comprehensive visual disturbance index and the primary and secondary relationship of adjustment, the adjustment method of each imaging parameter is determined.

[0015] Furthermore, the subject's visual features after parameter adjustment are reacquired, the corresponding visual index is re-determined based on the subject's visual features after parameter adjustment, and the subject's visual state after parameter adjustment is determined based on the re-determined visual index. When the subject's visual state does not meet the requirements, the subject's visual features before and after parameter adjustment are compared to identify the unrecovered subject visual features and the imaging parameter adjustment method corresponding to the unrecovered subject visual features is corrected.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: the method of the present invention identifies the migration of the subject's illumination area, independent changes in ambient light, and composite illumination changes by changing the subject's position and illumination, thus avoiding incorrect adjustment of imaging parameters due to confusion of the source of brightness changes in the subject area; then, it extracts the corresponding subject visual features according to different illumination states, determines the subject visual stability index, the environmental visual influence index, and the comprehensive visual disturbance index, and generates a subject visual state evaluation result based on the visual indices to determine the corresponding visual degradation type; further, based on the visual degradation type, the amount of visual change caused by the contribution of subject movement and the contribution of ambient light, and the coupling relationship of visual influence, it coordinates the adjustment of exposure, white balance, local dynamic range compression, regional tone mapping, image sharpening, texture enhancement, and noise suppression parameters, and redetermines the visual indices based on the subject visual features after parameter adjustment, verifies the subject visual state, and corrects the adjustment method of the corresponding imaging parameters when the subject visual state still does not meet the requirements, thereby forming a closed-loop control of illumination state recognition, visual state evaluation, imaging parameter adjustment, and adjustment effect verification, improving the visual stability of the subject image during program shooting.

[0017] Furthermore, the method of the present invention determines the driving source of brightness changes in the subject area by comparing the time of subject position change and the time of illumination change. Since brightness changes in the subject area during program shooting may be caused by the movement of the host, actor, or subject between different lighting areas, or by independent changes in ambient light such as stage lighting switching, changes in natural light, or fluctuations in display screen brightness, or by the combined effect of subject movement and ambient light changes, directly adjusting imaging parameters based solely on brightness changes in the subject area can easily confuse brightness changes caused by the subject entering different lighting areas with changes in ambient light itself, leading to incorrect adjustments of imaging parameters such as exposure. By comparing the time of subject position change and the time of illumination change, brightness changes in the subject area are distinguished into subject lighting area migration, independent changes in ambient light, and composite lighting changes. This allows subsequent extraction of subject visual features and assessment of visual state to correspond to the actual source of illumination changes, reducing parameter misadjustments caused by misjudgment of the driving source of brightness changes, and further improving the visual stability of the subject image during program shooting.

[0018] Furthermore, the method of the present invention determines the corresponding visual index based on the illumination state corresponding to the brightness change of the subject area. Since different illumination states affect the subject image in different ways, the same degree of brightness change in the subject area may manifest as a decrease in texture clarity, a reduction in local contrast, a color shift, a decrease in the integrity of the subject edge, or a change in the brightness relationship between the subject and the background. If the imaging parameter adjustment method is determined only based on the degree of brightness change, it is difficult to accurately reflect the actual visual degradation state of the image. By extracting the corresponding subject visual features according to different illumination states, determining the subject visual stability index under the subject illumination area migration state, determining the environmental visual influence index under the ambient light dynamic change state, and determining the visual change amount caused by the subject motion contribution and the visual change amount caused by the ambient light contribution under the composite illumination change state, a visual influence coupling relationship is established and a comprehensive visual disturbance index is determined. This can further determine the subject visual state and the corresponding visual degradation type, providing a basis for targeted adjustment of imaging parameters and further improving the visual stability of the subject image during program shooting.

[0019] Furthermore, the method of this invention performs coordinated adjustment of imaging parameters based on the subject's visual state assessment results corresponding to the visual index. Since there are interrelationships among parameters such as exposure, white balance, local dynamic range compression, regional tone mapping, image sharpening, texture enhancement, and noise suppression, independently adjusting a single parameter for a single visual feature may cause further changes in brightness, color, texture, or noise while improving the target visual feature. By determining the subject's visual features with a significant impact and their corresponding visual degradation types based on the subject's visual stability index or the environmental visual impact index, the corresponding imaging parameter adjustment method is determined. Under complex illumination changes, the dominant adjustment parameter is determined based on the relationship between the visual change caused by the subject's motion and the visual change caused by the ambient light. The adjustment method for each imaging parameter is determined based on the visual impact coupling relationship, enabling different imaging parameters to be coordinated around the current main visual degradation state, reducing mutual interference between different imaging parameters, and further improving the visual stability of the subject image during program shooting.

[0020] Furthermore, the method of the present invention reacquires the main visual features after completing the imaging parameter adjustment, determines the corresponding visual index based on the reacquired main visual features, and reviews the main visual state. If the main visual state still does not meet the requirements, it determines the unrecovered main visual feature items by comparing the main visual features before and after parameter adjustment, and corrects the imaging parameter adjustment method corresponding to the unrecovered main visual feature items. This allows the imaging parameters to continue to be corrected according to the actual adjustment results, avoiding insufficient parameter adjustment or mismatch in adjustment direction that causes the main image to remain in a visually abnormal state, and further improving the visual stability of the main image during program shooting. Attached Figure Description

[0021] Figure 1 This is an overall flowchart of the intelligent control method for program shooting parameters based on multi-source perception in an embodiment of the present invention. Figure 2 This is a flowchart illustrating the process of determining the cause of light change using a multi-source sensing-based intelligent control method for program shooting parameters in an embodiment of the present invention. Figure 3 This is a flowchart illustrating the process of determining the visual index using the intelligent control method for program shooting parameters based on multi-source perception, as described in an embodiment of the present invention. Figure 4 This is a flowchart illustrating the process of determining the dominant adjustment parameter using the intelligent control method for program shooting parameters based on multi-source sensing, as described in an embodiment of the present invention. Detailed Implementation

[0022] To make the objectives and advantages of the present invention clearer, the present invention will be further described below with reference to embodiments; it should be understood that the specific embodiments described herein are merely for explaining the present invention and are not intended to limit the present invention.

[0023] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0024] Please see Figure 1 The diagram shown is an overall flowchart of the intelligent control method for program shooting parameters based on multi-source sensing according to an embodiment of the present invention. The method described in this embodiment includes: Step S1: Acquire multi-source sensing data during program shooting. When a change in brightness of the main area is detected, determine the cause of the change in brightness of the main area based on the time of change in the main position and the time of change in illumination, and generate the corresponding illumination state. Step S2: Extract the subject's visual features based on the illumination state, determine the visual index corresponding to the illumination state, and generate a subject's visual state evaluation result based on the visual index. The visual index includes the subject's visual stability index, the environmental visual impact index, and the comprehensive visual disturbance index. Step S3: Based on the subject's visual state assessment results, determine the corresponding visual degradation type and adjust the parameters accordingly. Step S4: Reacquire the subject's visual features after parameter adjustment, and verify the subject's visual state based on the subject's visual features; Step S5: If the verification result does not meet the requirements, the adjustment method of the corresponding imaging parameters is corrected according to the changes in the main visual features before and after parameter adjustment.

[0025] Specifically, multi-source sensing data includes continuous image frame data, subject spatial location data, and ambient lighting data.

[0026] In this embodiment, the method identifies the migration of the subject's illumination area, independent changes in ambient light, and composite illumination changes by detecting changes in the subject's position and illumination, thus avoiding incorrect adjustment of imaging parameters due to confusion about the sources of brightness changes in the subject area. Subsequently, it extracts corresponding subject visual features based on different illumination states, determines the subject visual stability index, environmental visual impact index, and comprehensive visual disturbance index, and generates a subject visual state assessment result based on these visual indices to determine the corresponding visual degradation type. Furthermore, based on the visual degradation type, the amount of visual change caused by the contribution of subject movement and the contribution of ambient light, and the coupling relationship of visual impact, it coordinately adjusts parameters such as exposure, white balance, local dynamic range compression, regional tone mapping, image sharpening, texture enhancement, and noise suppression. Based on the subject visual features after parameter adjustment, it re-determines the visual indices to verify the subject visual state. If the subject visual state still does not meet the requirements, it corrects the adjustment method of the corresponding imaging parameters, thereby forming a closed-loop control of illumination state identification, visual state assessment, imaging parameter adjustment, and adjustment effect verification, improving the visual stability of the subject image during program shooting.

[0027] Please see Figure 2 As shown, this is a logical flowchart of the process for determining the cause of illumination change in an embodiment of the present invention. In this embodiment, based on the time of change of the subject's position and the time of illumination change, it is determined that the brightness change of the subject area is caused by the migration of the subject's illumination area, independent change of ambient light, or the combined effect of both. When the change in the subject's position occurs earlier than the change in illumination, it is determined that the subject has moved into a new illumination area, and a subject illumination area migration state is generated. When the moment of change in illumination is earlier than the moment of change in the subject's position, it is determined that the ambient light changes independently, and a dynamic change state of the ambient light is generated; When the moment of change of the subject's position coincides with the moment of change of the illumination, it is determined that the subject's movement and the change of ambient light work together to generate a composite illumination change state.

[0028] Specifically, the lighting status includes the migration status of the main lighting area, the dynamic change status of ambient light, and the change status of composite lighting.

[0029] It is understandable that the formation of changes in the brightness of the subject area has a corresponding temporal relationship with the changes in the subject's position relative to the illuminated area and the changes in the ambient light field itself. When the change in the subject's position precedes the change in illumination, it indicates that the subject first undergoes spatial migration, and then produces a brightness response due to entering an illuminated area with different illuminance or illumination direction. Therefore, it can be identified as a migration of the subject's illuminated area. When the change in illumination precedes the change in the subject's position, it indicates that the brightness of the subject area has changed before the subject has undergone corresponding spatial migration. Therefore, it can be identified as an independent change in ambient light. When both occur simultaneously, it indicates that the subject's spatial migration and the change in ambient light act together on the brightness of the subject area at the same time period. Therefore, it can be identified as a composite illumination change. Thus, the different driving sources of changes in the brightness of the subject area can be distinguished based on their temporal relationship.

[0030] In this embodiment, the method determines the driving source of brightness changes in the subject area by comparing the time of subject position change and the time of illumination change. Since brightness changes in the subject area during program shooting may be caused by the movement of the host, actor, or subject between different lighting areas, or by independent changes in ambient light such as stage lighting switching, changes in natural light, or fluctuations in display screen brightness, or by the combined effect of subject movement and ambient light changes, directly adjusting imaging parameters based solely on brightness changes in the subject area can easily confuse brightness changes caused by the subject entering different lighting areas with changes in ambient light itself, leading to incorrect adjustments of imaging parameters such as exposure. By comparing the time of subject position change and the time of illumination change, the brightness changes in the subject area are distinguished into subject lighting area migration, independent changes in ambient light, and composite lighting changes. This allows subsequent subject visual feature extraction and visual state assessment to correspond to the actual source of illumination changes, reducing parameter misadjustments caused by misjudgment of the driving source of brightness changes, and further improving the visual stability of the subject image during program shooting.

[0031] Please see Figure 3 As shown, this is a logical flowchart of the process for determining the visual index according to an embodiment of the present invention. In this embodiment, the visual features of the subject are extracted based on the illumination state to determine the visual index corresponding to the illumination state. When generating the subject illumination area migration state, the impact of illumination migration on the subject's recognizability is analyzed based on the corresponding subject visual characteristics to determine the subject visual stability index. When generating the dynamic change state of ambient light, the influence of ambient light change on the visual state of the subject is analyzed based on the corresponding subject visual characteristics to determine the ambient visual influence index. When generating the composite illumination change state, the amount of visual change caused by the subject's motion contribution and the amount of visual change caused by the ambient light contribution are determined according to the corresponding subject's visual characteristics. Based on the visual changes caused by the subject's motion and the visual changes caused by ambient light, a visual influence coupling relationship is established for the direction and magnitude of changes in the visual features of the same subject. A comprehensive visual disturbance index is then determined based on the visual changes and the visual influence coupling relationship.

[0032] Specifically, the visual changes caused by the subject's motion and the visual changes caused by ambient light are calculated separately, including: Based on the differences in the visual characteristics of the subject before and after the subject's movement, and excluding the visual characteristic changes corresponding to the changes in ambient light during the same period, the amount of visual change caused by the subject's movement is determined; based on the changes in the visual characteristics of the ambient light reference area during the subject's movement and the corresponding state of the visual characteristic changes in the subject area, the amount of visual change caused by the ambient light is determined.

[0033] Specifically, the process of establishing the visual influence coupling relationship is as follows: the visual changes caused by the subject's motion and the visual changes caused by the ambient light are aligned according to the same subject area and the same time window, and the direction and magnitude of change of the two in subject brightness, color, texture clarity, local contrast and edge integrity are determined respectively; when the change direction of the two on the same visual feature is the same, it is determined to be a mutually reinforcing relationship; when the change direction is opposite, it is determined to be a mutually canceling relationship; when only one side causes a significant change, it is determined to be a unilateral dominant relationship, so as to establish the visual influence coupling relationship according to the relationship type corresponding to each visual feature.

[0034] Specifically, the main visual features include texture clarity, local contrast, color consistency, subject edge integrity, brightness difference between subject and background, and local dynamic range.

[0035] Specifically, the subject visual stability index includes a comprehensive representation of the subject's texture clarity, local contrast, color consistency, and subject edge integrity, which is used to reflect the subject's recognizability and visual stability during migration in the illuminated area.

[0036] Specifically, the Environmental Visual Impact Index includes a comprehensive representation of the differences in brightness between the subject and the background, the state of color change, and the state of local dynamic range change, in order to reflect the degree of influence of dynamic changes in ambient light on the subject's visual state.

[0037] Specifically, the comprehensive visual disturbance index includes a comprehensive characterization of visual changes caused by the subject's motion, visual changes caused by ambient light, and the coupling state of their visual influence, in order to reflect the overall degree of disturbance caused by changes in composite illumination to the subject's visual state.

[0038] Specifically, the assessment results of the subject's visual state include the judgment results on whether the subject's visual state meets the requirements, the subject's visual features that have undergone abnormal changes, and the main sources of influence of the corresponding visual changes.

[0039] It is understandable that different lighting conditions have different effects on the subject image. The migration of the subject's lighting area mainly affects the subject's texture, local contrast, color consistency, and edge integrity. Dynamic changes in ambient light mainly affect the brightness relationship between the subject and the background, color status, and local dynamic range. Composite lighting changes simultaneously include the visual effects caused by subject movement and ambient light changes. Therefore, by extracting the subject's visual features corresponding to its effects on different lighting conditions, we can reflect the subject's recognizability, the degree of influence of ambient light on the subject's vision, and the degree of visual disturbance caused by the combined effect of the two. Based on this, we can determine the subject's visual stability index, the environmental visual influence index, or the comprehensive visual disturbance index, so that the visual indices correspond to the actual lighting changes.

[0040] In this embodiment, the method determines the corresponding visual index based on the illumination state corresponding to the brightness change of the main area. Since different illumination states affect the main image in different ways, the same degree of brightness change in the main area may manifest as a decrease in texture clarity, a reduction in local contrast, a color shift, a decrease in the integrity of the main edge, or a change in the brightness relationship between the main and background. If the imaging parameter adjustment method is determined only based on the degree of brightness change, it is difficult to accurately reflect the actual visual degradation state of the image. By extracting the corresponding main visual features according to different illumination states, determining the main visual stability index under the main illumination area migration state, determining the environmental visual influence index under the ambient light dynamic change state, and determining the visual change amount caused by the main motion contribution and the visual change amount caused by the ambient light contribution under the composite illumination change state, a visual influence coupling relationship is established and a comprehensive visual disturbance index is determined. This can further determine the main visual state and the corresponding visual degradation type, providing a basis for targeted adjustment of imaging parameters and further improving the visual stability of the main image during program shooting.

[0041] Please see Figure 4 As shown, this is a flowchart illustrating the process of determining the dominant adjustment parameters in an embodiment of the present invention. In this embodiment, the visual state of the subject is determined to meet the requirements based on the visual index. The subject's visual state is determined based on the subject's visual stability index to determine whether the subject's visual state meets the requirements. When the subject's visual state does not meet the requirements, the subject's visual feature with the greatest impact on the subject's visual stability index is identified. The type of visual degradation of the subject is determined based on the identified visual characteristics of the subject, and the corresponding imaging parameter adjustment method is determined based on the type of visual degradation of the subject; The environmental visual impact index is used to determine whether the subject's visual state meets the requirements, and when the subject's visual state does not meet the requirements, the subject's visual feature with the greatest impact on the environmental visual impact index is determined. The type of environmental visual degradation is determined based on the identified subject visual characteristics, and the corresponding imaging parameter adjustment method is determined based on the type of environmental visual degradation. The overall visual disturbance index is used to determine whether the subject's visual state meets the requirements. If the subject's visual state does not meet the requirements, the amount of visual change caused by the subject's motion contribution is compared with the amount of visual change caused by the ambient light contribution. The dominant adjustment direction of the imaging parameters is determined based on the relationship between the visual changes caused by the subject's motion and the visual changes caused by the ambient light. The primary and secondary adjustment relationships of each imaging parameter are determined based on the visual influence coupling relationship, so as to jointly adjust each imaging parameter. When the visual change caused by the main motion is greater than the visual change caused by the ambient light, the exposure time parameter, image sharpening parameter, texture enhancement parameter, and noise suppression parameter are determined as the dominant adjustment parameters. When the visual change caused by the contribution of ambient light is greater than or equal to the visual change caused by the contribution of subject motion, the exposure response parameter, white balance parameter, local dynamic range compression parameter, and area tone mapping parameter are determined as the dominant adjustment parameters. Based on the aforementioned visual influence coupling relationship, the moderating effect of each imaging parameter on the visual changes caused by the subject's motion and the visual changes caused by the ambient light is determined, and the primary and secondary relationship of the imaging parameters' moderating effect is determined based on the magnitude of the corresponding moderating effects of each imaging parameter. Based on the degree of visual disturbance represented by the comprehensive visual disturbance index and the primary and secondary relationship of adjustment, the adjustment method of each imaging parameter is determined.

[0042] Specifically, visual degradation types include texture sharpness degradation, brightness and contrast degradation, color consistency degradation, subject edge integrity degradation, and local dynamic range degradation.

[0043] Specifically, the types of visual degradation include degradation of texture clarity, degradation of local contrast, degradation of color consistency, and degradation of the integrity of the subject's edges.

[0044] Specifically, environmental visual degradation types include degradation of the brightness relationship between the subject and the background, degradation of the subject's color state, and degradation of local dynamic range.

[0045] Specifically, the imaging parameter adjustment method includes determining the imaging parameter to be adjusted, determining the direction of imaging parameter adjustment, determining the adjustment range of imaging parameter, and determining the primary and secondary relationship of adjustment among multiple imaging parameters.

[0046] Specifically, the parameters include exposure time parameters, exposure gain parameters, and white balance parameters.

[0047] Specifically, when determining the main visual feature that has the greatest impact on the main visual stability index, one main visual feature is selected in sequence from texture clarity, local contrast, color consistency, and main edge integrity. The selected main visual feature is restored to its corresponding feature state before the brightness change, while keeping other main visual features unchanged, and the main visual stability index is re-determined. The change in the main visual stability index before and after the restoration of each main visual feature is obtained, and the main visual feature that causes the largest change in the main visual stability index is determined as the main visual feature that has the greatest impact on the main visual stability index.

[0048] Specifically, when determining the main visual feature that has the greatest impact on the environmental visual impact index, one main visual feature is selected sequentially from the differences in brightness between the subject and the background, the state of color change, and the local dynamic range. The selected main visual feature is restored to its corresponding state before the change in ambient light, while keeping other main visual features unchanged, and the environmental visual impact index is redefined. The change in the environmental visual impact index before and after the restoration of each main visual feature is obtained, and the main visual feature that causes the largest change in the environmental visual impact index is determined as the main visual feature that has the greatest impact on the environmental visual impact index.

[0049] Specifically, the order of adjustment of imaging parameters is determined based on the magnitude of their respective adjustment effects. This includes: keeping other imaging parameters constant, adjusting each candidate imaging parameter individually along the direction of improving the current visual degradation state, and obtaining the changes in the corresponding subject visual features before and after adjustment; judging whether each imaging parameter can improve the current visual degradation state based on the direction of change in the subject visual features, and comparing the improvement in subject visual features corresponding to each imaging parameter that can produce an improvement effect; determining the imaging parameters with larger improvement in subject visual features as priority adjustment parameters, and determining the imaging parameters with smaller improvement as subsequent adjustment parameters, and forming the order of adjustment of imaging parameters from largest to smallest improvement.

[0050] It is understood that the visual index is a comprehensive representation of multiple visual features related to the image quality of a subject. Its changes can reflect the overall changes in visual features such as the sharpness of the subject's texture, local contrast, color consistency, edge integrity, the brightness relationship between the subject and the background, and the local dynamic range. When the corresponding visual features remain stable or meet the visual performance requirements of the current captured image, the visual index reflects that the subject's visual state meets the requirements. When one or more visual features continuously degrade and cause the visual stability reflected by the visual index to decrease or the degree of visual disturbance to increase, it indicates that the subject's visual state does not meet the requirements. Therefore, the visual index can be used to determine whether the subject's visual state meets the requirements and to further locate the subject's visual features that cause visual abnormalities.

[0051] In this embodiment, the parameters are adjusted in a coordinated manner, including: Based on the subject's visual state assessment results, determine the visual degradation type corresponding to the current subject's visual state, and obtain the imaging parameters related to the visual degradation type. The imaging parameters that can directly improve the target's visual features are determined as the dominant adjustment parameters, and the imaging parameters used to compensate for the associated visual changes caused by the dominant adjustment parameters are determined as the co-adjustment parameters. When the visual degradation of the subject manifests as a decrease in texture sharpness or a reduction in the integrity of the subject's edges, the exposure time is shortened first, and the image sharpening parameters and texture enhancement parameters are adjusted to reduce motion blur and restore the subject's outline and texture details. When shortening the exposure time causes a decrease in the brightness of the subject area, the exposure gain or area tone mapping parameters are adjusted simultaneously for brightness compensation, and the noise suppression parameters are adjusted according to the changes in dark noise. When the visual degradation of the subject manifests as an abnormal relationship between the brightness of the subject and the background or an imbalance in the local dynamic range, adjust the exposure response parameters, local dynamic range compression parameters, and area tone mapping parameters to compress the bright areas, compensate the low-bright areas, and maintain the brightness distinction between the subject and the background; when the color consistency of the subject is abnormal, adjust the white balance parameters according to the direction of color change to reduce the color shift of the subject. Under varying conditions of combined illumination, the visual changes caused by the subject's motion are compared with those caused by ambient light. The imaging parameter corresponding to the one with the larger visual change is taken as the primary adjustment target, and the adjustment priority of other imaging parameters is determined based on the coupling relationship of visual effects. When the effects of subject motion and ambient light mutually enhance the same visual feature, the adjustment degree of the corresponding parameter is increased. When the two have a mutual cancellation effect, the adjustment range of the corresponding parameter is limited to avoid overcompensation. After completing parameter adjustment, the subject's visual features are reacquired and the corresponding visual index is determined to review the subject's visual state. If the subject's visual state still does not meet the requirements, the changes in the subject's visual features before and after adjustment are compared to identify the unrecovered subject visual feature items. The adjustment range of the corresponding imaging parameters is increased, or the adjustment priority of the current parameters is reduced and the adjustment priority of the associated imaging parameters is increased, so as to perform coordinated adjustment again.

[0052] In this embodiment, the method coordinates the adjustment of imaging parameters based on the subject's visual state assessment results corresponding to the visual index. Since there are interrelationships among parameters such as exposure, white balance, local dynamic range compression, region tone mapping, image sharpening, texture enhancement, and noise suppression, independently adjusting a single parameter for a single visual feature may cause further changes in brightness, color, texture, or noise while improving the target visual feature. By determining the subject's visual features with a significant impact and their corresponding visual degradation types based on the subject's visual stability index or the environmental visual impact index, the corresponding imaging parameter adjustment method is determined. Under complex illumination changes, the dominant adjustment parameter is determined based on the relationship between the visual change caused by the subject's motion and the visual change caused by the ambient light. Furthermore, the adjustment method for each imaging parameter is determined based on the visual impact coupling relationship, enabling different imaging parameters to be coordinated around the current primary visual degradation state, reducing mutual interference between different imaging parameters, and further improving the visual stability of the subject's image during program shooting.

[0053] Specifically, the subject's visual features after parameter adjustment are reacquired, the corresponding visual index is re-determined based on the subject's visual features after parameter adjustment, and the subject's visual state after parameter adjustment is determined based on the re-determined visual index. When the subject's visual state does not meet the requirements, the subject's visual features before and after parameter adjustment are compared to identify the unrecovered subject visual features and the imaging parameter adjustment method corresponding to the unrecovered subject visual features is corrected.

[0054] In this embodiment, after adjusting the imaging parameters, the method reacquires the main visual features, determines the corresponding visual index based on the reacquired main visual features, and verifies the main visual state. If the main visual state still does not meet the requirements, the method determines the unrecovered main visual feature items by comparing the main visual features before and after parameter adjustment, and corrects the imaging parameter adjustment method corresponding to the unrecovered main visual feature items. This allows the imaging parameters to be further corrected based on the actual adjustment results, avoiding insufficient parameter adjustment or mismatch in adjustment direction that could cause the main image to remain in a visually abnormal state, and further improving the visual stability of the main image during program shooting.

[0055] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of the present invention.

Claims

1. A method for intelligent control of program shooting parameters based on multi-source sensing, characterized in that, include: Acquire multi-source sensing data during program shooting. When a change in brightness is detected in the main area, determine the cause of the change in brightness in the main area based on the time of change in the main position and the time of change in illumination, and generate the corresponding illumination state. Based on the illumination state, the visual features of the subject are extracted, the visual index corresponding to the illumination state is determined, and the visual state evaluation result of the subject is generated based on the visual index. The visual index includes the subject visual stability index, the environmental visual impact index, and the comprehensive visual disturbance index. Based on the subject's visual state assessment results, the corresponding visual degradation type is determined, and the parameters are adjusted accordingly. The subject's visual features after parameter adjustment are reacquired, and the subject's visual state is verified based on these features. If the verification results do not meet the requirements, the adjustment method of the corresponding imaging parameters is corrected according to the changes in the subject's visual characteristics before and after parameter adjustment.

2. The intelligent control method for program shooting parameters based on multi-source perception according to claim 1, characterized in that, When the change in the subject's position occurs earlier than the change in illumination, it is determined that the subject has moved into a new illumination area, and a subject illumination area migration state is generated. When the moment of change in illumination is earlier than the moment of change in the subject's position, it is determined that the ambient light changes independently, and a dynamic change state of the ambient light is generated; When the moment of change of the subject's position coincides with the moment of change of the illumination, it is determined that the subject's movement and the change of ambient light work together to generate a composite illumination change state.

3. The intelligent control method for program shooting parameters based on multi-source perception according to claim 2, characterized in that, When generating the subject illumination area migration state, the impact of illumination migration on the subject's recognizability is analyzed based on the corresponding subject visual characteristics to determine the subject visual stability index. When generating the dynamic change state of ambient light, the influence of ambient light changes on the subject's visual state is analyzed based on the corresponding subject's visual characteristics to determine the environmental visual influence index.

4. The intelligent control method for program shooting parameters based on multi-source perception according to claim 3, characterized in that, When generating the composite illumination change state, the amount of visual change caused by the subject's motion contribution and the amount of visual change caused by the ambient light contribution are determined according to the corresponding subject's visual characteristics. Based on the visual changes caused by the subject's motion and the visual changes caused by ambient light, a visual influence coupling relationship is established for the direction and magnitude of changes in the visual features of the same subject. A comprehensive visual disturbance index is then determined based on the visual changes and the visual influence coupling relationship.

5. The intelligent control method for program shooting parameters based on multi-source perception according to claim 4, characterized in that, The subject's visual state is determined based on the subject's visual stability index to determine whether the subject's visual state meets the requirements. When the subject's visual state does not meet the requirements, the subject's visual feature with the greatest impact on the subject's visual stability index is identified. The subject's visual degradation type is determined based on the identified subject's visual characteristics, and the corresponding imaging parameter adjustment method is determined based on the subject's visual degradation type.

6. The intelligent control method for program shooting parameters based on multi-source perception according to claim 5, characterized in that, The environmental visual impact index is used to determine whether the subject's visual state meets the requirements, and when the subject's visual state does not meet the requirements, the subject's visual feature with the greatest impact on the environmental visual impact index is determined. The type of environmental visual degradation is determined based on the identified subject visual characteristics, and the corresponding imaging parameter adjustment method is determined based on the type of environmental visual degradation.

7. The intelligent control method for program shooting parameters based on multi-source perception according to claim 6, characterized in that, The overall visual disturbance index is used to determine whether the subject's visual state meets the requirements. If the subject's visual state does not meet the requirements, the amount of visual change caused by the subject's motion contribution is compared with the amount of visual change caused by the ambient light contribution. The dominant adjustment direction of the imaging parameters is determined based on the relationship between the visual changes caused by the subject's motion and the visual changes caused by the ambient light. The primary and secondary adjustment relationships of each imaging parameter are determined based on the visual influence coupling relationship, so as to jointly adjust each imaging parameter.

8. The intelligent control method for program shooting parameters based on multi-source perception according to claim 7, characterized in that, When the visual change caused by the main motion is greater than the visual change caused by the ambient light, the exposure time parameter, image sharpening parameter, texture enhancement parameter, and noise suppression parameter are determined as the dominant adjustment parameters. When the visual change caused by the ambient light contribution is greater than or equal to the visual change caused by the subject motion contribution, the exposure response parameter, white balance parameter, local dynamic range compression parameter, and area tone mapping parameter are determined as the dominant adjustment parameters.

9. The intelligent control method for program shooting parameters based on multi-source perception according to claim 8, characterized in that, Based on the aforementioned visual influence coupling relationship, the moderating effect of each imaging parameter on the visual changes caused by the subject's motion and the visual changes caused by the ambient light is determined, and the primary and secondary relationship of the imaging parameters' moderating effect is determined based on the magnitude of the corresponding moderating effects of each imaging parameter. Based on the degree of visual disturbance represented by the comprehensive visual disturbance index and the primary and secondary relationship of adjustment, the adjustment method of each imaging parameter is determined.

10. The intelligent control method for program shooting parameters based on multi-source perception according to claim 9, characterized in that, The subject's visual features after parameter adjustment are reacquired, the corresponding visual index is re-determined based on the subject's visual features after parameter adjustment, and the subject's visual state after parameter adjustment is determined based on the re-determined visual index. When the subject's visual state does not meet the requirements, the subject's visual features before and after parameter adjustment are compared to identify the unrecovered subject visual features and the imaging parameter adjustment method corresponding to the unrecovered subject visual features is corrected.

Citation Information

Patent Citations

  • Shooting parameter adjusting method and device and electronic equipment

    CN121151672A