A method and system for multi-scene adaptive adjustment of a video conference terminal

Abstract

This invention relates to the field of video conferencing and multimedia information processing technology, and provides a multi-scenario adaptive adjustment method and system for video conferencing terminals. The method includes: acquiring and recording parameter modification operation information related to parameter configuration windows in each perspective video window, wherein the parameter modification operation information includes the time sequence of parameter modifications and the changes in parameter values. It enables joint analysis and adaptive adjustment of multi-perspective video windows, realizing a shift in the playback interface from "passive restoration" to "active focusing." When a user replays content from a second time point at a first time point, it comprehensively considers parameter value changes and experimental result changes to generate video window focus values ​​reflecting the relative attention levels of each target perspective video window, and dynamically adjusts the display size, display level, and audio output weight of each perspective video window accordingly, thereby highlighting perspective content highly correlated with changes in experimental results.

Description

Technical Field

[0001] This invention belongs to the field of video conferencing and multimedia information processing technology, and particularly relates to a multi-scenario adaptive adjustment method and system for video conferencing terminals. Background Technology

[0002] With the popularization of remote collaboration and distributed R&D models, video conferencing has been widely used in experimental communication scenarios such as algorithm development, model training, system debugging, and experiment review. In this type of video conferencing, the video conferencing terminal typically displays parameter configuration windows, experimental result windows, and related operation screens simultaneously in the form of multi-view video windows. Participants can frequently adjust experimental parameters during the meeting and observe changes in experimental results in real time. Existing video conferencing systems generally support the recording and playback of the meeting process. During the playback stage, the content of each video window can be restored according to the actual time sequence of the meeting, thus providing users with the ability to view the historical meeting process.

[0003] However, existing multi-view video conferencing playback methods typically only reproduce the footage based on a timeline. When a user jumps from the current point in time to a previous point in time during playback, each viewpoint video window is still presented according to its original display state at that historical point in time, failing to provide targeted display optimization based on the user's current meeting context and parameter adjustments made during the experiment. In experimental communication video conferences, because there is often a strong causal relationship between parameter configuration and experimental results, users focus more on key viewpoint windows that affect the experimental results during playback. However, existing technologies cannot identify which viewpoint video windows are more valuable in terms of result changes, easily leading users to frequently switch perspectives in a multi-window interface, increasing the burden of understanding and reducing playback efficiency.

[0004] Therefore, there is an urgent need for a technical solution that can comprehensively analyze and adaptively adjust the video windows of each perspective during multi-view video conference playback by combining parameter modification operation information and experimental result changes, in order to solve the problems that existing playback methods cannot highlight key experimental perspectives and cannot reflect the correlation between parameter changes and result changes. Summary of the Invention

[0005] The purpose of this invention is to provide a multi-scenario adaptive adjustment method and system for video conferencing terminals, aiming to solve the problems mentioned in the background art.

[0006] This invention is implemented as follows: a multi-scenario adaptive adjustment method for a video conferencing terminal, the method comprising:

[0007] During the video conference, acquire and record parameter modification operation information related to the parameter configuration window in each video window from different perspectives. The parameter modification operation information includes the time sequence of parameter modifications and the changes in parameter values.

[0008] When it is detected that the user triggers a playback operation for the second time point at the first time point, the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point are obtained.

[0009] Based on the current video content and historical video content, determine the degree of difference in result changes between the result windows in each viewpoint video window and the second time point. Based on the degree of difference in result changes, determine the target viewpoint video window set from each viewpoint video window.

[0010] Based on the parameter modification operation information that occurred between the second time point and the first time point, the change characteristics of the parameter values ​​in the target view video window are determined.

[0011] Based on the aforementioned change characteristics, video window focus values ​​corresponding to the target viewpoint video window are generated, which are used to adaptively adjust the display state of the target viewpoint video window during playback at the second time point.

[0012] As a further limitation of the technical solution of the present invention, the change of parameter value is used to characterize the change behavior of parameter between different time points, and includes the magnitude of parameter value change, the direction of parameter value change, the frequency of parameter value change, and the duration of parameter value change.

[0013] As a further limitation of the technical solution of this embodiment of the invention, the result window includes a chart window, an indicator window and a log window for displaying experimental results.

[0014] As a further limitation of the technical solution of this embodiment of the invention, based on the current video content and historical video content, the step of determining the result change difference degree of the result window in each viewpoint video window between the first time point and the second time point, and determining the target viewpoint video window set from each viewpoint video window according to the result change difference degree, includes:

[0015] Based on the current video content and the historical video content, the result feature information corresponding to the first time point and the second time point of the result window is extracted respectively. The result feature information includes the numerical features, trend features and statistical features displayed in the result window.

[0016] The result feature information at the first time point is compared with the result feature information at the second time point to determine the degree of difference in result change between the first time point and the second time point;

[0017] Based on the degree of difference in the results, the target viewpoint video window set is obtained by filtering from the video windows of each viewpoint.

[0018] As a further limitation of the technical solution of this embodiment of the invention, the step of determining the change characteristics of parameter values ​​in the target viewpoint video window based on parameter modification operation information occurring between the second time point and the first time point includes:

[0019] Acquire target view parameter modification operation information that occurred between the second time point and the first time point for the parameter configuration window corresponding to the target view video window;

[0020] Based on the target viewpoint parameter modification operation information, determine the change of target parameter values ​​between the second time point and the first time point for the parameters corresponding to the target viewpoint video window;

[0021] Based on the changes in the target parameter values, parameter change features are extracted to characterize the degree and behavior of parameter value changes.

[0022] As a further limitation of the technical solution of this embodiment of the invention, the step of generating video window focus values ​​corresponding to the target viewpoint video window respectively, based on the change characteristics, for adaptively adjusting the display state of the target viewpoint video window during the playback at the second time point, includes:

[0023] Based on the aforementioned change characteristics, the degree of change of the target view video window is compared and quantified to determine the window weight value corresponding to each target view video window.

[0024] Based on the window weight value, the window weight value is normalized to generate a video window focus value corresponding to each target viewpoint video window respectively;

[0025] Based on the focus value of the video window, the display parameters corresponding to the target view video window are determined. The display parameters include the display size, display position, display level, display transparency, display brightness, and audio output weight corresponding to the target view video window.

[0026] Based on the display parameters, the display state of the target view video window is adaptively adjusted during playback at the second time point.

[0027] A multi-scenario adaptive adjustment system for video conferencing terminals, the system comprising:

[0028] The parameter modification information acquisition module is used to acquire and record parameter modification operation information related to the parameter configuration window in each perspective video window during the video conference. The parameter modification operation information includes the time sequence of parameter modification and the changes in parameter values.

[0029] The video content acquisition module is used to acquire the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point when it is detected that the user triggers a playback operation for the second time point at the first time point.

[0030] The result change analysis module is used to determine the result change difference degree between the result windows of each viewpoint video window and the first time point and the second time point based on the current video content and historical video content, and to determine the target viewpoint video window set from each viewpoint video window according to the result change difference degree.

[0031] The parameter change feature extraction module is used to determine the change features of parameter values ​​in the target view video window based on parameter modification operation information that occurred between the second time point and the first time point.

[0032] The focus value generation and display adjustment module is used to generate video window focus values ​​corresponding to the target view video window respectively according to the change characteristics, and to adaptively adjust the display state of the target view video window during the playback at the second time point.

[0033] As a further limitation of the technical solution of this embodiment of the invention, the result change analysis module specifically includes:

[0034] The result feature extraction unit is used to extract result feature information corresponding to the result window at the first time point and the second time point based on the current video content and the historical video content, respectively. The result feature information includes numerical features, trend features and statistical features displayed in the result window.

[0035] The result feature comparison unit is used to compare the result feature information at the first time point with the result feature information at the second time point to determine the degree of difference in result change between the first time point and the second time point.

[0036] The target window filtering unit is used to filter the target view video window set from the video windows of each view based on the result change difference.

[0037] As a further limitation of the technical solution of this embodiment of the invention, the parameter change feature extraction module specifically includes:

[0038] The target view parameter modification information acquisition unit is used to acquire target view parameter modification operation information that occurred between the second time point and the first time point for the parameter configuration window corresponding to the target view video window.

[0039] The target parameter value change determination unit is used to determine the target parameter value change of the parameter corresponding to the target view video window between the second time point and the first time point based on the target view parameter modification operation information;

[0040] The parameter change feature extraction unit is used to extract parameter change features that characterize the degree and behavior of parameter value changes based on the changes in the target parameter values.

[0041] As a further limitation of the technical solution of this embodiment of the invention, the focus value generation and display adjustment module specifically includes:

[0042] The window weight value determination unit is used to compare and quantify the degree of change of the target view video window based on the change characteristics, and determine the window weight value corresponding to each target view video window.

[0043] The focus value generation unit is used to normalize the window weight value according to the window weight value and generate video window focus values ​​corresponding to each target view video window respectively.

[0044] The display parameter determination unit is used to determine the display parameters corresponding to the target view video window based on the focus value of the video window. The display parameters include the display size, display position, display level, display transparency, display brightness, and audio output weight corresponding to the target view video window.

[0045] The display state adjustment unit is used to adaptively adjust the display state of the target view video window during playback at the second time point according to the display parameters.

[0046] Compared with existing technologies, this invention proposes a multi-scenario adaptive adjustment method for video conferencing terminals, specifically designed for multi-view video conferencing playback scenarios involving experimental communication. By introducing parameter modification operation information, result change differences, and parameter change characteristics during playback triggering, it performs joint analysis and adaptive adjustment of multi-view video windows, achieving a shift from "passive restoration" to "active focusing" in the playback interface. Compared to existing technologies that simply reproduce meeting footage at historical time points, this invention, when a user replays content from a first time point to a second time point, comprehensively considers parameter value changes and experimental result changes to generate a video window focus value reflecting the relative attention level of each target viewpoint video window. Based on this value, it dynamically adjusts the display size, display layer, and audio output weight of each viewpoint video window, thereby highlighting viewpoint content highly relevant to changes in experimental results. This technical solution effectively reduces the operational burden of frequent viewpoint switching during multi-window playback, improves the efficiency of experimental process review and problem localization, and is particularly suitable for remote collaboration scenarios highly sensitive to parameter adjustments and result changes, such as algorithm development, model training, and system debugging. It has good practical value and broad application prospects. Attached Figure Description

[0047] Figure 1 A flowchart of the method provided in the embodiments of the present invention;

[0048] Figure 2 This is a flowchart illustrating the process of selecting a set of target viewpoint video windows in the method provided in this embodiment of the invention;

[0049] Figure 3 A flowchart illustrating the method for extracting parameter change features provided in this embodiment of the invention;

[0050] Figure 4 This is a flowchart illustrating the adaptive adjustment of the display state of the target view video window in the method provided in this embodiment of the invention.

[0051] Figure 5 Application architecture diagram of the system provided in the embodiments of the present invention;

[0052] Figure 6 This is a structural block diagram of the result change analysis module in the system provided in the embodiments of the present invention;

[0053] Figure 7 This is a structural block diagram of the parameter change feature extraction module in the system provided in the embodiments of the present invention;

[0054] Figure 8 This is a structural block diagram of the focus value generation and display adjustment module in the system provided in the embodiment of the present invention. Detailed Implementation

[0055] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0056] Figure 1 A flowchart of the method provided by an embodiment of the present invention is shown.

[0057] Specifically, a multi-scenario adaptive adjustment method for a video conferencing terminal includes the following steps:

[0058] Step S100: During the video conference, acquire and record parameter modification operation information related to the parameter configuration window in each viewpoint video window. The parameter modification operation information includes the time sequence of parameter modifications and the changes in parameter values.

[0059] The changes in parameter values ​​are used to characterize the parameter's behavior at different points in time, and include the magnitude of the parameter value change, the direction of the parameter value change, the frequency of the parameter value change, and the duration of the parameter value change.

[0060] The results window includes a chart window, an indicator window, and a log window for displaying experimental results.

[0061] In this embodiment of the invention, the application addresses a video conferencing system used for experimental communication scenarios. Such video conferencing is typically applied during algorithm development, model training, system debugging, or experimental result review. Participants collaborate remotely via video conferencing terminals, and during the meeting, they need to simultaneously monitor the configuration process of experimental parameters and the dynamic changes in experimental results as parameters change. Compared to ordinary video conferencing primarily consisting of personnel videos or presentations, this type of video conferencing is characterized by long experimental processes, frequent parameter adjustments, continuous changes in results, and a certain degree of causal correlation. As the meeting progresses, participants often need to review the experimental status at a specific historical point in time and compare it with the current experimental progress. Therefore, if the playback process simply restores the original footage, it can easily lead to the dispersion of key information and frequent shifts in attention. This application introduces a comprehensive analysis of parameter modification operation information and result changes during playback, enabling adaptive adjustment of multi-view video windows. This helps to highlight video windows with perspectives highly correlated with changes in experimental results, improving playback and comprehension efficiency, demonstrating significant necessity and practical effectiveness.

[0062] In this type of video conferencing, the display interface of the video conferencing terminal is typically divided into multiple perspective video windows, each used to display meeting content from different sources or of different types. For example, one or more perspective video windows may be used to display experimental results, while others may be used to display parameter configuration windows, code editing interfaces, log output interfaces, or the operation screens and explanation screens of the participants. In practical applications, the number of each perspective video window can be set according to the screen size and meeting requirements, usually consisting of multiple video windows displayed side by side, such as three to six, so that participants can simultaneously observe the adjustment process of experimental parameters and the changes in experimental results.

[0063] The parameter configuration window is an interface used to display and modify experimental parameters. It typically includes several configurable parameter items, such as model parameters, algorithm hyperparameters, system operating parameters, or experimental control parameters. Participants can add, delete, or modify parameters through this window. Each parameter modification corresponds to a specific operation time and the change in parameter values ​​before and after the modification. This invention acquires and records parameter modification operation information related to the parameter configuration window during video conferencing. This information includes at least the chronological order of parameter modifications and the changes in parameter values, thus comprehensively reflecting the sequence and trajectory of parameter adjustments during the experiment.

[0064] The description of parameter value changes is used to characterize the parameter's behavior at different time points. It does not simply refer to whether the parameter changes, but rather to characterize parameter changes from multiple dimensions. In this embodiment, the parameter value changes include the magnitude of the change, the direction of the change, the frequency of the change, and the duration of the change. Specifically, the magnitude of the change indicates the size of the parameter value change during a single or multiple parameter modifications; the direction of the change indicates whether the parameter value increases or decreases; the frequency of the change indicates the number of times the parameter is modified within a predetermined time interval; and the duration of the change indicates the length of time the parameter remains unchanged or changes continuously within a certain value range. Describing parameter value changes through these multiple dimensions more accurately reflects the intensity and rhythm of parameter adjustments during the experiment.

[0065] The results window is used to display experimental results and may include chart windows, indicator windows, and log windows. Chart windows typically display the trend information of experimental results over time or with parameters in the form of line charts, bar charts, or curves; indicator windows typically display the current values ​​or statistical results of key performance indicators during the experiment in numerical form; and log windows are used to output text log information during the experiment, such as running status, warning messages, or error messages. By setting different types of results windows, participants can observe and analyze the experimental results from multiple perspectives. In subsequent steps, this invention combines the changes in the content displayed in the results windows with parameter modification operation information to achieve adaptive adjustment of the multi-view video windows, thereby providing a more efficient and intelligent playback experience for experimental communication video conferences.

[0066] Furthermore, the multi-scenario adaptive adjustment method for the video conferencing terminal also includes the following steps:

[0067] Step S200: When it is detected that the user triggers a playback operation for the second time point at the first time point, the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point are obtained.

[0068] In this embodiment of the invention, when a user triggers a replay operation for a second time point at a first time point, it refers to the user actively selecting and jumping to another historical time point of the meeting for viewing during the replay phase of a video conference, either during or after the conference. For example, if a video conference is in progress or has ended and entered a replayable state, and the user is currently at the first time point on the conference timeline, such as the 40th minute of the conference, and notices a difference between the current experimental results and the results after a previous parameter adjustment, the user can switch the replay position to the second time point (15 minutes into the conference) by dragging the progress bar, clicking a timeline marker, or selecting a historical time node to review the state of the initial or a key stage of the experiment. This action of jumping from the first time point and requesting playback of the content at the second time point constitutes a replay operation for the second time point.

[0069] After the playback operation is detected, this embodiment of the invention simultaneously acquires the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point. The current video content corresponding to the first time point refers to the video content currently displayed in each viewpoint video window on the video conferencing terminal display interface when the user triggers the playback operation. This content reflects the experimental results, parameter configuration interfaces, log information, or other relevant screens displayed in each viewpoint video window during the current meeting or playback state. The historical video content corresponding to the second time point refers to the video content displayed in each viewpoint video window when the meeting actually reaches the second time point. This content is typically generated from video data recorded and stored in real time during the meeting and is used for restoration during the playback stage.

[0070] By simultaneously acquiring the current video content at a first time point and the historical video content at a second time point, this embodiment of the invention can establish a correspondence between the current meeting state and the historical meeting state when playback is triggered. This provides basic data support for subsequent analysis of the changes in the result window in the video windows from different perspectives at different time points. This not only reflects the original experimental state at historical time points but also allows for more targeted adaptive adjustments to the playback process based on the experimental progress currently of interest to the user, thereby improving the information presentation effect during multi-view video conference playback.

[0071] Furthermore, the multi-scenario adaptive adjustment method for the video conferencing terminal also includes the following steps:

[0072] Step S300: Based on the current video content and historical video content, determine the degree of difference in result changes between the result windows in each viewpoint video window and the second time point. Based on the degree of difference in result changes, determine the target viewpoint video window set from each viewpoint video window.

[0073] Specifically, Figure 2 The flowchart shows a process for filtering out a set of video windows from a target viewpoint.

[0074] Specifically, determining the degree of difference in result changes between the result windows of each viewpoint video window and the second time point based on the current video content and historical video content, and determining the target viewpoint video window set from each viewpoint video window according to the degree of difference in result changes, includes the following steps:

[0075] Step S301: Based on the current video content and the historical video content, extract the result feature information corresponding to the first time point and the second time point of the result window respectively. The result feature information includes the numerical features, trend features and statistical features displayed in the result window.

[0076] Step S302: Compare the result feature information at the first time point with the result feature information at the second time point to determine the degree of difference in result change between the first time point and the second time point;

[0077] Step S303: Based on the degree of difference in the result, the target viewpoint video window set is obtained by filtering from the video windows of each viewpoint.

[0078] In this embodiment of the invention, step S300 is used to analyze the changes of each result window in the multi-view video window between different time points after the user triggers the playback operation for the second time point, combining the current video content of the first time point and the historical video content of the second time point, and thereby determine the set of target view video windows that need to be highlighted during the playback process, so as to provide a basis for subsequent adaptive adjustment.

[0079] In step S301, based on the current video content and the historical video content, result feature information corresponding to the first and second time points of the result window is extracted respectively. The result feature information is used to abstractly describe the experimental results displayed in the result window, and may include numerical features, trend features, and statistical features. For example, in a chart window, numerical features may include the numerical values ​​corresponding to key nodes in the curve; trend features may include the overall upward or downward trend of the curve and changes in its slope; statistical features may include maximum, minimum, or average values, etc. In an indicator window, numerical features may include the specific value of a performance indicator at a corresponding time point; trend features may include the direction of change of the indicator over a period of time; statistical features may include the statistical results of the indicator in multiple experiments. In a log window, statistical features may include changes in the number of log entries and changes in the frequency of specific keywords, etc. Through the above method, the content displayed in different types of result windows is uniformly converted into result feature information that can be used for comparative analysis.

[0080] In step S302, the result feature information at the first time point is compared with the result feature information at the second time point to determine the degree of difference in result change between the first and second time points. Specifically, for the same result window, the result feature information extracted at the first time point and the result feature information extracted at the second time point can be compared item by item or as a whole to reflect the degree of change of the experimental results between different time points. For example, for a chart window, the curve values ​​corresponding to the first and second time points can be compared to determine whether the magnitude and trend of the value change have changed significantly; for an indicator window, the difference in indicator values ​​between the two time points can be compared; for a log window, the changes in the number of log entries or the frequency of key log information between the two time points can be compared. Through the above comparison process, the degree of difference in result change used to characterize the degree of change in results can be obtained.

[0081] The result variation variability is used to quantify the significance of changes in the result window between the first and second time points. Its value reflects the degree to which the experimental results change between the two time points. A larger result variation variability indicates a more significant change in the experimental results displayed in the result window between the first and second time points; a smaller result variation variability indicates relatively stable experimental results. By introducing the result variation variability, the changes in the result window from different perspectives in the video window can be uniformly measured, facilitating subsequent filtering.

[0082] In step S303, the target viewpoint video window set is obtained by filtering from the video windows of each viewpoint based on the degree of difference in result changes. Specifically, the degree of difference in result changes corresponding to each video window of each viewpoint can be compared according to preset filtering rules, and the video windows of viewpoints with greater degree of difference in result changes are selected as part of the target viewpoint video window set. For example, in an experimental communication video conference, the chart window corresponding to one viewpoint video window shows obvious curve fluctuations between the first and second time points, while the indicator window corresponding to another viewpoint video window shows less change. In this case, the viewpoint video window corresponding to the former can be filtered as the target viewpoint video window, while the latter is temporarily excluded from the target viewpoint video window set. Through the above filtering process, the embodiments of the present invention can highlight those viewpoint video windows that are more valuable in terms of experimental result changes in multi-view video windows, providing clear target objects for adaptive adjustment in subsequent playback processes.

[0083] Furthermore, the multi-scenario adaptive adjustment method for the video conferencing terminal also includes the following steps:

[0084] Step S400: Based on the parameter modification operation information that occurred between the second time point and the first time point, determine the change characteristics of the parameter values ​​in the target view video window.

[0085] Specifically, Figure 3 A flowchart for extracting parameter variation characteristics is shown.

[0086] Specifically, determining the change characteristics of parameter values ​​in the target view video window based on parameter modification information occurring between the second time point and the first time point includes the following steps:

[0087] Step S401: Obtain target view parameter modification operation information that occurred between the second time point and the first time point for the parameter configuration window corresponding to the target view video window;

[0088] Step S402: Based on the target viewpoint parameter modification operation information, determine the change of target parameter values ​​between the second time point and the first time point for the parameters corresponding to the target viewpoint video window;

[0089] Step S403: Based on the changes in the target parameter values, extract parameter change features to characterize the degree and behavior of parameter value changes.

[0090] In this embodiment of the invention, step S400 is used to analyze the parameter changes corresponding to the target viewpoint video windows based on the already determined set of target viewpoint video windows, combined with parameter modification behaviors that occur during the meeting. This allows for the extraction of parameter change features that reflect the intensity and behavior of parameter adjustments. This step can characterize the reasons for the changes in results from the "parameter side" of the experimental process, providing a basis for subsequently generating video window focus values ​​based on these change features.

[0091] In step S401, target view parameter modification operation information is obtained for the parameter configuration window corresponding to the target view video window between the second time point and the first time point. The target view parameter modification operation information refers to operation records related to the parameter configuration window corresponding to the target view video window, filtered from the parameter modification operation information recorded throughout the meeting. It includes at least the time sequence of each parameter modification and the values ​​before and after the modification. Through this step, the complete modification trajectory of the parameters corresponding to the target view video window within the time interval can be obtained.

[0092] In step S402, based on the target viewpoint parameter modification operation information, the change in the target parameter value of the parameter corresponding to the target viewpoint video window between the second time point and the first time point is determined. The change in the target parameter value describes the actual change state of the target parameter within the time interval, reflecting the change process of the parameter value over time. For example, in an experimental video conference, the parameter configuration window corresponding to a target viewpoint video window contains a learning rate parameter. This learning rate parameter has a value of 0.01 at the second time point, is adjusted multiple times during the subsequent experiment, and becomes 0.001 at the first time point. The change path of the learning rate parameter within the time interval can be determined based on the target viewpoint parameter modification operation information, including the time point of each modification and the specific values ​​before and after the modification. As another example, if a parameter is not modified within the time interval, its target parameter value change can be reflected as its value remaining unchanged.

[0093] In step S403, based on the changes in the target parameter values, parameter change features are extracted to characterize the degree and behavior of the parameter value changes. These parameter change features are a further abstraction of the target parameter value changes, used to depict the overall characteristics of parameter adjustment from multiple dimensions. In this embodiment, parameter change features can characterize the magnitude, direction, frequency, and duration of parameter value changes. For example, if a parameter is adjusted significantly multiple times within the time interval, its parameter change features can reflect a large magnitude and high frequency of changes; if a parameter is adjusted only once with a small magnitude, its parameter change features can reflect a small magnitude and low frequency of changes. Through this method, parameter change features can comprehensively reflect the adjustment intensity and behavior of the target parameter within the time interval, providing reliable data support for subsequently generating video window focus values ​​based on the change features and performing adaptive adjustment of the display state.

[0094] Furthermore, the multi-scenario adaptive adjustment method for the video conferencing terminal also includes the following steps:

[0095] Step S500: Based on the change characteristics, generate video window focus values ​​corresponding to the target view video window respectively, which are used to adaptively adjust the display state of the target view video window during the playback at the second time point.

[0096] Specifically, Figure 4 A flowchart is shown to adaptively adjust the display state of the target view video window.

[0097] Specifically, the process of generating video window focus values ​​corresponding to the target viewpoint video window based on the aforementioned change characteristics, and using these values ​​to adaptively adjust the display state of the target viewpoint video window during playback at the second time point, includes the following steps:

[0098] Step S501: Based on the change characteristics, compare and quantify the degree of change of the target view video window to determine the window weight value corresponding to each target view video window;

[0099] Step S502: Based on the window weight value, normalize the window weight value to generate video window focus values ​​corresponding to each target viewpoint video window respectively;

[0100] Step S503: Based on the focus value of the video window, determine the display parameters corresponding to the target view video window. The display parameters include the display size, display position, display level, display transparency, display brightness, and audio output weight corresponding to the target view video window.

[0101] Step S504: Based on the display parameters, adaptive adjustment of the display state of the target view video window is performed during playback at the second time point.

[0102] In this embodiment of the invention, step S500 is used to further convert the change features into control quantities that can be directly applied to the playback interface based on the obtained change features, so as to adaptively adjust the display state of the target view video window during the playback process at the second time point, so that the playback interface can highlight the view video window that is highly related to the changes in the experimental process and experimental results.

[0103] In step S501, based on the change characteristics, the degree of change of the target viewpoint video windows is compared and quantified to determine the window weight value corresponding to each target viewpoint video window. Specifically, the change characteristics originate from the analysis of parameter value changes in the preceding steps, and can reflect the intensity and behavior of the change of the parameters corresponding to the target viewpoint video windows between the second time point and the first time point. In this embodiment of the invention, the parameter change characteristics corresponding to different target viewpoint video windows can be obtained separately, and these change characteristics can be compared and quantified to obtain window weight values ​​used to characterize the relative degree of change of each target viewpoint video window. For example, in an experimental video conference, the parameters corresponding to the first target viewpoint video window undergo multiple large-scale adjustments within the time interval, while the parameters corresponding to the second target viewpoint video window only undergo one small-scale adjustment. After comparing and quantifying the change characteristics, a larger window weight value can be assigned to the first target viewpoint video window, and a smaller window weight value can be assigned to the second target viewpoint video window. In this way, the window weight value can reflect the relative importance of different target viewpoint video windows in terms of parameter change.

[0104] In step S502, the window weight values ​​are normalized according to the stated window weight values ​​to generate video window focus values ​​corresponding to each target viewpoint video window. The normalization process maps the window weight values ​​of different target viewpoint video windows to a unified numerical range, facilitating subsequent unified calculation and control of display parameters. For example, in the case of multiple target viewpoint video windows, the window weight values ​​can be normalized according to predetermined rules, converting them into values ​​between 0 and 1, or into a set of values ​​that satisfy a predetermined proportional relationship. After normalization, each target viewpoint video window corresponds to a video window focus value, which characterizes the relative attention level of that target viewpoint video window in the playback interface.

[0105] In step S503, display parameters corresponding to the target viewpoint video window are determined based on the focus value of the video window. These display parameters directly control the presentation of the target viewpoint video window in the playback interface and may include the display size, display position, display layer, display transparency, display brightness, and audio output weight corresponding to the target viewpoint video window. For example, when the focus value of a target viewpoint video window is large, its display parameters can be determined as a larger display size, a more prominent display layer, higher display brightness, or a greater audio output weight; conversely, when the focus value of a target viewpoint video window is small, its display parameters can be determined as a smaller display size, a more prominent display layer, lower display brightness, or a lower audio output weight. In this way, the display parameters can reflect the display priority of different target viewpoint video windows during playback.

[0106] In step S504, the display state of the target viewpoint video window is adaptively adjusted during playback at the second time point according to the display parameters. Specifically, the video conferencing terminal can dynamically adjust the display state of the target viewpoint video window based on the display parameters during playback. For example, when playing back the meeting content at the second time point, the target viewpoint video window with a higher focus value is automatically enlarged and placed in a prominent position on the interface, while the audio output weight corresponding to that window is increased; for the target viewpoint video window with a lower focus value, the display size can be reduced, the display brightness can be decreased, or the audio output weight can be reduced. Through the above adaptive adjustment method, this embodiment of the invention can guide the user's attention to the viewpoint video window most closely related to parameter changes and experimental result changes during the playback of multi-view video conferences, thereby improving the efficiency of information acquisition and understanding during playback.

[0107] Furthermore, Figure 5 An application architecture diagram of the system provided in an embodiment of the present invention is shown.

[0108] In another preferred embodiment of the present invention, a multi-scenario adaptive adjustment system for a video conferencing terminal includes:

[0109] The parameter modification information acquisition module 100 is used to acquire and record parameter modification operation information related to the parameter configuration window in each perspective video window during the video conference. The parameter modification operation information includes the time sequence of parameter modification and the changes in parameter values.

[0110] Furthermore, the video conferencing terminal multi-scenario adaptive adjustment system also includes:

[0111] The video content acquisition module 200 is used to acquire the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point when it is detected that the user triggers a playback operation for the second time point at the first time point.

[0112] Furthermore, the video conferencing terminal multi-scenario adaptive adjustment system also includes:

[0113] The result change analysis module 300 is used to determine the result change difference degree between the result windows of each viewpoint video window and the first time point and the second time point based on the current video content and historical video content, and to determine the target viewpoint video window set from each viewpoint video window according to the result change difference degree.

[0114] Specifically, Figure 6 A structural block diagram of the result change analysis module 300 in the system provided in an embodiment of the present invention is shown.

[0115] Furthermore, the video conferencing terminal multi-scenario adaptive adjustment system also includes:

[0116] The parameter change feature extraction module 400 is used to determine the change features of parameter values ​​in the target view video window based on parameter modification operation information that occurred between the second time point and the first time point.

[0117] Specifically, Figure 7 The diagram shows the structural block diagram of the parameter change feature extraction module 400 in the system provided in the embodiment of the present invention.

[0118] Furthermore, the video conferencing terminal multi-scenario adaptive adjustment system also includes:

[0119] The focus value generation and display adjustment module 500 is used to generate video window focus values ​​corresponding to the target view video window respectively according to the change characteristics, and to adaptively adjust the display state of the target view video window during the playback at the second time point.

[0120] Specifically, Figure 8 The diagram shows a structural block diagram of the focus value generation and display adjustment module 500 in the system provided by an embodiment of the present invention.

[0121] It should be understood that although the steps in the flowcharts of the various embodiments of the present invention are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the various embodiments may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0122] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0123] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0124] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of this patent should be determined by the appended claims.

[0125] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for multi-scenario adaptive adjustment of a video conference terminal, characterized in that, The method includes: During the video conference, acquire and record parameter modification operation information related to the parameter configuration window in each video window from different perspectives. The parameter modification operation information includes the time sequence of parameter modifications and the changes in parameter values. When it is detected that the user triggers a playback operation for the second time point at the first time point, the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point are obtained. Based on the current video content and historical video content, determine the degree of difference in result changes between the result windows in each viewpoint video window and the second time point. Based on the degree of difference in result changes, determine the target viewpoint video window set from each viewpoint video window. Based on the parameter modification operation information that occurred between the second time point and the first time point, the change characteristics of the parameter values ​​in the target view video window are determined. Based on the aforementioned change characteristics, video window focus values ​​corresponding to the target viewpoint video window are generated, which are used to adaptively adjust the display state of the target viewpoint video window during playback at the second time point.

2. The method of claim 1, wherein, The changes in parameter values ​​are used to characterize the parameter's behavior at different points in time, and include the magnitude of the parameter value change, the direction of the parameter value change, the frequency of the parameter value change, and the duration of the parameter value change.

3. The method of claim 1, wherein, The results window includes a chart window, an indicator window, and a log window for displaying experimental results.

4. The method of claim 3, wherein, Based on the current video content and historical video content, the steps of determining the degree of difference in result changes between the result windows in each viewpoint video window and the second time point, and determining the target viewpoint video window set from each viewpoint video window according to the degree of difference in result changes, include: Based on the current video content and the historical video content, the result feature information corresponding to the first time point and the second time point of the result window is extracted respectively. The result feature information includes the numerical features, trend features and statistical features displayed in the result window. The result feature information at the first time point is compared with the result feature information at the second time point to determine the degree of difference in result change between the first time point and the second time point; Based on the degree of difference in the results, the target viewpoint video window set is obtained by filtering from the video windows of each viewpoint.

5. The method of claim 1, wherein, The steps for determining the change characteristics of parameter values ​​in the target view video window based on parameter modification operation information occurring between the second time point and the first time point include: Acquire target view parameter modification operation information that occurred between the second time point and the first time point for the parameter configuration window corresponding to the target view video window; Based on the target viewpoint parameter modification operation information, determine the change of target parameter values ​​between the second time point and the first time point for the parameters corresponding to the target viewpoint video window; Based on the changes in the target parameter values, parameter change features are extracted to characterize the degree and behavior of parameter value changes.

6. The method of claim 1, wherein, The step of generating video window focus values ​​corresponding to the target viewpoint video window based on the aforementioned change characteristics, and using these values ​​to adaptively adjust the display state of the target viewpoint video window during playback at the second time point, includes: Based on the aforementioned change characteristics, the degree of change of the target view video window is compared and quantified to determine the window weight value corresponding to each target view video window. Based on the window weight value, the window weight value is normalized to generate a video window focus value corresponding to each target viewpoint video window respectively; Based on the focus value of the video window, the display parameters corresponding to the target view video window are determined. The display parameters include the display size, display position, display level, display transparency, display brightness, and audio output weight corresponding to the target view video window. Based on the display parameters, the display state of the target view video window is adaptively adjusted during playback at the second time point.

7. A multi-scenario adaptive adjustment system for video conference terminals, characterized in that, The system includes: The parameter modification information acquisition module is used to acquire and record parameter modification operation information related to the parameter configuration window in each perspective video window during the video conference. The parameter modification operation information includes the time sequence of parameter modification and the changes in parameter values. The video content acquisition module is used to acquire the current video content of each viewpoint video window corresponding to the first time point and the historical video content of each viewpoint video window corresponding to the second time point when it is detected that the user triggers a playback operation for the second time point at the first time point. The result change analysis module is used to determine the result change difference degree between the result windows of each perspective video window and the first time point and the second time point based on the current video content and historical video content, and to determine the target perspective video window set from each perspective video window according to the result change difference degree. The parameter change feature extraction module is used to determine the change features of parameter values ​​in the target view video window based on parameter modification operation information that occurred between the second time point and the first time point. The focus value generation and display adjustment module is used to generate video window focus values ​​corresponding to the target view video window based on the change characteristics, and to adaptively adjust the display state of the target view video window during playback at the second time point.

8. The multi-scene adaptive adjustment system of a video conference terminal according to claim 7, characterized in that, The result change analysis module specifically includes: The result feature extraction unit is used to extract result feature information corresponding to the result window at the first time point and the second time point according to the current video content and the historical video content, respectively. The result feature information includes numerical features, trend features and statistical features displayed in the result window. The result feature comparison unit is used to compare the result feature information at the first time point with the result feature information at the second time point to determine the degree of difference in result change between the first time point and the second time point. The target window filtering unit is used to filter the target view video window set from the video windows of each view based on the result change difference.

9. The multi-scene adaptive adjustment system of a video conference terminal according to claim 7, characterized in that, The parameter change feature extraction module specifically includes: The target view parameter modification information acquisition unit is used to acquire target view parameter modification operation information that occurred between the second time point and the first time point for the parameter configuration window corresponding to the target view video window. The target parameter value change determination unit is used to determine the target parameter value change of the parameter corresponding to the target view video window between the second time point and the first time point based on the target view parameter modification operation information; The parameter change feature extraction unit is used to extract parameter change features that characterize the degree and behavior of parameter value changes based on the changes in the target parameter values.

10. The multi-scene adaptive adjustment system of a video conference terminal according to claim 7, wherein, The focus value generation and display adjustment module specifically includes: The window weight value determination unit is used to compare and quantify the degree of change of the target view video window based on the change characteristics, and determine the window weight value corresponding to each target view video window. The focus value generation unit is used to normalize the window weight value according to the window weight value and generate video window focus values ​​corresponding to each target viewpoint video window respectively. The display parameter determination unit is used to determine the display parameters corresponding to the target view video window based on the focus value of the video window. The display parameters include the display size, display position, display level, display transparency, display brightness, and audio output weight corresponding to the target view video window. The display state adjustment unit is used to adaptively adjust the display state of the target view video window during playback at the second time point according to the display parameters.

Images