Methods, apparatus, equipment, and storage media for determining meeting quality
By calculating the differences and impact of audio and video metrics, the quality of meetings is automatically evaluated, solving the problem of low accuracy in existing technologies and improving the user experience.
Patent Information
- Application Number
- CN202210445673.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-26
- Publication Date
- 2025-11-14
- Estimated Expiration
- 2042-04-26
AI Technical Summary
Existing technologies have low accuracy in assessing the quality of online meetings, resulting in a poor user experience.
By acquiring audio and video metrics data and meeting duration of the target meeting, calculating the first metric coefficient, the second metric coefficient, and the first weight, the meeting quality level is automatically assessed. Combining the degree of difference and impact of audio and video metrics, the meeting quality is automatically evaluated.
It improved the accuracy of meeting quality assessment, reduced the impact of human factors, and enhanced the user experience.
Smart Images

Figure CN114757555B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of computer technology, and specifically relates to a method, apparatus, device and storage medium for determining meeting quality. Background Technology
[0002] With the development of technology, online meetings have become the choice of more and more users. In practical applications, the quality of online meetings directly affects the user's experience of the meeting. Therefore, evaluating the meeting quality to improve the user's participation experience is of great significance.
[0003] The current method for evaluating meeting quality suffers from low accuracy. Summary of the Invention
[0004] The purpose of this application is to provide a method, apparatus, device, and storage medium for determining meeting quality, which can solve the problem of low accuracy in current meeting quality assessment schemes.
[0005] In a first aspect, embodiments of this application provide a method for determining meeting quality, including:
[0006] Obtain audio and video metrics and meeting duration for the target meeting;
[0007] Based on the audio and video indicator data, determine the first indicator coefficient and the second indicator coefficient corresponding to the first audio and video indicator, as well as the first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator among the audio and video indicators.
[0008] The meeting quality level of the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0009] Secondly, embodiments of this application provide a device for determining meeting quality, comprising: an acquisition module and a determination module;
[0010] The acquisition module is used to acquire audio and video metrics data and meeting duration for the target meeting;
[0011] The determination module is used to determine, based on the audio and video indicator data, the first indicator coefficient and the second indicator coefficient corresponding to the first audio and video indicator, as well as the first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator among the audio and video indicators.
[0012] The determination module is also used to determine the meeting quality level of the target meeting based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0013] In a second aspect, embodiments of this application provide an electronic device, including: a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein when the program or instructions are executed by the processor, they implement the steps of the method for determining meeting quality as described in the first aspect.
[0014] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the meeting quality determination method as described in the first aspect.
[0015] Fifthly, embodiments of this application provide a computer program product in which instructions, when executed by a processor of an electronic device, cause the electronic device to perform the steps of the meeting quality determination method as described in the first aspect.
[0016] In a sixth aspect, embodiments of this application provide a chip including a processor and a communication interface, the communication interface and the processor being coupled together, the processor being used to run programs or instructions to implement the steps of the meeting quality determination method as described in the first aspect.
[0017] In determining the meeting quality of a target meeting, this embodiment determines the first and second index coefficients of the first audio and video indicators associated with the target meeting, as well as the first weight corresponding to the target meeting, based on the actual audio and video indicator data generated at the target meeting. Then, the quality of the target meeting is determined based on the determined first index coefficient, second index coefficient, and first weight. This achieves automated evaluation of meeting quality. Compared to traditional methods that rely on manual determination of meeting quality, this embodiment eliminates the need for manual determination, thus reducing the impact of human factors on the meeting quality results and improving the accuracy of the results. Attached Figure Description
[0018] Figure 1A flowchart illustrating a method for determining meeting quality as provided in an embodiment of this application;
[0019] Figure 2 A schematic diagram of a device for determining meeting quality provided in an embodiment of this application;
[0020] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0021] Figure 4 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0022] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0023] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0024] When evaluating the quality of a meeting, the relevant technologies mainly rely on manual scoring, which is inefficient and inaccurate.
[0025] Therefore, embodiments of this application provide a method, apparatus, device, and storage medium for determining meeting quality, which can more accurately evaluate meeting quality. The following, in conjunction with the accompanying drawings, provides a detailed description of the method, apparatus, device, and storage medium for determining meeting quality provided by embodiments of this application through specific examples.
[0026] Figure 1 The flowchart illustrates a method for determining meeting quality as provided in this application embodiment. This method can be applied to a first electronic device, which may be a smart device with data processing capabilities, such as a mobile phone, laptop, or tablet computer.
[0027] like Figure 1 As shown, the method for determining the quality of this meeting may include the following steps:
[0028] S110. Obtain the audio and video metrics data and meeting duration of the target meeting.
[0029] The target meeting can be the one whose meeting quality needs to be calculated.
[0030] Audio and video metrics can be metrics associated with the target meeting, that is, metrics that can be used to calculate the meeting quality of the target meeting. For example, audio and video metrics can include, but are not limited to, audio, video, uplink data, downlink data, etc.
[0031] Audio and video metrics data refers to the data related to audio and video metrics generated by the first electronic device during the target meeting. For example, audio and video metrics data may include, but are not limited to, audio uplink bitrate, audio downlink bitrate, audio uplink frame rate, audio downlink frame rate, video uplink bitrate, video downlink bitrate, video uplink frame rate, video downlink frame rate, packet loss rate, audio stuttering rate, video stuttering rate, audio-visual asynchrony, etc.
[0032] The meeting duration is the total duration of the target meeting. For example, the start and end times of the target meeting can be recorded separately, and then the meeting duration can be determined based on the start and end times.
[0033] S120. Based on the audio and video indicator data, determine the first indicator coefficient and the second indicator coefficient corresponding to the first audio and video indicator, as well as the first weight corresponding to the target meeting.
[0034] The first index coefficient is used to characterize the degree of difference between the audio and video index data and the target audio and video data that meets the first preset condition. The second index coefficient is used to characterize the influence of the second audio and video index on the first audio and video index. The first audio and video index is one or more of the audio and video indexes associated with the target meeting. The second audio and video index is an index other than the first audio and video index.
[0035] The first audio / video indicator can be one or more of the audio / video indicators determined above, and the second audio / video indicator can be an indicator other than the first audio / video indicator determined above.
[0036] Considering that different indicators may influence each other, in order to improve the accuracy of meeting results, the aforementioned audio and video indicators can be grouped, for example, by dimensions such as picture quality, sound, and smoothness. In this embodiment, the first audio and video indicator and the second audio and video indicator are located in different groups.
[0037] The first index coefficient can be used to characterize the degree of difference between the audio / video index data and the target audio / video data that meets the first preset condition. In this embodiment, when the audio / video index data meets the first preset condition, it indicates that the audio / video quality of the target meeting is good. The first preset condition can be set according to actual needs. For example, for audio bitrate, when the audio bitrate is greater than or equal to the preset audio bitrate, it indicates that the audio / video quality of the target meeting is good. Under the condition that other factors remain unchanged, the higher the audio bitrate, the better the corresponding audio / video quality. For example, the preset audio bitrate can be used as the target audio / video index data.
[0038] In practical applications, the greater the difference between the acquired audio and video metric data and the target audio and video data, the worse the audio and video quality, and the worse the user experience. The first metric coefficient is related to the duration and frequency of poor user experiences. For example, within the same duration, the more frequently poor user experiences occur, the larger the first metric coefficient will be.
[0039] The second index coefficient is used to characterize the influence of the second audio / video index on the first audio / video index. When there are multiple second audio / video indices, it can characterize the combined influence of multiple audio / video indices on the first audio / video index. In determining the meeting quality of the target meeting, this application embodiment considers not only the influence of a single audio / video index but also the influence of other audio / video indices within the same group on that single audio / video index, thus enabling a more accurate determination of the meeting quality of the target meeting.
[0040] The first weight can reflect the overall quality of the target meeting. The larger the value of the first weight, the worse the meeting quality to a certain extent.
[0041] In some embodiments, the first weight can be determined in the following manner:
[0042] The target meeting is segmented to obtain at least one audio / video segment and a first duration corresponding to the audio / video segment;
[0043] For each audio and video segment, determine the first transmission signal corresponding to the audio and video index data in the time domain, the second transmission signal corresponding to the audio and video index data in the frequency domain, and the first frequency at which the audio and video index data does not meet the second preset condition within the first duration.
[0044] Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each audio and video frequency band, determine the first weight corresponding to the target conference.
[0045] This application does not limit the number of audio and video segments, and the size of each audio and video segment can be the same or different. For example, the entire audio and video can be segmented to obtain at least one audio and video segment, and a duration corresponding to each audio and video segment. In this application embodiment, the duration corresponding to the audio and video segment is referred to as the first duration.
[0046] For example, the meeting duration can also be segmented to obtain at least one time interval and audio / video segments corresponding to each time interval. The lengths of the time intervals can be the same or different.
[0047] The first transmission signal is the signal corresponding to the audio and video data in the time domain, and the second transmission signal is the signal corresponding to the audio and video data in the frequency domain. The embodiments of this application determine the first weight from both the time domain and the frequency domain, which can improve the accuracy of the meeting quality determination results.
[0048] The second preset condition can be preset audio and video indicator data. For example, when the audio and video indicator data is the audio uplink frame rate, the second preset condition can be the preset audio uplink frame rate; or when the audio and video indicator data is the video downlink bitrate, the second preset condition can be the preset video downlink bitrate.
[0049] The audio and video metrics here do not meet the second preset condition if the audio and video metrics are less than the preset audio and video metrics. When the audio and video metrics are less than the preset audio and video metrics, it can indicate to some extent that the meeting quality is poor and the user experience is also poor.
[0050] Specifically, for each audio and video segment, the number of times the audio and video metric data is less than the preset audio and video metric data within that duration can be determined, which is also the number of times the user experience is poor. Thus, the first frequency can be obtained based on the ratio of the number of times to the duration.
[0051] For example, based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each audio and video frequency band, a first weight corresponding to the target conference is determined, satisfying the following form:
[0052]
[0053] Where C(t,w) is the first weight, t is the time, w is the frequency of the audio / video signal, f(t) is the first transmission signal, g(t) is the second transmission signal, N is the number of audio / video segments, and T is the first duration (time interval). This embodiment of the application takes the case where each audio / video segment has the same duration as an example. T =αc T α is a user-defined coefficient, ranging from 0 to 1, and c T The first frequency in which the audio and video index data does not meet the second preset condition within the first duration T.
[0054] Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each audio and video segment, and combined with the above formula, the first weight can be obtained, providing a basis for subsequently determining the meeting quality.
[0055] Taking the second audio / video indicator as including at least one third audio / video indicator as an example, in some embodiments, the second indicator coefficient corresponding to the first audio / video indicator is determined based on the audio / video indicator data, including:
[0056] Based on the audio and video indicator data, determine the coefficient of the third indicator corresponding to the third audio and video indicator;
[0057] For each first audio and video indicator, determine the first influence coefficient of the third audio and video indicator on the first audio and video indicator based on the coefficient of the first indicator and the coefficient of the third indicator.
[0058] Based on the first influence coefficient corresponding to each first audio and video indicator, determine the second indicator coefficient corresponding to the first audio and video indicator.
[0059] The process of determining the third index coefficient is similar to that of determining the first index coefficient, and will not be repeated here for the sake of brevity.
[0060] For example, for each first audio / video indicator, a first influence coefficient of the third audio / video indicator on the first audio / video indicator is determined based on the first indicator coefficient and the third indicator coefficient, satisfying the following form:
[0061]
[0062] Where m represents a specific audio / video segment, N is the number of audio / video segments, and beta i and beta j These represent the index coefficients corresponding to individual audio and video metrics within different groups. For example, in the embodiments of this application, beta i Beta can represent the coefficient of the first indicator corresponding to the first audio / video indicator. j This can represent the coefficient of the third indicator corresponding to the third audio / video indicator within other groups. It should be noted that when the number of groups is greater than or equal to 3, assuming the first audio / video indicator is in the first group, then the other groups here are the groups obtained by merging all groups except the first group. (ave((beta)) j (m) represents the mean of the first index coefficients of N audio and video segments.
[0063] The above formula can be used to determine the influence coefficient (i.e., the first influence coefficient) of audio and video indicators in other groups on the first audio and video indicator. Of course, other methods can also be used to determine the influence coefficient of audio and video indicators in other groups on the first audio and video indicator, and this application embodiment does not limit it.
[0064] Based on the first influence coefficient corresponding to each first audio and video indicator, the degree of joint influence of multiple audio and video indicators (i.e., second audio and video indicators) in other groups on the first audio and video indicator can be determined.
[0065] For example, determining the second index coefficient corresponding to each first audio-visual index based on the first influence coefficient corresponding to each first audio-visual index may include the following steps:
[0066] Arrange the first influence coefficients in order to obtain the first matrix. The number of rows in the first matrix corresponds to the number of the first audio and video indicators, and the number of columns in the first matrix corresponds to the number of the third audio and video indicators.
[0067] The determinant of each row of the first matrix is determined as the first determinant corresponding to each first audio and video indicator. The first determinant is used to characterize the degree of joint influence of the third audio and video indicator on the first audio and video indicator.
[0068] Based on the first determinant, determine the coefficient of the second indicator corresponding to the first audio and video indicator.
[0069] For example, for each first audio / video indicator, the influence coefficients of each third audio / video indicator on that first audio / video indicator can be arranged sequentially to obtain a first matrix.
[0070] For example, the first matrix can take the form shown below:
[0071]
[0072] Where n represents the number of audio and video indicators contained in each group, and this embodiment of the application takes the example that each group contains the same number of audio and video indicators. 1 represents the influence coefficient of the first audio and video indicator on itself. For ease of subsequent calculation, the influence coefficient of the first audio and video indicator on itself is introduced here. The number of rows in the first matrix = the number of first audio and video indicators + 1, and the number of columns in the first matrix = the number of third audio and video indicators + 1.
[0073] The degree of joint influence of each third audio and video indicator on the first audio and video indicator can be obtained by the determinant of the above matrix. For example, the determinant of each row of the first matrix (i.e., the first determinant) can be determined and the determinant can be used as the degree of joint influence of each third audio and video indicator on the first audio and video indicator.
[0074] For example, the second index coefficient corresponding to the first audio / video index can be determined based on the first determinant, and can satisfy the following form:
[0075]
[0076]
[0077] Where, r i Let r′ be the determinant corresponding to the first audio / video index i. i For r i The derivative of R i-1 That is, the matrix obtained by removing the last row and the last column from R, for p i After normalization, the coefficient of the second index, fusion_score, corresponding to the first audio / video index i, can be obtained. i .
[0078] S130. Determine the meeting quality level of the target meeting based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0079] Based on the first index coefficient, the second index coefficient, the first weight, and the meeting duration obtained from the above steps, the meeting quality of the target meeting can be determined, and the meeting quality level can be obtained.
[0080] In determining the meeting quality of a target meeting, this embodiment determines the first and second index coefficients of the first audio and video indicators associated with the target meeting, as well as the first weight corresponding to the target meeting, based on the actual audio and video indicator data generated at the target meeting. Then, the quality of the target meeting is determined based on the determined first index coefficient, second index coefficient, and first weight. This achieves automated evaluation of meeting quality. Compared to traditional methods that rely on manual determination of meeting quality, this embodiment eliminates the need for manual determination, thus reducing the impact of human factors on the meeting quality results and improving the accuracy of the results.
[0081] For example, S130 may include the following steps:
[0082] The target score for the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0083] Determine the meeting quality level of the target meeting based on the target score;
[0084] For example, the target score for a target meeting can be determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration, and can satisfy the following form:
[0085]
[0086] Where score is the target score, C is the first weight, ranging from 0 to 1, n1 is the number of audio and video metrics, and beta... i For the first index coefficient corresponding to the first audio / video index i, weight i The second weight of the first audio / video metric i, fusion_socre i The second index coefficient corresponds to the first audio / video index i, and t1 is the meeting duration.
[0087] In some embodiments, the second weight can be determined as follows: i :
[0088] For each audio and video segment, determine the second frequency at which the audio and video index data of the first audio and video index i does not meet the third preset condition, and the audio and video segment is obtained by dividing the target conference;
[0089] Based on the second frequency corresponding to each audio and video segment, the fourth index coefficient of the first audio and video index i is determined. The fourth index coefficient is used to characterize the importance of the first audio and video index i.
[0090] Based on the fourth index coefficient, determine the second weight corresponding to the first audio / video index i. i .
[0091] The third preset condition is similar to the first and second preset conditions. When the audio and video index data of the first audio and video index i does not meet the third preset condition, it can indicate to some extent that the meeting quality is poor and the user experience is poor. The second frequency can be determined based on the duration of the audio and video segment and the number of times the audio and video index data of the first audio and video index i does not meet the third preset condition within that duration.
[0092] For example, the fourth index coefficient satisfies the following form:
[0093]
[0094] Where, d i The fourth index coefficient, where N is the number of audio and video clips, and P... iq This represents the frequency at which the audio / video index data of the first audio / video index i does not meet the third preset condition in the audio / video segment q, which is also the second frequency. i To a certain extent, it can reflect the importance of the first audio / video metric i, such as d. i The larger the value, the more important the first audio / video indicator i is in determining the quality of the meeting.
[0095] According to the fourth index coefficient d iThis allows us to determine the second weight corresponding to the first audio / video metric i. i .
[0096] For example,
[0097] In some embodiments, the score of the target meeting can be obtained by combining the target score obtained above with the following formula:
[0098] Final score = Total score – score
[0099] The Final score is the score for the target meeting. The total score can be set according to actual needs, for example, it can be set to 100.
[0100] The final score determines the meeting quality level of the target meeting.
[0101] Taking a total score of 100 as an example, for instance, when the final score is between 90 and 100, the meeting quality level of the target meeting can be determined as Level 1 (Very Good); when the final score is between 80 and 90, the meeting quality level of the target meeting can be determined as Level 2 (Excellent); when the final score is between 70 and 80, the meeting quality level of the target meeting can be determined as Level 3 (Good); when the final score is between 60 and 70, the meeting quality level of the target meeting can be determined as Level 4 (Average); and when the final score is between 0 and 60, the meeting quality level of the target meeting can be determined as Level 5 (Poor).
[0102] The embodiments of this application can automatically evaluate the meeting quality of a target meeting based on the actual acquired audio and video indicator data, eliminating the need for manual determination, thereby improving the efficiency of meeting quality evaluation and the accuracy of the evaluation results.
[0103] In some embodiments, after S130, the method for determining the quality of the meeting may further include the following steps:
[0104] The meeting quality level of the target meeting is reported to the cloud so that the cloud can determine the quality level of the first electronic device based on the meeting quality level of the target meeting.
[0105] After determining the meeting quality level of a target meeting, the first electronic device in this application embodiment can report the result to the cloud with the user's permission. Based on the meeting quality levels of each target meeting reported by the first electronic device, the cloud can determine the quality level of the first electronic device and generate an operation report. This allows relevant personnel to continuously improve the quality of the first electronic device based on the operation report, thereby better promoting the first electronic device to a wider range of users.
[0106] In some embodiments, after determining the meeting quality level of each meeting, the first electronic device can also statistically analyze the meeting quality results for different time periods. For example, for periods with a high concentration of low-quality meetings, optimization strategies can be proposed to reduce the frequency of low-quality meetings during those periods. Exemplarily, optimization strategies may include, but are not limited to, increasing bandwidth, prioritizing audio quality, reducing video quality, and optimizing video compression and decoding techniques.
[0107] It should be noted that the meeting quality determination method provided in this application embodiment can be executed by a meeting quality determination device or a processing module within that device for executing the meeting quality determination method. This application embodiment uses the execution of the meeting quality determination method by a meeting quality determination device as an example to illustrate the meeting quality determination device provided in this application embodiment. This meeting quality determination device can be applied to a first electronic device.
[0108] Figure 2 This is a schematic diagram of a device for determining meeting quality, provided as an embodiment of this application.
[0109] like Figure 2 As shown, the meeting quality determination device 200 may include: an acquisition module 201 and a determination module 202;
[0110] The acquisition module 201 is used to acquire the audio and video metrics data and meeting duration of the target meeting;
[0111] The determining module 202 is used to determine, based on the audio and video indicator data, the first indicator coefficient and the second indicator coefficient corresponding to the first audio and video indicator, as well as the first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator among the audio and video indicators.
[0112] The determination module 202 is also used to determine the meeting quality level of the target meeting based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0113] In determining the meeting quality of a target meeting, this embodiment determines the first and second index coefficients of the first audio and video indicators associated with the target meeting, as well as the first weight corresponding to the target meeting, based on the actual audio and video indicator data generated at the target meeting. Then, the quality of the target meeting is determined based on the determined first index coefficient, second index coefficient, and first weight. This achieves automated evaluation of meeting quality. Compared to traditional methods that rely on manual determination of meeting quality, this embodiment eliminates the need for manual determination, thus reducing the impact of human factors on the meeting quality results and improving the accuracy of the results.
[0114] In some possible implementations of the embodiments of this application, the determining module 202 is specifically used for:
[0115] The target meeting is segmented to obtain at least one audio / video segment and a first duration corresponding to the audio / video segment;
[0116] For each audio and video segment, determine the first transmission signal corresponding to the audio and video index data in the time domain, the second transmission signal corresponding to the audio and video index data in the frequency domain, and the first frequency at which the audio and video index data does not meet the second preset condition within the first duration.
[0117] Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each audio and video frequency band, determine the first weight corresponding to the target conference.
[0118] In some possible implementations of the embodiments of this application, the second audio and video indicator includes at least one third audio and video indicator;
[0119] Module 202 is specifically used for:
[0120] Based on the audio and video indicator data, determine the coefficient of the third indicator corresponding to the third audio and video indicator;
[0121] For each first audio and video indicator, determine the first influence coefficient of the third audio and video indicator on the first audio and video indicator based on the coefficient of the first indicator and the coefficient of the third indicator.
[0122] Based on the first influence coefficient corresponding to each first audio and video indicator, determine the second indicator coefficient corresponding to the first audio and video indicator.
[0123] In some possible implementations of the embodiments of this application, the determining module 202 is specifically used for:
[0124] Arrange the first influence coefficients in order to obtain the first matrix. The number of rows in the first matrix corresponds to the number of the first audio and video indicators, and the number of columns in the first matrix corresponds to the number of the third audio and video indicators.
[0125] The determinant of each row of the first matrix is determined as the first determinant corresponding to each first audio and video indicator. The first determinant is used to characterize the degree of joint influence of the third audio and video indicator on the first audio and video indicator.
[0126] Based on the first determinant, determine the coefficient of the second indicator corresponding to the first audio and video indicator.
[0127] In some possible implementations of the embodiments of this application, the determining module 202 is specifically used for:
[0128] The target score for the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0129] Based on the target score, determine the meeting quality level of the target meeting.
[0130] The device for determining the meeting quality applied to the first electronic device in this application embodiment can be a device, or it can be a component, integrated circuit, or chip in the first electronic device. The first electronic device can be a mobile electronic device or a non-mobile electronic device. For example, a mobile electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc., while a non-mobile electronic device can be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc., and this application embodiment does not specifically limit the scope.
[0131] The first electronic device in this application embodiment can be an electronic device with an operating system. The operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system.
[0132] The meeting quality determination device for a first electronic device provided in this application embodiment can achieve... Figure 1 The various processes in the embodiment of the method for determining the conference quality applied to the first electronic device will not be described again here to avoid repetition.
[0133] like Figure 3As shown, this application embodiment also provides an electronic device 300, including a processor 301, a memory 302, and a program or instructions stored in the memory 302 and executable on the processor 301. When the program or instructions are executed by the processor 301, they implement the various processes of the above-described method embodiment for determining meeting quality and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0134] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.
[0135] In some possible implementations of the embodiments of this application, processor 301 may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.
[0136] In some possible implementations of embodiments of this application, memory 302 may include read-only memory (ROM), random access memory (RAM), disk storage media device, optical storage media device, flash memory device, electrical, optical, or other physical / tangible memory storage device. Therefore, typically, memory 302 includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method for determining meeting quality according to embodiments of this application.
[0137] Figure 4 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.
[0138] The electronic device 400 includes, but is not limited to, components such as: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, and processor 410.
[0139] Those skilled in the art will understand that the electronic device 400 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 410 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 4The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements; these will not be elaborated further here. The input unit 404 is used to: acquire audio and video metrics data and meeting duration of the target meeting;
[0140] The processor 410 is used to: determine, based on the audio and video indicator data, a first indicator coefficient and a second indicator coefficient corresponding to the first audio and video indicator, and a first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the degree of influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator. Based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration, the meeting quality level of the target meeting is determined.
[0141] In determining the meeting quality of a target meeting, this embodiment determines the first and second index coefficients of the first audio and video indicators associated with the target meeting, as well as the first weight corresponding to the target meeting, based on the actual audio and video indicator data generated at the target meeting. Then, the quality of the target meeting is determined based on the determined first index coefficient, second index coefficient, and first weight. This achieves automated evaluation of meeting quality. Compared to traditional methods that rely on manual determination of meeting quality, this embodiment eliminates the need for manual determination, thus reducing the impact of human factors on the meeting quality results and improving the accuracy of the results.
[0142] In some possible implementations of the embodiments of this application, the processor 410 is specifically used for:
[0143] The target meeting is segmented to obtain at least one audio / video segment and a first duration corresponding to the audio / video segment;
[0144] For each audio and video segment, determine the first transmission signal corresponding to the audio and video index data in the time domain, the second transmission signal corresponding to the audio and video index data in the frequency domain, and the first frequency at which the audio and video index data does not meet the second preset condition within the first duration.
[0145] Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each audio and video frequency band, determine the first weight corresponding to the target conference.
[0146] In some possible implementations of the embodiments of this application, the second audio and video indicator includes at least one third audio and video indicator;
[0147] Processor 410 is specifically used for:
[0148] Based on the audio and video indicator data, determine the coefficient of the third indicator corresponding to the third audio and video indicator;
[0149] For each first audio and video indicator, determine the first influence coefficient of the third audio and video indicator on the first audio and video indicator based on the coefficient of the first indicator and the coefficient of the third indicator.
[0150] Based on the first influence coefficient corresponding to each first audio and video indicator, determine the second indicator coefficient corresponding to the first audio and video indicator.
[0151] In some possible implementations of the embodiments of this application, the processor 410 is specifically used for:
[0152] Arrange the first influence coefficients in order to obtain the first matrix. The number of rows in the first matrix corresponds to the number of the first audio and video indicators, and the number of columns in the first matrix corresponds to the number of the third audio and video indicators.
[0153] The determinant of each row of the first matrix is determined as the first determinant corresponding to each first audio and video indicator. The first determinant is used to characterize the degree of joint influence of the third audio and video indicator on the first audio and video indicator.
[0154] Based on the first determinant, determine the coefficient of the second indicator corresponding to the first audio and video indicator.
[0155] In some possible implementations of the embodiments of this application, the processor 410 is specifically used for:
[0156] The target score for the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration.
[0157] Based on the target score, determine the meeting quality level of the target meeting.
[0158] It should be understood that, in this embodiment, the input unit 404 may include a graphics processing unit (GPU) 4041 and a microphone 4042. The GPU 4041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 406 may include a display panel 4061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 407 includes a touch panel 4071 and other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here. The memory 409 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 410 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understandable that the aforementioned modem processor may not be integrated into the processor 410.
[0159] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described method for determining the conference quality applied to a first electronic device and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0160] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer-readable storage medium, and examples of computer-readable storage media include non-transitory computer-readable storage media such as ROM, RAM, magnetic disks, or optical disks.
[0161] This application also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described method for determining the conference quality of electronic devices, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0162] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0163] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0164] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the related technology, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0165] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A method for determining meeting quality, characterized in that, include: Obtain audio and video metrics and meeting duration for the target meeting; Based on the audio and video indicator data, a first indicator coefficient and a second indicator coefficient corresponding to the first audio and video indicator are determined, as well as a first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator among the audio and video indicators. The meeting quality level of the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration. The second audio / video indicator includes at least one third audio / video indicator; Based on the audio and video indicator data, determine the second indicator coefficient corresponding to the first audio and video indicator, including: Based on the audio and video index data, determine the third index coefficient corresponding to the third audio and video index; For each of the first audio and video indicators, a first influence coefficient of the third audio and video indicator on the first audio and video indicator is determined based on the first indicator coefficient and the third indicator coefficient. The first influence coefficients are arranged in order to obtain a first matrix. The number of rows in the first matrix corresponds to the number of the first audio and video indicators, and the number of columns in the first matrix corresponds to the number of the third audio and video indicators. The determinant of each row of the first matrix is determined as the first determinant corresponding to each of the first audio and video indicators. The first determinant is used to characterize the degree of joint influence of the third audio and video indicator on the first audio and video indicator. Based on the first determinant, determine the second index coefficient corresponding to the first audio and video index; The step of determining the second index coefficient corresponding to the first audio / video index based on the first determinant includes: For the first audio / video index i, calculate Where, r i Let r be the determinant corresponding to the first audio / video index i. i ′ For r i The derivative of R i-1 The matrix obtained by removing the last row and last column from the first matrix; For the p i Normalization is performed to obtain the coefficient of the second index corresponding to the first audio / video index i; Based on the audio and video metrics data, a first weight corresponding to the target meeting is determined, including: The target meeting is segmented to obtain at least one audio / video segment and a first duration corresponding to the audio / video segment; For each audio and video segment, a first transmission signal corresponding to the audio and video index data in the time domain and a second transmission signal corresponding to the audio and video index data in the frequency domain are determined, as well as a first frequency at which the audio and video index data does not meet the second preset condition within the first duration. Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each of the audio and video segments, a first weight corresponding to the target conference is determined.
2. The method according to claim 1, characterized in that, The step of determining the meeting quality level of the target meeting based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration includes: The target score of the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration. The meeting quality level of the target meeting is determined based on the target score.
3. A device for determining meeting quality, characterized in that, include: Get the module and determine the module; The acquisition module is used to acquire audio and video metrics data and meeting duration of the target meeting; The determining module is used to determine, based on the audio and video indicator data, a first indicator coefficient and a second indicator coefficient corresponding to the first audio and video indicator, and a first weight corresponding to the target meeting. The first indicator coefficient is used to characterize the degree of difference between the audio and video indicator data and the target audio and video data that meets the first preset condition. The second indicator coefficient is used to characterize the influence of the second audio and video indicator on the first audio and video indicator. The first audio and video indicator is one or more indicators among the audio and video indicators associated with the target meeting, and the second audio and video indicator is an indicator other than the first audio and video indicator among the audio and video indicators. The determining module is further configured to determine the meeting quality level of the target meeting based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration; The second audio / video indicator includes at least one third audio / video indicator; The determining module is specifically used for: Based on the audio and video index data, determine the third index coefficient corresponding to the third audio and video index; For each of the first audio and video indicators, a first influence coefficient of the third audio and video indicator on the first audio and video indicator is determined based on the first indicator coefficient and the third indicator coefficient. The first influence coefficients are arranged in order to obtain a first matrix. The number of rows in the first matrix corresponds to the number of the first audio and video indicators, and the number of columns in the first matrix corresponds to the number of the third audio and video indicators. The determinant of each row of the first matrix is determined as the first determinant corresponding to each of the first audio and video indicators. The first determinant is used to characterize the degree of joint influence of the third audio and video indicator on the first audio and video indicator. Based on the first determinant, determine the second index coefficient corresponding to the first audio and video index; The determining module is specifically used for: For the first audio / video index i, calculate Where, r i Let r be the determinant corresponding to the first audio / video index i. i ′ For r i The derivative of R i-1 The matrix obtained by removing the last row and last column from the first matrix; For the p i Normalization is performed to obtain the coefficient of the second index corresponding to the first audio / video index i; The target meeting is segmented to obtain at least one audio / video segment and a first duration corresponding to the audio / video segment; For each audio and video segment, a first transmission signal corresponding to the audio and video index data in the time domain and a second transmission signal corresponding to the audio and video index data in the frequency domain are determined, as well as a first frequency at which the audio and video index data does not meet the second preset condition within the first duration. Based on the first transmission signal, the second transmission signal, and the first frequency corresponding to each of the audio and video segments, a first weight corresponding to the target conference is determined.
4. The apparatus according to claim 3, characterized in that, The determining module is specifically used for: The target score of the target meeting is determined based on the first indicator coefficient, the second indicator coefficient, the first weight, and the meeting duration. The meeting quality level of the target meeting is determined based on the target score.
5. An electronic device, characterized in that, include: A processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method for determining meeting quality as described in any one of claims 1 to 2.
6. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, the steps of the method for determining meeting quality as described in any one of claims 1-2 are implemented.
7. A computer program product, characterized in that, When the instructions in the computer program product are executed by the processor of the electronic device, the electronic device causes the electronic device to perform the steps of the method for determining meeting quality as described in any one of claims 1-2.
Citation Information
Patent Citations
Video quality evaluating method and device
CN107277499A