Live broadcast quality evaluation method and device for live broadcast course system, and storage medium

Abstract

The application discloses a live class system live quality evaluation method, comprising: obtaining user feedback index item information in the live class live process; counting feedback UV of each feedback index item after the live class ends, and calculating the feedback rate of each feedback index item according to the formula feedback rate = feedback UV / number of people attending the class; comparing and analyzing the feedback rate of each feedback index item of all live classes to comprehensively evaluate the current live class system live quality. The live class system live quality evaluation method starts from the user experience level, obtains user feedback index item information in the live class live process, considers the feedback index item from the aspects of the image, sound, interaction and attendance of the live class, thereby performing index feedback on the user experience in the live class watching process, monitors the feedback rate of each feedback index item of the live class, realizes the monitoring of the live class system live quality, and provides a basis for the optimization direction of the live class system.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of cloud computing, in particular to a live class system live quality evaluation method, an evaluation device and a storage medium. BACKGROUND

[0002] As a course training method relying on Internet technology, the live class realizes real-time communication between teachers and students through the Internet, greatly facilitates teachers and students, and the real-time communication of the live class enables students to feedback problems in time and teachers to answer questions in time, thereby ensuring the classroom effect. Therefore, the stability of the live quality of the live class system is directly related to the teaching effect of the live class.

[0003] At present, the evaluation of the live quality of the live class system is mainly from the hardware technology level, such as monitoring and analyzing the network state of the live class system server or the video frame number of the live class, but the live class system involves server end, user end and supplier end and other multi-party resources. Purely monitoring from the server end cannot reflect the user experience.

[0004] Therefore, the present application aims to solve the quality evaluation of the live class system from the user's point of view, which helps the technical maintenance personnel to maintain and upgrade the live class system, and truly improves the user experience from the user's point of view.

[0005] Therefore, the present application aims to solve the quality evaluation of the live class system from the user's point of view, which helps the technical maintenance personnel to maintain and upgrade the live class system, and truly improves the user experience from the user's point of view. SUMMARY

[0006] In order to solve the above technical problems, the present application provides a live class system live quality evaluation method, an evaluation device and a storage medium, which realizes the evaluation of the live quality of the live class system from the user's point of view, and the specific technical solutions are as follows:

[0007] The present application provides a live class system live quality evaluation method, which comprises:

[0008] Obtaining feedback index item information of the user in the live process of the live class;

[0009] Statistically counting the feedback UV of each feedback index item after the live class, and further calculating the feedback rate of each feedback index item according to the feedback UV;

[0010] Summarizing and comparing the feedback rates of each feedback index item, and comprehensively evaluating the live quality of the current live class system.

[0011] As an optional embodiment of the present application, the live class system live quality evaluation method of the present application comprises:

[0012] The feedback index item information comprises feedback image information;

[0013] monitoring the comment interaction area of the live class during the live process, and when a keyword / word or code identifier representing the feedback image information is monitored, obtaining a user ID publishing the keyword / word or code identifier;

[0014] counting the user IDs corresponding to each keyword / word or code identifier representing the feedback image information after the live class ends, performing a de-duplication process to calculate image feedback UV, and calculating an image feedback rate according to the formula image feedback rate=image feedback UV / number of attendees.

[0015] As an optional implementation of the present embodiment, the live class system live quality evaluation method of the present embodiment includes:

[0016] The feedback index item information includes feedback sound information;

[0017] monitoring the comment interaction area of the live class during the live process, and when a keyword / word or code identifier representing the feedback sound information is monitored, obtaining a user ID publishing the keyword / word or code identifier;

[0018] counting the user IDs corresponding to each keyword / word or code identifier representing the feedback image information after the live class ends, performing a de-duplication process to calculate image feedback UV, and calculating an image feedback rate according to the formula image feedback rate=image feedback UV / number of attendees.

[0019] As an optional implementation of the present embodiment, the live class system live quality evaluation method of the present embodiment includes:

[0020] The feedback index item information includes feedback interaction information;

[0021] monitoring the comment interaction area of the live class during the live process, and when a keyword / word or code identifier representing the feedback interaction information is monitored, obtaining a user ID publishing the keyword / word or code identifier;

[0022] counting the user IDs corresponding to each keyword / word or code identifier representing the feedback image information after the live class ends, performing a de-duplication process to calculate image feedback UV, and calculating an image feedback rate according to the formula image feedback rate=image feedback UV / number of attendees.

[0023] As an optional implementation of the present embodiment, the live class system live quality evaluation method of the present embodiment includes:

[0024] The feedback index item information includes feedback attendance information;

[0025] Obtain the user request of the failure of the request for entering the live class classroom, count all the user requests of the failure of the attendance after the live class, and calculate the UV of the failure of the attendance by de-duplication processing. The attendance feedback rate is calculated according to the formula: attendance feedback rate = UV of the failure of the attendance / number of the attendance.

[0026] As an optional implementation of the embodiment, the method for evaluating the live quality of the live class system in the embodiment comprises: presetting an APP point in the APP of the live class system for feeding back the user request of the failure of the attendance, obtaining the user request of the failure of the attendance fed back by the APP point, and calculating the UV of the failure of the attendance by summarizing and de-duplication processing.

[0027] As an optional implementation of the embodiment, the method for evaluating the live quality of the live class system in the embodiment comprises:

[0028] The feedback index item information comprises feedback image information, feedback sound information, feedback interaction information, and feedback attendance information.

[0029] Count the user IDs corresponding to the feedback image information, the feedback sound information, the feedback interaction information, and the feedback attendance information after the live class, and calculate the comprehensive feedback UV by de-duplication processing. The comprehensive feedback rate is calculated according to the formula: comprehensive feedback rate = comprehensive feedback UV / number of the attendance.

[0030] As an optional implementation of the embodiment, the analysis and comparison of the feedback rates of all the feedback index items of all the live classes for comprehensive evaluation of the live quality of the current live class system comprises:

[0031] Top N sorting of the feedback index items of each live class system: the feedback rates of the feedback index items of all the live classes in a set time period are summarized and counted, and the live classes with the top N feedback rates of the feedback index items are sorted and selected;

[0032] And / or average feedback rate calculation of the live class system: the total feedback UV and the total number of the attendance of all the feedback index items of all the live classes in a set time period are summarized and counted, and the average feedback rate is calculated according to the formula: average feedback rate = total feedback UV / total number of the attendance;

[0033] And / or live class system feedback rate median live class counting: the feedback rates of the feedback index items of all the live classes in a set time period are summarized and counted, and the live classes in the middle of the sorting are counted by sorting all the live classes according to each feedback index item as the sorting condition.

[0034] The embodiment simultaneously provides an evaluation device for the live quality of a live class system, comprising:

[0035] A feedback index item obtaining module obtains the feedback index item information of a user in the live process of a single live class.

[0036] a feedback rate statistical calculation module, which calculates the feedback rate of each feedback index item according to the formula feedback rate = feedback UV / number of students attending the class;

[0037] and a live class system live quality evaluation module, which analyzes and compares the feedback rates of all feedback index items of all live classes and comprehensively evaluates the current live class system live quality.

[0038] The embodiment also provides a storage medium storing a computer executable program, and the computer executable program is executed to realize the evaluation method of the live class system live quality.

[0039] Compared with the prior art, the evaluation method of the live class system live quality has the following beneficial effects:

[0040] The evaluation method of the live class system live quality starts from the user experience, acquires the feedback index item information of the user in the live process of the live class, considers the feedback index item from the image, sound, interaction and attendance of the live class, thereby performing index feedback on the experience of the user in the live process of the live class, monitors the feedback rate of each feedback index item of the live class, realizes the monitoring of the live quality of the live class system, and provides a basis for the optimization direction of the live class system. BRIEF DESCRIPTION OF DRAWINGS

[0041] Figure 1 The evaluation method of the live class system live quality Figure 1 ;

[0042] Figure 2 The evaluation method of the live class system live quality Figure 2 ;

[0043] Figure 3 The evaluation method of the live class system live quality Figure 3 ;

[0044] Figure 4 The evaluation method of the live class system live quality Figure 4 ;

[0045] Figure 5 The evaluation method of the live class system live quality Figure 5 ;

[0046] Figure 6 The evaluation method of the live class system live quality Figure 6 ;

[0047] Figure 7The flow of the evaluation method of the live class system live quality of the embodiment of the application Figure 7 . DETAILED DESCRIPTION

[0048] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments of the present application.

[0049] Therefore, the following detailed description of the embodiments of the present application is not intended to limit the scope of the claimed application, but merely represents some embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the scope of protection of the present application.

[0050] It should be noted that the embodiments in the present application and the features and technical solutions in the embodiments can be combined with each other without conflict.

[0051] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0052] In the description of the present application, it should be noted that the orientation or position relationship indicated by the terms "upper", "lower", etc. is based on the orientation or position relationship shown in the drawings, or the orientation or position relationship commonly placed when the product of the present application is used, or the orientation or position relationship commonly understood by those skilled in the art. Such terms are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the indicated device or element must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first", "second", etc. are only used for differentiation and cannot be understood as indicating or implying relative importance.

[0053] Referring to Figure 1 and Figure 2 It is shown that the embodiment provides an evaluation method of live class system live quality, which comprises:

[0054] Obtaining feedback index item information of a user in a live class live process;

[0055] Counting feedback UV of each feedback index item after the live class ends, and calculating the feedback rate of each feedback index item according to the formula feedback rate = feedback UV / number of people attending the class;

[0056] Summarizing and comparing the feedback rates of all feedback index items of all live classes, and comprehensively evaluating the current live class system live quality.

[0057] The UV of the embodiment refers to the number of computers accessing a certain website, and the cookie of the user computer is used as the basis for statistics. The same client is counted only once within a time period (such as 00:00-24:00). The feedback UV refers to the independent visitors of the feedback index item.

[0058] The evaluation method of the live class system live quality of the embodiment starts from the user experience level, obtains the feedback index item information of the user in the live process of the live class, considers the feedback index item from the aspects of the image, sound, interaction and attendance of the live class, thereby giving the feedback of the index of the experience of the user in the process of watching the live class, monitors the live quality of the live class system by monitoring the feedback rate of each feedback index item of the live class, and provides a basis for the optimization direction of the live class system.

[0059] As an optional implementation manner of the embodiment, referring to FIG. 1, Figure 3 In the evaluation method of the live class system live quality of the embodiment,

[0060] The feedback index item information includes feedback image information;

[0061] The comment interaction area of the live class in the live process is monitored, and when the keyword / word or code identifier representing the feedback image information is monitored, the user ID publishing the keyword / word or code identifier is obtained.

[0062] The user IDs corresponding to the keywords / words or code identifiers representing the feedback image information after the live class are counted, and the image feedback UV is calculated by removing the duplicate processing. The image feedback rate is calculated according to the formula image feedback rate=image feedback UV / attendance number.

[0063] The embodiment monitors the comment interaction area in the live process of the live class, actively obtains the keyword / word or code identifier representing the feedback image information in the comment interaction area and the corresponding user ID, and the image feedback rate can be obtained by calculating the proportion of users feeding back the image problem.

[0064] The keywords / words representing the feedback image information of the embodiment include but are not limited to “card”, “stuttering”, “black screen”, “blue screen”, “white screen”, “unclear”, “invisible”, “no image” and the like. When the above keywords / words appear in the comment interaction area, the user ID feeding back the image information is actively obtained.

[0065] The embodiment needs to shield invalid words when monitoring the keywords / words, for example, monitoring the keyword "card", further obtaining the meaning of the keyword "card" in the sentence where the keyword "card" is located, and if the keyword "card" does not represent the meaning of "image card" or "video card", the user ID corresponding to the current keyword "card" is discarded. For example, when the keyword "card" appears in the sentence "card card teacher" or "name card", the user ID corresponding to the keyword "card" is discarded.

[0066] The code identifier representing the feedback image information in the embodiment is a sentence or an expression image representing the feedback image information preset in the chat common language, and when the code identifier corresponding to the sentence or the expression image is monitored in the comment area, the user ID feeding back the image information is actively obtained.

[0067] As an optional implementation of the embodiment, refer to Figure 4 The evaluation method of the live class system live quality in the embodiment includes:

[0068] The feedback index item information includes feedback sound information;

[0069] The comment interaction area of the live class in the live process is monitored, and when the keyword / word or code identifier representing the feedback sound information is monitored, the user ID publishing the keyword / word or code identifier is obtained;

[0070] The user IDs corresponding to the keywords / words or code identifiers representing the feedback image information after the live class are counted, and the sound feedback UV is calculated by removing the repeated processing, and the sound feedback rate is calculated according to the formula sound feedback rate = sound feedback UV / number of students.

[0071] The embodiment monitors the comment interaction area of the live class in the live process, actively obtains the keyword / word or code identifier representing the feedback sound information in the comment interaction area and the corresponding user ID, and the sound feedback rate can be obtained by calculating the user proportion of the feedback sound problem.

[0072] The keywords / words representing the feedback image information in the embodiment include but are not limited to "no sound", "unclear", "inaudible", "noise", "small sound", etc., and when the keywords / words are monitored in the comment interaction area, the user ID feeding back the sound information is actively obtained.

[0073] The code identifier representing the feedback sound information in the embodiment is a sentence or an expression image representing the feedback sound information preset in the chat common language, and when the code identifier corresponding to the sentence or the expression image is monitored in the comment area, the user ID feeding back the sound information is actively obtained.

[0074] As an optional implementation of the embodiment, refer toFigure 5 As shown, in the evaluation method for the live streaming quality of the live class system in this embodiment:

[0075] The feedback indicator items include feedback and interaction information;

[0076] Monitor the comment interaction area during the live class. When a keyword / word or code identifier representing feedback interaction information is detected, obtain the user ID of the user who posted the keyword / word or code identifier.

[0077] After the live class ends, the user IDs corresponding to the keywords / words or code identifiers of each feedback image information are counted, and the uniqueness of the interaction feedback is calculated. The interaction feedback rate is calculated according to the formula: interaction feedback rate = audio feedback UV / number of attendees.

[0078] This embodiment monitors the comment interaction area during the live broadcast of a class, actively acquiring keywords / words or code identifiers representing feedback interaction information in the comment interaction area and their corresponding user IDs. The audio feedback rate can be obtained by calculating the percentage of users who provide feedback interaction questions.

[0079] In this embodiment, the keywords / words representing feedback interaction information include, but are not limited to, "not received", "did not receive", "did not receive the question", and "unable to submit". When the above keywords / words are detected in the comment interaction area, the user ID that provides feedback interaction information is actively obtained.

[0080] In this embodiment, the code identifier representing feedback interaction information is a statement or emoticon image that represents feedback interaction information preset in commonly used chat phrases. When the code identifier corresponding to the statement or emoticon image appears in the comment area, the user ID that provides feedback interaction information is actively obtained.

[0081] As an optional implementation method in this embodiment, see Figure 6 As shown, the method for evaluating the live streaming quality of the live class system in this embodiment includes:

[0082] The feedback indicator items include feedback on class attendance;

[0083] Get user requests that failed to enter the live class classroom, count all user requests that failed to attend the live class after the class ends, perform deduplication to calculate the UV of failed attendees, and calculate the attendance feedback rate according to the formula: attendance feedback rate = attendance failure UV / number of attendees.

[0084] The embodiment can be achieved by setting an "enter classroom" button for a user to click into a live class classroom, or a "check-in" button for the user to enter the live class classroom for check-in. When the user fails to click the "enter classroom" button or the "check-in" button, a user request for class failure occurs to the server side. When the same user fails multiple times, only one statistical processing is performed through deduplication processing, so as to obtain the class failure UV and calculate the class feedback rate. Further, the APP of the live class system is preset with an APP burying point for feedback of the user request for class failure. The user request for class failure is obtained through the APP burying point, and the class failure UV is calculated through summary and deduplication processing.

[0085] As an optional embodiment of the embodiment, referring to FIG. 1, Figure 7 The live class system live quality evaluation method of the embodiment includes:

[0086] The feedback index item information includes feedback image information, feedback sound information, feedback interaction information, and feedback class information.

[0087] The user IDs corresponding to the feedback image information, the feedback sound information, the feedback interaction information, and the feedback class information are summarized and statistically processed after the live class ends, and the comprehensive feedback UV is calculated through deduplication processing. The comprehensive feedback rate is calculated according to the formula comprehensive feedback rate = comprehensive feedback UV / class number.

[0088] The live class system live quality evaluation method of the embodiment is used to comprehensively calculate the comprehensive feedback rate according to the feedback image information, the feedback sound information, the feedback interaction information, and the feedback class information of the live class, so as to evaluate the quality of the live class as a whole.

[0089] The live class system live quality evaluation method of the embodiment can also be used to compare and evaluate each feedback index information, and to evaluate a certain feedback index.

[0090] As an optional embodiment of the embodiment, in the live class system live quality evaluation method of the embodiment, the feedback rates of all feedback index items of all live classes are summarized, analyzed, and compared, and the current live class system live quality is comprehensively evaluated, including:

[0091] The topN ranking of each live class system feedback index item: the feedback rate of each feedback index item of all live classes in the set time period is summarized and counted, and the live classes with the top N feedback rates of each feedback index item are sorted and selected; the topN ranking of the embodiment is to rank the N% live classes with the highest feedback rate of the feedback index item, and the specific topN can be set as top1 / top5 / top10 / top50: the 1% live class / the 5% live class / the 10% live class / the 50% live class with the highest feedback rate is ranked from large to small according to the feedback rate.

[0092] And / or live class system average feedback rate calculation: the total feedback UV and the total number of attendees of each feedback index item of all live classes in the set time period are summarized and counted, and the average feedback rate is calculated according to the formula average feedback rate = total feedback UV / total number of attendees; the calculation of the average feedback rate can evaluate the quality of the live class system as a whole in a certain period of time, and grasp the overall quality of the live class system from a macro perspective.

[0093] And / or live class system feedback rate median live class statistics: the feedback rate of each feedback index item of all live classes in the set time period is summarized and counted, and all live classes are sorted according to each feedback index item as the sorting condition, and the live classes in the middle of the sorting are counted; the feedback rate median live class statistics can be used as an evaluation standard, and the live classes with a feedback rate higher than the middle of the sorting are considered to be low-quality live classes, and the live classes with a feedback rate lower than the middle of the sorting are considered to be high-quality live classes.

[0094] The embodiment simultaneously provides an evaluation device for the live quality of a live class system, which comprises:

[0095] A feedback index item acquisition module acquires feedback index item information of a user during a live process of a single live class;

[0096] A feedback rate statistical calculation module counts the feedback UV of each feedback index item after the live class ends, and calculates the feedback rate of each feedback index item according to the formula feedback rate = feedback UV / number of attendees;

[0097] And a live class system live quality evaluation module analyzes and compares the feedback rates of all feedback index items of all live classes, and comprehensively evaluates the live quality of the current live class system.

[0098] The evaluation device for the live quality of the live class system of the embodiment starts from the user experience, acquires the feedback index item information of the user during the live process of the live class, considers the feedback index item from the image, sound, interaction, and attendance of the live class, and thus feeds back the index of the experience of the user during the live process of the live class, monitors the live quality of the live class system by monitoring the feedback rate of each feedback index item of the live class, and provides a basis for the optimization direction of the live class system.

[0099] As an optional implementation of this embodiment, the feedback indicator acquisition module in the live broadcast quality evaluation device of the live broadcast system in this embodiment includes a feedback image acquisition module:

[0100] The feedback image acquisition module monitors the comment interaction area of ​​the live class during the live broadcast. When it detects keywords / words or code identifiers that represent feedback image information, it obtains the user ID of the user who posted the keywords / words or code identifiers.

[0101] The feedback rate calculation module counts the user IDs corresponding to the keywords / words or code identifiers representing feedback image information after the live class ends, performs deduplication processing to calculate the image feedback UV, and calculates the image feedback rate according to the formula: Image feedback rate = Image feedback UV / Number of attendees.

[0102] In this embodiment, the feedback image acquisition module monitors the comment interaction area during the live class, actively acquiring keywords / words or code identifiers representing feedback image information in the comment interaction area and their corresponding user IDs. The image feedback rate can be obtained by calculating the percentage of users with feedback image issues.

[0103] The keywords / words representing the feedback image information in this embodiment include, but are not limited to, "stuck", "lag", "black screen", "blue screen", "white screen", "cannot see", "cannot see", "no image", etc. When the above keywords / words are detected in the comment interaction area, the user ID of the user who provided the feedback image information is actively obtained.

[0104] In this embodiment, when monitoring keywords / words, invalid words need to be filtered out. For example, if the keyword "card" is detected, the meaning of the keyword "card" in the sentence is further obtained. If the word "card" does not refer to "image card" or "video card," then the user ID corresponding to the word "card" is discarded from the statistics. For example, if phrases such as "Teacher Kaka" or "name is Kaka" appear in the sentence containing "card," then the user ID corresponding to the word "card" is discarded from the statistics.

[0105] In this embodiment, the code identifier representing the feedback image information is a statement or emoticon image that is preset in commonly used chat phrases. When the code identifier corresponding to the statement or emoticon image appears in the comment area, the user ID that provides the feedback image information is actively obtained.

[0106] As an optional implementation of this embodiment, the feedback indicator acquisition module in the live broadcast quality evaluation device of the live broadcast system in this embodiment includes a feedback sound acquisition module:

[0107] The feedback sound acquisition module monitors a comment interaction area in a live process of the live class, and acquires a user ID of a keyword / word or code identifier representing feedback sound information when the keyword / word or code identifier is monitored.

[0108] The feedback rate statistical calculation module calculates a user ID corresponding to each keyword / word or code identifier representing feedback image information after the live class ends, performs a de-duplication process to obtain sound feedback UV, and calculates a sound feedback rate according to a formula: sound feedback rate = sound feedback UV / number of students attending the class.

[0109] The feedback sound acquisition module of the embodiment monitors a comment interaction area in a live process of the live class, and actively acquires a keyword / word or code identifier representing feedback sound information and a user ID corresponding to the keyword / word or code identifier in the comment interaction area. The sound feedback rate can be obtained by calculating a user proportion of feedback sound problems.

[0110] The keyword / word representing feedback image information in the embodiment includes but is not limited to "no sound", "unclear", "inaudible", "noise", "small sound", and the like. When the keyword / word is monitored in the comment interaction area, the user ID of feedback sound information is actively acquired.

[0111] The code identifier representing feedback sound information in the embodiment is a sentence or an expression image representing feedback sound information in a chat commonly used language. When the code identifier corresponding to the sentence or the expression image is monitored in the comment area, the user ID of feedback sound information is actively acquired.

[0112] As an optional implementation of the embodiment, the feedback index item acquisition module in the live class system live quality evaluation device of the embodiment includes a feedback interaction acquisition module.

[0113] The feedback interaction acquisition module monitors a comment interaction area in a live process of the live class, and acquires a user ID of a keyword / word or code identifier representing feedback interaction information when the keyword / word or code identifier is monitored.

[0114] The feedback rate statistical calculation module calculates a user ID corresponding to each keyword / word or code identifier representing feedback image information after the live class ends, performs a de-duplication process to obtain sound feedback UV, and calculates a sound feedback rate according to a formula: sound feedback rate = sound feedback UV / number of students attending the class.

[0115] The feedback interaction acquisition module of the embodiment monitors a comment interaction area in a live process of the live class, and actively acquires a keyword / word or code identifier representing feedback interaction information and a user ID corresponding to the keyword / word or code identifier in the comment interaction area. The sound feedback rate can be obtained by calculating a user proportion of feedback interaction problems.

[0116] The keywords / words representing the feedback interaction information of the embodiment include, but are not limited to, "not received", "not received", "not received topic", and "unable to submit", and the like. When the above keywords / words are monitored in the comment interaction area, the user ID of the feedback interaction information is actively acquired.

[0117] The code identifier representing the feedback interaction information of the embodiment is a statement or an expression image representing the feedback interaction information preset in the chat common language. When the code identifier corresponding to the statement or the expression image is monitored in the comment area, the user ID of the feedback interaction information is actively acquired.

[0118] As an optional implementation of the embodiment, the feedback index item acquisition module in the live class system live quality evaluation device of the embodiment includes a feedback to class acquisition module:

[0119] The feedback to class acquisition module acquires a user request of a failed request to enter a live class classroom.

[0120] The feedback rate statistical calculation module calculates all failed user requests to attend the class after the live class, performs a deduplication processing to obtain a failed UV to attend the class, and calculates a feedback rate to attend the class according to a formula: feedback rate to attend the class = failed UV to attend the class / number of people attending the class.

[0121] The embodiment can set an "enter classroom" button for a user to click to enter a live class classroom, or a "check-in" button for a user to enter a live class classroom to check in. When the user fails to click the "enter classroom" button or the "check-in" button, a user request of a failed request to attend the class is generated to the server side. When the same user fails multiple times, only one statistic is performed through deduplication processing, so as to obtain a failed UV to attend the class and calculate a feedback rate to attend the class.

[0122] Further, an APP burying point for a user request of a failed request to attend the class is preset in the APP of the live class system. The feedback to class acquisition module acquires the user request of the failed request to attend the class fed back by the APP burying point, performs a deduplication processing, and calculates a failed UV to attend the class.

[0123] As an optional implementation of the embodiment, the live class system live quality evaluation device of the embodiment includes a comprehensive feedback module:

[0124] The feedback index item information includes feedback image information, feedback sound information, feedback interaction information, and feedback to class information.

[0125] The comprehensive feedback module collects and counts the feedback image information, the feedback sound information, the feedback interaction information and the feedback attendance information corresponding to the user ID after the live class, carries out the de-duplication processing to obtain the comprehensive feedback UV, and calculates the comprehensive feedback rate according to the formula: comprehensive feedback rate = comprehensive feedback UV / attendance number.

[0126] The comprehensive feedback module in the live class system live quality evaluation device of the embodiment carries out comprehensive calculation on the feedback image information, the feedback sound information, the feedback interaction information and the feedback attendance information of the live class to obtain the comprehensive feedback rate, and evaluates the quality of the live class as a whole.

[0127] The live class system live quality evaluation device of the embodiment can also compare and evaluate each feedback index information, and focus on evaluating a certain feedback index.

[0128] As an optional implementation of the embodiment, the live class system live quality evaluation device of the embodiment includes:

[0129] The feedback index item module sorts each live class according to the feedback rate of each feedback index item: the feedback rates of each feedback index item of all live classes in a set time period are collected and counted, and the live classes whose feedback rates are top N are sorted and selected; the top N sorting of the embodiment is sorting the N% live classes with the highest feedback rate of the feedback index item, and the specific top N can be set as top1 / top5 / top10 / top50: the 1% live class / the 5% live class / the 10% live class / the 50% live class with the highest feedback rate are sorted from large to small according to the feedback rate.

[0130] The average feedback rate calculation module is configured to calculate the average feedback rate of the live class system: the total attendance number of all live classes in a set time period and the total index item feedback UV of each feedback index item are collected and counted, and the average feedback rate of the live class is calculated according to the formula: average feedback rate = total index item feedback UV / total attendance number; the calculation of the average feedback rate can evaluate the quality of the live class system as a whole in a certain time period, and grasp the overall quality of the live class system from a macro perspective.

[0131] The feedback median statistical module is configured to calculate the feedback rate median live class of the live class system: the feedback rates of each feedback index item of all live classes in a set time period are collected and counted, and the live classes in the middle of the sorting are counted according to the sorting condition of each feedback index item; the feedback rate median live class can be used as an evaluation standard, the live class with a feedback rate higher than the middle of the sorting is regarded as a low-quality live class, and the live class with a feedback rate lower than the middle of the sorting is regarded as a high-quality live class.

[0132] The embodiment also provides a storage medium, which stores a computer executable program, and the computer executable program is executed to realize the method for evaluating the live quality of the live class system.

[0133] The storage medium in the embodiment can include a data signal carrying readable program codes, which propagates in a baseband or as a part of a carrier. The propagating data signal can adopt various forms, including but not limited to electromagnetic signals, optical signals or any suitable combination of the above. The readable storage medium can also be any readable medium other than the readable storage medium, which can send, propagate or transmit programs for use by or in combination with an instruction execution system, device or apparatus. The program codes contained in the readable storage medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, RF and the like, or any suitable combination of the above.

[0134] The embodiment also provides an electronic device, which includes a processor and a memory, and the memory is used to store a computer executable program, and when the computer program is executed by the processor, the processor executes the method for evaluating the live quality of the live class system.

[0135] The electronic device is in the form of a general computing device. The processor can be one or multiple and work cooperatively. The present application also does not exclude distributed processing, that is, the processor can be dispersed in different entity devices. The electronic device of the present application is not limited to a single entity, but also can be the sum of multiple entity devices.

[0136] The memory stores a computer executable program, which is usually machine readable code. The computer readable program can be executed by the processor to enable the electronic device to execute the method of the present application or at least part of the steps in the method.

[0137] The memory includes a volatile memory, such as a random access memory (RAM) and / or a cache memory, and can also include a non-volatile memory, such as a read only memory (ROM).

[0138] It should be understood that the electronic device of the present application can also include elements or components not shown in the above examples. For example, some electronic devices also include a display unit, such as a display screen, and some electronic devices also include human-computer interaction elements, such as buttons, keyboards and the like. As long as the electronic device can execute the computer readable program in the memory to realize the method of the present application or at least part of the steps in the method, it can be considered as the electronic device covered by the present application.

[0139] Through the above description of the embodiments, those skilled in the art can easily understand that the present application can be implemented by hardware capable of executing a specific computer program, such as a system of the present application and an electronic processing unit, a server, a client, a mobile phone, a control unit, a processor, etc. contained in the system. The present application can also be implemented by computer software for executing the method of the present application, such as control software executed by a microprocessor, an electronic control unit, a client, a server, etc. However, it should be noted that the computer software for executing the method of the present application is not limited to being executed by one or specific hardware entity, but can also be implemented in a distributed manner without specific hardware. For computer software, the software product can be stored in a computer-readable storage medium (which can be a CD-ROM, a U disk, a mobile hard disk, etc.), or can be distributed on a network, as long as it can enable electronic equipment to execute the method according to the present application.

[0140] The above embodiments are only used to illustrate the present application and not to limit the technical solutions described in the present application. Although the present application has been described in detail with reference to the above embodiments, the present application is not limited to the above specific embodiments, and any modification or equivalent replacement of the present application; all technical solutions and improvements that do not deviate from the spirit and scope of the present application are encompassed in the scope of the claims of the present application.

Claims

1. An evaluation method for live quality of a live class system, characterized in that, The method comprises the following steps: Obtain feedback index item information of users during a live class; Count the feedback UV of each feedback index item after the live class, the feedback UV refers to the independent visitors of the feedback index item, and the feedback rate of each feedback index item is further calculated according to the feedback UV; Summarize the feedback rates of each feedback index item of all live classes for analysis and comparison, and comprehensively evaluate the live quality of the current live class system; The feedback index item information comprises feedback image information; Monitor the comment interaction area of the live class during the live process, and obtain the user ID of the keyword / word or code identifier representing the feedback image information when the keyword / word or code identifier is monitored; Count the user IDs corresponding to the keyword / word or code identifier representing the feedback image information after the live class, and calculate the image feedback UV through de-duplication processing, and calculate the image feedback rate according to the formula image feedback rate=image feedback UV / number of attendees; The feedback index item information comprises feedback sound information; Monitor the comment interaction area of the live class during the live process, and obtain the user ID of the keyword / word or code identifier representing the feedback sound information when the keyword / word or code identifier is monitored; Count the user IDs corresponding to the keyword / word or code identifier representing the feedback sound information after the live class, and calculate the sound feedback UV through de-duplication processing, and calculate the sound feedback rate according to the formula sound feedback rate=sound feedback UV / number of attendees; The feedback index item information comprises feedback interaction information; Monitor the comment interaction area of the live class during the live process, and obtain the user ID of the keyword / word or code identifier representing the feedback interaction information when the keyword / word or code identifier is monitored; Count the user IDs corresponding to the keyword / word or code identifier representing the feedback interaction information after the live class, and calculate the interaction feedback UV through de-duplication processing, and calculate the interaction feedback rate according to the formula interaction feedback rate=interaction feedback UV / number of attendees; The feedback index item information comprises feedback attendance information; Obtain the user request of failed request to enter the live class, count all the failed user requests to attend the live class after the live class, and calculate the failed attendance UV through de-duplication processing, and calculate the attendance feedback rate according to the formula attendance feedback rate=failure attendance UV / number of attendees; Pre-set an APP bury point for the user request of failed request to attend in the APP of the live class system, obtain the user request of failed request to attend through the APP bury point, summarize and calculate the failed attendance UV through de-duplication processing; Count the user IDs corresponding to the feedback image information, feedback sound information, feedback interaction information and feedback attendance information after the live class, and calculate the comprehensive feedback UV through de-duplication processing, and calculate the comprehensive feedback rate according to the formula comprehensive feedback rate=comprehensive feedback UV / number of attendees; The step of summarizing the feedback rates of each feedback index item of all live classes for analysis and comparison, and comprehensively evaluating the live quality of the current live class system comprises the following steps: The topN ranking of each live class system feedback index item: the feedback rate of each feedback index item of all live classes in a set time period is summarized and counted, and the live classes with the top N feedback rate of each feedback index item are sorted and selected; And / or average feedback rate calculation of live class system: the total feedback UV and the total number of live classes of each feedback index item of all live classes in a set time period are summarized and counted, and the average feedback rate is calculated according to the formula average feedback rate = total feedback UV / total number of live classes; And / or live class system feedback rate median live class statistics: the feedback rate of each feedback index item of all live classes in a set time period is summarized and counted, and the live classes in the middle of the sorting are counted according to the sorting condition of each feedback index item.

2. The apparatus for evaluating the quality of live broadcast of a live broadcast class system, characterized in that, It includes: The feedback index item acquisition module acquires the feedback index item information of the user in the live process of a single live class; The feedback rate statistical calculation module calculates the feedback UV of each feedback index item after the live class ends, the feedback UV refers to the independent visitors of the feedback index item, and the feedback rate of each feedback index item is calculated according to the formula feedback rate = feedback UV / number of live classes; And the live class system live quality evaluation module analyzes and compares the feedback rate of each feedback index item of all live classes, and comprehensively evaluates the current live class system live quality; The feedback image acquisition module monitors the comment interaction area of the live class in the live process, and when the keyword / word or code identifier representing the feedback image information is monitored, the user ID publishing the keyword / word or code identifier is acquired; The feedback rate statistical calculation module counts the user ID corresponding to each keyword / word or code identifier representing the feedback image information after the live class ends, and calculates the image feedback UV after de-duplication processing, and calculates the image feedback rate according to the formula image feedback rate = image feedback UV / number of live classes; The feedback sound acquisition module monitors the comment interaction area of the live class in the live process, and when the keyword / word or code identifier representing the feedback sound information is monitored, the user ID publishing the keyword / word or code identifier is acquired; The feedback rate statistical calculation module counts the user ID corresponding to each keyword / word or code identifier representing the feedback sound information after the live class ends, and calculates the sound feedback UV after de-duplication processing, and calculates the sound feedback rate according to the formula sound feedback rate = sound feedback UV / number of live classes; The feedback interaction acquisition module monitors the comment interaction area of the live class in the live process, and when the keyword / word or code identifier representing the feedback interaction information is monitored, the user ID publishing the keyword / word or code identifier is acquired; The feedback rate statistical calculation module counts the user ID corresponding to each keyword / word or code identifier representing the feedback interaction information after the live class ends, and calculates the interaction feedback UV after de-duplication processing, and calculates the interaction feedback rate according to the formula interaction feedback rate = interaction feedback UV / number of live classes; ​ ​ ​ The feedback attendance acquisition module comprises a feedback-to-class acquisition module: The feedback-to-class acquisition module acquires a user request for requesting to enter a live class classroom but failing; The feedback rate statistical calculation module calculates all user requests for failing to attend a class after a live class ends, performs deduplication processing, and obtains a failed attendance UV, and calculates a failed attendance feedback rate according to a formula: failed attendance feedback rate = failed attendance UV / attendance number; An APP in the live class system is preset with an APP point for feeding back a user request for failing to attend a class, the feedback-to-class acquisition module acquires the user request for failing to attend a class fed back by the APP point, performs summarization and deduplication processing, and obtains a failed attendance UV; The live class system live quality evaluation device comprises a comprehensive feedback module: The comprehensive feedback module calculates a comprehensive feedback UV by performing deduplication processing on user IDs corresponding to feedback image information, feedback sound information, feedback interaction information, and feedback attendance information after a live class ends, and calculates a comprehensive feedback rate according to a formula: comprehensive feedback rate = comprehensive feedback UV / attendance number; The feedback rates of all feedback index items of all live classes are analyzed and compared, and the live quality of the current live class system is comprehensively evaluated, comprising: Live class system feedback index item topN sorting: the feedback rates of all feedback index items of all live classes in a set time period are summarized and statistically calculated, and live classes with feedback rates ranked top N are sorted and selected; And / or live class system average feedback rate calculation: the total feedback UV and the total attendance number of all feedback index items of all live classes in a set time period are summarized and statistically calculated, and an average feedback rate is calculated according to a formula: average feedback rate = total feedback UV / total attendance number; And / or live class system feedback rate median live class statistics: the feedback rates of all feedback index items of all live classes in a set time period are summarized and statistically calculated, all live classes are sorted according to each feedback index item as a sorting condition, and live classes located in the middle of the sorting are counted.

3. Storage medium, characterized in that The computer executable program is stored, and when the computer executable program is executed, the live class system live quality evaluation method as claimed in claim 1 is realized.

Images