Live broadcast data statistical method, electronic equipment and storage medium

Through facial recognition technology, live videos are recorded in segments and searched for substitution time, which solves the problem of low live data statistics efficiency, realizes automated data statistics and accuracy, and is suitable for the data statistics needs of the live streaming industry.

CN119255003AInactive Publication Date: 2025-01-03HANGZHOU MIANCHAO INFORMATION TECH CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
CN202411785229.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-06
Publication Date
2025-01-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the live broadcast industry, anchors need to manually record time when they are on or off, which leads to inefficient efficiency in statistics of live broadcast data and is prone to omissions, affecting the accuracy of data.

Method used

Use facial recognition technology to record live videos in segments to determine whether there is a phenomenon of changing live broadcasters in the video clips. Use dichotomy to find the time of replacement, determine the up and down time of each live broadcaster, and automatically count the live broadcast data. .

Benefits of technology

It significantly improves the efficiency of live broadcast data statistics, eliminates the trouble of manually recording up and down time, and ensures the accuracy and completeness of the data, especially in the presence of agency broadcasting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119255003A_ABST
    Figure CN119255003A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of data processing, in particular to a live broadcast data statistical method, electronic equipment and a storage medium, and aims to improve statistical efficiency. The live broadcast data statistical method provided by the invention comprises the following steps: carrying out segmented recording on a video of a live broadcast room according to a preset recording time length; judging whether the phenomenon of replacing the live broadcast personnel exists in each recorded video clip through a face recognition technology, and if yes, searching for the personnel replacement time; according to the searched person changing time and the first frame time and the last frame time of all the video clips, the up-playing time and the down-playing time of each live broadcast person are determined; and carrying out statistics on live broadcast data of each anchor according to the up broadcast time and the down broadcast time. By using the method of the invention, statistics of live broadcast data can be rapidly completed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a live broadcast data statistics method, electronic equipment and storage medium. Background Art

[0002] Relying on the rapidly developing Internet technology, the live broadcast industry provides users with an instant and interactive viewing experience, bringing profound changes and opportunities to multiple fields such as education, entertainment, and e-commerce.

[0003] Currently, every anchor needs to manually record the time when they start or end broadcasting. If they forget to record, they need to look through the video to find the time when they start or end broadcasting, which greatly affects the efficiency of live broadcast data statistics. Summary of the invention

[0004] In order to solve the above problems in the prior art, the present invention proposes a live broadcast data statistics method, an electronic device and a storage medium, which improve the statistical efficiency.

[0005] A first aspect of the present invention provides a live broadcast data statistics method, the method comprising: A10, recording the live broadcast room video in segments according to the preset recording time length; A20, using face recognition technology to determine whether there is a change of live broadcast personnel in each recorded video clip, and if so, find the time of the change; A30, determining the start and end time of each live broadcast staff member according to the found replacement time and the first frame time and the last frame time of all video clips; A40: Count the live broadcast data of each anchor according to the start broadcast time and the end broadcast time.

[0006] Preferably, step A20 includes: A21, for a certain video clip, select the first face image and the last face image; A22, determining whether the first face image and the last face image belong to the same live broadcast person; if so, it is considered that there is no phenomenon of changing the live broadcast person in the video clip; otherwise, it is considered that there is the phenomenon of changing the live broadcast person; A23, if the phenomenon of replacing the live broadcast personnel exists, the replacement time is searched in the video clip based on the binary search method.

[0007] Preferably, step A23 includes: The first frame time and the last frame time of the video clip are recorded as the start time and the end time respectively; Take the middle time between the start time and the end time; Compare the face image at the middle time in the video clip with the face image at the start time, and if they belong to the same person, update the start time with the value of the middle time; otherwise, update the end time with the value of the middle time; Repeat the steps of taking the middle time between the start time and the end time and comparing the facial image at the middle time with the facial image at the start time until the time between the start time and the end time is less than a threshold, and record the middle time as the replacement time.

[0008] Preferably, step A30 includes: Recording the first frame time of the first video clip as the broadcast time of the first live broadcaster; If the first video clip contains the phenomenon of the replacement of the live broadcast personnel, the corresponding replacement time is recorded as the off-broadcast time of the first live broadcast personnel and the on-broadcast time of the second live broadcast personnel; otherwise, the last frame time of the video clip is recorded as the off-broadcast time of the first live broadcast personnel; If the live broadcast personnel are replaced in the second video clip, the off-broadcast time of the previous live broadcast personnel is updated with the corresponding replacement time, and the replacement time is recorded as the on-broadcast time of the next live broadcast personnel; otherwise, the off-broadcast time of the previous live broadcast personnel is updated with the last frame time of the video clip; The execution is repeated until the start broadcast time and the end broadcast time of each live broadcast personnel within the preset time range are determined.

[0009] Preferably, step A40 includes: A41, identifying the anchor and the substitute, and using the substitute's off-air time to update the corresponding anchor's off-air time; A42, according to the start broadcast time and the end broadcast time of each anchor, searching for live broadcast data in a corresponding time period and performing statistics; Among them, the live broadcast data includes: the number of completed orders, the total transaction amount of goods, the number of page views, the number of unique visitors and the amount of advertising.

[0010] Preferably, step A41 includes: Calculate the length of live broadcast time of each live broadcaster according to the start broadcast time and the end broadcast time of the live broadcaster; The first person to broadcast live is recorded as the first anchor; If the first anchor has set a proxy broadcast duration, and the live broadcast duration of the second live broadcaster is less than or equal to the proxy broadcast duration, the second live broadcaster is considered to be a proxy broadcaster, and the off-broadcast time of the first anchor is updated with the off-broadcast time of the proxy broadcaster, and the third live broadcaster is recorded as the second anchor; otherwise, the second live broadcaster is recorded as the second anchor; If the second anchor has set a proxy broadcast duration, and the live broadcast duration of the next live broadcaster is less than or equal to the proxy broadcast duration, the next live broadcaster is considered to be a proxy broadcaster, and the off-broadcast time of the second anchor is updated with the off-broadcast time of the proxy broadcaster, and the next live broadcaster is recorded as the third anchor; otherwise, the next live broadcaster is recorded as the third anchor; The process is repeated until all the broadcast agents are identified and the corresponding broadcasting time is updated.

[0011] Preferably, step A40 includes: A45, each live broadcaster is recorded as an anchor; A46, according to the start broadcast time and the end broadcast time of each anchor, searching for live broadcast data in a corresponding time period and performing statistics; Among them, the live broadcast data includes: the number of completed orders, the total transaction amount of goods, the number of page views, the number of unique visitors and the amount of advertising.

[0012] Preferably, the method further comprises: When the above-mentioned phenomenon of changing live broadcast personnel occurs, a reminder message is sent.

[0013] According to a second aspect of the present invention, an electronic device is provided, comprising a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the method described above.

[0014] According to a third aspect of the present invention, a computer-readable storage medium is provided, storing a computer program that can be loaded by a processor and execute the method described above.

[0015] The present invention has the following beneficial effects: The live broadcast data statistics method of the present invention records the live broadcast room video into segments, and uses face recognition technology to determine whether the live broadcast personnel have been replaced in each video segment, and then determines the start and end time of each live broadcast personnel. It can significantly improve the statistical efficiency and avoid the trouble of manually recording the start and end time of the broadcast.

[0016] The program automatically identifies substitute broadcasters and combines the live broadcast data of the host and the substitute broadcasters, further improving statistical efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic diagram of the main steps of the first embodiment of the live broadcast data statistics method of the present invention; Figure 2 It is a schematic diagram of the main steps of Example 2 of the live broadcast data statistics method in the present invention. DETAILED DESCRIPTION

[0018] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0019] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] It should be noted that, in the description of the present invention, the terms "first" and "second" are only for the convenience of description, and do not indicate or imply the relative importance of the devices, elements or parameters, and therefore cannot be understood as limiting the present invention. In addition, the term "and / or" in the present invention is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally indicates that the associated objects before and after are in an "or" relationship.

[0021] Figure 1 Schematic diagram of the main steps of the first embodiment of the live broadcast data statistics method of the present invention. Figure 1 As shown, the method of this embodiment includes steps A10-A40: Step A10: Record the live broadcast room video in segments according to the preset recording time length.

[0022] In this embodiment, the preset recording time length is 15 minutes.

[0023] Step A20: Use face recognition technology to determine whether there is a change of live broadcast personnel in each recorded video clip. If yes, find the time of the change. This step may specifically include steps A21-A23: Step A21: For a certain video clip, select the first face image and the last face image.

[0024] Step A22, determine whether the first face image and the last face image belong to the same live broadcast person; if so, it is considered that there is no phenomenon of changing the live broadcast person in the video clip; otherwise, it is considered that there is the phenomenon of changing the live broadcast person.

[0025] Step A23: If there is a phenomenon of changing the live broadcast personnel, then search for the time of the change in the video clip based on the binary search method. This step can further include steps A231-A234: Step A231, record the first frame time and the last frame time of the video clip as the start time start and the end time end respectively.

[0026] Step A232, taking the middle time mid between the start time start and the end time end; Step A233, comparing the face image at the middle time mid in the video clip with the face image at the start time start, if they belong to the same person, updating the start time start with the value of the middle time mid; otherwise, updating the end time end with the value of the middle time mid; Step A234, repeat steps A232 to A233 until the time between the start time start and the end time end is less than the threshold, and the middle time mid value at this time is the substitution time.

[0027] In this embodiment, the threshold is set to 60 seconds, which means that the substitution time is accurate to the minute.

[0028] Step A30: Determine the start and end time of each live broadcast staff member according to the replacement time found and the first frame time and the last frame time of all video clips. This step may specifically include steps A31-A34: Step A31: record the first frame time of the first video clip as the start time of the first live broadcaster.

[0029] Step A32: If there is a change of live broadcast personnel in the first video clip, the corresponding replacement time is recorded as the off-broadcast time of the first live broadcast personnel and the on-broadcast time of the second live broadcast personnel; otherwise, the last frame time of the video clip is recorded as the off-broadcast time of the first live broadcast personnel.

[0030] In this embodiment, the "first live broadcast personnel", "second live broadcast personnel", etc. are defined based on the time sequence in which these personnel conduct live broadcasts, and does not exclude the situation where the first live broadcast personnel and a subsequent live broadcast personnel (such as the fourth live broadcast personnel) are the same person.

[0031] Step A33: If there is a change of live broadcast personnel in the second video clip, the corresponding change time is used to update the off-broadcast time of the previous live broadcast personnel, and the change time is recorded as the on-broadcast time of the next live broadcast personnel; otherwise, the last frame time of the video clip is used to update the off-broadcast time of the previous live broadcast personnel.

[0032] In this embodiment, the live broadcast staff before the substitution time is called the "previous live broadcast staff", and the live broadcast staff after the substitution time is called the "next live broadcast staff". Therefore, the "previous live broadcast staff" and the "next live broadcast staff" only indicate that the order of appearance of these two staff in the current video clip is different.

[0033] Step A34: Process each subsequent video clip with reference to step A33 until the start and end time of each live broadcast staff within the preset time range is determined.

[0034] In this embodiment, the preset time range is one day, and the video recording starts from the start of the live broadcast room in the morning until the live broadcast room is closed in the evening, and the start and end time of each live broadcast person in this day is determined.

[0035] Step A40: Count the live broadcast data of each anchor according to the broadcast time and the broadcast time.

[0036] During the live broadcast, the host may need to leave for a short period of time due to some emergency matters. In this case, a substitute arranged by him / her can take his / her place to continue the live broadcast.

[0037] There are two cases in step A40: one is to consider the phenomenon of proxy broadcasting, in which case the live broadcast data of the proxy broadcaster during the live broadcast is combined with the live broadcast data of the replaced anchor; the other is to not consider the phenomenon of proxy broadcasting, and each live broadcaster is regarded as a separate anchor. The following are respectively explained.

[0038] (I) In the case of considering the proxy broadcast phenomenon, step A40 may include A41-A42: Step A41, identifying the anchor and the proxy, and using the proxy's off-air time to update the corresponding anchor's off-air time. This step may specifically include steps A411-A414: Step A411: Calculate the length of the live broadcast time of each live broadcast staff member according to the start and end broadcast time of the live broadcast staff member.

[0039] Step A412: record the first live broadcaster as the first anchor.

[0040] In this embodiment, "the first anchor" and "the second anchor" only represent the time sequence of these anchors' live broadcast activities, and it does not exclude the situation that the first anchor and the second anchor are the same person.

[0041] Step A413: If the first anchor sets the proxy broadcast duration, and the live broadcast time of the second live broadcaster is less than or equal to the proxy broadcast duration, the second live broadcaster is considered to be the proxy broadcaster, and the off-broadcast time of the first anchor is updated with the off-broadcast time of the proxy broadcaster, and the third live broadcaster is recorded as the second anchor; otherwise, the second live broadcaster is recorded as the second anchor.

[0042] In this embodiment, the program allows a host to set whether to enable proxy broadcasting and set the proxy broadcasting duration according to actual conditions.

[0043] Step A413: If the second anchor sets the substitute broadcast duration, and the live broadcast time of the next live broadcaster is less than or equal to the substitute broadcast duration, the next live broadcaster is considered to be the substitute broadcaster, and the off-broadcast time of the second anchor is updated with the off-broadcast time of the substitute broadcaster, and the next live broadcaster is recorded as the third anchor; otherwise, the next live broadcaster is recorded as the third anchor.

[0044] In this embodiment, "the next live broadcast person" and "the next live broadcast person" refer to the first and second live broadcast persons who perform live broadcast immediately after the second anchor, respectively.

[0045] Step A414: for each subsequent anchor, refer to step A413 to determine whether the proxy broadcast duration is set and perform corresponding processing until all proxy broadcast personnel are identified and the corresponding anchor's off-air time is updated.

[0046] Step A42: According to the start and end time of each anchor, the live broadcast data in the corresponding time period is searched and counted.

[0047] In this step, the situation where the same person broadcasts live multiple times can be taken into account. For example, if the first broadcaster and the fourth broadcaster are the same anchor, the data of these two broadcasts can be combined and calculated.

[0048] Among them, live broadcast data includes: number of completed orders, total commodity transaction amount, page views, number of unique visitors and advertising volume.

[0049] (II) If the proxy broadcast phenomenon is not considered, step A40 may include A45-A46: Step A45, record each live broadcaster as an anchor; Step A46: According to the start and end time of each anchor, the live broadcast data in the corresponding time period is searched and counted.

[0050] In this step, the situation where the same anchor broadcasts live multiple times can be taken into account. For example, if the second anchor and the sixth anchor are the same person, then the data of these two live broadcasts can be combined and calculated.

[0051] Among them, the live broadcast data includes: the number of completed orders, the total transaction amount of goods, the number of page views, the number of unique visitors and the amount of advertising.

[0052] Figure 2 Schematic diagram of the main steps of the second embodiment of the live broadcast data statistics method of the present invention. Steps B10, B30, and B40 in this embodiment correspond to A10, A30, and A40 in the above embodiment 1 respectively. The difference between step B20 and step A20 in embodiment 1 is that in addition to finding the time of the substitution when a person is replaced in the live broadcast room, a reminder message is also sent in B20. Figure 2 As shown, the method of this embodiment includes steps B10-B40: Step B10: Record the live broadcast room video in segments according to the preset recording time length.

[0053] Step B20: Use face recognition technology to determine whether there is a change of live broadcast personnel in each recorded video clip. If so, find the time of the change and send a reminder message.

[0054] The reminder information may include: the ID of the previous live broadcaster, the ID of the next live broadcaster, and the time of replacement, etc.

[0055] Step B30: Determine the start and end time of each live broadcast staff member according to the found replacement time and the first frame time and the last frame time of all video clips.

[0056] Step B40: Count the live broadcast data of each anchor according to the broadcast time and the broadcast time.

[0057] In some implementations, step B10 may be executed by the first thread, step B20 may be executed by the second thread, and step B30-B40 may be executed by the third thread, so as to realize checking whether a person is replaced while recording, and sending a reminder message when a person is replaced.

[0058] In the above-mentioned Embodiment 1 and Embodiment 2, although each step is described in the above-mentioned chronological order, those skilled in the art can understand that in order to achieve the effect of this embodiment, different steps do not have to be executed in such an order, and they can be executed simultaneously (in parallel) or in a reverse order. These simple changes are within the scope of protection of the present invention.

[0059] Based on the above method, the present invention also provides an embodiment of an electronic device. The electronic device of this embodiment includes a memory and a processor. The memory stores a computer program that can be loaded by the processor and execute the method as described above.

[0060] Furthermore, the present invention also provides an embodiment of a computer-readable storage medium, in which the storage medium of this embodiment stores a computer program that can be loaded by a processor and execute the method described above.

[0061] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0062] Those skilled in the art should be able to appreciate that the method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of electronic hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in electronic hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0063] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A method for statistically analyzing live broadcast data, characterized in that: The method comprises: A10, recording the live broadcast room video in segments according to the preset recording time length; A20, using face recognition technology to determine whether there is a change of live broadcast personnel in each recorded video clip, and if so, find the time of the change; A30, determining the start and end time of each live broadcast staff member according to the found replacement time and the first frame time and the last frame time of all video clips; A40: Count the live broadcast data of each anchor according to the start broadcast time and the end broadcast time.

2. The live broadcast data statistics method according to claim 1, characterized in that: Step A20 includes: A21, for a certain video clip, select the first face image and the last face image; A22, determining whether the first face image and the last face image belong to the same live broadcast person; if so, it is considered that there is no phenomenon of changing the live broadcast person in the video clip; otherwise, it is considered that there is the phenomenon of changing the live broadcast person; A23, if the phenomenon of replacing the live broadcast personnel exists, the replacement time is searched in the video clip based on the binary search method.

3. The live broadcast data statistics method according to claim 2, characterized in that: Step A23 includes: The first frame time and the last frame time of the video clip are recorded as the start time and the end time respectively; Take the middle time between the start time and the end time; Compare the face image at the middle time in the video clip with the face image at the start time, and if they belong to the same person, update the start time with the value of the middle time; otherwise, update the end time with the value of the middle time; Repeat the steps of taking the middle time between the start time and the end time and comparing the facial image at the middle time with the facial image at the start time until the time between the start time and the end time is less than a threshold, and record the middle time as the replacement time.

4. The live broadcast data statistics method according to claim 1, characterized in that: Step A30 includes: Recording the first frame time of the first video clip as the broadcast time of the first live broadcaster; If the first video clip contains the phenomenon of the replacement of the live broadcast personnel, the corresponding replacement time is recorded as the off-broadcast time of the first live broadcast personnel and the on-broadcast time of the second live broadcast personnel; otherwise, the last frame time of the video clip is recorded as the off-broadcast time of the first live broadcast personnel; If the live broadcast personnel are replaced in the second video clip, the off-broadcast time of the previous live broadcast personnel is updated with the corresponding replacement time, and the replacement time is recorded as the on-broadcast time of the next live broadcast personnel; otherwise, the off-broadcast time of the previous live broadcast personnel is updated with the last frame time of the video clip; The execution is repeated until the start broadcast time and the end broadcast time of each live broadcast personnel within the preset time range are determined.

5. The live broadcast data statistics method according to claim 1, characterized in that: Step A40 includes: A41, identifying the anchor and the substitute, and using the substitute's off-air time to update the corresponding anchor's off-air time; A42, according to the start broadcast time and the end broadcast time of each anchor, searching for live broadcast data in a corresponding time period and performing statistics; Among them, the live broadcast data includes: the number of completed orders, the total transaction amount of goods, the number of page views, the number of unique visitors and the amount of advertising.

6. The live broadcast data statistics method according to claim 5, characterized in that: Step A41 includes: Calculate the length of live broadcast time of each live broadcaster according to the start broadcast time and the end broadcast time of the live broadcaster; The first person to broadcast live is recorded as the first anchor; If the first anchor has set a proxy broadcast duration, and the live broadcast duration of the second live broadcaster is less than or equal to the proxy broadcast duration, the second live broadcaster is considered to be a proxy broadcaster, and the off-broadcast time of the first anchor is updated with the off-broadcast time of the proxy broadcaster, and the third live broadcaster is recorded as the second anchor; otherwise, the second live broadcaster is recorded as the second anchor; If the second anchor has set a proxy broadcast duration, and the live broadcast duration of the next live broadcaster is less than or equal to the proxy broadcast duration, the next live broadcaster is considered to be a proxy broadcaster, and the off-broadcast time of the second anchor is updated with the off-broadcast time of the proxy broadcaster, and the next live broadcaster is recorded as the third anchor; otherwise, the next live broadcaster is recorded as the third anchor; The process is repeated until all the broadcast agents are identified and the corresponding broadcasting time is updated.

7. The live broadcast data statistics method according to claim 1, characterized in that: Step A40 includes: A45, each live broadcaster is recorded as an anchor; A46, according to the start broadcast time and the end broadcast time of each anchor, searching for live broadcast data in a corresponding time period and performing statistics; Among them, the live broadcast data includes: the number of completed orders, the total transaction amount of goods, the number of page views, the number of unique visitors and the amount of advertising.

8. The live broadcast data statistics method according to any one of claims 1 to 7, characterized in that: The method further comprises: When the above-mentioned phenomenon of changing live broadcast personnel occurs, a reminder message is sent.

9. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Method and device for displaying interaction condition of direct broadcast room

    CN106604149A

  • Live broadcasting record statistical method and device

    CN106954079A

  • Electronic screen use condition monitoring method and system based on face recognition

    CN107862195A

  • Face recognition method and device based on video sequence

    CN108171207A

  • Control method and apparatus of user behavior and using time in IPTV

    CN108965933A