Physical education live broadcast method and device based on wisdom education
By using cloud NPT services to optimize between devices clock synchronization and network delay noise reduction algorithms in physical education live broadcast, the problem of different playback progress between multiple devices is solved, low-cost synchronous playback is achieved, and AI action recognition is supported.
Patent Information
- Application Number
- CN202411618442.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-13
- Publication Date
- 2025-02-21
AI Technical Summary
In live sports teaching broadcasts, due to the differences in playback progress between multiple multimedia devices, the sounds interfere with each other and affect the listening effect. The existing solutions are costly and cannot realize the AI action recognition capabilities of the device based on the video playback progress.
By issuing an NTP transaction round-trip request to the cloud NPT service in the second terminal device, obtaining the clock difference value and correcting it, ensuring clock synchronization between devices, realizing the consistency of video playback progress, and optimizing the clock difference with the network delay noise reduction algorithm. Value calculation.
It realizes that multiple devices play synchronously in the same space or different spaces, keeps the playback progress consistent, reduces costs, does not require wiring, is highly operable, and supports AI action recognition based on the video playback progress.
Smart Images

Figure CN119496918A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of intelligent teaching, and in particular to a method and device for live broadcasting of sports teaching based on smart education. Background Art
[0002] With the development of the Internet and mobile communication technology, online education and distance learning have been widely used. As an effective teaching method, teaching video live broadcast has been popularized in educational institutions of all levels and types.
[0003] However, in physical education, live broadcast of physical education requires multiple multimedia devices to play the same audio and video in one space. Due to the difference in playback progress between the devices, the sounds interfere with each other, seriously affecting the listening effect. A common solution is to use an HDMI HUB to receive video signals from a single playback source to achieve consistent playback progress. However, this method requires selecting hardware of corresponding specifications based on the number of devices, wiring needs to be considered, the hardware cost is high, and the device can only be used as an output end of the video signal, and the device cannot realize the AI motion recognition capability based on the video playback progress. Summary of the invention
[0004] One object of the present invention is to provide a method and apparatus for live broadcasting of sports teaching based on smart education, so that multiple devices can play synchronously in the same space or different spaces, and keep the playback progress consistent under low-cost conditions.
[0005] This purpose is achieved by adopting the following technical solutions:
[0006] A sports teaching live broadcast method based on smart education, the teaching live broadcast method is performed on a first terminal device and a second terminal device, the second terminal device includes at least one interactive terminal, and the method includes:
[0007] In response to the play command issued by the first terminal device, the second terminal device issues a first-stage NTP transaction round-trip request F1 to the cloud NPT service, and obtains the first-stage NTP clock difference L1; the second terminal uses the clock difference L1 as a clock correction value to adjust the instruction execution time; before playing the video, when the first terminal device issues the play command, a first timestamp is generated; after correcting the first-stage NTP clock difference L1, the video is played after a first preset time is delayed based on the first timestamp. Preferably, the first preset time is 3 seconds.
[0008] However, the local time of each device is different. Conventional clock synchronization frequency is low and usually measured in days. Due to the difference in the clock crystal unit of each device, there is inevitably a time difference of more than hundreds of milliseconds, which leads to visible asynchrony in playback. Therefore, when the second terminal device of the present invention receives the playback instruction, it actively initiates a clock synchronization request to the first terminal device, thereby avoiding the local time difference of the device before the task starts.
[0009] After the second terminal device plays the video, it sends a second-stage NTP transaction round-trip request F2 at a preset frequency, calculates the second-stage NTP clock difference L2 of the second terminal device; obtains the standard clock difference based on the second-stage NTP clock difference L2; and adjusts the playback progress based on the standard clock difference.
[0010] At a preset first time interval, the second terminal device sends three second-stage NTP transaction round-trip requests F2;
[0011] The three second-stage NTP clock difference values L21 sent by the second terminal device are calculated, and each time the smallest second-stage NTP clock difference value L2 is taken as the current NTP clock difference value LT.
[0012] Obtain the three second-stage NTP clock differences L21 of the second terminal device and store them in a queue;
[0013] At a preset second time interval, the second terminal device sends a third-phase NTP transaction round-trip request F3;
[0014] Calculate the NTP clock difference L3 of the third stage sent by the second terminal device each time;
[0015] Compare the NTP clock difference L3 in the third phase with the three queue values in the queue;
[0016] Update the three queue values in the queue; obtain the average value P of the three queue values in the queue; obtain the difference C between the third stage NTP clock difference L3 and the average value P; compare the average value P with the difference C. If The queue value of the earliest queue is replaced with the NTP clock difference L3 in the third stage.
[0017] The minimum queue value in a queue is the standard clock difference.
[0018] The second terminal device adjusts the playback progress according to the standard clock difference, specifically including:
[0019] At a preset third time interval, obtaining the current playback progress of the second terminal device;
[0020] The progress difference time A is obtained according to the difference between the current playback progress and the standard clock;
[0021] Adjust the playback progress according to the progress difference time A.
[0022] If the progress difference time A is less than 5s, the playback speed multiplier
[0023] If the progress difference time A is greater than or equal to 5s, direct frame skipping is adopted to adjust the current playback progress to the playback progress of the progress difference time A.
[0024] The algorithm used by the NTP protocol has a certain estimate of the specific time, and this estimate will deviate with network fluctuations; as a result, sometimes the obtained time may be very different, causing visible asynchrony in playback.
[0025] Therefore, the present invention adds a network delay noise reduction algorithm. Since most of the estimation error of NTP comes from network delay (assuming that the request and return time of the network are of equal length), we can assume that the greater the network delay, the greater the clock error that may be caused.
[0026] First, at a preset first time interval, the second terminal device sends three second-stage NTP transaction round-trip requests F2 to obtain the current NTP clock difference LT, obtain the three second-stage NTP clock differences L21 of the second terminal device, and store them in a queue.
[0027] Then, at a preset second time interval, the second terminal device sends a third-stage NTP transaction round-trip request F3, and calculates the third-stage NTP clock difference L3 sent by the second terminal device each time; determines whether to add the obtained third-stage NTP clock difference L3 to the queue, and updates the queue.
[0028] Finally, the minimum queue value in the queue is used as the standard clock difference, and the second terminal device adjusts the playback progress according to the standard clock difference.
[0029] The present invention can effectively synchronize multiple devices in different spaces or the same space, and alleviate the clock error between the slave device and the master device. Meanwhile, the present invention has low cost, does not require wiring, and has strong operability.
[0030] Secondly, the synchronization method of the present invention can be used for synchronization of interactive videos of interactive terminals, which is more conducive to the effective progress of sports teaching live broadcast and improves the experience of the second terminal device.
[0031] On the other hand, a sports teaching live broadcast device based on smart education, wherein the device includes a processor; and a memory arranged to store computer executable instructions, and when the executable instructions are executed, the processor performs operations according to any of the methods described above.
[0032] According to another aspect of the present application, a computer-readable medium storing instructions is provided, and when the instructions are executed, the system performs the operation according to any of the above methods.
[0033] Compared with the prior art, the present invention has the following advantages and beneficial effects:
[0034] The present invention is a method and device for live sports teaching based on smart education. The present invention uses a universal and simple method to synchronize multiple devices in different spaces or the same space, thereby alleviating the clock error between the slave device and the master device.
[0035] Moreover, the present invention can simultaneously realize the recognition of AI actions based on the progress of video playback, which is more conducive to the live broadcast of physical education. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] The drawings described herein are used to provide a further understanding of the embodiments of the present invention, constitute a part of this application, and do not constitute a limitation of the embodiments of the present invention. In the drawings:
[0037] Figure 1 Schematic diagram of the process of this method. DETAILED DESCRIPTION
[0038] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.
[0039] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those within the scope of this description. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.
[0040] Those skilled in the art should understand that, in the disclosure of the present invention, the orientation or position relationship indicated by the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.
[0041] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.
[0042] Example 1
[0043] Please refer to Figure 1 , Figure 1 This is a flow chart of the method. The teaching live broadcast method is performed on a first terminal device and a second terminal device. The second terminal device includes at least one interactive terminal. The method includes:
[0044] Step 1: In response to the play instruction issued by the first terminal device, the second terminal device issues a first-stage NTP transaction round-trip request F1 to the cloud NPT service, and obtains the first-stage NTP clock difference L1; the second terminal uses the clock difference L1 as a clock correction value to adjust the instruction execution time; when the first terminal device issues a play instruction, a first timestamp is generated; after correcting the first-stage NTP clock difference L1, the video is played after a first preset time is delayed based on the first timestamp; wherein the first preset time is 3 seconds;
[0045] Step 2, after the second terminal device plays the video, at a preset first time interval, the second terminal device sends three second-stage NTP transaction round-trip requests F2;
[0046] Step 3, calculating the three second-stage NTP clock difference values L21 sent by the second terminal device, and taking the smallest second-stage NTP clock difference value L2 as the current NTP clock difference value LT each time;
[0047] Step 4, obtaining the NTP clock difference L21 of the second terminal device in the third second phase and storing it in a queue; when storing it in the queue, recording the time when the queue value enters the queue;
[0048] Step 5: At a preset second time interval, the second terminal device sends a third-phase NTP transaction round-trip request F3;
[0049] Step 51, calculating the NTP clock difference L3 of the third stage sent by the second terminal device each time;
[0050] Step 52, comparing the NTP clock difference L3 of the third stage with the three queue values in the queue;
[0051] Step 53, obtaining an average value P of three queue values in the queue;
[0052] Step 54, obtaining a difference C between the NTP clock difference L3 in the third stage and the average value P;
[0053] Step 55, compare the average value P with the difference C. If Replace the queue value that enters the queue earliest with the NTP clock difference value L3 in the third stage;
[0054] Step 56: The minimum queue value in the queue is the standard clock difference.
[0055] Step 7, obtaining the current playback progress of the second terminal device at a preset third time interval;
[0056] Step 71, obtaining a progress difference time A according to the current play progress and the standard clock difference;
[0057] Step 72, adjusting the playback progress according to the progress difference time A;
[0058] Step 73: If the progress difference time A is less than 5 seconds, the playback speed multiplier
[0059] Step 74: If the progress difference time A is greater than or equal to 5 seconds, directly skipping frames is adopted to adjust the current playback progress to the playback progress of the progress difference time A.
[0060] The NTP transaction round trip request specifically includes:
[0061] Determine a request sending timestamp T1 and a request receiving timestamp T2 for issuing a round-trip request for an NTP transaction, and a response sending timestamp T3 and a response receiving timestamp T4 for the round-trip request for the NTP transaction;
[0062] Determine the request delay based on the request sending timestamp T1 and the request receiving timestamp T2;
[0063] Determine the response delay based on the response sending timestamp T3 and the response receiving timestamp T4;
[0064] Based on the request delay and the response delay, calculate the second-stage NTP clock difference t1 between the first terminal device and the second terminal device,
[0065] Among them, in step 2, the preset first time interval is to request once every 50ms, and a total of three requests.
[0066] In step 5, the preset second time interval is that the second terminal device sends a third-phase NTP transaction round-trip request F3 at a frequency of 6000+(discrete value of 25 to 1000) ms.
[0067] Example 2
[0068] On the basis of the above embodiment, the first terminal device is a teacher-side tablet computer, and the second terminal device is a plurality of smart fitness mirrors. The present invention can be live broadcasted within the school, and can also be live broadcasted for designated schools.
[0069] Live broadcast teachers can use live video to explain the key points of teaching, and use smart fitness mirrors to guide students to follow the exercises to complete the live broadcast class. Live broadcast teachers can intuitively understand the data of students participating in the live broadcast school through data, and the live broadcast class is digitized to empower live broadcast teachers.
[0070] The live broadcast teacher uses a tablet computer to start the live broadcast, and then teaches the teaching content online by speaking, and controls the smart fitness mirror of the branch school by operating the tablet computer. The branch school teacher leads the students into the digital sports classroom, divides them into groups, and then leads the students to stand in front of the smart fitness mirror, and then patrols the whole classroom to maintain class discipline. Students are guided by the live broadcast teacher to attend the class.
[0071] The smart fitness mirror has an interactive function. When students sit in front of the camera of the smart fitness mirror and exercise according to the movements in the smart fitness mirror, the camera obtains student information and provides feedback on whether the movements are standard on the smart fitness mirror and the teacher's tablet computer.
[0072] The devices referred to in this application include but are not limited to user devices, network devices, or devices formed by integrating user devices and network devices through a network. The user devices include but are not limited to any mobile electronic products that can interact with users (for example, interact with users through a touchpad), such as smart phones, tablet computers, etc., and the mobile electronic products can use any operating system, such as Android operating system, iOS operating system, etc. Among them, the network device includes an electronic device that can automatically perform numerical calculations and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application-specific integrated circuits, programmable logic devices, field programmable gate arrays, digital signal processors, embedded devices, etc. The network devices include but are not limited to computers, network hosts, single network servers, multiple network server sets or multiple servers. The cloud consists of a large number of computers or network servers based on cloud computing, wherein cloud computing is a type of distributed computing, a virtual supercomputer consisting of a group of loosely coupled computer sets. The network includes but is not limited to the Internet, wide area network, metropolitan area network, local area network, VPN network, wireless self-organizing network (Ad Hoc Network), etc. Preferably, the device may also be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the network device and the touch terminal, or the network device and the touch terminal via a network.
[0073] Example 3
[0074] The present invention provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method and device for live broadcasting of sports teaching based on smart education are implemented.
[0075] The processor may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0076] The memory can be used to store the computer program and / or module, and the processor realizes various functions of a device for obtaining a ranking list in the invention by running or executing the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory can include a high-speed random access memory and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0077] Example 4
[0078] The present invention provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the method and device for live broadcasting of sports teaching based on smart education are implemented.
[0079] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a device or a device or used in combination with it.
[0080] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0081] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A sports teaching live broadcast method based on smart education, characterized in that: The teaching live broadcast method is performed on a first terminal device and a second terminal device, the second terminal device includes at least one interactive terminal, and the method includes: In response to the play instruction issued by the first terminal device, the second terminal device issues a first-stage NTP transaction round-trip request F1 to the cloud NPT service, and obtains the first-stage NTP clock difference L1; the second terminal uses the clock difference L1 as a clock correction value to adjust the instruction execution time; After the second terminal device plays the video, it sends a second-stage NTP transaction round-trip request F2 at a preset frequency, and calculates the second-stage NTP clock difference L2 of the second terminal device; The standard clock difference is obtained according to the NTP clock difference L2 in the second stage; The second terminal device adjusts the playback progress according to the standard clock difference.
2. The method for live sports teaching based on smart education according to claim 1 is characterized in that: When the first terminal device issues a play instruction, a first timestamp is generated; after correcting the NTP clock difference L1 of the first stage, the video is played after delaying the first preset time based on the first timestamp.
3. The method for live sports teaching based on smart education according to claim 2 is characterized in that: The first preset time is 3 seconds.
4. The method for live sports teaching based on smart education according to claim 1 is characterized in that: At the preset frequency, the second phase of the NTP transaction round-trip request F2 is issued, which specifically includes: At a preset first time interval, the second terminal device sends three second-stage NTP transaction round-trip requests F2; The three second-stage NTP clock difference values L21 sent by the second terminal device are calculated, and each time the smallest second-stage NTP clock difference value L2 is taken as the current NTP clock difference value LT.
5. The method for live sports teaching based on smart education according to claim 4 is characterized in that: The standard clock difference is obtained based on the NTP clock difference in the second phase, including: Obtain three second-stage NTP clock difference values L21 of the second terminal device, store them in a queue, and obtain three queue values; At a preset second time interval, the second terminal device sends a third-phase NTP transaction round-trip request F3; Calculate the NTP clock difference L3 of the third stage sent by the second terminal device each time; Compare the NTP clock difference L3 in the third phase with the three queue values in the queue; Update the three queue values in the queue; The standard clock difference is obtained by using the three queue values in the queue.
6. The method for live sports teaching based on smart education according to claim 5 is characterized in that: Update the three queue values in the queue, including: Get the average value P of the three queue values in the queue; Obtain the difference C between the NTP clock difference L3 in the third stage and the average value P; Compare the mean value P with the difference C. If The queue value that enters the queue earliest is replaced with the NTP clock difference L3 in the third stage.
7. The method for live sports teaching based on smart education according to claim 6 is characterized in that: The minimum queue value in a queue is the standard clock difference.
8. The method for live sports teaching based on smart education according to claim 1 is characterized in that: The second terminal device adjusts the playback progress according to the standard clock difference, specifically including: At a preset third time interval, obtaining the current playback progress of the second terminal device; The progress difference time A is obtained according to the difference between the current playback progress and the standard clock; Adjust the playback progress according to the progress difference time A.
9. The method for live sports teaching based on smart education according to claim 1, characterized in that: Adjust the playback progress according to the progress difference time, including: If the progress difference time A is less than 5s, the playback speed multiplier If the progress difference time A is greater than or equal to 5s, direct frame skipping is adopted to adjust the current playback progress to the playback progress of the progress difference time A.
10. A sports teaching live broadcast device based on smart education, characterized in that: The device is used to execute the method according to any one of claims 1 to 9.