Online teaching method, system, device and storage medium based on image superposition

Abstract

The present invention provides an online teaching method, system, device, and storage medium based on image superposition, the method comprising: projecting an original video image onto an imaging medium to form a projection area on the surface of the imaging medium; shooting a live video, defining a frame in the live video as a live video frame, performing portrait image recognition on the live video frame, obtaining a portrait area in the picture to generate a portrait image and partition information of the position of the portrait area in the projection area; editing the portrait area in the picture of the original video image according to the partition information to obtain a projected image frame, replacing the original video image with the projected image frame, and projecting it onto the imaging medium; generating a teaching video, wherein each teaching video frame of the teaching video is formed by aligning and superimposing the projected image frame of each frame in the live video and the portrait image associated with the projected image frame in time sequence according to the partition information. The present invention can improve the viewing experience of students and reduce the promotion cost of online teaching.

Description

Technical Field

[0001] The present invention relates to the field of online education, and in particular to an online teaching method, system, device and storage medium based on image superposition. Background Art

[0002] The rapid development of information technology, particularly the internet and mobile internet, has created ways of living, working, and learning that transcend time and space, fundamentally changing the way knowledge is acquired. Teaching and learning are no longer restricted by time, space, or location, and the channels for acquiring knowledge are flexible and diverse. Online education, also known as e-Learning, or distance education or online learning, generally refers to a type of online learning activity, similar to the concept of online training.

[0003] An online education platform, or online training system, is a software tool for implementing online training and education. It leverages network and software technologies to create a customizable and scalable online distance learning academy. Through easy-to-use courseware and test import and creation capabilities, it helps industries or businesses quickly build their own proprietary knowledge bases. Furthermore, it offers features such as training needs surveys, goal setting, curriculum design, training plan management, training process monitoring, and assessment and evaluation, helping clients efficiently implement employee training and assessment tasks.

[0004] In current online education that requires displaying courseware, the first method is to use expensive electronic screens. The electronic screens display the courseware, and the teachers operate and explain in front of the electronic screens. However, this is expensive, and teachers must conduct courses in professional online classrooms.

[0005] Figure 1 It is a schematic diagram of a whiteboard-based online teaching method in the prior art. Figure 2 This is a schematic diagram of the viewing state of the receiving end of the prior art whiteboard-based online teaching method. Figure 1 and 2 As shown, the second method uses a projection device 110 to project the courseware onto a wall 130. The instructor 120 stands in front of the wall 130, and the camera 100 captures the instructor 120 and the wall 130 to generate a teaching video. This video is then transmitted via a server 2 to the student's mobile phone 3, where the student can view the teaching video screen 31. However, since the instructor 120 stands in front of the wall 130, the courseware projection 32 will inevitably be blocked by the instructor. In the teaching video screen 31, the instructor will be obscured by the courseware projection 32, resulting in a mottled light and shadow pattern mixed with the courseware content. This affects both the student's ability to view the courseware and the instructor, severely disrupting the visual experience of online education.

[0006] Therefore, the present invention provides an online teaching method, system, device and storage medium based on image superposition. Summary of the Invention

[0007] In response to the problems in the prior art, the purpose of the present invention is to provide an online teaching method, system, device and storage medium based on image overlay, which overcomes the difficulties of the prior art and can generate a viewing experience similar to that of a high-cost electronic screen through low-cost projection equipment, thereby improving the students' viewing experience and reducing the promotion cost of online teaching.

[0008] An embodiment of the present invention provides an online teaching method based on image superposition, comprising the following steps: S101, projecting an original video image onto an imaging medium to form a projection area on the surface of the imaging medium;

[0009] S102, shooting a live video, defining a frame in the live video as a live video frame, performing portrait image recognition on the live video frame, obtaining a portrait area in the picture to generate a portrait image and partition information of a position of the portrait area within the projection area;

[0010] S103, editing the portrait area in the original video image according to the partition information to obtain a projected image frame, replacing the original video image with the projected image frame, and projecting the projected image frame onto the imaging medium;

[0011] S104: Generate a teaching video, wherein each teaching video frame of the teaching video is formed by aligning and superimposing the projection image frame of each frame in the live video and the portrait image associated with the projection image frame in time sequence according to the partition information.

[0012] Preferably, in step S101, a teaching image is projected onto a wall by a projection device, and a unique first timestamp is generated for each frame of the teaching image when it is projected.

[0013] Preferably, the step S102 includes the following steps:

[0014] S1021. Shooting a live video frame using an image acquisition device;

[0015] S1022, performing portrait image recognition on the scene video frame;

[0016] S1023, obtaining a portrait area in the picture;

[0017] S1024, obtaining a closed outline of the portrait area;

[0018] S1025, establishing a coordinate system for the scene video frame;

[0019] S1026: Partition information of the coordinate position of the closed contour within the projection area obtained according to the coordinate system.

[0020] Preferably, the portrait area and the partition information are respectively associated with the first timestamp of the image based on a time sequence.

[0021] Preferably, in step S103, the projection image frame is obtained after removing the portrait area in the original video image according to the partition information.

[0022] Preferably, the method for removing the portrait area is any one of the following:

[0023] Deleting the image information corresponding to the portrait area in the original video image according to the partition information;

[0024] Filling the portrait area in the original video image with black according to the partition information; or

[0025] A black pattern is generated according to the range of the portrait area, and the black pattern is superimposed on the portrait area in the original video image.

[0026] Preferably, in step S103, a unique second timestamp is generated for each of the projected image frames when they are projected.

[0027] Preferably, in step S102, a portrait image is generated separately for the portrait area in each frame, and the portrait image is associated with the teaching video frame based on a time sequence according to the second timestamp;

[0028] The step S104 includes: superimposing each frame of the portrait image on top of the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp, and generating the teaching video in sequence according to the time sequence of the second timestamps of the third image.

[0029] Preferably, the teaching video is sent to a receiving end, and the receiving end displays the teaching video.

[0030] Preferably, the step S104 includes the following steps:

[0031] superimposing each frame of the portrait image on top of a projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp;

[0032] Among the n frames of third images corresponding to the n frames of teaching video frames in each of the teaching video segments, one frame of the third image is copied and inserted therein to generate the teaching video.

[0033] Preferably, the third image corresponding to the teaching video is transmitted in real time and displayed on the receiving end.

[0034] Preferably, one frame is selected from the n frames of third images corresponding to the same teaching video clip as a target frame to be copied, and the method of selecting the target frame is one of the following:

[0035] A third image starting from one of the n third images;

[0036] The third image of the last frame among the n frames of third images; and

[0037] The third image with the smallest volume among n frames of third images.

[0038] An embodiment of the present invention further provides an online teaching system based on image superposition, which is used to implement the above-mentioned online teaching method based on image superposition. The online teaching system based on image superposition includes:

[0039] A first projection module projects an original video image onto an imaging medium to form a projection area on a surface of the imaging medium;

[0040] The test partition module shoots a live video, defines a frame in the live video as a live video frame, performs portrait image recognition on the live video frame, obtains the portrait area in the picture to generate a portrait image, and partition information of the position of the portrait area in the projection area;

[0041] a second projection module, which edits the portrait area in the original video image according to the partition information to obtain a projection image frame, replaces the original video image with the projection image frame, and projects the projection image frame onto the imaging medium;

[0042] The video synthesis module generates a teaching video, wherein each teaching video frame of the teaching video is formed by aligning and superimposing the projection image frame of each frame in the live video and the portrait image associated with the projection image frame time sequence according to the partition information.

[0043] An embodiment of the present invention further provides an online teaching device based on image superposition, comprising:

[0044] processor;

[0045] a memory storing executable instructions for the processor;

[0046] The processor is configured to execute the steps of the above-mentioned online teaching method based on image superposition by executing the executable instructions.

[0047] An embodiment of the present invention further provides a computer-readable storage medium for storing a program, which, when executed, implements the steps of the above-mentioned online teaching method based on image superposition.

[0048] The image superposition-based online teaching method, system, device, and storage medium of the present invention can generate a viewing experience similar to that of a high-cost electronic screen through low-cost projection equipment, thereby improving the students' viewing experience and reducing the promotion cost of online teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Other features, objects and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings.

[0050] Figure 1 It is a schematic diagram of a whiteboard-based online teaching method in the prior art.

[0051] Figure 2 This is a schematic diagram of the viewing status of a receiving end of a whiteboard-based online teaching method in the prior art.

[0052] Figure 3 It is a flow chart of the online teaching method based on image superposition of the present invention.

[0053] Figures 4 to 13 It is a schematic diagram of the implementation process of the online teaching method based on image superposition of the present invention.

[0054] Figure 14 It is a schematic diagram of the architecture of the online teaching system based on image superposition of the present invention.

[0055] Figure 15 Schematic diagram of the structure of the online teaching device based on image superposition of the present invention.

[0056] Figure 16 It is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. DETAILED DESCRIPTION

[0057] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. Identical reference numerals in the figures represent identical or similar structures, and thus a repeated description thereof will be omitted.

[0058] Figure 3 Flowchart of the online teaching method based on image superposition of the present invention. Figure 3 As shown, the first online teaching method based on image superposition of the present invention includes the following steps:

[0059] S101 : Projecting an original video image onto an imaging medium to form a projection area on a surface of the imaging medium.

[0060] S102 , shooting a live video, defining a frame in the live video as a live video frame, performing portrait image recognition on the live video frame, obtaining a portrait area in the picture to generate a portrait image and partition information of a position of the portrait area in the projection area.

[0061] S103 , editing the portrait area in the original video image according to the partition information to obtain a projection image frame, replacing the original video image with the projection image frame, and projecting the frame onto an imaging medium.

[0062] S104: Generate a teaching video, where each teaching video frame is formed by aligning and superimposing the projection image frame of each frame in the live video and the portrait image associated with the projection image frame in time sequence according to the partition information.

[0063] The present invention detects the position of the teacher in the video screen and allows the projection of the courseware to fully avoid the teacher for filming. Under the premise that it is not affected by the projection, the interactive actions of the teacher and the courseware are obtained and superimposed with the electronic courseware, thereby forming a visual effect of simulating teaching using an electronic screen. However, since the present invention is only applicable to projection equipment and shooting equipment, the cost is significantly lower and the layout is more flexible. Teachers can use the present invention to conduct online education with high visual experience with students at any place, and are no longer restricted by the location of the online classroom.

[0064] The partition information is used to indicate the specific position of the portrait area in the projection area.

[0065] In a preferred embodiment, in step S101, a teaching image is projected onto a wall by a projection device, and a unique first timestamp is generated for each frame of the teaching image when it is projected.

[0066] In a preferred embodiment, step S102 includes the following steps:

[0067] S1021. Shoot a live video frame using an image acquisition device.

[0068] S1022: Perform portrait image recognition on the scene video frame.

[0069] S1023: Obtain a portrait area in the picture.

[0070] S1024: Obtain a closed contour of the portrait area.

[0071] S1025: Establish a coordinate system for the live video frame.

[0072] S1026 , partition information of the coordinate position of the closed contour in the projection area obtained according to the coordinate system.

[0073] In a preferred embodiment, the portrait area and the partition information are respectively associated with the first timestamp of the image based on a time sequence.

[0074] In a preferred embodiment, in step S103, the projection image frame is obtained by removing the portrait area in the original video image according to the partition information.

[0075] In a preferred embodiment, the method for removing the portrait area is any one of the following:

[0076] The image information corresponding to the portrait area in the original video image is deleted according to the partition information.

[0077] Fill the portrait area in the original video image with black according to the partition information. Or

[0078] A black pattern is generated according to the range of the portrait area, and the black pattern is superimposed on the portrait area in the original video image.

[0079] In a preferred embodiment, in step S103 , a unique second timestamp is generated for each projected image frame when it is projected.

[0080] In a preferred embodiment, in step S102, a portrait image is generated separately from the portrait area in each frame, and the portrait image is associated with the teaching video frame based on a time sequence according to the second timestamp.

[0081] Step S104 includes: superimposing each frame of the portrait image on top of the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp, and sequentially generating the teaching video according to the time sequence of the second timestamps of the third image.

[0082] In a preferred embodiment, the teaching video is sent to a receiving end, and the receiving end displays the teaching video.

[0083] In a preferred embodiment, step S104 includes the following steps:

[0084] Each frame of the portrait image is superimposed on the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp.

[0085] Among the n frames of third images corresponding to the n frames of teaching video frames in each teaching video segment, one frame of the third image is copied and inserted therein to generate a teaching video.

[0086] In a preferred embodiment, the third image corresponding to the teaching video is transmitted in real time and displayed on the receiving end.

[0087] In a preferred embodiment, one frame is selected from n third images corresponding to the same teaching video clip as a target frame to be copied, and the method for selecting the target frame is one of the following:

[0088] The third image of the first frame among the n frames of third images.

[0089] The third image of the last frame among the n frames of third images. And

[0090] The third image with the smallest volume among n frames of third images.

[0091] In order to avoid the situation in which the live video frames shot are not included in the teaching video clips and are not transmitted to the students' receiving end for a long time during the live broadcast, which will cause obvious delays, the method of adding copied target frames is used to ensure that the timing of shooting the instructor is consistent with the timing of the students' receiving end, thus avoiding the occurrence of delays.

[0092] Figures 4 to 13 This is a schematic diagram of the implementation process of the online teaching method based on image superposition of the present invention. Figures 4 to 13 The specific implementation process of the present invention is described in detail.

[0093] like Figure 4 As shown, the present invention uses a projection device 110 to project courseware onto a wall 130. A teacher 120 stands in front of the wall 130 and a camera 100 films the teacher 120 and the wall 130 to generate a teaching video. However, unlike the prior art, the projection device 110 in the present invention does not always project the entire screen, but only projects the entire screen during test frames. When recording teaching video clips, partial projection is performed, avoiding the teacher's body. Finally, the teaching video is transmitted to the student's mobile phone 3 via the server 2, so that the student can watch the screen 36 of the teaching video. Figure 4 、 5 As shown in the timing arrangement P of the projection device 110, at time P1, the projection device 110 projects the first image (see Figure 6 ) is projected onto the imaging medium, and part of the first image is projected onto the teacher, which will cause obvious deformation. In the timing arrangement T of the shooting device 100, at the time T1 corresponding to the time P1, the shooting device 100 shoots a live video frame (see Figure 7 ), and perform portrait image recognition on the live video frame to obtain the portrait area 42 in the picture and the partition information 10 of the position of the portrait area 42 in the projection area. In this embodiment, each moment corresponds to a frame of the picture, which will not be described in detail later.

[0094] like Figure 8As shown, for the projection device 110, at the time P2 to P6 after the time P1, the portrait area in the original video image is filled with black according to the partition information 10 to obtain the projection image frame 11 (see Figure 9 ), which is equivalent to the projection image frame 11 only including the courseware blackboard area except the portrait area. During the time periods P2 to P6 after the P1 moment, the projection device 110 projects the projection image frame 11 frame by frame onto the imaging medium, wherein the image of the portrait area is not projected onto the imaging medium, thereby ensuring that the teacher 120 is not covered by the projected information. For the shooting device 100, during the time periods T2 to T6 after the T1 moment, the shooting device 100 shoots a teaching video clip including 5 teaching video frames. For the teaching video frames (see Figure 10 ) performs portrait image recognition, obtains the portrait region 44 in each frame, and generates the portrait image 12. This is equivalent to subtracting the portrait region corresponding to the instructor 120 from the five frames of the teaching video captured by the camera 100 from time T2 to T6, and generating the portrait image 12 from the partial image representing the instructor 120. The above process is repeated until the projection device 110 completes the subsequent frames P7 to P12. The process is similar to the above process and will not be repeated here.

[0095] refer to Figure 11 , generate a teaching video, each frame of the teaching video is composed of a projection image frame and a portrait image associated with the projection image frame time sequence according to the partition information. Each frame of the portrait image is superimposed on the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp. For example, in the time sequence arrangement N of the teaching video, the first frame N1 is a third image generated by superimposing the projection image frame 11 (P2 moment) and the portrait image 12 (T2 moment) associated with the projection image frame time sequence. Therefore, the third image at time N1 (see Figure 12 ) has the portrait image 33 of the teacher 120 at this moment that is not affected by the projection and the blackboard image 43 of the courseware at this moment. The second frame N2 of the teaching video is a third image generated by superimposing the projection image frame 11 (P3 moment) and the portrait image 12 (T3 moment) associated with the projection image frame time sequence, which will not be described in detail later. Finally, the teaching video is sent to the receiving end, and the receiving end displays the teaching video. After the entire teaching video is recorded, an independent video file can be generated, and this video file can be transmitted to the students for viewing. In the entire teaching video, the teacher himself can see the projection in real time and explain without being disturbed by the projection. The student's receiving end (for example: mobile phone, IPAD) will not have a picture of the teacher being covered by the projection. The overall visual effect is exactly the same as using an expensive and difficult to carry electronic display, but the implementation cost is greatly reduced.

[0096] refer to Figure 13 , providing a use scenario of online education based on real-time live broadcast. In order to meet the synchronization of video timing between teachers and students and avoid the interference of live video frames on timing synchronization, each frame of portrait image can be superimposed on the top of the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp. In each teaching video clip, one frame of the third image corresponding to the n frames of teaching video frames is copied and inserted into it to generate a teaching video. For example Figure 13 In the teaching video, the fifth frame N5, which is the third image generated by superimposing the projected image frame 11 (at time P2) and the portrait image 12 (at time T2), is copied and placed after the fifth frame N5 as the sixth frame N6. This ensures synchronization of the video timing between the instructor and the students. This avoids significant delays caused by the live video frames not being included in the teaching video clips for a long time during the live broadcast.

[0097] Figure 14 Schematic diagram of the architecture of the online teaching system 5 based on image superposition of the present invention. Figure 14 As shown, an embodiment of the present invention further provides an online teaching system 5 based on image superposition, which is used to implement the above-mentioned online teaching method based on image superposition. The online teaching system 5 based on image superposition includes:

[0098] The first projection module 51 projects the original video image onto an imaging medium to form a projection area on the surface of the imaging medium;

[0099] The test partition module 52 shoots a live video, defines a frame in the live video as a live video frame, performs portrait image recognition on the live video frame, obtains the portrait area in the picture, generates a portrait image, and partition information of the position of the portrait area in the projection area;

[0100] The second projection module 53 edits the portrait area in the original video image according to the partition information to obtain a projection image frame, replaces the original video image with the projection image frame, and projects it onto the imaging medium;

[0101] The video synthesis module 54 generates a teaching video. Each teaching video frame is composed of a projection image frame from each live video frame and a portrait image associated with the projection image frame, aligned and superimposed according to the partition information. The first projection module 51 projects the teaching image onto a wall using a projection device. Each frame of the teaching image is projected and generates a unique first timestamp.

[0102] The test partitioning module 52 uses an image acquisition device to shoot a live video frame; performs portrait image recognition on the picture of the live video frame; obtains the portrait area in the picture; obtains the closed contour of the portrait area; establishes a coordinate system for the picture of the live video frame; and obtains partition information of the coordinate position of the closed contour in the projection area based on the coordinate system.

[0103] The portrait area and the partition information are respectively associated with the first timestamp of the image based on a time sequence.

[0104] The second projection module 53 removes the portrait area from the original video image based on the partition information to obtain a projected image frame. The portrait area removal method is any of the following: deleting the image information corresponding to the portrait area in the original video image based on the partition information; filling the portrait area in the original video image with black based on the partition information; or generating a black pattern based on the portrait area and superimposing the black pattern on the portrait area in the original video image. A unique second timestamp is generated for each projected image frame during projection.

[0105] The test partitioning module 52 generates a portrait image for the portrait area in each frame separately, and the portrait image is associated with the teaching video frame based on the time sequence according to the second timestamp.

[0106] The video synthesis module 54 superimposes each frame of the portrait image on the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp, and generates the teaching video in sequence according to the time sequence of the second timestamps of the third image.

[0107] The teaching video is sent to the receiving end, and the receiving end displays the teaching video.

[0108] The video synthesis module 54 superimposes each portrait image frame on top of a projected image frame associated with the same second timestamp, generating a third image associated with the second timestamp. A third image is copied and inserted into the n third images corresponding to the n teaching video frames in each teaching video clip to generate a teaching video. The third image corresponding to the teaching video is transmitted in real time and displayed on the receiving end. One of the n third images corresponding to the same teaching video clip is selected as the target frame to be copied. The target frame is selected by one of the following methods: the third image at the beginning of the n third images; the third image at the end of the n third images; and the third image with the lowest volume among the n third images.

[0109] The online teaching system 5 based on image superposition of the present invention can generate a viewing experience similar to that of a high-cost electronic screen through low-cost projection equipment, thereby improving the viewing experience of students and reducing the promotion cost of online teaching.

[0110] An embodiment of the present invention further provides an online teaching device based on image superposition, comprising a processor and a memory storing executable instructions of the processor. The processor is configured to execute the executable instructions to perform the steps of the online teaching method based on image superposition.

[0111] As shown above, this embodiment can generate a viewing experience similar to that of a high-cost electronic screen through low-cost projection equipment, thereby improving the viewing experience of students and reducing the promotion cost of online teaching.

[0112] Those skilled in the art will appreciate that various aspects of the present invention may be implemented as systems, methods, or program products. Accordingly, various aspects of the present invention may be implemented in the following forms: entirely in hardware, entirely in software (including firmware, microcode, etc.), or in a combination of hardware and software, collectively referred to herein as "circuits," "modules," or "platforms."

[0113] Figure 15 This is a schematic diagram of the structure of the online teaching device based on image superposition of the present invention. Figure 15 An electronic device 600 according to this embodiment of the present invention will be described. Figure 15 The electronic device 600 shown is merely an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0114] like Figure 15 As shown, electronic device 600 is implemented as a general-purpose computing device. Components of electronic device 600 may include, but are not limited to, at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different platform components (including storage unit 620 and processing unit 610), and a display unit 640.

[0115] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps according to various exemplary embodiments of the present invention described in the electronic prescription circulation processing method section of this specification. For example, the processing unit 610 can execute the following steps: Figure 1 Follow the steps shown in .

[0116] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0117] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0118] Bus 630 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0119] The electronic device 600 can also communicate with one or more external devices 700 (e.g., a keyboard, a pointing device, a Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 600, and / or any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., a router, a modem, etc.). Such communication can occur via an input / output (I / O) interface 650. Furthermore, the electronic device 600 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 660. The network adapter 660 can communicate with other modules of the electronic device 600 via the bus 630. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with the electronic device 600, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms.

[0120] An embodiment of the present invention further provides a computer-readable storage medium for storing a program that, when executed, implements the steps of the online teaching method based on image overlay. In some possible implementations, various aspects of the present invention may also be implemented in the form of a program product, which includes program code. When the program product is executed on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above-mentioned electronic prescription circulation processing method section of this specification.

[0121] As shown above, this embodiment can generate a viewing experience similar to that of a high-cost electronic screen through low-cost projection equipment, thereby improving the viewing experience of students and reducing the promotion cost of online teaching.

[0122] Figure 16 Schematic diagram of the structure of the computer readable storage medium of the present invention. Figure 16, a program product 800 for implementing the above method according to an embodiment of the present invention is described. The program product 800 may be a portable compact disc read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0123] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0124] Computer-readable storage media may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.

[0125] The program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0126] In summary, the online teaching method, system, device and storage medium based on image superposition of the present invention can generate a viewing experience similar to that of a high-cost electronic screen through a low-cost projection device, thereby improving the students' viewing experience and reducing the promotion cost of online teaching.

[0127] The above is a further detailed description of the present invention in conjunction with specific preferred embodiments, and the specific implementation of the present invention should not be considered to be limited to these descriptions. For those skilled in the art of the present invention, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should be considered to fall within the scope of protection of the present invention.

Claims

1. An online teaching method based on image superposition, characterized in that: The following steps are involved: S101, projecting an original video image onto an imaging medium to form a projection area on the surface of the imaging medium; S102: Shoot a live video, define a frame in the live video as a live video frame, perform portrait image recognition on the live video frame, obtain a portrait area in the picture to generate a portrait image, and extract a closed contour of the portrait area; establish a coordinate system for the picture of the live video frame; obtain partition information of the coordinate position of the closed contour in the projection area based on the coordinate system, the partition information is used to indicate the specific position of the portrait area in the projection area, and the portrait area and the partition information are respectively associated with the original video image in time sequence; S103, removing the portrait area in the original video image according to the partition information to obtain a projected image frame, replacing the original video image with the projected image frame, and projecting the projected image frame onto the imaging medium; S104: Generate a teaching video, wherein each teaching video frame of the teaching video is formed by aligning and superimposing the projection image frame of each frame in the live video and the portrait image associated with the projection image frame in time sequence according to the partition information.

2. The online teaching method based on image superposition according to claim 1, characterized in that: In S101, a teaching image is projected onto a wall by a projection device, and a unique first timestamp is generated for each frame of the teaching image when it is projected.

3. The online teaching method based on image superposition according to claim 2, characterized in that: The portrait area and the partition information are respectively associated with the first timestamp of the image based on a time sequence.

4. The online teaching method based on image superposition according to claim 1, characterized in that: The method for removing the portrait area is any one of the following: Deleting the image information corresponding to the portrait area in the original video image according to the partition information; Filling the portrait area in the original video image with black according to the partition information; or A black pattern is generated according to the range of the portrait area, and the black pattern is superimposed on the portrait area in the original video image.

5. The online teaching method based on image superposition according to claim 1, characterized in that: In S103 , a unique second timestamp is generated for each of the projected image frames when they are projected.

6. The online teaching method based on image superposition according to claim 5, characterized in that: In S102, a portrait image is generated separately from the portrait area in each frame, and the portrait image is associated with the teaching video frame based on a time sequence according to the second timestamp; The S104 includes: superimposing each frame of the portrait image on top of the projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp, and generating the teaching video in sequence according to the time sequence of the second timestamps of the third image.

7. The online teaching method based on image superposition according to claim 6, characterized in that: The teaching video is sent to a receiving end, and the receiving end displays the teaching video.

8. The online teaching method based on image superposition according to claim 1, characterized in that: The S104 includes the following steps: superimposing each frame of the portrait image on top of a projection image frame associated with the same second timestamp to generate a third image associated with the second timestamp; Among the n frames of third images corresponding to the n frames of teaching video frames in each of the teaching video segments, one frame of the third image is copied and inserted therein to generate the teaching video.

9. The online teaching method based on image superposition according to claim 8, characterized in that: The third image corresponding to the teaching video is transmitted in real time and displayed on the receiving end.

10. The online teaching method based on image superposition according to claim 8, characterized in that: One of the n third images corresponding to the same teaching video clip is selected as a target frame to be copied, and the method of selecting the target frame is one of the following: A third image starting from one of the n third images; The third image of the last frame among the n frames of third images; and The third image with the smallest volume among n frames of third images.

11. An online teaching system based on image superposition, used to implement the online teaching method based on image superposition according to claim 1, characterized in that: include: A first projection module projects an original video image onto an imaging medium to form a projection area on a surface of the imaging medium; The test partition module captures a live video, defines a frame in the live video as a live video frame, performs portrait image recognition on the live video frame, obtains a portrait area in the picture to generate a portrait image, and extracts a closed contour of the portrait area; establishes a coordinate system for the picture of the live video frame; obtains partition information of the coordinate position of the closed contour in the projection area based on the coordinate system, the partition information is used to indicate the specific position of the portrait area in the projection area, and the portrait area and the partition information are respectively associated with the original video image in time sequence; a second projection module, which removes the portrait area in the original video image according to the partition information to obtain a projection image frame, replaces the original video image with the projection image frame, and projects the projection image frame onto the imaging medium; The video synthesis module generates a teaching video, wherein each teaching video frame of the teaching video is formed by aligning and superimposing the projection image frame of each frame in the live video and the portrait image associated with the projection image frame time sequence according to the partition information.

12. An online teaching device based on image superposition, characterized in that: include: processor; a memory storing executable instructions for the processor; The processor is configured to execute the steps of the online teaching method based on image overlay according to any one of claims 1 to 10 by executing the executable instructions.

13. A computer-readable storage medium for storing a program, characterized in that: When the program is executed, the steps of the online teaching method based on image superposition according to any one of claims 1 to 10 are implemented.

Images