A method for constructing cross-device simulation teaching scenarios based on cloud rendering

Abstract

This invention relates to the field of electronic digital data transmission technology, specifically to a method for constructing a cross-device simulated teaching scenario based on cloud rendering. The method includes the following steps: setting up a data transmission channel in a wireless network, with devices interconnected through this channel; uploading teaching scenario image data, decomposing the image data to obtain image frames, constructing a database, and receiving and storing the frames present in the decomposed image data. This invention can obtain image frames from the uploaded teaching scenario image data and further construct a virtual scene for the teacher during online teaching using these frames. Furthermore, it uses a three-dimensional coordinate system, the center of the three-dimensional coordinate system, and the teacher's position to switch between virtual scenes, making the virtual teaching scenario constructed by this method more realistic and providing a better learning experience for teachers and students during online teaching.

Description

Technical Field

[0001] This invention relates to the field of electronic digital data transmission technology, and specifically to a method for constructing a cross-device simulation teaching scenario based on cloud rendering. Background Technology

[0002] Online courses are online courses taught via the internet using electronic devices. Unlike in-person classroom teaching, online courses offer advantages such as diverse learning methods, flexibility, and convenience, and are increasingly being used by students and parents.

[0003] Currently, when online courses are conducted, the background environment in which the instructor is located often affects the audiovisual experience. Some students are attracted by the background environment captured by the instructor's camera during the lecture, resulting in a lack of concentration. To address this, some online course instructors set up a screen or use obstructions to block the background at the beginning of the course. While this method can prevent students' attention from being drawn to the instructor's background, it also reduces the students' audiovisual experience during the online learning process, making them feel less immersed and like they are in a classroom. Summary of the Invention

[0004] In view of the above-mentioned shortcomings of the existing technology, the present invention provides a method for constructing a cross-device simulation teaching scenario based on cloud rendering, which solves the technical problems mentioned in the background.

[0005] To achieve the above objectives, the present invention provides the following technical solution:

[0006] A method for constructing a cross-device simulation teaching scenario based on cloud rendering includes the following steps:

[0007] Step 1: Set up a data transmission channel in the wireless network, and the devices will connect to each other through the set data transmission channel;

[0008] Step 2: Upload teaching scene video data, decompose the video data to obtain video frames, build a database, and receive and store the video frames in the decomposed video data.

[0009] Step 3: Configure a three-dimensional coordinate system on the teaching scene image data, obtain the image data frames obtained in Step 2, and configure the three-dimensional coordinate system with the image data frames.

[0010] Step 4: Receive the mutually configured 3D coordinate system and image frame data, use the center point of the 3D coordinate system as a reference point, identify the orientation of each frame, and further configure the orientation of the frames with the mutually configured 3D coordinate system and image frame data.

[0011] Step 5: Capture dynamic targets, confirm the spatial coordinates and orientation of the initial position of the dynamic target in the three-dimensional coordinate system, obtain the position information and orientation of the dynamic target in real time, drive the database to receive the obtained position information and orientation of the dynamic target in real time, and configure the frame according to the position information and orientation of the dynamic target.

[0012] Step 6: Synchronously acquire dynamic target audio data, and send the video frames configured in real time in Step 5, along with the audio data, to the receiving device of the simulation teaching scene through the data transmission channel set in Step 1.

[0013] Furthermore, the database constructed in step 2 is set on the receiving device of the simulation teaching scenario, and the receiving device of the simulation teaching scenario is in an offline state by default. Each time step 1 is executed, the data transmission channel set in step 1 is further connected to the database set on the receiving device of the simulation teaching scenario.

[0014] Furthermore, in step 2, the decomposition operation of the teaching video data is performed to obtain the frame using the following formula:

[0015]

[0016] In the formula, D i (x, y) is the scaling function for the decomposition of the teaching scene image data frames; λ i is the weight parameter for calculating the distance between the frame markers in the i-th run of the formula; n is the number of markers in the teaching video data; F(x,y) is the obtained frame containing the marker (x,y); i is the formula run count.

[0017] Furthermore, in step 3, the accuracy of the three-dimensional coordinate system configured for the teaching scene image data is 1m. 3 In step 3, the mutual configuration of the three-dimensional coordinate system and the image data frame is completed manually by the user.

[0018] Furthermore, step 3 and step 4 are further subdivided into sub-steps, including the following steps:

[0019] Step 41: The data configured in Step 3 is sent to the database built in Step 2 in real time, so that the data configured in the database iterates over the corresponding frame data originally stored in the database.

[0020] When step 3 is executed, step 41 is further executed; when step 4 is executed, step 41 is executed again, using the data configured in step 4 as the processing target to complete the iteration of the data stored in the database.

[0021] Furthermore, in step 4, the acquisition frequency of the real-time dynamic target's position information and orientation is set manually by the system user, with the initial acquisition frequency set to 0.05 to 0.3 seconds per acquisition.

[0022] Furthermore, in step 5, when capturing a dynamic target, the real-time position of the dynamic target is corrected using the following formula:

[0023]

[0024] In the formula: q u For dynamic target picking points; n is an image containing dynamic targets with a total of n pixels; u is the pixel position deviation corresponding to the initial information of the dynamic target; x ε ε represents the offset distance of the pixel corresponding to the ε-th dynamic target pickup point; c represents the color level of the image histogram; and δ represents the unit impulse function.

[0025] Furthermore, in step 6, when transmitting video frames and audio data through the data transmission channel, the timestamp of the teaching scene image data corresponding to the video frame and the current timestamp of the receiving end of the simulated teaching scene are read simultaneously. The user terminal sets a judgment threshold to determine whether the difference between the two sets of timestamps is within the judgment threshold range. If the judgment result is yes, a playback delay is further set to delay the playback of the received video frames and audio data. If the judgment result is no, video frames and audio data are received in real time, and the video frames and audio data are stored. After the reception is completed, the video frames and audio data are read.

[0026] Furthermore, step 6 has sub-steps, including the following steps:

[0027] Step 61: Collect spatial image data of the current location of the dynamic target, set the activity area of ​​the dynamic target in the spatial image data, and send the set dynamic target activity area to the simulation teaching scene sending device held by the dynamic target.

[0028] Furthermore, when step 61 is executed, the simulation teaching scene transmitting device monitors the dynamic target's reading status of the set dynamic target activity area in real time. After the dynamic target reads the dynamic target activity area on the simulation teaching scene transmitting device, it provides the dynamic target with the permission to operate the simulation teaching scene transmitting device to send screen frames and audio data.

[0029] Compared with known public technologies, the technical solution provided by this invention has the following beneficial effects:

[0030] 1. This invention provides a method for constructing a cross-device simulated teaching scene based on cloud rendering. By executing the steps in this method, frame images can be obtained from the uploaded teaching scene image data, and then the virtual scene of the teacher starting online teaching can be constructed using the frame images. Furthermore, the virtual scene can be switched using a three-dimensional coordinate system, the center of the three-dimensional coordinate system, and the teacher's position. This makes the virtual teaching scene constructed by this method more realistic and brings a better learning experience to teachers and students during online teaching.

[0031] 2. In the process of executing the steps of the method of the present invention, while configuring the teacher's audio data in the virtual scene, it can also limit the range of activities of the teacher in the virtual teaching scene constructed by the method, thereby effectively avoiding the problem of teacher image clipping in the virtual teaching scene, making the application of the virtual teaching scene more perfect and the students' visual experience of the virtual teaching scene better.

[0032] 3. In the process of executing its steps, the method of the present invention can also store the constructed virtual teaching scenario so that the virtual teaching scenario can be reused and can serve different teachers, thereby making the method more applicable and bringing more convenience to teachers in the process of conducting online courses. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0034] Figure 1 This is a flowchart illustrating a method for constructing a cross-device simulation teaching scenario based on cloud rendering. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0036] The present invention will be further described below with reference to embodiments.

[0037] Example 1

[0038] This embodiment presents a method for constructing a cross-device simulation teaching scenario based on cloud rendering, such as... Figure 1 As shown, it includes the following steps:

[0039] Step 1: Set up a data transmission channel in the wireless network, and the devices will connect to each other through the set data transmission channel;

[0040] Step 2: Upload teaching scene video data, decompose the video data to obtain video frames, build a database, and receive and store the video frames in the decomposed video data.

[0041] Step 3: Configure a three-dimensional coordinate system on the teaching scene image data, obtain the image data frames obtained in Step 2, and configure the three-dimensional coordinate system with the image data frames.

[0042] Step 4: Receive the mutually configured 3D coordinate system and image frame data, use the center point of the 3D coordinate system as a reference point, identify the orientation of each frame, and further configure the orientation of the frames with the mutually configured 3D coordinate system and image frame data.

[0043] Step 5: Capture dynamic targets, confirm the spatial coordinates and orientation of the initial position of the dynamic target in the three-dimensional coordinate system, obtain the position information and orientation of the dynamic target in real time, drive the database to receive the obtained position information and orientation of the dynamic target in real time, and configure the frame according to the position information and orientation of the dynamic target.

[0044] Step 6: Synchronously acquire dynamic target audio data, and send the real-time configured frame and audio data from Step 5 together to the receiving device of the simulation teaching scene through the data transmission channel set in Step 1.

[0045] Step 3 and Step 4 have sub-steps, including the following steps:

[0046] Step 41: The data configured in Step 3 is sent to the database built in Step 2 in real time, so that the data configured in the database iterates over the corresponding frame data originally stored in the database.

[0047] When step 3 is executed, step 41 is executed further, and when step 4 is executed, step 41 is executed again. The data configured in step 4 is used as the processing target to complete the iteration of the data stored in the database.

[0048] Step 6 has sub-steps, including the following steps:

[0049] Step 61: Collect spatial image data of the current location of the dynamic target, set the activity area of ​​the dynamic target in the spatial image data, and send the set dynamic target activity area to the simulation teaching scene sending device held by the dynamic target.

[0050] In this embodiment, based on the implementation of embodiment 1, by further executing step 41, the image frames in the image data used to construct the simulated teaching scene can be stored, thereby providing data support for the subsequent steps in the method and enabling the image frames to be reused.

[0051] Furthermore, through the further settings in step 61, the activity area of ​​the teacher and the simulated teaching scene is further defined, thereby ensuring that the teacher moves within the designated area of ​​the simulated teaching scene, thus minimizing the possibility of the teacher clipping through the simulation or moving out of the simulated teaching scene while running in the simulated teaching scene.

[0052] Example 2

[0053] At the implementation level, based on Example 1, this example refers to... Figure 1 The following provides a further detailed explanation of the method for constructing a cross-device simulation teaching scenario based on cloud rendering in Example 1:

[0054] The database constructed in step 2 is set on the receiving device of the simulation teaching scenario, and the receiving device of the simulation teaching scenario is in an offline state by default. Each time step 1 is executed, the data transmission channel set in step 1 is further connected to the database set on the receiving device of the simulation teaching scenario.

[0055] like Figure 1 As shown, the decomposition operation of the teaching video data in step 2 is performed by calculating and obtaining the frame using the following formula:

[0056]

[0057] In the formula, D i (x, y) is the scaling function for the decomposition of the teaching scene image data frames; λ i is the weight parameter for calculating the distance between the frame markers in the i-th run of the formula; n is the number of markers in the teaching video data; F(x,y) is the obtained frame containing the marker (x,y); i is the formula run count.

[0058] The above formula provides accurate frame decomposition processing for teaching scene image data, so that the method has sufficient data to realize the construction of simulated teaching scene teaching when it performs its steps.

[0059] like Figure 1As shown, in step 3, the accuracy of the three-dimensional coordinate system configured for the teaching scene image data is 1m. 3 In step 3, the mutual configuration of the three-dimensional coordinate system and the image data frame is completed manually by the user.

[0060] like Figure 1 As shown, the acquisition frequency of the location information and orientation of the dynamic target in real time in step 4 is set manually by the user on the system side, and the initial acquisition frequency is set to 0.05~0.3s / time.

[0061] like Figure 1 As shown, in step 5, when capturing a moving target, the real-time position of the moving target is corrected using the following formula:

[0062]

[0063] In the formula: q u For dynamic target picking points; n is an image containing dynamic targets with a total of n pixels; u is the pixel position deviation corresponding to the initial information of the dynamic target; x ε ε represents the offset distance of the pixel corresponding to the ε-th dynamic target pickup point; c represents the color level of the image histogram; and δ represents the unit impulse function.

[0064] The above formula can be used to capture the real-time position of dynamic targets in the simulated teaching scenario, namely, the teacher. This allows for real-time switching of the teacher's frame in the simulated teaching scenario, resulting in better adaptation between the frame and the teacher's image data in the simulated teaching scenario.

[0065] Example 3

[0066] At the implementation level, based on Example 1, this example refers to... Figure 1 The following provides a further detailed explanation of the method for constructing a cross-device simulation teaching scenario based on cloud rendering in Example 1:

[0067] Step 6: When transmitting video frames and audio data through the data transmission channel, the timestamp of the teaching scene image data corresponding to the video frame and the current timestamp of the receiving end of the simulated teaching scene are read synchronously. The user end sets a judgment threshold to determine whether the difference between the two sets of timestamps is within the judgment threshold range. If the judgment result is yes, the playback delay is further set to delay the playback of the received video frames and audio data. If the judgment result is no, the video frames and audio data are received in real time, stored, and read after the reception is completed.

[0068] like Figure 1As shown, during step 61, the simulation teaching scenario transmitting device monitors the dynamic target's reading status of the set dynamic target activity area in real time. After the dynamic target reads the dynamic target activity area on the simulation teaching scenario transmitting device, it grants the dynamic target the permission to operate the simulation teaching scenario transmitting device to send screen frames and audio data.

[0069] In summary, the method described in the above embodiments can acquire frame images from uploaded teaching scene image data, and further construct a virtual scene of the teacher starting online teaching based on these frame images. Furthermore, it uses a three-dimensional coordinate system, the center of the three-dimensional coordinate system, and the teacher's position to switch between virtual scenes, making the virtual teaching scene constructed by this method more relevant and providing a better learning experience for both teachers and students during online teaching. Moreover, during the execution of its steps, while configuring the teacher's audio data for the virtual scene, the method can also limit the teacher's activity range within the constructed virtual teaching scene, effectively avoiding the problem of teacher image clipping in the virtual teaching scene. This makes the application of the virtual teaching scene more complete and provides students with a better visual experience. Simultaneously, the method can also store the constructed virtual teaching scene for reuse and to serve different teachers, thus improving its applicability and bringing more convenience to teachers during online courses.

[0070] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for constructing a cross-device simulation teaching scenario based on cloud rendering, characterized in that, Includes the following steps: Step 1: Set up a data transmission channel in the wireless network, and the devices will connect to each other through the set data transmission channel; Step 2: Upload teaching scene video data, decompose the video data to obtain video data frames, build a database, receive and store the video data frames contained in the decomposed video data; the video data frames are used to construct the virtual scene of the teacher in the process of starting online teaching. Step 3: Configure a three-dimensional coordinate system on the teaching scene image data, obtain the image data frames obtained in Step 2, and configure the three-dimensional coordinate system with the image data frames. Step 4: Receive the mutually configured 3D coordinate system and image data frame data, use the center point of the 3D coordinate system as the reference point, identify the orientation of each image data frame, and further configure the orientation of the image data frame with the mutually configured 3D coordinate system and image data frame data. Step 5: Capture dynamic targets, confirm the spatial coordinates and orientation of the initial position of the dynamic target in the three-dimensional coordinate system, acquire the position information and orientation of the dynamic target in real time, drive the database to receive the acquired position information and orientation of the dynamic target in real time, and configure the image data frame according to the position information and orientation of the dynamic target. Step 6: Synchronously acquire dynamic target audio data, and send the video data frames configured in real time in Step 5, along with the audio data, to the receiving device of the simulation teaching scene through the data transmission channel set in Step 1.

2. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, The database constructed in step 2 is set on the receiving device of the simulation teaching scenario, and the receiving device of the simulation teaching scenario is in an offline state by default. Each time step 1 is executed, the data transmission channel set in step 1 is further connected to the database set on the receiving device of the simulation teaching scenario.

3. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, In step 2, the decomposition of the teaching video data is performed to obtain the video data frames using the following formula: ； In the formula, The scaling function for decomposing image data frames in teaching scenarios; is the weighting parameter used to calculate the distance between the frame markers in the image data during the i-th run of the formula; n is the number of markers contained in the teaching image data; To obtain the points containing the markers Image data frames; i is the formula execution count.

4. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, In step 3, the accuracy of the three-dimensional coordinate system configured for the teaching scene image data is 1m³. When step 3 is executed, the mutual configuration of the three-dimensional coordinate system and the image data frame is completed manually by the user.

5. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, Step 4 has sub-steps, including the following steps: Step 41: The data configured in Step 3 is sent to the database built in Step 2 in real time, so that the data configured in the database iterates over the corresponding image frame data originally stored in the database. When step 3 is executed, step 41 is further executed; when step 4 is executed, step 41 is executed again, using the data configured in step 4 as the processing target to complete the iteration of the data stored in the database.

6. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, In step 4, the acquisition frequency of the location information and orientation of the dynamic target in real time is set manually by the user on the system side, and the initial acquisition frequency is set to 0.05~0.3s / time.

7. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, In step 5, when capturing a dynamic target, the real-time position of the dynamic target is corrected using the following formula: ； In the formula: is the dynamic target pickup point; n is the image containing the dynamic target with a total of n pixels; u is the pixel position deviation corresponding to the initial information of the dynamic target; For the first The offset distance of each pixel corresponding to a dynamic target pickup point; c is the color level of the image histogram; It is a unit impulse function.

8. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, In step 6, when transmitting image data frames and audio data through the data transmission channel, the timestamp of the teaching scene image data corresponding to the image data frame and the current timestamp of the simulated teaching scene receiver are read simultaneously. The user terminal sets a judgment threshold to determine whether the difference between the two sets of timestamps is within the judgment threshold range. If the judgment result is yes, a playback delay is further set to delay the playback of the received image data frames and audio data. If the judgment result is no, the image data frames and audio data are received in real time, stored, and read after the reception is completed.

9. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 1, characterized in that, Step 6 has sub-steps, including the following steps: Step 61: Collect spatial image data of the current location of the dynamic target, set the activity area of ​​the dynamic target in the spatial image data, and send the set dynamic target activity area to the simulation teaching scene sending device held by the dynamic target.

10. The method for constructing a cross-device simulation teaching scenario based on cloud rendering according to claim 9, characterized in that, When step 61 is executed, the simulation teaching scene transmitting device monitors the dynamic target's reading status of the set dynamic target activity area in real time. After the dynamic target reads the dynamic target activity area on the simulation teaching scene transmitting device, it provides the dynamic target with the permission to operate the simulation teaching scene transmitting device to send image data frames and audio data.

Images