Interactive teaching system

Abstract

The invention relates to the technical field of online education and entrepreneurship guidance, and discloses an interactive teaching system, and the system comprises a teacher end which is used for initiating teaching live broadcast through a cloud end; the student live broadcast end is used for receiving the teaching live broadcast from the cloud end and displaying the teaching live broadcast according to the teaching live broadcast; the trainee operation end is used for displaying the sandbox environment instance through the cloud end to obtain a trainee interface and obtaining trainee operation data according to the trainee interface, and the trainee operation data is used for updating the sandbox environment instance; and the assistance end is also used for displaying an interface picture of the sandbox environment instance in a read-only mode to obtain an assistance interface, or accessing the sandbox environment instance through the cloud end in an assistance mode and displaying the sandbox environment instance through the cloud end to obtain the assistance interface. Therefore, interactive teaching experience of environment instant use, real-time visual operation and remote safety assistance integration is realized.

Description

Technical Field

[0001] This invention relates to the fields of online education and entrepreneurship guidance, and in particular to an interactive teaching system. Background Technology

[0002] Traditional online education often employs a "live streaming + pre-recorded video" model, where teachers provide one-way lectures and students passively watch, lacking real-time interaction and hands-on practice. This is especially problematic in courses requiring practical application, such as programming and artificial intelligence. Students need to install complex software environments locally, a process that is cumbersome and prone to errors; teachers cannot monitor students' progress in real time, making timely guidance difficult; and if assistance is provided through traditional remote tools, granting access to students' local systems poses information security risks. Therefore, current technologies struggle to achieve an interactive teaching experience that integrates a ready-to-use environment, real-time visual operation, and secure remote assistance. Summary of the Invention

[0003] Based on this, it is necessary to address the technical problem that existing technologies cannot achieve an interactive teaching experience that integrates immediate use of the environment, real-time visual operation, and remote security assistance. Therefore, an interactive teaching system is proposed.

[0004] This application provides an interactive teaching system, the system comprising: Cloud; The teacher's end is used to initiate live teaching sessions via the cloud platform; The student live streaming terminal is used to receive the teaching live stream from the cloud and display it according to the teaching live stream; The student operation terminal is used to display the sandbox environment instance through the cloud, obtain the student interface, and obtain student operation data based on the student interface, wherein the student operation data is used to update the sandbox environment instance. The assistance terminal is also used to display the interface screen of the sandbox environment instance in read-only mode to obtain an assistance interface, or to access the sandbox environment instance through the cloud in assistance mode and display the sandbox environment instance through the cloud to obtain an assistance interface.

[0005] Furthermore, the cloud platform includes a cloud desk cluster and a backend management cluster. Each cloud desk in the cloud desk cluster is a sandbox environment instance, and each cloud desk in the cloud desk cluster is connected to one of the student operation terminals. The backend management cluster communicates with the cloud desk cluster, the teacher terminal, the student live streaming terminal, the student operation terminal, and the assistant terminal, respectively. The cloud desk cluster communicates with the assistant terminal and the student operation terminal, respectively.

[0006] Furthermore, the sandbox environment instance includes a screen synchronization proxy; The screen synchronization agent is used to capture the screen of the student interface to generate monitoring data and synchronize the monitoring data to the cloud desk cluster. The assistance terminal is used to obtain the monitoring data through the cloud desk cluster and display the monitoring data to obtain the assistance interface.

[0007] Furthermore, the assistance terminal is also used to send assistance instructions to the cloud, or the student operation terminal is also used to send assistance instructions to the cloud; The cloud platform is used to respond to the assistance command and update the remote mode to assistance mode; The assistance terminal is also used to obtain teacher operation data according to the assistance interface when the remote mode is assistance mode, wherein the teacher operation data is used to update the sandbox environment instance. The assist terminal is also used to send an end command to the cloud, or the student operation terminal is also used to send an end command to the cloud; The cloud platform is used to respond to the end command and control the assistance terminal to stop executing the step of obtaining teacher operation data based on the assistance interface.

[0008] Furthermore, the student operating terminal is used to display a sandbox environment instance through the cloud, obtaining a student interface, including: Obtain student identity information, perform login verification based on the student identity information, and obtain the verification result; When the verification result is successful, the course information is obtained based on the student's identity information and used as the target course information; The student interface is obtained by displaying a sandbox environment instance corresponding to the target course information through the cloud.

[0009] Furthermore, the cloud is also used to load a Windows virtual machine image corresponding to the target course information to generate an independent instance corresponding to the student's identity information, and to use the independent instance as the sandbox environment instance; The student's operating terminal establishes and maintains a remote connection with the sandbox environment instance in the cloud for display, thereby obtaining the student's interface.

[0010] Furthermore, the student live streaming terminal is also used to acquire student interaction data and send the student interaction data to the cloud, wherein the student interaction data includes audio or video. The teacher's end is also used to obtain and display the student interaction data from the cloud.

[0011] Furthermore, the cloud is also used to obtain a get out of class termination instruction from the student's live streaming terminal or the teacher's terminal, and to obtain the course mode based on the student's identity information in the get out of class termination instruction; The cloud is also used to generate backup data based on the sandbox environment instance when the course mode is exclusive, and to destroy or reset the sandbox environment instance when the course mode is shared. The student interface is used to display a sandbox environment instance through the cloud to obtain a student interface, including: when the course mode is exclusive, displaying a sandbox environment instance through the cloud based on the backup data to obtain the student interface; and when the course mode is shared, displaying an initialized sandbox environment instance through the cloud to obtain the student interface.

[0012] Furthermore, the cloud desk cluster communicates with the student's operating terminal via VNC protocol or WebSocket + custom protocol; The cloud desk cluster communicates with the assisting terminal via VNC protocol or WebSocket + custom protocol; The live teaching communication between the student's live streaming client and the cloud is conducted via the WebRTC / RTMP protocol, and the login verification between the student's live streaming client and the cloud is conducted via the HTTP protocol and the JSON communication protocol. The live teaching session between the teacher's client and the cloud is conducted via the WebRTC / RTMP protocol, and the login verification between the teacher's client and the cloud is conducted via the HTTP and JSON communication protocols.

[0013] Furthermore, the teacher's end, the backend management cluster, and the student live streaming end use a first data channel for data transmission, while the student operation end, the cloud desk cluster, and the assistance end use a second data channel for data transmission. The first data channel and the second data channel are set up independently.

[0014] Furthermore, the student operating terminal is also used to acquire student query data, match answer data with the question-and-answer knowledge base built into the student operating terminal to obtain target data, and display the target data. The answer data includes one or more of answer text, answer audio, and answer video, and the answer data is pre-generated and stored in the question-and-answer knowledge base.

[0015] Furthermore, the teacher's end is also used to initiate sharing commands to the cloud desk cluster; The cloud desk cluster is also used to generate sharing data based on the sandbox environment instance corresponding to the sharing instruction, and send the sharing data to the backend management cluster. The backend management cluster is also used to send the shared data to the student's live streaming terminal; The student live streaming terminal is also used to display the backend management cluster based on the shared data, and is also used to package the teaching live stream initiated by the teacher terminal and the shared data to obtain the updated teaching live stream; The student live-streaming terminal is also used to display the teaching live stream initiated by the teacher and the shared data based on the updated teaching live stream.

[0016] Furthermore, the assisting terminal is also used to acquire a read-only switching instruction and send the read-only switching instruction to the cloud; The student operating terminal is also used to obtain the read-only switching instruction from the cloud, and stop obtaining the student operation data from the student interface according to the read-only switching instruction.

[0017] Furthermore, the student live-streaming terminal is also used to obtain a first screenshot command, capture the screen of the teaching live stream displayed on the student live-streaming terminal according to the first screenshot command, obtain a first image, and store the first image in a first library; and / or, The student's operating terminal is also used to obtain a second screenshot command, capture the screen of the student's interface according to the second screenshot command, obtain a second image, and store the second image in a second library.

[0018] Furthermore, the live teaching session comprises live data containing explanations of business theory and demonstrations of practical projects; the sandbox environment instance is a virtual machine instance containing the software environment and data templates required for entrepreneurial simulation, so that the interactive teaching system is suitable for entrepreneurial guidance services; and / or, The live teaching session is live data containing programming instruction and project demonstrations. The sandbox environment instance is a virtual machine instance containing the software environment and data templates required for programming instruction, so that the interactive teaching system is suitable for programming instruction services; and / or, The live teaching session is live data containing corporate training lectures and project demonstrations. The sandbox environment instance is a virtual machine instance of the software environment and data templates required for corporate training, so that the interactive teaching system can be used for corporate training services.

[0019] The interactive teaching system of this application includes a teacher's end for initiating live teaching via the cloud, a student's end for receiving the live teaching from the cloud and displaying it, and a student's operation end for displaying a sandbox environment instance via the cloud to obtain a student interface and obtaining student operation data based on the student interface. The student operation data is used to update the sandbox environment instance. The teacher's end is also used to display the interface of the sandbox environment instance in read-only mode to obtain an assistance interface, or to access the sandbox environment instance via the cloud in assistance mode and display it via the cloud to obtain an assistance interface. First, this application achieves a ready-to-use teaching environment by constructing and distributing sandbox environment instances to both student and teacher terminals, resolving the issue of complex environment configuration for student devices. Second, through read-only access to the sandbox environment instance by the assistant terminal, real-time, low-latency visual monitoring of the student interface on the live streaming terminal is achieved, resolving the problem of not being able to fully perceive the teaching status. Third, further, by allowing teachers to directly operate the same sandbox environment instance in assistance mode, secure, consistent, and efficient remote interactive assistance is achieved within the cloud environment, resolving the security risks and environmental differences inherent in traditional remote control. The synergistic effect of the first, second, and third points ultimately realizes an interactive teaching experience that integrates a ready-to-use environment, real-time visual operation, and secure remote assistance. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] in: Figure 1 This is a block diagram of an interactive teaching system in one embodiment; Figure 2 This is a scene simulation diagram of the interactive teaching system of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] Please see Figure 1This application provides an interactive teaching system, the system comprising: Cloud 1; Teacher terminal 2 is used to initiate live teaching sessions via the cloud platform 1; Student live streaming terminal 3 is used to receive the teaching live stream from the cloud 1 and display it according to the teaching live stream; The student operation terminal 4 is used to display the sandbox environment instance through the cloud 1, obtain the student interface, and obtain student operation data based on the student interface, wherein the student operation data is used to update the sandbox environment instance. The assistance terminal 5 is also used to display the interface screen of the sandbox environment instance in read-only mode to obtain the assistance interface, or to access the sandbox environment instance through the cloud 1 in assistance mode and display the sandbox environment instance through the cloud 1 to obtain the assistance interface.

[0024] In this embodiment of the interactive teaching system, the teacher terminal 2 is used to initiate a live teaching session through the cloud 1, the student live streaming terminal 3 is used to receive the live teaching session from the cloud 1 and display it accordingly, the student operation terminal 4 is used to display a sandbox environment instance through the cloud 1 to obtain a student interface, and obtain student operation data based on the student interface, wherein the student operation data is used to update the sandbox environment instance, and the assistance terminal 5 is also used to display the interface screen of the sandbox environment instance in read-only mode to obtain an assistance interface, or to access the sandbox environment instance through the cloud 1 in assistance mode and display the sandbox environment instance through the cloud 1 to obtain an assistance interface. First, this application achieves a ready-to-use teaching environment by constructing and distributing a sandbox environment instance to the student operating terminal 4 and the teacher terminal 2, thus solving the problem of complex environment configuration for student devices. Second, through read-only access to the sandbox environment instance by the assistance terminal 5, real-time, low-latency visual monitoring of the student interface on the student live streaming terminal 3 is achieved, solving the problem of the inability to fully perceive the teaching status. Third, further, by allowing the teacher terminal 2 to directly operate the same sandbox environment instance in assistance mode, secure, consistent, and efficient remote interactive assistance is achieved within the cloud environment 1, solving the security risks and environmental differences inherent in traditional remote control. The synergistic effect of the first, second, and third steps ultimately realizes an interactive teaching experience that integrates a ready-to-use environment, real-time visual operation, and secure remote assistance.

[0025] Cloud 1: In this system, Cloud 1 serves as the core hub and resource pool, responsible for coordinating data exchange and command transmission between Teacher Terminal 2, Student Live Stream Terminal 3, and Student Operation Terminal 4, and providing computing and storage resources. Specifically, it receives and forwards the teaching live stream initiated by Teacher Terminal 2 to Student Live Stream Terminal 3, and is also responsible for creating, managing, and providing an independent sandbox environment instance for each student. Cloud 1 ensures centralized control of the teaching process and flexible allocation of resources.

[0026] Teacher-side 2: This refers to the client application running on the teacher's terminal device (such as a computer). Its main function is to act as the teaching initiation and control center: it initiates and pushes live teaching content to all students through the cloud 1.

[0027] Assistance Terminal 5: It can access the sandbox environment instance corresponding to the student based on a specific permission mode (read-only or assistance), thereby enabling real-time viewing of the student's interface or remote interactive operations when necessary.

[0028] Optionally, both the teacher client 2 and the assistant client 5 are independent clients.

[0029] Optionally, the teacher's side 2 and the assistant's side 5 can be integrated into the same client.

[0030] Student Live Streaming Terminal 3: This refers to the client application running on the student's terminal device (such as a computer or tablet). Its core function is to receive and present live teaching content initiated by Teacher Terminal 2 and forwarded by the cloud 1, enabling students to watch the teacher's explanations and demonstrations synchronously. Student Live Streaming Terminal 3 is the main interface for students to receive theoretical lecture content.

[0031] Student Terminal 4: This is a virtualized operating environment client provided to each student, running on or closely integrated with Cloud 1. It is not a simple display terminal, but rather responsible for rendering and displaying a pre-configured sandbox environment instance (such as a Windows virtual machine containing specific software) corresponding to a specific course, forming a student interface for practical operation. Simultaneously, it collects real-time operation data from the student on this interface (such as mouse clicks and keyboard input) and uses this data to update the state of the sandbox environment instance.

[0032] Optionally, both the student live streaming client 3 and the student operation client 4 are independent clients.

[0033] Optionally, the student live streaming terminal 3 and the student operation terminal 4 can be integrated into the same client.

[0034] A sandbox environment instance is an isolated, secure virtual runtime environment used to execute untrusted programs or perform experimental operations.

[0035] A Windows virtual machine is a virtual computer simulated on a physical computer (host machine) using virtualization technology. It possesses complete hardware capabilities (such as CPU, memory, and hard disk). It can independently run a complete Windows operating system and applications, isolated from the host machine and other virtual machines, while sharing underlying physical resources. CPU stands for Central Processing Unit.

[0036] Sandbox environment instance: This refers to an independent and isolated virtual computing environment dynamically generated for a specific student based on a pre-built course image (such as a Windows virtual machine image). This instance includes all the software, tools, and initial data templates required for the course, providing students with a "ready-to-use" practical platform. Its real-time state is updated driven by the student's or instructor's operational data.

[0037] A Windows virtual machine image is a pre-packaged virtual machine template file containing a complete Windows operating system, pre-installed software applications, system configuration, and initial data. As a system "master disk" that cannot be directly run, it is used to quickly and in batches create multiple independent Windows virtual machine instances with completely identical environments on the cloud or local server, thereby achieving standardized, one-click deployment, and unified management of teaching or work environments.

[0038] Student Interface: This refers to the graphical user interface displayed on the student's terminal 4, which is synchronized in real time with the sandbox environment instance. Through this interface, students view the status of their personalized sandbox environment and perform all practical operations, providing an experience similar to operating a local computer.

[0039] Assistance Interface: This refers to the screen displayed on the assistance terminal 5, showing the real-time status of a specific student sandbox environment instance. It is the visual feedback obtained after the assistance terminal 5 accesses (whether in read-only or assistance mode) the sandbox environment instance, allowing the teacher to see content completely consistent with the student interface on the student's operating terminal 4. In other words, the teacher can browse one or more student interfaces through the assistance interface on the assistance terminal 5.

[0040] Student interaction data: This refers to the input data generated when students interact with the sandbox environment instance through the student interface on the student operation terminal 4, such as mouse movement trajectory, click events, and keyboard key sequences. This data is captured by the student operation terminal 4 and used to drive the state update of the sandbox environment instance.

[0041] Read-only mode: This refers to a permission state when the assistant terminal 5 accesses the student's sandbox environment instance. In this mode, the assistant terminal 5 can receive and display the student's interface (i.e., the assistance interface) in real time, as if watching a live broadcast, but cannot input any operation commands into the instance; it is only used to monitor the student's operation process.

[0042] Assistance Mode: This refers to another permission state when the assistance terminal 5 accesses the student's sandbox environment instance. In this mode, the assistance terminal 5 can not only receive and display the student's interface in real time (i.e., the assistance interface), but also input operation data (i.e., teacher operation data) into the student's sandbox environment instance through the assistance interface, thereby directly controlling the student's environment for demonstration or troubleshooting, and realizing remote one-on-one assistance.

[0043] Specifically, the operation of the interactive teaching system of this application begins with a teacher initiating a live teaching session for a course via teacher terminal 2. Teacher terminal 2 pushes the live stream, which includes courseware explanations or software demonstrations, to cloud terminal 1. Cloud terminal 1 then acts as a relay station for the live stream, distributing the live stream data to the student live streaming terminals 3 of all enrolled students. Student live streaming terminals 3 receive and decode the live stream and display it on their device screens, enabling students to watch the teacher's teaching content synchronously.

[0044] Optionally, when a student logs into the system through student terminal 4, student terminal 4 sends the student's identity information to cloud 1 to request access to the practice environment. After cloud 1 verifies the identity, it quickly loads or wakes up a pre-configured sandbox environment instance (e.g., a Windows virtual machine with a specific programming IDE and sample projects already installed) matching the student's selected course. Student terminal 4 then establishes a remote connection (e.g., via VNC protocol) with this sandbox environment instance located in cloud 1, receives its graphical output, and renders it as a local operation interface. When the student practices on this operation interface, all interactive actions are captured by student terminal 4 as student operation data and sent back to cloud 1 in real time. Cloud 1 updates the internal state of the sandbox environment instance accordingly, achieving real-time synchronization between operation and environment. VNC, Virtual Network Console, is a protocol for remote graphical desktop control. IDE, Integrated Development Environment.

[0045] During the teaching process, the teacher can request to view the learning status of any student through the teacher terminal 2. In access mode or assistance mode, the assistance terminal 5 sends a request to the cloud terminal 1 to display the interface screen of the sandbox environment instance. The cloud terminal 1 establishes a connection between the assistance terminal 5 and the student's operation terminal 4. At this time, the assistance terminal 5 receives the screen screen of the student's operation terminal 4 in real time and displays it as the assistance interface, thus enabling low-latency viewing of the student's actual operation process without the student needing to send additional data, achieving panoramic monitoring.

[0046] If students encounter difficulties, teachers can switch the access mode to "assistance mode". In this mode, the assistance terminal 5 accesses the sandbox environment instance. The teacher's operations on the assistance interface (such as moving the cursor, clicking, and typing) are captured as teacher operation data and sent to the student's sandbox environment instance through the cloud 1, directly driving changes in the instance. The operation interface of the student's operation terminal 4 is also updated synchronously, thereby realizing secure remote control and guidance of the student's cloud desktop by the teacher.

[0047] Cloud 1: Employs a distributed server cluster architecture, deploying a virtualization manager, streaming media relay service, API gateway, and database. It uses virtualization technology to batch generate / manage Windows sandbox instances; maintains signaling and data channels with various ends through WebSocket / TCP (Transmission Control Protocol) long connections; and processes business logic through RESTful APIs, realizing the core hub functions of resource scheduling, session management, and data relay. WebSocket is a network protocol for full-duplex communication over a single TCP connection. The API gateway is a core intermediary component in the distributed system, serving as a unified access layer between clients and backend services, and implementing service routing and protocol conversion through a reverse proxy mechanism.

[0048] Teacher-side 2: Develop a native Windows client application, integrating a video capture and encoding module (for capturing courseware / practical interfaces), an audio / video encoder, and a streaming media push SDK (Software Development Kit). It interacts with the signaling server in Cloud 1 via WebSocket, pushes live streams to Cloud 1 via RTMP / WebRTC protocols, and receives student status and monitoring stream data forwarded from Cloud 1 via another independent WebSocket connection. RTMP stands for Real-Time Messaging Protocol. WebRTC stands for Web Real-Time Communication.

[0049] Assistance Terminal 5: Can be used as a standalone module or integrated into Teacher Terminal 2. Implements remote desktop client functionality based on VNC client library or custom WebSocket protocol, receives and decodes real-time screen streams (read-only mode) forwarded by Cloud 1 from the sandbox instance of the target student's operation terminal 4, and encodes local input events into operation command streams in assistance mode, which are then transmitted back to Cloud 1 through the same channel to inject into the target instance.

[0050] Student Live Streaming Client 3: Develop a cross-platform (Windows / iOS / Android) client application, integrating a streaming media player component to receive, decode, and render the teacher's live stream sent from Cloud 1. It also communicates with Cloud 1 via HTTP / WebSocket to complete business interactions such as login, course list retrieval, and sending interactive messages. HTTP, Hypertext Transfer Protocol, is an application-layer protocol used to transmit hypertext data over a network. Windows refers to Microsoft Windows operating system. iOS is the iPhone Operating System. Android is the Android Operating System (developed by Google).

[0051] Student Operation Terminal 4: Develop lightweight desktop clients or high-performance browser-based web applications. The core of this task is establishing a remote graphical connection with the cloud-based sandbox instance 1: if using VNC, integrate VNC Viewer; if using WebSocket, implement a custom remote framebuffer protocol client. This client is responsible for rendering the instance interface, capturing and uploading local input events, and can include a built-in screen synchronization agent to generate monitoring streams from captured screens. VNC Viewer is a remote desktop control software that allows users to connect to remote computers via a network for remote control and management.

[0052] Understandably, when a teacher is teaching, the teacher uses a teacher terminal 2 and an assistant terminal 5, and each student uses a student live streaming terminal 3 and a student operation terminal 4. In other words, when a teacher teaches multiple students, the cloud 1 connects to at least one student live streaming terminal 3 and at least one student operation terminal 4.

[0053] Figure 2 The system provides a scenario simulation diagram of an interactive teaching system. The student's computer is equipped with the student operation terminal 4, the student's PAD (tablet computer) is equipped with the student live streaming terminal 3, the teacher's live streaming screen displays the interface of the teacher terminal 2, and the classroom monitoring screen displays the assistance interface of the assistance terminal 5.

[0054] In one embodiment, the cloud 1 is provided with a cloud desk cluster 11 and a backend management cluster 12. Each cloud desk in the cloud desk cluster 11 is a sandbox environment instance. Each cloud desk in the cloud desk cluster 11 is connected to one of the student operation terminals 4. The backend management cluster 12 is connected to the cloud desk cluster 11, the teacher terminal 2, the student live broadcast terminal 3, the student operation terminal 4 and the assistant terminal 5 respectively. The cloud desk cluster 11 is connected to the assistant terminal 5 and the student operation terminal 4 respectively.

[0055] The cloud desk cluster is the core computing cluster in the system specifically responsible for hosting and running sandbox environment instances dynamically allocated to each student.

[0056] The cloud-based desk cluster implementation includes the following modules and mechanisms: virtualization platform layer, resource scheduler, instance controller, The core components of the cloud-based desk cluster include: virtualization host, instance manager, and streaming media gateway.

[0057] Virtualization host: Equipped with a hypervisor, it has powerful CPU (Central Processing Unit), GPU (Graphics Processing Unit), and memory resources for creating and running Windows virtual machine instances.

[0058] Instance Manager: Responsible for receiving instructions from the background management cluster and executing virtual machine lifecycle operations, including: quickly cloning / creating new instances from a specified image, starting / stopping / hibernating instances, allocating computing resources (such as memory and GPU) to instances, and destroying instances.

[0059] Streaming Gateway: Responsible for handling real-time screen streaming data between the student's operating end and the assistant's end. When using VNC or a custom protocol, this component maintains remote desktop connections with each end, forwarding graphics frames (from instance to client) and input events (from client to instance).

[0060] The backend management cluster is the computing cluster responsible for all core business logic, resource scheduling, data management, and system control of the system, including non-real-time graphics rendering.

[0061] The core components of the backend management cluster include: API (Application Programming Interface) gateway / business server, identity authentication and session management service, resource scheduler, storage service, and live stream forwarding service.

[0062] API Gateway / Business Server: Provides all RESTful APIs (a request-response communication architecture based on the HTTP protocol) or WebSocket signaling interfaces to handle all business requests from the teacher's end, student live streaming end, student operation end, and assistance end, such as: user login authentication, course list query, class start / end commands, assistance mode switching requests, screenshot storage requests, etc. RESTful APIs handle business requests (such as login and course selection), while WebSockets transmit real-time data (such as screen displays and operation commands). Identity authentication and session management service: Verifies user identity and manages user login status and classroom sessions.

[0063] Resource scheduler: Based on course requirements, student login status, and the real-time load of the cloud desk cluster, it intelligently decides which physical server to create a new sandbox environment instance to achieve load balancing.

[0064] Storage services: Manage persistent data such as Windows virtual machine image libraries, instance snapshots backed up for "exclusive mode" courses, and user screenshots (first library, second library).

[0065] Live stream forwarding service: responsible for receiving the teaching live stream from the teacher's end and distributing it to each student's live stream end (this function can also be independently called "streaming media cluster", but in terms of management ownership, its control logic is controlled by the backend management cluster).

[0066] The management channel (which must be connected) between the backend management cluster and the cloud desk cluster communicates via a high-speed intranet-specific management protocol (such as an HTTP-based REST API). REST API stands for Representational State Transfer API, an application programming interface that follows the REST architectural style.

[0067] Communication direction and content: The backend management cluster sends control commands to the cloud desk cluster, such as "create an instance of course X for student A", "switch instance B to assistance mode", and "destroy instance C"; the cloud desk cluster reports status information to the backend management cluster, such as "instance D created successfully, IP address is A1", "instance E has too high load", and "remaining resources of server F".

[0068] The communication connection between the student's client and the backend management cluster handles all business signaling, including: login authentication, obtaining course information, sending get out of class termination instructions, querying the knowledge base, and uploading screenshot metadata. This is the key path for implementing the functions of claims 4, 5, 8, 11, and 14.

[0069] The communication connection between the student's client and the cloud desktop cluster is dedicated to transmitting real-time graphical interface data. After successful login verification, the backend management cluster returns a connection token and the access address (IP / domain name) of the target cloud desktop instance to the student's client. The student's client then uses this token and address to directly establish a remote desktop connection with the specific instance in the cloud desktop cluster, receive screen streams, and send local operation events.

[0070] In one embodiment, the sandbox environment instance includes a screen synchronization proxy; The screen synchronization agent is used to capture the screen of the student interface to generate monitoring data and synchronize the monitoring data to the cloud desk cluster 11. The assistance terminal 5 is used to obtain the monitoring data through the cloud desk cluster 11 and display the monitoring data to obtain the assistance interface.

[0071] The screen synchronization proxy is a resident background service program running within the sandbox environment instance. Its core function is to actively and continuously capture the screen of the student interface (i.e., the graphical user interface through which students operate the sandbox environment instance), generating a series of image or video streams arranged in time sequence, i.e., monitoring data. This program acts as a bridge connecting the student's practical environment and the teacher's monitoring terminal, responsible for collecting first-hand visual operation footage and relaying it through the cloud desk cluster 11 to push the real-time footage to the teacher's assistance terminal 5, providing the teacher with a realistic, synchronous, and low-latency view of student operations. It is a key technical component for achieving "real-time visual operation."

[0072] In other words, screen capture of the student interface is implemented within a sandbox environment instance.

[0073] In practice, the screen synchronization agent runs automatically after the sandbox environment instance is created. The sandbox environment instance captures the currently active student interface at a configurable frequency (e.g., 5-30 frames per second) and resolution by calling the operating system's underlying graphics interface or a dedicated screenshot library (e.g., in a Windows virtual machine instance, the Windows Graphics Capture API or DirectX graphics interface). The captured raw image data is encoded and compressed (e.g., using H.264 / 265 encoding) to form a data stream, which serves as monitoring data. This monitoring data stream is uploaded to the cloud 1 in real time through a preset secure transmission channel (e.g., a custom protocol based on WebSocket). Upon receiving the data, the cloud 1 forwards the corresponding monitoring data according to the subscription request of the assistance terminal 5. The assistance terminal 5 decodes and renders the received monitoring data, displaying it as an assistance interface completely synchronized with the student interface, allowing the teacher to view the entire student practice process in real time without interfering with student operations. The Windows Graphics Capture API is a screen capture programming interface. The DirectX graphics interface is a collection of low-level multimedia programming interfaces, primarily used for high-performance graphics rendering, video processing, and game development.

[0074] As is understandable, monitoring data is the "output" of the sandbox environment instance's execution results. It reflects the instance's current state but is not used to change the instance's internal state. Therefore, monitoring data is not used to update the sandbox environment instance; it is only used for observation.

[0075] In traditional online teaching, teachers often rely on students actively sharing their screens or using general remote tools for point-to-point connections to view student actions. This approach suffers from high latency, screen asynchrony, inability to monitor multiple students simultaneously, and heavy dependence on student network and performance. This embodiment deploys a screen synchronization proxy at the kernel level to directly capture the graphical output of the student's terminal 4, ensuring the authenticity and integrity of the image from the data source. The generated monitoring data is uniformly distributed via the cloud 1, allowing the assistance terminal 5 to access any student's interface in a read-only manner with low latency, achieving a fundamental shift from "passive inquiry" to "active panoramic monitoring." This technology enables teachers to grasp the progress and status of all students' actions in real time and intuitively, accurately identify common problems and individual bottlenecks, thus providing accurate evidence and entry points for timely and efficient remote security assistance, effectively improving the timeliness of teaching interaction and the pertinence of guidance.

[0076] In one embodiment, the assistance terminal 5 is further configured to send an assistance command to the cloud 1, or the student operation terminal 4 is further configured to send an assistance command to the cloud 1. The assistance terminal 5 is also used to obtain teacher operation data according to the assistance interface when the remote mode is assistance mode, wherein the teacher operation data is used to update the sandbox environment instance. The assistance terminal 5 is also used to send an end command to the cloud 1, or the student operation terminal 4 is also used to send an end command to the cloud 1. The cloud 1 is used to respond to the end command and control the cessation of the step of obtaining teacher operation data according to the assistance interface.

[0077] The assist instruction carries the student's identity information. The end instruction carries the student's identity information.

[0078] The student operation terminal 4 provides a command initiation control, allowing students to select or trigger an "assistance command". The student operation terminal 4 also provides a command termination control, allowing students to select or trigger an "end command".

[0079] The assistance terminal 5 provides a command initiation control, allowing teachers to select or trigger an "assistance command". The assistance terminal 5 also provides a command termination control, allowing teachers to select or trigger an "end command".

[0080] When the cloud receives the termination command, it controls the cessation of the step of obtaining teacher operation data based on the assistance interface, that is, stopping the modification permission of the assistance interface.

[0081] When a teacher needs to intervene (e.g., a student requests help via voice or text), the teacher initiates a control via a command on the assistance terminal 5. The assistance terminal 5 then generates an assistance command containing the student's identity information and sends it to the cloud terminal 1. After verifying permissions, the cloud terminal 1 establishes a two-way control channel from the assistance terminal 5 to the sandbox environment instance corresponding to the student's identity information carried in the assistance command. Subsequently, any interactive operations performed by the teacher on the assistance interface displayed on the assistance terminal 5 (such as moving the cursor to a specific button and clicking it) are collected in real-time by the event capture module of the assistance terminal 5 and encoded into structured teacher operation data. This teacher operation data is sent to the cloud terminal 1 through the two-way control channel (e.g., a channel based on the VNC protocol or a custom WebSocket protocol). The cloud terminal 1 directly injects this data into the sandbox environment instance corresponding to the student's identity information carried in the assistance command. The sandbox environment instance receives and parses this operation data, simulating it as a local input event, thereby updating the sandbox environment instance.

[0082] Traditional remote assistance solutions require direct control of the student's local physical computer, posing security risks such as the need to grant local system permissions and the potential for privacy data leaks. Furthermore, they are limited by the heterogeneous hardware and software environments of the students' local devices, resulting in poor connection stability and operational consistency. This application innovatively shifts the object of remote control from the student's local device to a unified sandbox environment instance hosted in the cloud. In assistance mode, the teacher's operation data only affects this cloud instance, and the student's local terminal only serves as a display terminal, requiring no system control permissions, fundamentally isolating security risks. Simultaneously, since the teacher and student operate on the same cloud instance, the operating environment is completely consistent, avoiding guidance failures due to environmental differences. This technology enables "hands-on" remote guidance to be conducted in a safe, stable, and efficient environment, significantly reducing the average assistance time of several minutes in traditional solutions, and significantly improving the depth of teaching interaction and the efficiency of problem-solving.

[0083] In one embodiment, the student operation terminal 4 is used to display a sandbox environment instance through the cloud 1 to obtain a student interface, including: Obtain student identity information, perform login verification based on the student identity information, and obtain the verification result; When the verification result is successful, the course information is obtained based on the student's identity information and used as the target course information; The student interface is obtained by displaying a sandbox environment instance corresponding to the target course information through the cloud 1.

[0084] Student identity information: This refers to the data set used to uniquely identify an individual student and associate their course permissions. It typically includes, but is not limited to, student account, password, student ID, biometric information (such as facial recognition data), or third-party authentication tokens. This information is entered by the student during the login process via the student operation terminal 4 or submitted automatically, serving as the core basis for the system to identify the user's identity, verify their learning eligibility, and associate them with their assigned course resources.

[0085] Login verification: This refers to the process by which cloud platform 1 receives the student's identity information submitted by the student's live streaming client 3 and compares it with the pre-set legitimate identity records in the database. This process is used to confirm the authenticity, validity, and current status of the submitter's identity (such as whether it is within the validity period or whether it is disabled), and generates a result indicating whether the verification was successful or failed (verification result). It is the security gate that controls whether the student can enter the next stage—obtaining a personalized teaching environment.

[0086] Target course information: This refers to the configuration data of a specific course that the student is about to enter or continue learning, which is automatically retrieved and determined by the system based on the student's identity information from their associated course list, course selection records, or current teaching progress. This information includes at least a unique course identifier and may extend to the specific software environment configuration required by the course, virtual machine image identifiers, etc., and serves as the basis for the cloud 1 to dynamically allocate suitable sandbox environment instances to students.

[0087] First, the student's client 4 starts and presents a login interface, guiding or automatically obtaining the student's input or submitted identity information (such as account and password). Then, the student's client 4 sends this identity information to the cloud 1 via the network. Upon receiving the information, the cloud 1 invokes its identity authentication service, compares the information with a pre-stored registration information database, executes login verification logic, and finally generates and returns a clear verification result (success or failure). If the verification result is successful, the cloud 1 will query the student's user profile, course selection records, or currently active class information based on the verified student's identity information to accurately determine the course the student needs to enter for this session, extracting the relevant identifiers and configurations of this course as the target course information. Next, based on this target course information, the cloud 1 locates the corresponding pre-made course virtual machine image (e.g., a Windows image customized for the "Python Data Analysis" course). Then, the cloud 1 dynamically allocates computing resources to the student and quickly generates (or wakes from hibernation) an independent sandbox environment instance bound to the student's identity based on the course virtual machine image. Finally, a stable graphics data transmission channel is established and maintained between the student's terminal 4 and the newly created (or designated) sandbox environment instance on the cloud 1 through an efficient remote desktop protocol (such as VNC) or a custom streaming protocol. The real-time screen output of the instance on the cloud 1 is transmitted to the student's local terminal 4 via this channel. The rendering engine of the student's terminal 4 receives the data stream, decodes and displays it, thereby presenting an interactive student interface on the student's terminal device, completing the entire process from identity authentication to the readiness of the dedicated operating environment.

[0088] This embodiment automatically matches courses and quickly deploys a dedicated sandbox environment after identity verification, achieving a minimalist "login to class" experience. Students do not need to manually configure anything and instantly obtain a pre-built practical environment that is completely identical to the course, completely eliminating the complex installation and debugging process of traditional methods. At the same time, this process ensures the standardization and centralized management of the teaching environment, providing a stable foundation for unified monitoring and remote assistance by teachers, significantly improving teaching efficiency and learning experience.

[0089] In one embodiment, the cloud 1 is further configured to load a Windows virtual machine image corresponding to the target course information to generate an independent instance corresponding to the student identity information, and use the independent instance as the sandbox environment instance. The student's operating terminal 4 establishes and maintains a remote connection with the sandbox environment instance in the cloud 1 for display, thereby obtaining the student's interface.

[0090] Independent instance: refers to a dedicated, resource-isolated virtual machine runtime environment dynamically generated for a specific student based on a Windows virtual machine image.

[0091] Remote connection: refers to the network link established between the student's operating terminal 4 and the cloud sandbox environment instance 1 via protocols such as VNC or WebSocket, used to transmit graphical interfaces and operating commands.

[0092] Specifically, Cloud 1 locates the corresponding Windows virtual machine image based on the target course information and uses virtualization technology to quickly clone or create a resource-independent virtual machine instance bound to the student's identity information, using this image as a sandbox environment instance for this teaching session. Subsequently, the student's terminal 4 initiates a connection request to Cloud 1, establishing a stable remote desktop connection between the student's terminal 4 and the designated sandbox environment instance. This connection continuously transmits real-time graphical interface data of the instance to the student's terminal 4, which receives and renders this data, displaying it as an interactive student interface on the student's local machine, thus completing the mapping from the Cloud 1 environment to the local display.

[0093] This embodiment dynamically generates independent instances for students based on standardized images in the cloud (1), ensuring the consistency and isolation of the teaching environment and avoiding local configuration differences and conflicts. The student's operating terminal (4) directly renders the instance interface via remote connection, allowing students to operate the complex cloud (1) environment without requiring local high-performance computing resources, achieving a "thin client" experience. This design shifts environment deployment and computing pressure to the cloud (1), ensuring out-of-the-box convenience while supporting centralized resource scheduling and elastic scaling, fundamentally solving the problems of difficult maintenance and inconsistent user experience in distributed environments.

[0094] In one embodiment, the student live streaming terminal 3 is further used to acquire student interaction data and send the student interaction data to the cloud 1, wherein the student interaction data includes: audio or video; The teacher terminal 2 is also used to obtain and display the student interaction data from the cloud 1.

[0095] Student interaction data refers to real-time media data collected and generated by students during live teaching sessions through their terminal devices' audio input devices (such as microphones) or video input devices (such as cameras), intended for students to ask questions, answer questions, or communicate with teachers.

[0096] Cloud 1: As a relay and distribution server for audio and video streams, it is responsible for receiving student interaction data from student live streaming terminal 3 and forwarding it to the designated teacher terminal 2.

[0097] Display: This refers to the process by which the teacher terminal 2 receives student interaction data forwarded from the cloud 1, decodes and renders it, and then plays and presents it in a specific interface area (such as a separate window, picture-in-picture, or list item) on the teacher terminal 2 in an audible and visual form.

[0098] During a live teaching session, student live streaming terminal 3 utilizes the audio and / or video capture module of its local device (e.g., when a student clicks the "Raise Hand to Speak" button) to acquire the student's voice or video in real time, encoding it to form student interaction data. Subsequently, student live streaming terminal 3 uploads this student interaction data to cloud terminal 1 via a predetermined network protocol (e.g., based on WebRTC or RTMP). Upon receiving the student interaction data, cloud terminal 1 determines the target teacher terminal 2 based on classroom management logic (e.g., speaking queue or teacher designation) and forwards the student interaction data. Teacher terminal 2 continuously monitors the data push from cloud terminal 1. When it receives the forwarded student interaction data stream, it immediately decodes it and displays it in real time in a specific area of ​​its interactive interface (e.g., the "Student Speaking Area"), allowing the teacher to simultaneously see or hear the student's real-time audio and video feedback.

[0099] This embodiment establishes independent real-time audio and video uplink and downlink channels between the student's live streaming terminal 3 and the teacher's terminal 2, and efficiently relays these channels via the cloud 1, constructing a low-latency, two-way audio and video interactive link. This technology allows students to ask questions or participate in discussions at any time using the most intuitive voice or video methods while watching live streams and conducting cloud desktop practice. Teachers can instantly receive and view the real-time status and feedback of multiple students. This effectively solves the pain points of traditional online teaching platforms, such as limited interactive methods (mainly relying on text chat) and the difficulty for teachers to perceive students' true learning status and emotions.

[0100] In one embodiment, the cloud 1 is further configured to obtain a get out of class termination instruction from the student live streaming terminal 3 or the teacher terminal 2, and obtain the course mode based on the student identity information in the get out of class termination instruction; The cloud 1 is also used to generate backup data based on the sandbox environment instance when the course mode is exclusive, and to destroy or reset the sandbox environment instance when the course mode is shared. The student operation terminal 4 is used to display a sandbox environment instance through the cloud 1 to obtain a student interface, including: when the course mode is exclusive, displaying a sandbox environment instance through the cloud 1 based on the backup data to obtain the student interface; when the course mode is shared, displaying an initialized sandbox environment instance through the cloud 1 to obtain the student interface.

[0101] End of get out of class instruction: refers to an instruction issued by the student's live streaming terminal 3 or the teacher's terminal 2 that marks the end of the current classroom session, which includes at least the identity information of the student who triggered the instruction.

[0102] Course Mode: Refers to a preset identifier associated with a student's identity or selected course, used to define the lifecycle management strategy of their sandbox environment instance, mainly including "exclusive" and "shared".

[0103] The course mode is exclusive: This means that the student's sandbox environment instance will not be immediately destroyed or reset after the course ends, and its running status and data will be retained for the student to continue using later.

[0104] Backup data: refers to the persistent storage of the complete disk status, memory snapshot, and configuration information of the cloud-based sandbox environment instance for one student at a specific time (such as the next class period) in exclusive mode.

[0105] An initialized sandbox environment instance refers to a brand-new sandbox environment instance that is recreated or reset based on the original course image and does not contain any user personal processes and data.

[0106] The course mode is shared: This means that the sandbox environment instance of the student will be released or reset to its initial state after the course ends, and can be used by other students in a loop.

[0107] When Cloud 1 receives a get out of class termination instruction containing student identity information from student live streaming terminal 3 or teacher terminal 2, it first queries the configuration of the course to which the student belongs based on the identity information to determine the course mode (exclusive or shared). If the course mode is exclusive, Cloud 1 generates a complete state backup (backup data) of the sandbox environment instance currently running by the student and suspends or puts the instance to sleep. When the student logs in again, Cloud 1 directly restores the complete environment state at the time of the last class termination based on this backup data and displays it as the student interface. If the course mode is shared, Cloud 1 directly releases or destroys the student's sandbox environment instance after the class terminates. When the student (or other students) logs in to the same course again, Cloud 1 creates a brand new, initialized sandbox environment instance based on the original course image and displays it as the student interface.

[0108] Traditional solutions employ a blanket reset policy for all environments after each class, which fails to support project-based teaching requiring multiple consecutive lessons (such as software development). Alternatively, a uniform retention policy leads to the ineffective use of cloud resources. This solution introduces "exclusive" and "shared" modes with targeted processing (backups are generated in exclusive mode, and initialization is performed in shared mode), achieving intelligent and refined environment management. This solution balances personalized learning progress preservation with efficient utilization of cloud computing resources while meeting the needs of different teaching scenarios.

[0109] In one embodiment, the cloud desk cluster 11 communicates with the student operation terminal 4 via VNC protocol or WebSocket + custom protocol; The cloud desk cluster 11 communicates with the assist terminal 5 via VNC protocol or WebSocket + custom protocol; The teaching live broadcast between the student live broadcast terminal 3 and the cloud 1 communicates via the WebRTC / RTMP protocol, and the login verification between the student live broadcast terminal 3 and the cloud 1 communicates via the HTTP protocol and the JSON communication protocol. The live teaching session between the teacher's terminal 2 and the cloud 1 is conducted via the WebRTC / RTMP protocol, and the login verification between the teacher's terminal 2 and the cloud 1 is conducted via the HTTP protocol and the JSON communication protocol.

[0110] VNC protocol: A graphical desktop sharing system based on the RFB protocol, used to remotely control the screen of another computer over a network and transmit keyboard and mouse events.

[0111] WebSocket + Custom Protocol: This refers to defining a dedicated data packet format and interaction logic on top of the full-duplex communication channel provided by WebSocket to achieve efficient real-time data exchange.

[0112] WebRTC / RTMP protocols are real-time audio and video streaming protocols: WebRTC supports low-latency peer-to-peer communication between browsers, making it suitable for two-way interaction; RTMP, on the other hand, requires a streaming media server for relaying, and is widely used in live streaming and distribution scenarios due to its high stability, making it suitable for the system's requirement for teachers to initiate one-way teaching live streams to the cloud server.

[0113] HTTP protocol and JSON (JavaScript Object Notation, a lightweight data interchange format) communication protocol: refers to request-response communication based on HTTP, and using JSON as the data serialization format to realize the transmission of structured commands and status information.

[0114] During system operation, persistent connection channels based on VNC or WebSocket (a remote desktop protocol carrying custom encoding) are established between the cloud desk cluster 11 and the student operation terminal 4, and between the cloud desk cluster 11 and the assistance terminal 5, to transmit real-time graphical interfaces and operation commands. Simultaneously, to transmit course signaling, authentication, and other control information between the student live streaming terminal 3 and cloud 1, and between the teacher terminal 2 and cloud 1, requests are initiated via HTTP, and data content is encapsulated and parsed in JSON format. Furthermore, the data stream of the teaching live stream between the student live streaming terminal 3 and cloud 1, and between the teacher terminal 2 and cloud 1, communicates via WebRTC / RTMP protocol to establish long connections and complete business logic interactions.

[0115] This embodiment optimizes communication efficiency and functional decoupling by adapting dedicated protocols to different types of data streams (real-time audio / video / operation streams and signaling / control streams). The graphical interface and operation require low latency and high real-time performance, employing VNC or WebSocket long connections to ensure smooth remote desktop interaction. The live data stream uses WebRTC / RTMP protocols, while the business signaling needs to be reliable, structured, and easily extensible, using HTTP+JSON to achieve standardized cross-platform interfaces and flexible business logic management. This heterogeneous protocol combination allows the system to balance real-time interactive performance with standardized control management, improving overall communication reliability and maintainability.

[0116] In one embodiment, the teacher terminal 2, the backend management cluster 12, and the student live streaming terminal 3 use a first data channel for data transmission, while the student operation terminal 4, the cloud desk cluster 11, and the assistance terminal 5 use a second data channel for data transmission. The first data channel and the second data channel are set independently.

[0117] The first data channel refers to the data transmission link established between the teacher's end 2, the back-end management cluster 12, and the student's live streaming end 3, which is dedicated to transmitting audio and video streams for live teaching.

[0118] Understandably, the first data channel can also be used to transmit classroom signaling data (such as chatting, raising hands).

[0119] The second data channel refers to the data transmission link established between the student operation terminal 4, the cloud desk cluster 11, and the assistance terminal 5, which is dedicated to transmitting real-time interface screens (monitoring data) and remote operation commands of the sandbox environment instance.

[0120] Independent configuration: This means that the first data channel and the second data channel are isolated from each other in terms of logical or physical resources (such as network ports, bandwidth queues, server threads), and run independently without interfering with each other.

[0121] During system initialization, a dedicated transmission path, the first data channel, is established for the live teaching stream initiated by teacher terminal 2, which is relayed from teacher terminal 2 through the backend management cluster 12 to each student's live streaming terminal 3. This channel carries the live content and classroom interaction signaling. Simultaneously, another dedicated transmission path, the second data channel, is established between each student's student operation terminal 4 and the assistance function of the assistance terminal 5, relayed via the cloud desk cluster 11. This channel carries the instance's screen feed (for teacher monitoring) and the operation commands sent by the teacher in assistance mode. These two channels are processed by different service components in the cloud 1, using independent network connections and data processing logic.

[0122] This embodiment achieves key technical optimizations by transmitting the live teaching stream and the sandbox environment monitoring / operation stream through independent dedicated data channels. The two types of data streams have different characteristics (the live stream requires high bandwidth and one-way broadcasting; the monitoring / operation stream requires low latency and two-way interaction). Mixing them could easily lead to resource contention, increased latency, screen stuttering, or lost commands. By setting up independent data channels, traffic isolation and dedicated resources are achieved, ensuring the smoothness and stability of the live teaching broadcast. Simultaneously, it ensures the real-time nature of the teacher's monitoring screen and the accurate and rapid response of remote assistance operations, thus improving the overall service quality and reliability from a system architecture perspective.

[0123] In one embodiment, the student operation terminal 4 is further used to acquire student query data, match answer data with the question-and-answer knowledge base built into the student operation terminal 4 to obtain target data, and display the target data. The answer data includes one or more of answer text, answer audio, and answer video, and the answer data is pre-generated and stored in the question-and-answer knowledge base.

[0124] Student query data: refers to the data of questions or requests for help or answers made by students during the operation of the student terminal 4, triggered by text input, voice questions or specific commands.

[0125] Question and Answer Knowledge Base: This refers to a database pre-installed on the student's device or that can be quickly accessed, which stores frequently asked questions closely related to the course content and their pre-generated standardized answer data sets.

[0126] Answer data: refers to pre-made and stored responses to specific questions in the knowledge base, which may take the form of structured text, recorded audio explanations, or demonstration videos, or one or more combinations thereof.

[0127] Target data: refers to one or more answer data entries retrieved from the question-and-answer knowledge base through a matching algorithm that are most relevant to the current student's query data.

[0128] When a student encounters a problem and triggers a query while using the student interface 4 (e.g., by clicking a help button or entering keywords), the student interface 4 first captures the student's query data. Then, the student interface 4 uses its built-in matching engine to compare the query data with the index in the local question-and-answer knowledge base (e.g., based on keyword matching or vector similarity calculation), filtering out one or more answer data entries with the highest relevance as target data. Finally, depending on the type of target data (text, audio, or video), the student interface 4 calls the corresponding rendering or playback components in a specific area of ​​its interface (e.g., a sidebar pop-up) to display it, thus providing real-time assistance to the student.

[0129] Students frequently encounter repetitive problems during practical exercises. Relying entirely on teachers for real-time Q&A would overburden teachers and cause long waiting times for students. This embodiment addresses this by providing a pre-built, structured database of frequently asked questions, enabling students' terminals 4 to respond autonomously. After a student initiates a query, the system can match and push the most relevant text, audio, or video answers within milliseconds, achieving "instant answers." This significantly reduces the workload of teachers in providing repetitive answers, shortens student waiting times, and ensures the continuity and efficiency of the learning process, with particularly pronounced advantages in high-concurrency teaching scenarios.

[0130] In one embodiment, the teacher terminal 2 is also used to send a sharing command to the cloud desk cluster 11; The cloud desk cluster 11 is also used to generate sharing data according to the sandbox environment instance corresponding to the sharing instruction, and send the sharing data to the backend management cluster 12. The backend management cluster 12 is also used to send the shared data to the student live streaming terminal 3; The student live streaming terminal 3 is also used to display data based on the shared data. The backend management cluster 12 is also used to package the teaching live broadcast initiated by the teacher terminal 2 and the sharing data to obtain the updated teaching live broadcast; The student live streaming terminal 3 is also used to display the teaching live stream initiated by the teacher terminal 2 and the sharing data based on the updated teaching live stream.

[0131] Sharing command: This refers to a control command initiated by the teacher on the teacher's side 2 interface, which instructs the teacher to broadcast the screen of the operation interface of a specific student sandbox environment instance that they are currently viewing or operating to other students in the classroom.

[0132] Understandably, the content of the live teaching session on the teacher's side 2 includes: courseware, teacher operation demonstration window, and the display content of the sandbox environment instance of the remotely controlled students that shares data.

[0133] The sharing instruction carries the student's identity information.

[0134] Shared data: This specifically refers to the real-time graphical interface output data stream of the target sandbox environment instance, including its desktop state, application windows, and all visible elements.

[0135] When a teacher is monitoring or assisting a student, if they deem the student's interface valuable for demonstration or discussion, they trigger a sharing command for the student's sandbox environment instance on the teacher's end 2 interface. The teacher's end 2 sends this sharing command to the backend management cluster 12. Upon receiving the sharing command, the backend management cluster 12 sends a control command to the cloud classroom cluster 11. The cloud classroom cluster 11 responds to the control command by capturing and copying the real-time display content (screen stream) of the instance corresponding to the sharing command. Subsequently, the cloud classroom cluster 11 simultaneously pushes the copied display content (i.e., the shared data) to the backend management cluster 12. The backend management cluster 12 sends the shared data stream to each of the student live streaming ends 3. The student live streaming ends 3 display the shared data stream according to a preset display template. The teaching live stream initiated by the teacher's end 2 and the shared data stream are packaged together, and the packaged data (i.e., the updated teaching live stream) is sent to each of the student live streaming ends 3. The student live streaming terminal 3 displays the updated teaching live streaming data stream and shared data initiated by the teacher terminal 2 according to the preset display template.

[0136] It is understandable that the sharing command does not share "monitoring data", but rather "the display content of the sandbox environment instance".

[0137] This embodiment introduces a one-click sharing mechanism, quickly transforming the practical interfaces of individual students into visual teaching resources shared by the entire class, resulting in significant teaching efficiency improvements. In traditional online teaching, it is difficult for teachers to conveniently synchronize a student's operation process to the whole class; they can only rely on verbal descriptions or re-demonstrations, which is inefficient and not intuitive. In this embodiment, the teacher discovers a typical operation case → triggers a sharing command → the system automatically copies and distributes the real-time video stream of the target instance to all students' live streaming terminals 3 → achieving "zero-time-difference" broadcasting of the operation screen. This technology enables case-based teaching, error troubleshooting, and the display of excellent works to be carried out instantly, greatly enriching classroom interaction, improving the efficiency and intuitiveness of teaching demonstrations, and promoting mutual learning and inspiration among students.

[0138] In one embodiment, the assisting terminal 5 is further configured to acquire a read-only switching instruction and send the read-only switching instruction to the cloud 1; The student operation terminal 4 is also used to obtain the read-only switching instruction from the cloud 1, and stop obtaining the student operation data from the student interface according to the read-only switching instruction.

[0139] Read-only switching command: refers to the control command actively triggered by the teacher on the assistant terminal 5, used to indicate the suspension of the operation permissions of specified or all students in the sandbox environment instance of their student operation terminal 4.

[0140] Stop acquiring student operation data from the student interface: This means that after receiving the read-only switch command, the student operation terminal 4 interrupts or pauses the operation of its local input event listening and acquisition module, so that any keyboard and mouse operations of the student on the student interface are no longer captured, encapsulated and sent to the cloud 1 to update the sandbox environment instance, but the interface display function remains normal.

[0141] When a teacher needs students to pause practical exercises and focus on listening to the lecture, a read-only switching command is triggered on the interface of the assistant terminal 5 (which can be selected to target specific students or all students). The assistant terminal 5 sends this command to the cloud terminal 1. Upon receiving the command, the cloud terminal 1 forwards it to one or more student operation terminals 4 of the target student, depending on the scope of the command. After receiving the read-only switching command from the cloud terminal 1, the student operation terminal 4 immediately invokes its control module to disconnect or suspend the connection path between its input acquisition logic and the sandbox environment instance. This prevents all subsequent operations performed by the student on the student interface from being collected as valid student operation data and uploaded, thus remotely blocking the student's operation behavior.

[0142] This embodiment introduces a remotely issued read-only switching command, empowering teachers with centralized control over the progress of classroom practical exercises. This results in standardized teaching order and ensures the transmission of key knowledge. When unified explanation is needed, it is necessary to ensure that students' attention shifts from the operating interface to the live explanation. If students continue to operate independently, it is easy to become distracted and miss information. The teacher issues a read-only switching command with one click. The command is reliably transmitted to the target student's operating terminal 4 via the cloud 1. The student's operating terminal 4 actively disables the operation collection function locally. Thus, within seconds, the practical interface of all or some students enters a "read-only" state, forcibly suspending their independent operation. This mechanism effectively solves the pain points of loose discipline and easily disrupted teaching rhythm in online practical classrooms, ensuring the teacher's leadership at key teaching points and improving the efficiency and effectiveness of group teaching.

[0143] In one embodiment, the student live streaming terminal 3 is further configured to obtain a first screenshot instruction, capture the screen of the teaching live stream displayed on the student live streaming terminal 3 according to the first screenshot instruction, obtain a first image, and store the first image in a first library; and / or, The student operation terminal 4 is also used to obtain a second screenshot command, capture the screen of the student interface according to the second screenshot command, obtain a second image, and store the second image in a second library.

[0144] First screenshot command: This refers to the command actively triggered by the student during the live teaching session, using the student's live streaming terminal 3 interface controls or shortcut keys, to capture the currently displayed live screen. First image: This refers to the image file generated by statically capturing the rendering live teaching screen within the student's live streaming terminal 3 window based on the first screenshot command. First library: This refers to the storage area used to categorize and store the first images; it can be a directory specified by the student locally or a personal image library allocated to them in the cloud 1.

[0145] Second screenshot command: This refers to a command actively triggered by the student during hands-on practice on the student operating terminal 4, using interface controls or shortcut keys, to capture the current student interface (i.e., the sandbox environment instance operation screen). Second image: This refers to the image file generated by statically capturing the student interface displayed on the student operating terminal 4 according to the second screenshot command. Second library: This refers to the storage area used to categorize and store the second images; it can be physically or logically separated from the first library.

[0146] Optionally, when a student considers a particular frame important while watching the live stream, the first screenshot command is triggered. The student's live stream client 3 calls the system's graphical interface to capture the window area of ​​the teaching live stream, generates the first image, and saves it to the preset first library (local folder or uploaded to the cloud 1 personal space).

[0147] Optionally, when a student needs to record a certain operation status or result during the operation of the student operation terminal 4, a second screenshot command is triggered. The student operation terminal 4 calls the graphical interface to capture the complete screen of the current student interface, generates a second image, and saves it to a preset second library (which can be another local directory or a different storage service in the cloud 1).

[0148] This embodiment optimizes learning material management and improves review efficiency by providing independent screenshot functions on both the student live-streaming terminal 3 and the student operation terminal 4, and directing them to different repositories. Traditional online learning lacks convenient classroom recording tools, making it difficult for students to save key teaching moments and personal operation results. The student learning process includes two different and parallel scenarios: "listening" (live-streaming) and "practice" (cloud desktop). The content and purpose of the images to be recorded differ in these two scenarios. By setting separate first and second screenshot commands and corresponding repositories, students can capture key frames from the live stream and snapshots of their personal operations with a single click. The captured images are stored in an orderly manner, facilitating retrieval, review, and summarization by scenario after class. This design aligns with the dual-thread characteristics of online practical learning, constructing a structured personal learning portfolio for students and effectively supporting knowledge consolidation and skill review.

[0149] In one embodiment, the live teaching session is live data containing explanations of business theory and demonstrations of practical projects; the sandbox environment instance is a virtual machine instance containing the software environment and data templates required for entrepreneurship simulation, so that the interactive teaching system is suitable for entrepreneurship guidance services; and / or, The live teaching session is live data containing programming instruction and project demonstrations. The sandbox environment instance is a virtual machine instance containing the software environment and data templates required for programming instruction, so that the interactive teaching system is suitable for programming instruction services; and / or, The live teaching session is live data containing corporate training lectures and project demonstrations. The sandbox environment instance is a virtual machine instance of the software environment and data templates required for corporate training, so that the interactive teaching system can be used for corporate training services.

[0150] Optionally, in the entrepreneurship guidance service scenario, the teaching live broadcast is live data that includes explanations of business theory and demonstrations of practical entrepreneurship projects. The sandbox environment instance is an independent instance generated based on a virtual machine image that is pre-loaded with dedicated software required for entrepreneurship simulation (such as market analysis tools and financial modeling software) and initial data templates (such as business canvas and financial statement templates), thereby providing students with a virtual entrepreneurship practice platform that can be used immediately.

[0151] Live data of business theory explanation and project practice demonstration: Specifically refers to the real-time teaching data stream initiated by teacher 2 and designed for entrepreneurship guidance courses. Its content switches between courseware explanation (business theory, case analysis) and practice demonstration (such as operation of business plan writing software, use of financial modeling tools) according to teaching needs.

[0152] Virtual machine instances containing the software environment and data templates required for entrepreneurship simulation: These are standalone instances generated based on a pre-made Windows virtual machine image for the entrepreneurship simulation course. This image is pre-installed with specific software required for the course (such as market analysis tools, financial software, and presentation tools) and loaded with initial data templates (such as blank business canvases and financial statement templates), forming a ready-to-use virtual entrepreneurship practice workbench.

[0153] In the entrepreneurship guidance teaching scenario, the teacher initiates a live broadcast through the teacher's terminal 2. The content of the live broadcast can be manually switched between a courseware interface explaining business theory and a practical interface demonstrating the use of specific tools. The live stream is distributed to the student's live broadcast terminal 3 via the cloud 1. Simultaneously, the student logs in through the student's terminal 4. Based on their entrepreneurship course information, the cloud 1 loads the corresponding Windows virtual machine image, which is pre-loaded with entrepreneurship simulation software and templates, to generate a personalized sandbox environment instance. The student can then conduct synchronous exercises and project building in the entrepreneurship simulation environment corresponding to the live broadcast within the student's interface on the student's terminal 4.

[0154] Optionally, in programming teaching service scenarios, the teaching live stream is live data that includes programming language explanations, algorithm teaching, and project code demonstrations. The sandbox environment instance is an independent instance generated based on a virtual machine image that has a pre-set specific programming development environment (such as IDE, compiler, debugging tools), dependency libraries, and sample code templates, thereby providing students with a unified and isolated cloud-based programming practice environment.

[0155] Optionally, in the enterprise training service scenario, the teaching live broadcast is live data containing explanations and demonstrations of enterprise culture, business processes, and operation of dedicated systems. The sandbox environment instance is an independent instance generated based on a virtual machine image that is pre-loaded with specific business systems (such as ERP and CRM software), training simulation data, and operation manuals within the enterprise, thereby providing employees with a safe and simulated enterprise system operation training environment.

[0156] This embodiment significantly enhances the teaching effectiveness and experience in the specific field of entrepreneurship guidance by configuring a general teaching system accordingly. Teaching scenarios requiring hands-on practice heavily rely on a combination of theory and practice, and the practical component demands specific software and data templates. Traditional online models struggle to provide a unified, readily usable, and complex practical environment. This solution solves this environment preparation challenge by customizing a sandbox environment instance that includes entrepreneurship software and templates. Dual-interface live streaming enables a direct integration of theory and demonstration, allowing students to seamlessly transition from knowledge acquisition to hands-on operation in a simulated training environment within a unified platform. Teachers can also monitor and provide precise guidance to students in real time, thus achieving a leap from theoretical discussion to cloud-based practical training, effectively improving the immersion, practicality, and output efficiency of teaching.

[0157] Understandably, this system is used for teaching courses for preschool education, primary school students, middle school students, university students, and students with higher education.

[0158] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0159] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.

Claims

1. An interactive teaching system, characterized in that, The system includes: Cloud; The teacher's end is used to initiate live teaching sessions via the cloud platform; The student live streaming terminal is used to receive the teaching live stream from the cloud and display it according to the teaching live stream; The student operation terminal is used to display the sandbox environment instance through the cloud, obtain the student interface, and obtain student operation data based on the student interface, wherein the student operation data is used to update the sandbox environment instance. The assistance terminal is also used to display the interface screen of the sandbox environment instance in read-only mode to obtain an assistance interface, or to access the sandbox environment instance through the cloud in assistance mode and display the sandbox environment instance through the cloud to obtain an assistance interface.

2. The interactive teaching system according to claim 1, characterized in that, The cloud platform includes a cloud desk cluster and a backend management cluster. Each cloud desk in the cloud desk cluster is a sandbox environment instance. Each cloud desk in the cloud desk cluster is connected to one of the student operation terminals. The backend management cluster communicates with the cloud desk cluster, the teacher terminal, the student live streaming terminal, the student operation terminal, and the assistant terminal. The cloud desk cluster communicates with the assistant terminal and the student operation terminal.

3. The interactive teaching system according to claim 2, characterized in that, The sandbox environment instance includes a screen synchronization proxy; The screen synchronization agent is used to capture the screen of the student interface to generate monitoring data and synchronize the monitoring data to the cloud desk cluster. The assistance terminal is used to obtain the monitoring data through the cloud desk cluster and display the monitoring data to obtain the assistance interface.

4. The interactive teaching system according to claim 1, characterized in that, The assistance terminal is also used to send assistance instructions to the cloud, or the student operation terminal is also used to send assistance instructions to the cloud. The cloud platform is used to respond to the assistance command and update the remote mode to assistance mode; The assistance terminal is also used to obtain teacher operation data according to the assistance interface when the remote mode is assistance mode, wherein the teacher operation data is used to update the sandbox environment instance. The assist terminal is also used to send an end command to the cloud, or the student operation terminal is also used to send an end command to the cloud; The cloud platform is used to respond to the termination command and control the cessation of the step of obtaining teacher operation data based on the assistance interface.

5. The interactive teaching system according to claim 4, characterized in that, The student interface is used to display a sandbox environment instance via the cloud, resulting in a student interface, including: Obtain student identity information, perform login verification based on the student identity information, and obtain the verification result; When the verification result is successful, the course information is obtained based on the student's identity information and used as the target course information; The student interface is obtained by displaying a sandbox environment instance corresponding to the target course information through the cloud.

6. The interactive teaching system according to claim 5, characterized in that, The cloud is also used to load a Windows virtual machine image corresponding to the target course information to generate an independent instance corresponding to the student's identity information, and to use the independent instance as the sandbox environment instance. The student's operating terminal establishes and maintains a remote connection with the sandbox environment instance in the cloud for display, thereby obtaining the student's interface.

7. The interactive teaching system according to claim 1, characterized in that, The student live streaming terminal is also used to acquire student interaction data and send the student interaction data to the cloud, wherein the student interaction data includes audio or video. The teacher's end is also used to obtain and display the student interaction data from the cloud.

8. The interactive teaching system according to claim 1, characterized in that, The cloud is also used to obtain a get out of class termination instruction from the student's live streaming terminal or the teacher's terminal, and to obtain the course mode based on the student's identity information in the get out of class termination instruction; The cloud is also used to generate backup data based on the sandbox environment instance when the course mode is exclusive, and to destroy or reset the sandbox environment instance when the course mode is shared. The student interface is used to display a sandbox environment instance through the cloud to obtain a student interface, including: when the course mode is exclusive, displaying a sandbox environment instance through the cloud based on the backup data to obtain the student interface; When the course mode is shared, the student interface is obtained by displaying an initialized sandbox environment instance in the cloud.

9. The interactive teaching system according to claim 2, characterized in that, The cloud desk cluster communicates with the student's operating terminal via VNC protocol or WebSocket + custom protocol; The cloud desk cluster communicates with the assisting terminal via VNC protocol or WebSocket + custom protocol; The live teaching communication between the student's live streaming client and the cloud is conducted via the WebRTC / RTMP protocol, and the login verification between the student's live streaming client and the cloud is conducted via the HTTP protocol and the JSON communication protocol. The live teaching session between the teacher's client and the cloud is conducted via the WebRTC / RTMP protocol, and the login verification between the teacher's client and the cloud is conducted via the HTTP and JSON communication protocols.

10. The interactive teaching system according to claim 2, characterized in that, The teacher terminal, the backend management cluster, and the student live streaming terminal use a first data channel for data transmission, while the student operation terminal, the cloud desk cluster, and the assistance terminal use a second data channel for data transmission. The first data channel and the second data channel are set up independently.

11. The interactive teaching system according to claim 1, characterized in that, The student operating terminal is also used to acquire student query data, match answer data with the question-and-answer knowledge base built into the student operating terminal to obtain target data, and display the target data. The answer data includes one or more of answer text, answer audio, and answer video, and the answer data is pre-generated and stored in the question-and-answer knowledge base.

12. The interactive teaching system according to claim 2, characterized in that, The teacher's end is also used to send sharing commands to the cloud desk cluster; The cloud desk cluster is also used to generate sharing data based on the sandbox environment instance corresponding to the sharing instruction, and send the sharing data to the backend management cluster. The backend management cluster is also used to send the teaching live stream initiated by the teacher and the sharing data to the student live stream for packaging, so as to obtain the updated teaching live stream; The student live streaming terminal is also used to display the teaching live stream initiated by the teacher terminal and the shared data based on the updated teaching live stream.

13. The interactive teaching system according to claim 1, characterized in that, The assist terminal is also used to obtain a read-only switching instruction and send the read-only switching instruction to the cloud. The student operating terminal is also used to obtain the read-only switching instruction from the cloud, and stop obtaining the student operation data from the student interface according to the read-only switching instruction.

14. The interactive teaching system according to claim 1, characterized in that, The student live streaming terminal is further configured to obtain a first screenshot command, capture the screen of the teaching live stream displayed on the student live streaming terminal according to the first screenshot command, obtain a first image, and store the first image in a first library; and / or, The student's operating terminal is also used to obtain a second screenshot command, capture the screen of the student's interface according to the second screenshot command, obtain a second image, and store the second image in a second library.

15. The interactive teaching system according to claim 1, characterized in that, The live teaching session comprises live data containing explanations of business theory and demonstrations of practical projects. The sandbox environment instance is a virtual machine instance containing the software environment and data templates required for entrepreneurship simulation, enabling the interactive teaching system to be suitable for entrepreneurship guidance services; and / or, The live teaching session is live data containing programming instruction and project demonstrations. The sandbox environment instance is a virtual machine instance containing the software environment and data templates required for programming instruction, so that the interactive teaching system is suitable for programming instruction services; and / or, The live teaching session is live data containing corporate training lectures and project demonstrations. The sandbox environment instance is a virtual machine instance of the software environment and data templates required for corporate training, so that the interactive teaching system can be used for corporate training services.

Images