Remote interaction method, supervised learning system, and storage medium

Abstract

The application relates to the technical field of remote monitoring, and discloses a remote interaction method. The method is applied to a supervised learning system, the supervised learning system comprises a learning client, a supervision client and a server; the method comprises the following steps: the server acquires shared related information sent by the supervision client in response to a tutoring mode instruction; the server sends shared materials to the learning client according to the shared related information, the shared materials are used for display on the learning client; and the server sends abnormal prompt information to the supervision client when it is determined that the learning client has display abnormities. The server sends the shared materials determined by the supervision client to the learning client, so that the learning client can synchronously display; and the server sends abnormal prompt information to the supervision client when the learning client has display abnormities, so that the supervision user can remotely tutor and supervise the learning of the learning user. The application further discloses a supervised learning system and a storage medium.

Description

Technical Field

[0001] This application relates to the field of remote monitoring technology, such as a remote interaction method, a supervised learning system, and a storage medium. Background Technology

[0002] As people's living standards continue to improve and the electronic communications industry develops rapidly, people's channels for obtaining information have become increasingly diversified. In family life, electronic devices with display functions, such as televisions, have quickly become an indispensable part of the home, thanks to their ability to simultaneously transmit pictures, documents, audio, and video. For example, televisions have become an important tool for children's learning and entertainment in the family.

[0003] However, in most families, parents cannot be with their children continuously after school due to work or other reasons. Children have limited self-control and concentration, and without parental supervision, effective supervision of their studies and guidance on homework are impossible. This poses a challenge for children to complete their homework efficiently. Therefore, how parents can provide homework guidance and supervision when they are not present is a crucial issue that urgently needs to be addressed by those skilled in the art.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0006] This disclosure provides a remote interaction method, a supervised learning system, and a storage medium to address the issues of homework tutoring and learning supervision for children when parents are not present.

[0007] In some embodiments, the remote interaction method is applied to a supervised learning system, which includes a learning client, a supervisory client, and a server. The method includes: the server responding to a tutoring mode instruction to obtain shared information sent by the supervisory client; the server sending shared materials to the learning client based on the shared information, the shared materials being displayed on the learning client; and the server sending an error message to the supervisory client if it determines that there is a display anomaly on the learning client.

[0008] In some embodiments, the sharing-related information includes the type information of the shared materials. The server sends the shared materials to the learning client based on the sharing-related information, including: the server determining the target sending method of the shared materials based on the type information of the shared materials; and the server sending the shared materials to the learning client in the target sending method.

[0009] In some embodiments, the server determines the target sending method of the shared material based on the type information of the shared material, including: if the type information of the shared material conforms to a first format type, determining the target sending method as sending the shared material and its corresponding identification information; if the type information of the shared material conforms to a second format type, determining the target sending method as sending the transmission parameters associated with the shared material.

[0010] In some embodiments, a display anomaly in the learning client is determined by the following method: the server obtains the current playback interface of the monitoring client, and the current display interface of the learning client when the current playback interface is obtained; if the current display interface does not match the current playback interface, the server determines that a display anomaly exists in the learning client.

[0011] In some embodiments, after the server sends shared materials to the learning client, the remote interaction method further includes: the server obtaining the first operation behavior of the learning user on the learning client; the server determining the target operation intention of the learning user based on the first operation behavior; and the server sending the operation instruction corresponding to the first operation behavior to the monitoring client if the server determines that the target operation intention conforms to the preset intention.

[0012] In some embodiments, after the server sends shared materials to the learning client, the remote interaction method further includes: the server obtaining a second operation behavior of the supervising user on the supervising client; the server sending the operation instruction corresponding to the second operation behavior to the learning client, so that the learning client displays the second operation behavior while displaying the shared materials.

[0013] In some embodiments, before acquiring the shared information sent by the supervisory client, the remote interaction method further includes: the server acquiring first network connection information of the learning client and second network connection information of the supervisory client; the server determining the activation conditions of the tutoring mode based on the first network connection information; and the server acquiring the shared information only after determining that the second network connection information meets the activation conditions.

[0014] In some embodiments, the remote interaction method is applied to a supervised learning system, which includes a learning client, a supervisory client, and a server. The method includes: the supervisory client responding to a tutoring mode instruction sending shared information to the server, so that the server sends shared materials to the learning client based on the shared information, the shared materials being displayed on the learning client; and the supervisory client receiving an error message from the server if it determines that there is a display anomaly on the learning client.

[0015] In some embodiments, the supervised learning system includes a learning client, a supervising client, and a server, wherein the server is configured to perform the remote interaction method as described above.

[0016] In some embodiments, the storage medium stores program instructions that, when executed, perform the remote interaction method described above.

[0017] The remote interaction method, supervised learning system, and storage medium provided in this disclosure can achieve the following technical effects:

[0018] In the tutoring mode of the supervised learning system, the server sends shared materials to the learning client based on the shared information sent by the supervising client and monitors the learning client's display of the shared materials. When display anomalies occur on the learning client, the server sends an error message to the supervising client, enabling the supervising user to remotely monitor the display of shared materials on the learning client. In this way, by sending the shared materials determined by the supervising client to the learning client for display and promptly alerting the supervising user when display anomalies occur, without excessively consuming communication network resources for screen control, the supervising user, even when not physically present, can provide homework tutoring and learning supervision to the learning user.

[0019] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0020] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein:

[0021] Figure 1 This is a schematic diagram of a remote interaction method provided in an embodiment of this disclosure;

[0022] Figure 2 This is a schematic diagram of another remote interaction method provided in an embodiment of this disclosure;

[0023] Figure 3This is a schematic diagram of another remote interaction method provided in an embodiment of this disclosure;

[0024] Figure 4 This is a schematic diagram of another remote interaction method provided in an embodiment of this disclosure;

[0025] Figure 5 This is a schematic diagram of another remote interaction method provided in an embodiment of this disclosure;

[0026] Figure 6 This is a schematic diagram of another remote interaction method provided in an embodiment of this disclosure;

[0027] Figure 7 This is an interactive schematic diagram of a supervised learning process provided in an embodiment of this disclosure;

[0028] Figure 8 This is a schematic diagram of a remote interaction device provided in an embodiment of this disclosure. Detailed Implementation

[0029] To provide a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this disclosure. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0030] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this disclosure described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0031] This disclosure provides a supervised learning system, which includes a learning client, a supervising client, and a server. Understandably, this supervised learning system is primarily used to address the issue of remote tutoring and supervision between a supervising user on the supervising client and a learning user on the learning client. Therefore, the learning client and the supervising client rely on different terminal devices. Generally, the learning client and the supervising client are also connected to different local area networks.

[0032] In this solution, the learning client and the supervision client have communication capabilities, and the server can also communicate with both the learning client and the supervision client separately. The server of the supervised learning system can be deployed on a cloud server or a separately configured smart gateway; no specific limitation is made here.

[0033] In this embodiment, both the learning client and the monitoring client are located on a user-operable terminal device. The terminal device can refer to an electronic device with wireless connectivity, which can connect to the internet and communicate with the server. The specific communication method is not limited here; it can be via Bluetooth, Wi-Fi, or other methods.

[0034] In some embodiments, the terminal device can be a mobile device, a computer, an in-vehicle device, or any combination thereof. Mobile devices may include, for example, mobile phones, smart home devices, wearable devices, smart mobile devices, virtual reality devices, or any combination thereof, devices with display functions. Smart home devices refer to home products formed by incorporating microprocessors, sensor technology, and network communication technology. They possess characteristics of intelligent control, intelligent sensing, and intelligent applications. The operation of smart home devices often relies on the application and processing of modern technologies such as the Internet of Things (IoT), the Internet, and electronic chips. For example, smart home devices can be connected to electronic devices to enable users to remotely control and manage them; for instance, a smart home device can be a smart TV.

[0035] According to one aspect of the embodiments of this disclosure, a remote interaction method is provided, comprising: in response to a tutoring mode instruction, acquiring sharing-related information sent by a supervisory client; sending shared materials to a learning client based on the sharing-related information, the shared materials being displayed on the learning client; and, if it is determined that there is a display anomaly on the learning client, sending an anomaly prompt message to the supervisory client. As an optional implementation, the above-described remote interaction method may be applied to, but is not limited to, the server side of a supervised learning system; that is, the remote interaction method provided in the embodiments of this disclosure can be executed through the server side of a supervised learning system.

[0036] Combination Figure 1 As shown, in some embodiments, the specific process of this remote interaction method may include the following steps:

[0037] S110, The server obtains the shared information sent by the monitoring client.

[0038] S120. The server sends shared materials to the learning client based on the shared information, and the shared materials are displayed on the learning client.

[0039] S130. If the server determines that there is a display error on the learning client, it sends an error message to the monitoring client.

[0040] Using the remote interaction method provided in this embodiment, when the supervised learning system is in tutoring mode, the server sends shared materials to the learning client based on the shared information sent by the supervising client, and monitors the learning client's display of the shared materials. When the learning client exhibits display anomalies, the server sends an anomaly alert to the supervising client, enabling the supervising user to remotely monitor the display of the shared materials on the learning client. In this way, by having the server send the shared materials determined by the supervising client to the learning client for display, and promptly alert the supervising user when display anomalies occur, without excessively consuming communication network resources for screen control, the supervising user, even when not physically present, can provide homework tutoring and learning supervision to the learning user.

[0041] Optionally, the learning client is set on the first terminal device, and the supervision client is set on the second terminal device. Taking parents remotely tutoring their children's homework as an example, the first terminal device can be a smart TV, and the second terminal device can be the parent's mobile phone.

[0042] Understandably, the learning user is in the learning client, and can perform operations on the first terminal device to enable the learning client to receive the learning user's operation instructions; the supervising user is in the supervising client, and can perform operations on the second terminal device to enable the supervising client to receive the supervising user's operation instructions.

[0043] In step S110, the sharing-related information can be used to characterize the shared material itself, which the server can obtain, and all information related to the shared material. In this embodiment, the sharing-related information may include one or more of the following: shared material, storage address of the shared material, and transmission parameters of the shared material. In this way, the server can uniquely determine the shared material to be sent to the learning client based on the sharing-related information.

[0044] In step S120, the server can determine the specific content of the shared materials, the target sending method of the shared materials, and the operation instructions corresponding to the monitored user actions based on the shared information. Specifically, the specific content of the shared materials can be determined based on the storage address of the shared materials and / or the transmission parameters of the shared materials. In this way, determining the specific content of the shared materials not only allows the server to determine the shared materials that need to be sent to the learning client, but also facilitates the server to determine the type information of the shared materials and the sending method based on their specific content.

[0045] In this solution, the server can combine the parameters passed to the shared materials with control commands to obtain a link to the shared materials that the learning client can execute.

[0046] As an alternative embodiment, such as Figure 2 As shown, step S120 further includes:

[0047] S121. The server determines the target sending method of the shared material based on the type information of the shared material.

[0048] S122. The server sends shared materials to the learning client using the target sending method.

[0049] Using the remote interaction method provided in this disclosure, after obtaining the sharing-related information sent by the monitoring client, the server determines the sending method of the shared materials based on the type information of the shared materials in the sharing-related information, so that the server can send the shared materials to the learning client through the target sending method. In this solution, after determining the specific content of the shared materials, the server distinguishes the types of shared materials to transmit different types of shared materials in different ways. This improves the sharing method between the monitoring client and the learning client, enabling the transmission and sharing of shared materials using limited communication network resources, avoiding the use of sharing methods that excessively occupy the communication network, and providing convenience for monitoring users to remotely tutor learning users.

[0050] Optionally, the shared information includes the type information of the shared material, which can be the format type. In this solution, the format type can include document file format, image file format, video file format, audio file format, web page link, etc. Thus, the monitoring client needs to first determine the format type of the shared material. After the monitoring client determines the format type of the shared material, it sends the shared information, including the format type, to the server.

[0051] In some embodiments, the server sends shared materials to the learning client based on shared information, including: the server determining the target sending method of the shared materials based on the type information of the shared materials; and the server sending the shared materials to the learning client using the target sending method.

[0052] Optionally, the server determines the target sending method for the shared materials based on the type information of the shared materials. This includes: if the type information of the shared materials conforms to a first format type, determining the target sending method as sending the shared materials and their corresponding identification information; if the type information of the shared materials conforms to a second format type, determining the target sending method as sending the transmission parameters associated with the shared materials. In this solution, if the above-mentioned format types conform to document file formats, image file formats, and webpage links, the type information of the shared materials is determined to conform to the first format type; if the above-mentioned format types conform to video file formats and audio file formats, the type information of the shared materials is determined to conform to the second format type.

[0053] In this embodiment of the disclosure, the term "correspondence" can refer to an association or binding relationship. For example, after the server receives the sharing-related information sent by the monitoring client, it determines that the shared material is a collection of images, and the server assigns a number to each image in the shared material; at this time, the identification information corresponding to the shared material can refer to the number of each image. It is understandable that after assigning numbers to the shared material, the server can determine the content of the page being displayed by the learning client by obtaining the number of the page being displayed by the learning client. This makes it easier for the server to obtain information about the display status of the learning client.

[0054] Optionally, sending shared materials and their corresponding identification information includes: the server receiving the shared materials sent by the monitoring client, as well as the identification information of the shared materials; the server sending the shared materials and their corresponding identification information to the learning client, so that the learning client can display the shared materials on the first terminal device and save the shared materials and their identification information on the first terminal device.

[0055] Specifically, during the process of displaying shared materials on the first terminal device, the learning client can scale the display of the shared materials according to the display screen size of the first terminal device to ensure the display effect of the shared materials on the first terminal device, thereby making it easier for learning users to view.

[0056] Optionally, the transmission parameters associated with the shared materials are sent, including: the server receiving the shared materials sent by the monitoring client; if the shared materials are determined to be in video or audio file format, the server generating a playback link for the shared materials and sending the playback link to the learning client. Understandably, video and audio files occupy a large amount of space, and direct transmission would excessively consume communication network resources. Therefore, by sending the corresponding playback link to the learning client after determining that the shared materials are video or audio files, the server can utilize limited communication network resources to achieve the transmission and sharing of shared materials, thereby improving the response speed of the first terminal device.

[0057] In step S130, the server needs to determine whether there is a display anomaly in the learning client based on the display of shared materials and the monitoring of user operation behavior by the learning client; and if the server determines that there is a display anomaly in the learning client, it sends an anomaly prompt message to the monitoring client.

[0058] Optionally, the server can determine if there is a display anomaly in the learning client by obtaining the current playback interface of the monitoring client and the current display interface of the learning client when obtaining the current playback interface; if the current display interface does not match the current playback interface, the server determines that there is a display anomaly in the learning client.

[0059] In this embodiment of the disclosure, a mismatch between the currently displayed interface and the currently playing interface may include: determining that the currently displayed interface and the currently playing interface are inconsistent; or, the second operation performed by the monitoring user on the monitoring client is not reflected in the currently displayed interface. When the server detects the aforementioned display anomaly, it will send an anomaly notification message to the monitoring client.

[0060] Optionally, the server may send an error message to the monitoring client, which could include a prompt for the monitoring client to click the share button. The server prompts the monitoring user to click the share button, thus synchronizing the current playback interface of the monitoring client to the learning client. The monitoring client may be configured with a share button, which can be a button on a second terminal device or a touch button provided by the monitoring client. Clicking the share button by the monitoring user triggers the learning client to synchronously display the shared material played by the monitoring client.

[0061] In practical applications, display anomalies on the learning client are usually caused by untimely synchronization. The steps performed by the server can effectively solve the problem of untimely synchronization. The server can detect the display status of the learning client and promptly notify the monitoring client when display anomalies occur, prompting the monitoring user to perform operations to correct the synchronization anomalies.

[0062] This allows the supervising user to operate a second terminal device, thereby synchronizing the current display interface of the learning client with the current playback interface of the supervising client, and thus enabling remote supervision of the display of shared materials on the learning client.

[0063] As an alternative embodiment, such as Figure 3 As shown, step S130 further includes:

[0064] S131. The server obtains the current playback interface of the monitoring client, and the current display interface of the learning client when obtaining the current playback interface.

[0065] S132. If the server determines that there is a display error in the learning client when the current display interface does not match the current playback interface.

[0066] Using the remote interaction method provided in this embodiment, when the server discovers that the current display interface of the learning client is inconsistent with the current playback interface of the monitoring client, it can determine that there is a display abnormality in the learning client. At this time, the server sends an abnormality prompt message to the monitoring client so that the monitoring user can operate the second terminal device to synchronize the current display interface of the learning client with the current playback interface of the monitoring client, thereby realizing remote monitoring of the display of shared materials on the learning client.

[0067] In some embodiments, after the server sends shared materials to the learning client, the remote interaction method further includes: the server acquiring the first operational behavior of the learning user on the learning client; and the server sending the operation instruction corresponding to the first operational behavior to the supervision client. This achieves reverse sharing from the learning client to the supervision client, allowing the supervision user to intuitively understand the learning user's expression through a second terminal device, thereby achieving a better tutoring effect for the learning user.

[0068] In other embodiments, after the server sends shared materials to the learning client, the remote interaction method further includes: the server obtaining the first operation behavior of the learning user on the learning client; the server determining the target operation intention of the learning user based on the first operation behavior; and the server sending the operation instruction corresponding to the first operation behavior to the monitoring client if the target operation intention is consistent with the preset intention.

[0069] In this embodiment, the first terminal device can be a smart TV with touch functionality. The learning user can perform a first operation by directly touching the screen of the first terminal device. Since the learning user's first operation on the learning client may fall into two categories: one is that during the sharing of materials, the learning user has ideas or questions and needs to convey information to the supervising user; the other is that the learning user wishes to engage in other entertainment activities by operating the first terminal device. In this solution, when the server detects that the learning user has performed a first operation, it determines the subsequent execution content by determining the learning user's target operation intention.

[0070] As another alternative embodiment, such as Figure 4 As shown, after performing step S120, the remote interaction method may further include the following steps:

[0071] S140. The server obtains the first operation behavior of the learning user on the learning client.

[0072] S150. The server determines the target operation intent of the learning user based on the first operation behavior.

[0073] S160. If the server determines that the target operation intent matches the preset intent, it sends the operation instruction corresponding to the first operation behavior to the monitoring client.

[0074] In step S140, the first operational behavior can be used to characterize the learning user's control operations on the first terminal device.

[0075] In step S150, the server determines the target operation intent of the learning user based on the first operation behavior, which may include: if the first operation behavior indicates that the learning user clicks or swipes on the displayed page, determining the target operation intent as an interactive intent; if the first operation behavior indicates that the learning user zooms out or closes the displayed page, determining the target operation intent as an entertainment intent.

[0076] In step S160, the preset intent can be the learning user's interaction intent. That is, the server will only send the operation instruction corresponding to the learning user's first operation to the monitoring client if it determines that the target operation intent of the learning user's first operation conforms to the interaction intent. This allows the monitoring user to intuitively understand the learning user's expression through the second terminal device, thereby achieving a better tutoring effect for the learning user. Conversely, if the server determines that the target operation intent of the learning user's first operation does not conform to the interaction intent, for example, if the target operation intent conforms to the entertainment intent, the server will send an exception prompt message to the monitoring client to remind the monitoring user to pay attention to the learning user's learning status, thereby achieving the effect of remote learning supervision for the learning user.

[0077] In some embodiments, after the server sends shared materials to the learning client, the remote interaction method further includes: the server acquiring a second operation behavior of the supervising user on the supervising client; the server sending the operation instruction corresponding to the second operation behavior to the learning client, so that the learning client displays the second operation behavior while displaying the shared materials. In this scheme, the second operation behavior can be used to characterize the supervising user's control operation on the second terminal device.

[0078] As an alternative embodiment, such as Figure 5 As shown, after performing step S120, the remote interaction method may further include the following steps:

[0079] S170. The server obtains the second operation behavior of the monitoring user on the monitoring client.

[0080] S180. The server sends the operation instruction corresponding to the second operation to the learning client.

[0081] In step S170, the first operation may include a click operation and a swipe operation, wherein the click operation includes a single click and a double click.

[0082] In step S180, the learning client can display a small hand icon at the corresponding position for a single click; the learning client can display the next page for a double click; and the learning client can display a red line along the swipe path for a swipe operation.

[0083] In some embodiments, whether a learning user or a supervising user wants to view previously displayed shared screens, they can do so by selecting a screen number or by performing a preset swipe operation. During the viewing process, if any user wants to share the screen they are viewing, they can send a sharing request to the server via the share button. The server can then send the corresponding screen number to the recipient to achieve synchronous sharing.

[0084] In some embodiments, before acquiring the shared information sent by the supervisory client, the remote interaction method further includes: the server acquiring first network connection information of the learning client and second network connection information of the supervisory client; the server determining the activation conditions of the tutoring mode based on the first network connection information; and the server acquiring the shared information only after determining that the second network connection information meets the activation conditions.

[0085] Optionally, the server can determine the activation conditions of the tutoring mode in the following way: the activation condition is determined to be that the second network connection information indicates that the monitoring client and the learning client are connected to different networks. Since the remote interaction method provided in this embodiment is mainly aimed at the scenario of parents remotely supervising their children's learning at home, in this solution, the activation conditions of the tutoring mode include the case that the learning client and the monitoring client are connected to different networks.

[0086] As an alternative embodiment, such as Figure 6 As shown, before performing step S110, the remote interaction method may further include the following steps:

[0087] S210, The server obtains the first network connection information of the learning client and the second network connection information of the monitoring client.

[0088] S220: The server determines the activation conditions of the tutoring mode based on the first network connection information.

[0089] S230. The server determines whether the second network connection information meets the startup conditions of the tutoring mode.

[0090] Using the remote interaction method provided in this embodiment, when the server responds to the tutoring mode command and determines that the second network connection information of the supervising client meets the activation conditions of the tutoring mode, the server sends shared materials to the learning client based on the sharing-related information sent by the supervising client, and monitors the display of the shared materials on the learning client. When there is a display anomaly on the learning client, the server sends an anomaly alert to the supervising client, enabling the supervising user to remotely monitor the display of the shared materials on the learning client. In this way, by sending the shared materials determined by the supervising client to the learning client for display and promptly alerting the supervising user when there is a display anomaly on the learning client, without excessively consuming communication network resources for screen control, the supervising user, even if not physically present, can provide homework tutoring and learning supervision to the learning user.

[0091] According to another aspect of the present disclosure, a remote interaction method is also provided, comprising: a monitoring client responding to a tutoring mode instruction to send sharing-related information to a server, so that the server sends shared materials to a learning client based on the sharing-related information, the shared materials being displayed on the learning client; and the monitoring client receiving an error message from the server when it is determined that there is a display anomaly on the learning client.

[0092] Using the remote interaction method provided in this embodiment, when the supervised learning system is in tutoring mode, the supervising client sends sharing-related information to the server. This enables the server to send shared materials to the learning client based on the information sent by the supervising client, and allows the supervised learning system to monitor the learning client's display of the shared materials. In this way, by sending sharing-related information to the server through the supervising client, the server then sends the shared materials determined by the supervising client to the learning client for display. Furthermore, if there are display anomalies on the learning client, the supervising user on the supervising client receives timely reminders. This eliminates the need for excessive network usage for screen control, allowing supervising users who are not physically present to provide homework tutoring and learning supervision.

[0093] In some embodiments, the supervised learning system requires binding the supervisory client and the learning client upon initial use. This binding can be achieved by logging into the same account on both a first and second terminal device.

[0094] Optionally, in tutoring mode, the supervised learning system can activate the voice communication function between the learning client and the supervising client to enable smoother communication between the supervising user and the learning user, thereby achieving better homework tutoring and learning supervision results.

[0095] In some embodiments, after the supervised learning system ends the current tutoring mode, the supervised client can delete the shared materials and their numbers stored locally during the current tutoring mode, and send the operation content to the server for recording.

[0096] Optionally, the supervised learning system can terminate the tutoring mode in the following way: Upon receiving a shared material deletion request from the supervising client, the server sends a control command to the learning client to end the current tutoring mode, causing the learning client to stop displaying the shared materials and delete the shared materials and their IDs stored locally on the learning client. Simultaneously, the server can save the shared materials and related sharing information, forming a historical sharing record.

[0097] In practical applications, such as Figure 7 As shown, when the learning client and the monitoring client are connected to different networks, the tutoring mode is activated. The monitoring client executes step S111, determining the type information of the shared material; then, step S112, the monitoring client sends the sharing-related information containing the type information of the shared material to the server. After receiving the sharing-related information containing the type information of the shared material, the server executes step S121, determining the target sending method of the shared material based on the type information, and then executes step S122, sending the shared material to the learning client using the target sending method. Upon receiving the shared material, the learning client executes step S123, displaying the shared material. During the display of the shared material on the learning client, the server can execute step S131, obtaining the current playback interface of the monitoring client and the current display interface of the learning client at the time of obtaining the current playback interface; and compare the current display interface with the current playback interface. If the current display interface and the current playback interface do not match, the server determines that there is a display anomaly on the learning client. If the server determines that there is a display anomaly on the learning client, it executes step S130 to send an anomaly notification to the monitoring client, so as to promptly remind the monitoring user and enable the monitoring user who is not near the learning user to supervise the learning user's learning.

[0098] According to another aspect of the embodiments of this disclosure, a remote interaction device is also provided. The remote interaction device includes: an acquisition module, an execution module, and a determination module; the acquisition module is configured to acquire shared information sent by a supervisory client in response to a tutoring mode instruction; the execution module is configured to send shared materials to a learning client based on the shared information, the shared materials being displayed on the learning client; the determination module is configured to send an error message to the supervisory client if the server determines that there is a display error on the learning client.

[0099] Combination Figure 8 As shown, as an optional implementation, this remote interaction device 300 includes a processor 301 and a memory 302. Optionally, the device may further include a communication interface 303 and a bus 304. The processor 301, communication interface 303, and memory 302 can communicate with each other via the bus 304. The communication interface 303 can be used for information transmission. The processor 301 can call logical instructions in the memory 302 to execute the remote interaction method of the above embodiment.

[0100] Furthermore, the logic instructions in the aforementioned memory 302 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0101] The memory 302, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of this disclosure. The processor 301 executes functional applications and data processing by running the program instructions / modules stored in the memory 302, thereby realizing the remote interaction method in the above embodiments.

[0102] The memory 302 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 302 may include high-speed random access memory and may also include non-volatile memory.

[0103] This disclosure provides a supervised learning system, including a learning client, a supervising client, and a server, wherein the server is configured to execute the remote interaction method described above.

[0104] The supervised learning system provided in this embodiment, when in tutoring mode, sends shared materials to the learning client based on the shared information sent by the supervising client and monitors the learning client's display of the shared materials. When the learning client experiences display anomalies, the server sends an error message to the supervising client, enabling the supervising user to remotely monitor the display of the shared materials. Thus, by sending the shared materials determined by the supervising client to the learning client for display and promptly alerting the supervising user when display anomalies occur, without excessively consuming communication network resources for screen control, the supervising user, even when not physically present, can provide homework tutoring and learning supervision to the learning user.

[0105] This disclosure provides a computer-readable storage medium storing computer-executable instructions configured to perform the aforementioned remote interaction method.

[0106] The aforementioned computer-readable storage medium may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0107] The technical solutions of this disclosure can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes one or more instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in this disclosure. The aforementioned storage medium can be a non-transitory storage medium, including: a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media capable of storing program code; it can also be a transient storage medium.

[0108] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0109] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0110] The methods and products (including but not limited to devices and equipment) disclosed in the embodiments herein can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed units may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected to implement this embodiment according to actual needs. Furthermore, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0111] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A remote interaction method, characterized in that, Applied to a supervised learning system, the supervised learning system includes a learning client, a supervision client, and a server, and the remote interaction method includes: The server responds to the coaching mode instruction and obtains the shared information sent by the supervising client; The server sends shared materials to the learning client based on the shared information, and the shared materials are displayed on the learning client. If the server determines that the learning client has a display anomaly, it sends an anomaly notification message to the monitoring client. Before acquiring the shared information sent by the supervisory client, the remote interaction method further includes: the server acquiring the first network connection information of the learning client and the second network connection information of the supervisory client; the server determining the activation conditions of the tutoring mode based on the first network connection information; and the server generating a tutoring mode instruction when it determines that the second network connection information meets the activation conditions.

2. The remote interaction method according to claim 1, characterized in that, The shared information includes the type information of the shared materials. The server sends the shared materials to the learning client based on the shared information, including: The server determines the target sending method of the shared material based on the type information of the shared material; The server sends shared materials to the learning client using the target sending method.

3. The remote interaction method according to claim 2, characterized in that, The server determines the target sending method of the shared material based on the type information of the shared material, including: If the type information of the shared material conforms to the first format type, the server determines that the target sending method is to send the shared material and its corresponding identification information. If the type information of the shared material conforms to the second format type, the server determines that the target sending method is to send the transmission parameters associated with the shared material.

4. The remote interaction method according to claim 1, characterized in that, The following methods were used to determine that the learning client had a display anomaly: The server obtains the current playback interface of the monitoring client, and the current display interface of the learning client when obtaining the current playback interface; If the current display interface does not match the current playback interface, the server determines that there is a display anomaly in the learning client.

5. The remote interaction method according to any one of claims 1 to 4, characterized in that, After the server sends shared materials to the learning client, the remote interaction method further includes: The server obtains the first operation behavior of the learning user on the learning client; Based on the first operation, the server determines the target operation intention of the learning user; If the server determines that the target operation intent matches the preset intent, it sends the operation instruction corresponding to the first operation behavior to the monitoring client.

6. The remote interaction method according to any one of claims 1 to 4, characterized in that, After the server sends shared materials to the learning client, the remote interaction method further includes: The server obtains the second operation behavior of the monitoring user on the monitoring client; The server sends the operation instruction corresponding to the second operation to the learning client, so that the learning client can display the second operation while displaying the shared materials.

7. The remote interaction method according to claim 1, characterized in that, The conditions for initiating the coaching model are determined in the following ways: The activation condition is determined to be that the second network connection information indicates that the networks connected to the monitoring client and the learning client belong to different networks.

8. A remote interaction method, characterized in that, Applied to a supervised learning system, the supervised learning system includes a learning client, a supervision client, and a server, and the remote interaction method includes: In response to the tutoring mode instruction, the monitoring client sends sharing-related information to the server, so that the server sends shared materials to the learning client based on the sharing-related information. The shared materials are used to be displayed on the learning client. If the monitoring client determines that there is a display anomaly in the learning client, it receives an anomaly prompt message sent by the server. The tutoring mode instruction is generated as follows: the server obtains the first network connection information of the learning client and the second network connection information of the monitoring client; the server determines the activation conditions of the tutoring mode based on the first network connection information; and the server generates the tutoring mode instruction when it determines that the second network connection information meets the activation conditions.

9. A supervised learning system, characterized in that, It includes a first client, a second client, and a server, wherein the server is configured to perform the remote interaction method as described in any one of claims 1 to 7.

10. A storage medium storing program instructions, characterized in that, When the program instructions are executed, they perform the remote interaction method as described in any one of claims 1 to 7.

Images