Remote interactive collaboration method and device

Abstract

The present application discloses a remote interactive collaboration method and device, which specifically include: when any of the preset events occurs, obtaining collaborative content information corresponding to the first learning content; sending the collaborative content information to a second electronic device; receiving collaborative work information returned by the second electronic device in response to the collaborative content information; and outputting the collaborative work information.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a remote interactive collaboration method and device. Background Art

[0002] Remote assistance is a technology that allows one computer (Remote / client) to remotely control another computer (Host / server) on the Internet. When conducting remote interactive collaboration based on existing remote assistance technology, the assistant needs to maintain a long connection with the learner to keep an eye on the learner's learning situation at any time. Furthermore, when the learner encounters difficulties, the assistant can remotely control the learner's computer and operate on behalf of the learner to solve the learner's learning problems.

[0003] However, when the assistant performs remote operation on behalf of the learner, the learner can only stop learning and watch the assistant's operation, and can continue learning after the assisted operation is completed, which affects the learner's immersive learning experience. At the same time, it also consumes a lot of the assistant's time and energy. Therefore, the efficiency of remote assisted learning in the existing technology is low and the experience is poor. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a remote interactive collaboration method and device, which can solve the problem of low efficiency of assisted learning in remote interactive collaboration.

[0005] In order to solve the above technical problems, this application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a remote interactive collaboration method, which is applied to a first electronic device, and the method includes:

[0007] When any of the preset events occurs, obtaining the collaborative content information corresponding to the first learning content;

[0008] sending the collaborative content information to a second electronic device;

[0009] receiving collaborative operation information returned by the second electronic device in response to the collaborative content information;

[0010] The collaborative operation information is output.

[0011] In a second aspect, an embodiment of the present application provides a remote interactive collaboration method, which is applied to a second electronic device, and the method includes:

[0012] Receiving collaborative content information corresponding to first learning content sent by the first electronic device;

[0013] Displaying a collaboration window control according to the type of the collaboration content information;

[0014] Outputting the collaboration content information in the collaboration window control, and acquiring the collaboration operation information input by the second user through the collaboration window control;

[0015] The collaborative operation information is sent to the first electronic device.

[0016] In a third aspect, an embodiment of the present application provides a remote interactive collaboration device, applied to a first electronic device, the device comprising:

[0017] A first acquisition module, used for acquiring collaborative content information corresponding to the first learning content when any of the preset events occurs;

[0018] A first sending module, configured to send the collaborative content information to a second electronic device;

[0019] A first receiving module is configured to receive the collaborative operation information returned by the second electronic device in response to the collaborative content information; and

[0020] The first output module is used to output the collaborative operation information.

[0021] In a fourth aspect, an embodiment of the present application provides a remote interactive collaboration device, which is applied to a second electronic device, and the device includes:

[0022] A second receiving module, configured to receive collaborative content information corresponding to the first learning content sent by the first electronic device;

[0023] An information processing module, configured to display a collaboration window control according to the type of the collaboration content information;

[0024] A second acquisition module, configured to output the collaboration content information in the collaboration window control, and acquire the collaboration operation information input by the second user through the collaboration window control;

[0025] The second sending module is used to send the collaborative operation information to the first electronic device.

[0026] In an embodiment of the present application, during the process of remote interactive collaboration between a first electronic device and a second electronic device, when any of the preset events occurs, the first electronic device sends collaborative content information corresponding to the first learning content to the second electronic device; receives collaborative work information returned by the second electronic device in response to the collaborative content information, and outputs the collaborative work information, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a flowchart of the steps of a remote interactive collaboration method provided by an embodiment of the present application;

[0028] Figure 2 is a flowchart of an example of a remote interactive collaboration method provided by an embodiment of the present application;

[0029] Figure 3 is a flowchart of another remote interactive collaboration method provided by an embodiment of the present application;

[0030] Figure 4 This is a flowchart of the steps of another remote interactive collaboration method provided by an embodiment of the present application;

[0031] Figure 5 is a block diagram of a remote interactive collaboration device provided in an embodiment of the present application;

[0032] Figure 6 is a block diagram of another remote interactive collaboration device provided in an embodiment of the present application;

[0033] Figure 7 is a structural schematic diagram of an electronic device provided by this embodiment;

[0034] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. In addition, the "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.

[0037] The remote interactive collaboration method and device provided in the embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0038] Figure 1is a flowchart of the steps of a remote interactive collaboration method provided by an embodiment of the present application, such as Figure 1 As shown, the method may include steps S101-S108.

[0039] S101: When any one of preset events occurs, the first electronic device obtains collaborative content information corresponding to the first learning content.

[0040] In this embodiment, a first remote interactive collaboration program may be installed on the first electronic device. The foreground interface of the first remote interactive collaboration program may provide a first control for opening a learning file, a second control for initiating a solution-based collaboration, and a third control for initiating an operational collaboration, as well as a display window for displaying the open learning file. Among them, the solution-based collaboration requires the assistant to provide assistance in the form of answers. The operational collaboration requires the assistant to provide assistance in the form of operational demonstrations.

[0041] In this embodiment, the first user is a user using the first electronic device. In some scenarios, the first user may be a learner, for example, a student. When the first user needs to learn through the first electronic device, it is necessary to open the first remote interactive collaboration program installed on the first electronic device. The learning file is opened in the display window through the first control in the first remote interactive collaboration program for learning. The learning file may be a learning file stored in the first remote interactive collaboration program, or a learning file stored in other programs, or a learning file stored on a set server. The storage location of the learning file is not specifically limited in this application. When the first user encounters problems during the learning process, he can click the second control or the third control to initiate remote interactive collaboration according to his own needs.

[0042] In this embodiment, a second remote interactive collaboration program may be installed on the first electronic device. The foreground interface of the second remote interactive collaboration program may provide a fourth control for initiating answer-based collaboration and a fifth control for initiating operation-based collaboration.

[0043] In this embodiment, when the first user needs to learn through the first electronic device, it is necessary to open the learning file for learning while opening the second remote interactive collaboration program installed on the first electronic device. The learning file may also be a learning file stored in other programs, or a learning file stored on a setting server. The storage location of the learning file is not specifically limited in this application. The second remote interactive collaboration program can be adjusted to a background running state when the learning file is in the foreground display state, or it can be displayed in the foreground in the form of a set icon when the learning file is in the foreground display state. When the first user encounters problems during the learning process, the second remote interactive collaboration program can be directly switched from the background running state to the foreground running state, or the second remote interactive collaboration program can be switched to the foreground running state by setting an icon, and then the first user can click the fourth control or the fifth control in the second remote interactive collaboration program according to his own needs to initiate remote interactive collaboration.

[0044] In this embodiment, the collaboration content information may be information reflecting the collaboration content. It is understandable that the first user may describe the learning problem encountered by himself through the collaboration content information.

[0045] In one embodiment, the collaborative content information may include dialogue information input by the first user and at least one item in the first file corresponding to the first learning content. The dialogue information may be in any form that can describe the learning problem. For example, the dialogue information may be voice information that describes the learning problem in the form of voice, text information that describes the learning problem in the form of text, or picture information that describes the learning problem in the form of a picture. The form of the dialogue information is not specifically limited in this application.

[0046] In this embodiment, the preset event can be triggered by the first user. It is understandable that when the first user encounters difficulties, the collaborative content information is sent to the second user. In this way, the second user does not need to pay attention to the learning status of the first user in real time, but only needs to provide targeted assistance when receiving the collaborative content information, which reduces the time and energy spent by the second user in the assistance process and improves the efficiency of remote assisted learning. Among them, the second user is the user of the second electronic device. In some scenarios, the second user can be an assistant, for example, a parent.

[0047] In one embodiment, the preset event may include a first event of receiving a first input from a first user. The first input reflects that the first user has initiated a solution-based collaboration. In an embodiment in which a first remote interactive collaboration program is installed on the first electronic device, the first user may initiate a solution-based collaboration by clicking a second control for initiating a solution-based collaboration provided in the interface of the first remote interactive collaboration program. When the first electronic device detects that the second control has been clicked, it confirms that the first input from the first user has been received.

[0048] When a first event occurs, obtaining collaborative content information corresponding to the first learning content includes: displaying a first input control; and obtaining first dialogue information input by a first user in the first input control, and using the first dialogue information as collaborative content information. The interface of the first input control may include at least one of a voice input port, a text input port, and a picture input port. When the first input control is displayed, the first user may select any input port according to his / her usage habits to input the first dialogue information describing the learning problem.

[0049] In another embodiment, the preset event may include a second event in which a second input of the first user is received. In this embodiment, the second input reflects that the first user has initiated an operational collaboration. In an embodiment in which a second remote interactive collaboration program is installed on the first electronic device, the first user may initiate an operational collaboration by clicking on a fifth control for initiating operational collaboration provided by the second remote interactive collaboration program interface. When the first electronic device detects that the fifth control has been clicked, it confirms that the second input of the first user has been received.

[0050] In the event of a second event, obtaining collaborative content information corresponding to the first learning content includes: displaying a second input control; and obtaining the second dialogue information input by the first user in the second input control, and the first file corresponding to the first learning content, and using the second dialogue information and the first file as collaborative content information. Among them, the second input box can have a similar interface setting to the first input box, which will not be repeated here. When the second input control is displayed, the first user can select any input port according to his own usage habits to input the second dialogue information describing the learning problem.

[0051] In this embodiment, the first user needs the second user to provide assistance in the form of operation display. Therefore, it is necessary to provide the first file corresponding to the first learning content of the first user as collaborative content information to the second user so that the second user can perform operation display in the first file. For example, the first learning content of the first user is painting creation. At this time, when the first user initiates operational collaboration, the drawing file corresponding to the first user initiating operational collaboration can be used as the first file corresponding to the first learning content.

[0052] In this embodiment, the preset event itself can also be set as a trigger condition. It is understandable that when the first user encounters a learning problem, he may ignore that the time spent on solving the learning problem has exceeded the normal range or he may not realize that the problem can be quickly solved by seeking help. In this case, by triggering the collaboration through the preset event, the assistant can promptly learn that the first user has the above problem, so as to provide assistance to the first user in a timely manner.

[0053] In one embodiment, the preset event may include a third event or a fourth event, wherein the third event is that no input is received within a first set time period, and the fourth event is that a first user image with a set facial expression is obtained.

[0054] In this embodiment, the remote interactive collaboration program can actively monitor the learning status of the first user. For example, when the first user turns on the remote interactive collaboration program, the remote interactive collaboration program will detect the input of the first user in real time. If no input is received within the first set time (i.e., when the third event occurs), it is assumed that the first user has encountered a problem that is difficult to solve by himself during the learning process. For another example, when the first user turns on the remote interactive collaboration program, the remote interactive collaboration program can control the camera device of the first electronic device to obtain the first user image of the first user during the learning process according to a preset rule. Detect whether the acquired first user image has a set facial expression, wherein the set facial expression can be an expression that appears when the first user encounters a problem that is difficult to solve, for example, the set facial expression can be a frown, or it can be eyes looking up, etc. When the first user image with a set facial expression is obtained (i.e., the fourth event occurs), it is assumed that the first user has encountered a problem that is difficult to solve by himself during the learning process. In some scenarios, it can also be assumed that the first user has encountered a problem that is difficult to solve by himself during the learning process when the third event and the fourth event occur at the same time.

[0055] When the third event or the fourth event occurs, the collaborative content information corresponding to the first learning content is obtained, including: obtaining a first file corresponding to the first learning content, and using the first file as the collaborative content information. Alternatively, when the third event and the fourth event occur at the same time, the first file corresponding to the first learning content is obtained, and the first file is used as the collaborative content information.

[0056] In this embodiment, the collaborative content information may include a first file corresponding to the first learning content, so that the second user can understand at which learning link the first user encountered a problem that was difficult to solve by himself, and can provide timely and targeted assistance.

[0057] S102: The first electronic device sends the collaborative content information to the second electronic device.

[0058] In this embodiment, the first electronic device may send the collaborative content information to the second electronic device via a wired network or a wireless network, or may send the collaborative content information to the second electronic device via other communication methods, which is not specifically limited in this application.

[0059] S103: The second electronic device receives the collaborative content information corresponding to the first learning content sent by the first electronic device.

[0060] In this embodiment, a remote interactive collaboration program is installed on the second electronic device to receive the collaborative content information sent by the first electronic device through the remote interactive collaboration program. The remote interactive collaboration program installed on the second electronic device can be the same as the remote interactive collaboration program installed on the first electronic device. For example, when the first remote interactive collaboration program is installed on the first electronic device, the first remote interactive collaboration program is also installed on the second electronic device. It can also be other remote interactive collaboration programs that are compatible with the remote interactive collaboration program installed on the first electronic device.

[0061] S104, the second electronic device displays a collaboration window control according to the type of the collaboration content information. It is understandable that different types of collaboration content information mean different ways in which the second user needs to provide assistance. Therefore, it is necessary to provide a corresponding collaboration window control according to the type of collaboration content information so that the second user can provide assistance to the first user in an appropriate manner.

[0062] In one embodiment, displaying a collaborative window control according to the type of collaborative content information includes: when the collaborative content information includes a first file corresponding to a first learning content, displaying a first collaborative window control for opening the first file so that a second user can view or operate the first file. And, when the collaborative content information includes conversation information input by a first user, displaying a second collaborative window control; wherein the first user is a user using a first electronic device, and the conversation information input by the first user includes at least one of text, voice, and picture. The interface of the second collaborative window control may include a display box, through which the received collaborative work content information may be output, and the interface of the second collaborative window control may also include at least one of a voice input port, a text input port, and a picture input port, so that the second user can choose an appropriate way to provide assistance.

[0063] In one embodiment, before displaying the collaboration window according to the type of the collaboration content information, the method further includes: displaying information items corresponding to the collaboration content information in an information list.

[0064] When the second electronic device receives the collaborative content information corresponding to the first learning content sent by the first electronic device, it will display an information item corresponding to the collaborative content information on the second electronic device to prompt the second user through the information item that the assistance content information has been received. In this way, even if the second user does not always pay attention to the learning status of the first user, he can also know in time that the first user has encountered learning problems.

[0065] In this embodiment, displaying the collaboration window control according to the type of the collaboration content information includes: receiving a third input for the information item; and, in response to the third input, displaying the collaboration window control according to the type of the collaboration content information.

[0066] For example, when the information item is displayed on the second electronic device, the second user can click on the information item. When the second electronic device detects that the second user clicks on the information item, it confirms that a third input corresponding to the information item has been received. When the third input is received, the collaboration window control is displayed according to the type of the collaboration content information.

[0067] S105: The second electronic device outputs the collaborative content information in the collaborative window control, and obtains the collaborative task information input by the second user through the collaborative window control.

[0068] In this embodiment, the collaborative operation information may be information describing the assistance content. It is understandable that the second user may provide assistance to the first user by providing the collaborative operation information.

[0069] In one embodiment, the homework information may include at least one of the answer information input by the second user and the operation step information displayed in the first file corresponding to the first learning content. The answer information may be in any form of voice, text and picture that can answer the collaborative problem. The answer information may be consistent with the form of the dialogue information. For example, when the first user describes the learning problem in voice form, the second user can answer the learning problem in voice form. The answer information may also be different from the form of the dialogue information. For example, when the first user describes the collaborative problem in voice form, the second user believes that the learning problem can be more effectively answered by displaying pictures, then the second user can answer the learning problem in the form of pictures. The form of the answer information is not specifically limited in this application.

[0070] In an embodiment where the preset event includes a second event of receiving a second input from a first user, the collaborative assignment information includes at least operation step information for performing operation display in a first file corresponding to the first learning content, so that when the first electronic device receives the collaborative assignment information, it can perform operation display in the first file corresponding to the first learning content according to the operation step information to assist in solving the operation problem encountered by the first user.

[0071] In this embodiment, obtaining the collaborative operation information input by the second user through the collaborative window includes: obtaining the operation step information of the second user operating the first file in the first collaborative window. The collaborative operation information includes the operation step information. The operation step information may include the order of the operation steps and the operation instructions for each operation step. When the first electronic device receives the collaborative operation information, it can perform a display operation on the first file corresponding to the first learning content according to the operation step information to assist the first user in solving problems encountered during the operation.

[0072] S106: The second electronic device sends the collaborative operation information to the first electronic device.

[0073] S107: The first electronic device receives the collaborative operation information returned by the second electronic device in response to the collaborative content information.

[0074] S108: The first electronic device outputs collaborative work information.

[0075] In this embodiment, the first electronic device may output the collaborative operation information when receiving the collaborative operation information, or may output the collaborative operation information when a set condition is met.

[0076] In one embodiment, before outputting the collaborative homework information, the method further includes: obtaining the second learning content when the collaborative homework information is received. Verifying whether the second learning content is consistent with the first learning content. In the case where the second learning content is inconsistent with the first learning content, verifying whether the set conditions are met. In the case where any of the set conditions is met, the collaborative homework information is output. The set conditions include at least one of the first condition and the second condition, the first condition is to complete the second learning content, and the second condition is that no input is received within a second set time length.

[0077] It is understandable that when any of the set conditions is met, it proves that the first user has completed the current learning task or is in a resting state. At this time, outputting the collaborative homework information can avoid interfering with the learning process of the first user and increase the immersive learning experience of the first user. At the same time, it can also assist the first user in solving problems encountered in the learning process.

[0078] In one embodiment, when the second learning content is inconsistent with the first learning content, after outputting the collaborative assignment information, the second file corresponding to the second learning content is displayed, thereby automatically jumping to open the second learning file currently being studied for the first user, thereby improving the first user's user experience.

[0079] In an embodiment where the collaborative assignment information includes operation step information, outputting the collaborative assignment information includes: displaying corresponding operation steps in a first file corresponding to the first learning content according to the operation step information, so as to assist the first user in solving operation-related problems.

[0080] In this embodiment, when any of the preset events occurs, the first electronic device obtains the collaborative content information corresponding to the first learning content. The collaborative content information is sent to the second electronic device. The second electronic device receives the collaborative content information corresponding to the first learning content sent by the first electronic device. According to the type of the collaborative content information, a collaborative window control is displayed. The collaborative content information is output in the collaborative window control, and the collaborative work information input by the second user through the collaborative window control is obtained. The collaborative work information is sent to the first electronic device. The first electronic device receives the collaborative work information returned by the second electronic device for the collaborative content information. The collaborative work information is output. As a result, the second user does not need to maintain a long connection with the first user and always pay attention to the learning status of the first user. He only needs to assist the first user in solving the problem by providing the collaborative work information when receiving the collaborative content information, thereby reducing the time and energy consumption of the second user in the collaborative process and improving the efficiency of remote assisted learning.

[0081] The following describes the steps of an example of a remote collaboration method in combination with a scenario. The scenario is as follows: a student creates a drawing through a first remote interactive collaboration program installed on a first electronic device, and asks a parent to show the drawing steps of a first graphic during the drawing creation process. The parent performs remote interactive collaboration through the first remote interactive collaboration program installed on a second electronic device.

[0082] Figure 2 is a flowchart of an example of a remote interactive collaboration method provided by an embodiment of the present application, such as Figure 2 As shown, the method may include steps S201-S208.

[0083] S201: When receiving a second input from a student, the first electronic device displays a second input control.

[0084] In this embodiment, when the student clicks on the third control on the first remote interactive collaboration program interface, it is determined that the first electronic device has received the student's second input.

[0085] S202, the first electronic device obtains, through the second input control, second dialogue information reflecting that the student invites the parents to display the first image drawing steps, and obtains the student's first drawing file. The first drawing file is the drawing file corresponding to when the student clicks the third control.

[0086] S203: The first electronic device sends the first drawing file and the second conversation information as collaborative content information to the second electronic device used by the parent.

[0087] S204: When the collaboration content information is received, the second electronic device displays an information item corresponding to the collaboration content information.

[0088] S205: When the parent clicks on the information item, the second electronic device opens the first drawing file through the first collaborative window control, and displays the second dialogue information through the second collaborative window control.

[0089] S206, the second electronic device obtains step information of the parent drawing the first image in the first collaborative window control, wherein the step information includes the order of the steps and the operation instructions corresponding to the steps.

[0090] S207: The second electronic device sends the acquired operation step information as collaborative task information to the first electronic device.

[0091] S208, when the first electronic device receives the collaborative homework information, it obtains the student's second drawing file. The second drawing file is the drawing file corresponding to when the collaborative homework information is received.

[0092] S209, the first electronic device checks whether the contents of the first drawing file and the second drawing file are consistent, and if they are inconsistent, determines whether a second condition of not receiving any input within a second time length is satisfied.

[0093] S210: When the first electronic device determines that the second condition is met, the first electronic device opens a pre-stored first drawing file, and displays a drawing of the first image on the first drawing file according to the operation step sequence and the operation instruction in the collaborative task information.

[0094] S211: After outputting the collaborative work information, the first electronic device opens the second drawing file.

[0095] In this embodiment, through the above steps, parents do not need to maintain a long connection with students and pay attention to the students' learning status at all times. They only need to assist students in solving problems by providing collaborative homework information when receiving collaborative content information, thereby reducing the time and energy consumption of parents in the collaborative process and improving the efficiency of remote assisted learning. At the same time, during the process of parents' collaboration, students can continue to maintain immersive learning without being disturbed, and solve their own problems through the received collaborative homework information at the appropriate time, thereby improving the user experience.

[0096] Figure 3 is a flowchart of another remote interactive collaboration method provided by an embodiment of the present application, the method is implemented by a first electronic device, such as Figure 3 As shown, the method may include the following steps S301-S304.

[0097] S301: When any one of the preset events occurs, obtain collaborative content information corresponding to the first learning content.

[0098] This step is the same as step S101 and will not be described again here.

[0099] S302: Send the collaborative content information to the second electronic device.

[0100] This step is the same as step S102 and will not be described again here.

[0101] S303: Receive collaborative operation information returned by the second electronic device in response to the collaborative content information.

[0102] This step is the same as step S106 and will not be described again here.

[0103] S304: Output collaborative work information.

[0104] This step is the same as step S108 and will not be described again here.

[0105] In this embodiment, during the remote interactive collaboration between the first electronic device and the second electronic device, when any of the preset events occurs, the first electronic device sends the collaborative content information corresponding to the first learning content to the second electronic device; receives the collaborative work information returned by the second electronic device in response to the collaborative content information, and outputs the collaborative work information, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning.

[0106] Figure 4 is a flowchart of another remote interactive collaboration method provided by an embodiment of the present application, the method is implemented by a second electronic device, such as Figure 4 As shown, the method may include the following steps S401-S404.

[0107] S401: Receive collaborative content information corresponding to first learning content sent by a first electronic device.

[0108] This step is the same as step S103 and will not be described again here.

[0109] S402: Display a collaboration window control according to the type of collaboration content information.

[0110] This step is the same as step S104 and will not be described again here.

[0111] S403: Output the collaborative content information in the collaborative window control, and obtain the collaborative task information input by the second user through the collaborative window control.

[0112] This step is the same as step S105 and will not be described again here.

[0113] S403: Send the collaborative operation information to the first electronic device.

[0114] This step is the same as step S106 and will not be described again here.

[0115] In this embodiment, during the remote interactive collaboration between the first electronic device and the second electronic device, the second electronic device receives the collaborative content information corresponding to the first learning content sent by the first electronic device, displays the collaborative window control according to the type of the collaborative content information, outputs the collaborative content information in the collaborative window control, obtains the collaborative work information input by the second user through the collaborative window control, and sends the collaborative work information to the first electronic device, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning.

[0116] Figure 5 is a block diagram of a remote interactive collaboration device provided in an embodiment of the present application, which is applied to a first electronic device, such as Figure 5 As shown, the remote interactive collaboration device 5000 may include:

[0117] The first acquisition module 5100 is used to acquire the collaborative content information corresponding to the first learning content when any of the preset events occurs.

[0118] The first sending module 5200 is used to send the collaborative content information to the second electronic device.

[0119] The first receiving module 5300 is configured to receive the collaborative operation information returned by the second electronic device in response to the collaborative content information.

[0120] The first output module 5400 is used to output collaborative work information.

[0121] In this embodiment, during the remote interactive collaboration between the first electronic device and the second electronic device, when any of the preset events occurs, the first electronic device sends the collaborative content information corresponding to the first learning content to the second electronic device; receives the collaborative work information returned by the second electronic device in response to the collaborative content information, and outputs the collaborative work information, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning.

[0122] In one embodiment, the collaborative content information includes at least one of the dialogue information input by the first user and the first file corresponding to the first learning content.

[0123] In one embodiment, the preset event includes at least one of: a first event of receiving a first input from a first user, a second event of receiving a second input from the first user, a third event of not receiving any input within a first set time period, and a fourth event of acquiring an image of the first user with a set facial expression;

[0124] When the first event occurs, the first acquisition module is specifically used to: display a first input box control; and acquire first dialogue information input by a first user in the first input control box, and use the first dialogue information as the collaborative content information.

[0125] When a second event occurs, the first acquisition module is specifically used to: display a second input box control; and obtain the second conversation information input by the first user in the second input box control, and the first file corresponding to the first learning content, and use the second conversation information and the first file as collaborative content information.

[0126] When the third event or the fourth event occurs, the first acquisition module is specifically used to: acquire a first file corresponding to the first learning content, and use the first file as the collaborative content information.

[0127] In one embodiment, the collaborative work information includes operation step information; the first output module is specifically used to display the corresponding operation steps in the first file corresponding to the first learning content according to the operation step information.

[0128] In one embodiment, the first output module is also used to obtain the second learning content when the collaborative homework information is received; verify whether the second learning content is consistent with the first learning content; if the second learning content is inconsistent with the first learning content, verify whether any of the set conditions is met; if any of the set conditions is met, output the collaborative homework information.

[0129] The set condition includes at least one of a first condition and a second condition, the first condition is completing the second learning content, and the second condition is not receiving any input within a second set time length.

[0130] In one embodiment, the first output module is further configured to display a second file corresponding to the second learning content after outputting the collaborative homework information when the second learning content is inconsistent with the first learning content.

[0131] Figure 6 is a block diagram of another remote interactive collaboration device provided in an embodiment of the present application, which is applied to a second electronic device, such as Figure 6 As shown, the remote interactive collaboration device 6000 may include:

[0132] The second receiving module 6100 is configured to receive collaborative content information corresponding to the first learning content sent by the first electronic device.

[0133] The information processing module 6200 is used to display a collaboration window control according to the type of collaboration content information.

[0134] The second acquisition module 6300 is used to output the collaborative content information in the collaborative window control, and acquire the collaborative task information input by the second user through the collaborative window control.

[0135] The second sending module 6400 is used to send the collaborative operation information to the first electronic device.

[0136] In this embodiment, during the remote interactive collaboration between the first electronic device and the second electronic device, the second electronic device receives the collaborative content information corresponding to the first learning content sent by the first electronic device, displays the collaborative window control according to the type of the collaborative content information, outputs the collaborative content information in the collaborative window control, obtains the collaborative work information input by the second user through the collaborative window control, and sends the collaborative work information to the first electronic device, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning.

[0137] In one embodiment, the information processing module is specifically used to, when the collaborative content information includes a first file corresponding to the first learning content, display a first collaborative window control for opening the first file; when the collaborative content information includes conversation information input by a first user, display a second collaborative window control; wherein the first user is a user using a first electronic device, and the conversation information input by the first user includes at least one of text, voice, and picture.

[0138] In one embodiment, when the collaborative content information includes a first file corresponding to the first learning content, the second acquisition module is further used to obtain operation step information of the second user operating the first file in the first collaborative window control; wherein the collaborative operation information includes operation step information.

[0139] In one embodiment, the information processing module is further used to display information items corresponding to the collaborative content information in the information list; receive a third input for the information item; and display a collaborative window control in response to the third input according to the type of the collaborative content information.

[0140] The remote interactive collaboration device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0141] The remote interactive collaboration device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0142] The remote interactive collaboration device provided in the embodiment of the present application can achieve Figures 1 to 4 To avoid repetition, the various processes implemented by the method embodiment in the present invention will not be described again here.

[0143] When the remote interactive collaboration method of this embodiment is used for collaboration, the second user does not need to maintain a long connection with the first user, and always pay attention to the status of the first user. It only needs to assist the first user in solving the problem by providing collaborative homework information when receiving collaborative content information, thereby reducing the time and energy consumption of the second user in the collaboration process and improving the efficiency of remote assisted learning. At the same time, during the collaboration of the second user, the child can continue to maintain immersive learning without being disturbed, and solve the problems encountered by himself at the appropriate time through the received collaborative homework information, thereby improving the user experience.

[0144] Figure 7 is a schematic diagram of the structure of an electronic device provided by this embodiment, such as Figure 7 As shown, the electronic device 7000 includes a processor 7001, a memory 7002, and a program or instruction stored in the memory 7002 and executable on the processor 7001. When the program or instruction is executed by the processor 7001, it implements an embodiment of a remote interactive collaboration method implemented by a first electronic device or implements each process of an embodiment of a remote interactive collaboration method implemented by a second electronic device, and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0145] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0146] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application.

[0147] The electronic device 8000 includes but is not limited to: a radio frequency unit 8001, a network module 8002, an audio output unit 8003, an input unit 8004, a sensor 8005, a display unit 8006, a user input unit 8007, an interface unit 8008, a memory 8009, and a processor 8010 and other components.

[0148] Those skilled in the art will appreciate that the electronic device 8000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 8010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0149] The network module 8002 is used to send the collaborative content information to the second electronic device.

[0150] Processor 8010 is used to obtain collaborative content information corresponding to the first learning content when any of the preset events occurs; send the collaborative content information to the second electronic device; receive collaborative operation information returned by the second electronic device in response to the collaborative content information; and output the collaborative operation information.

[0151] The processor 8010 is further configured to, when a first event occurs: display a first input box control; and obtain first dialogue information input by a first user in the first input control box, and use the first dialogue information as collaborative content information.

[0152] When a second event occurs: display a second input box control; and obtain second conversation information input by the first user in the second input box control and a first file corresponding to the first learning content, and use the second conversation information and the first file as collaborative content information.

[0153] When the third event or the fourth event occurs: a first file corresponding to the first learning content is obtained, and the first file is used as the collaborative content information.

[0154] Processor 8010 is further configured to display corresponding operation steps in a first file corresponding to the first learning content according to the operation step information when the collaborative task information includes operation step information.

[0155] The processor 8010 is further configured to obtain the second learning content when the collaborative work information is received; verify whether the second learning content is consistent with the first learning content; if the second learning content is inconsistent with the first learning content, verify whether any of the set conditions is met; if any of the set conditions is met, output the collaborative work information. The set conditions include at least one of the first condition and the second condition, the first condition is to complete the second learning content, and the second condition is not to receive any input within the second set time length.

[0156] The processor 8010 is further configured to display a second file corresponding to the second learning content after outputting the collaborative homework information when the second learning content is inconsistent with the first learning content.

[0157] In this embodiment, during the remote interactive collaboration between the first electronic device and the second electronic device, when any of the preset events occurs, the first electronic device sends the collaborative content information corresponding to the first learning content to the second electronic device; receives the collaborative work information returned by the second electronic device in response to the collaborative content information, and outputs the collaborative work information, so that the second electronic device can obtain the collaborative content information sent by the first electronic device without maintaining a long connection with the first electronic device, thereby reducing the time and energy spent by the assistant using the second electronic device in the remote interactive assistance process and improving the efficiency of remote assisted learning.

[0158] It should be understood that in the embodiment of the present application, the input unit 8004 may include a graphics processor (Graphics Processing Unit, GPU) 80041 and a microphone 80042, and the graphics processor 80041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 8006 may include a display panel 80061, and the display panel 80061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 8007 includes a touch panel 80071 and other input devices 80072. The touch panel 80071 is also called a touch screen. The touch panel 80071 may include two parts: a touch detection device and a touch controller. Other input devices 80072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 8009 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 8010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 8010.

[0159] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the operation guidance method embodiment of the above-mentioned application is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0160] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0161] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0162] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0163] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A remote interactive collaboration method, characterized in that: Applied to a first electronic device, the method includes: When any of the preset events occurs, obtaining the collaborative content information corresponding to the first learning content; sending the collaborative content information to a second electronic device; receiving collaborative operation information returned by the second electronic device in response to the collaborative content information; Acquire the second learning content when receiving the collaborative homework information; When the second learning content is inconsistent with the first learning content and any one of the set conditions is satisfied, outputting the collaborative work information; The set condition includes at least one of a first condition and a second condition, the first condition is that the second learning content is completed, and the second condition is that no input is received within a second set time length.

2. The method according to claim 1, characterized in that The preset event includes: at least one of a first event of receiving a first input from a first user, a second event of receiving a second input from the first user, a third event of not receiving any input within a first set time period, and a fourth event of acquiring an image of the first user with a set facial expression; When the first event occurs, obtaining the collaborative content information corresponding to the first learning content includes: Displaying a first input control; Acquire first dialogue information input by the first user in the first input control, and use the first dialogue information as the collaboration content information; When the second event occurs, obtaining the collaborative content information corresponding to the first learning content includes: Display a second input control; Acquire second dialogue information input by the first user in the second input control and a first file corresponding to the first learning content, and use the second dialogue information and the first file as the collaborative content information; When the third event or the fourth event occurs, obtaining the collaborative content information corresponding to the first learning content includes: A first file corresponding to the first learning content is acquired, and the first file is used as the collaborative content information.

3. The method according to claim 1, characterized in that The collaborative operation information includes operation step information; the output collaborative operation information includes: According to the operation step information, corresponding operation steps are displayed in a first file corresponding to the first learning content.

4. The method according to claim 1, characterized in that: In the case where the second learning content is inconsistent with the first learning content, after outputting the collaborative homework information, the method further includes: A second file corresponding to the second learning content is displayed.

5. A remote interactive collaboration device, characterized in that: Applied to a first electronic device, the device comprises: A first acquisition module, used for acquiring collaborative content information corresponding to the first learning content when any of the preset events occurs; A first sending module, configured to send the collaborative content information to a second electronic device; A first receiving module is configured to receive the collaborative operation information returned by the second electronic device in response to the collaborative content information; and A first output module, used for acquiring second learning content when receiving the collaborative homework information; When the second learning content is inconsistent with the first learning content and any one of the set conditions is satisfied, outputting the collaborative work information; The set condition includes at least one of a first condition and a second condition, the first condition is that the second learning content is completed, and the second condition is that no input is received within a second set time length.

Images