Multi-device picture interaction method and multi-device picture interaction teaching system

Abstract

The application relates to a multi-device picture interaction method and a multi-device picture interaction teaching system, relates to the technical field of display, and is applied to a multi-device picture interaction method of a main device, which comprises the following steps: in the case that at least one auxiliary device is in communication connection with the main device and the at least one auxiliary device in communication connection accesses an interaction interface created by the main device, responding to an interaction starting operation, instructing each auxiliary device to enter a corresponding research interface; displaying an interaction process picture researched by each auxiliary device in real time; responding to an interaction ending operation, instructing each auxiliary device to exit the corresponding research interface, and displaying an interaction result picture returned by each auxiliary device; the user of the main device can know the interaction conditions of the auxiliary devices in real time, the interaction result pictures of the auxiliary devices can be uniformly stored and managed based on the main device, and the interaction result pictures can be checked and edited subsequently.

Description

Multi-device picture interaction method and multi-device picture interaction teaching system TECHNICAL FIELD

[0001] The present application relates to the technical field of display, in particular to a multi-device picture interaction method and a multi-device picture interaction teaching system. BACKGROUND

[0002] With the development of the times, the college education concept gradually changes from the traditional one-way teaching method to interactive learning and cooperative learning. In the current college education environment, the demand for multi-screen group discussion is increasingly prominent.

[0003] In the current multi-screen group discussion scenario, students in a group generally sit around a device to conduct discussion activities. The teacher needs to approach each discussion group by walking around to observe and guide the discussion of each discussion group. This leads to the fact that when there are many discussion groups, the teacher cannot take care of the discussion of each discussion group, and cannot also learn in time whether each group has produced a discussion result. Obviously, this will lead to low teaching efficiency.

[0004] In addition, after each group produces a discussion result, the discussion result is also displayed on the student's own device. When each group displays the discussion result, the discussion result needs to be sent to the teacher's device through other data transmission methods or by using third-party data transmission software. Obviously, this reduces the flexibility of interactive learning, and the related operation is also complex.

[0005] Therefore, it is urgent to provide a multi-device picture interaction method capable of improving the flexibility of interactive learning, the simplicity of operation, and the teaching efficiency.

[0006] SUMMARY

[0007] Therefore, it is necessary to provide a multi-device picture interaction method and a multi-device picture interaction teaching system capable of improving the flexibility of interactive learning, the simplicity of operation, and meeting the interactive result retention requirement.

[0008] In a first aspect, the present application provides a multi-device picture interaction method applied to a master device, comprising:

[0009] In the case that at least one auxiliary device is in communication connection with the master device, and the at least one auxiliary device in communication connection accesses an interactive interface created by the master device, in response to an interactive start operation, instructing each auxiliary device to enter a respective corresponding discussion interface;

[0010] display the interactive process picture of the real-time study of each of the auxiliary devices; the interactive process picture is a picture of interaction of the auxiliary device in the corresponding study interface;

[0011] in response to an interaction end operation, instruct each of the auxiliary devices to exit the corresponding study interface, and display the interaction result picture returned by each of the auxiliary devices; the interaction result picture is a picture displayed when the auxiliary device exits the corresponding study interface.

[0012] In one of the embodiments, the method further comprises: in response to a media data transmission operation, instructing the auxiliary device pointed to by the media data transmission operation to display related media data; wherein the media data comprises at least one of a picture, a video, an audio or a document.

[0013] In one of the embodiments, the main device comprises a side display area.

[0014] The display of the interactive process picture of the real-time study of each of the auxiliary devices comprises: displaying the interactive process picture of the real-time study returned by each of the auxiliary devices in the side display area.

[0015] In one of the embodiments, the main device further comprises a main display area connected to the side display area.

[0016] The method further comprises: displaying an interaction theme associated with each of the interactive process pictures in the main display area.

[0017] In one of the embodiments, the method further comprises: in response to an interaction stop operation for any of the auxiliary devices, instructing the auxiliary device pointed to by the interaction stop operation to exit the corresponding study interface and clear related interaction data.

[0018] In one of the embodiments, the method further comprises: in response to an editing operation on the interaction result picture, displaying an editing pattern input by the editing operation in the interaction result picture.

[0019] In one of the embodiments, the method further comprises: in response to a zoom-in operation on the interactive process picture of any of the auxiliary devices, displaying the corresponding interactive process picture in full screen.

[0020] In one of the embodiments, the method further comprises: in response to an editing operation on the interactive process picture displayed in full screen, displaying an editing pattern input by the editing operation in the interactive process picture, and instructing the corresponding auxiliary device to display the editing pattern in the interactive process picture synchronously.

[0021] In one of the embodiments, the method further comprises: in response to an interaction interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the interaction interface.

[0022] In one of the embodiments, the method further comprises:

[0023] In response to the screenshot operation, capturing a screenshot picture pointed by the screenshot operation;

[0024] In response to a screenshot sharing operation for the screenshot picture, instructing the secondary device to display the screenshot picture pointed by the screenshot sharing operation.

[0025] In a second aspect, the application further provides a multi-device picture interaction method, applied to a secondary device, comprising:

[0026] In the case of accessing an interaction interface created by a primary device, in response to an interaction start operation transmitted by the primary device, entering a corresponding research interface;

[0027] In response to an editing operation, displaying an interaction process picture generated by the editing operation in the research interface, and sending the interaction process picture of real-time research to the primary device;

[0028] In response to an interaction end operation transmitted by the primary device, exiting the research interface, and sending an interaction result picture displayed when exiting the research interface to the primary device.

[0029] In one of the embodiments, the method further comprises: in response to an interaction result picture display operation, displaying the interaction result picture called by the interaction interface of the primary device.

[0030] In one of the embodiments, the method further comprises: in response to an interaction completion operation, transmitting corresponding interaction completion information to the primary device.

[0031] In one of the embodiments, after the step of transmitting corresponding interaction completion information to the primary device, the method further comprises:

[0032] In response to an editing operation, displaying an interaction process picture generated by the editing operation in the research interface, and sending the interaction process picture to the primary device.

[0033] In one of the embodiments, after the step of entering the corresponding research interface, the method further comprises:

[0034] In response to a video interaction request, connecting a user associated with the video interaction request, displaying a video picture of the user, and instructing a communication device of the user to enter the research interface.

[0035] In one of the embodiments, the method further comprises:

[0036] In response to an interaction interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the research interface; or,

[0037] In response to an interaction interface sharing operation, at least one of an invitation code and a two-dimensional code for joining the interaction interface created by the master device is displayed.

[0038] In one embodiment, after entering the corresponding research interface, the method further includes:

[0039] In response to a running operation for a target application, a running screen of the target application is displayed; the target application is an application currently installed on the secondary device.

[0040] In a third aspect, the present application also provides a multi-device screen interaction teaching system; the devices in the teaching system include a master device and at least one secondary device; the at least one secondary device is in communication connection with the master device; wherein,

[0041] The master device is configured to, in the case that the at least one secondary device in communication connection accesses an interaction interface created by the master device, in response to an interaction start operation, instruct each secondary device to enter a corresponding research interface; display an interaction process screen of real-time research of each secondary device; the interaction process screen is a screen of interaction of the secondary device in the corresponding research interface; in response to an interaction end operation, instruct each secondary device to exit the corresponding research interface, and display an interaction result screen returned by each secondary device; the interaction result screen is a screen displayed when the secondary device exits the corresponding research interface.

[0042] The secondary device is configured to, in the case that the secondary device accesses the interaction interface created by the master device, in response to an interaction start operation transmitted by the master device, enter a corresponding research interface; in response to an editing operation, display an interaction process screen generated by the editing operation in the research interface, and send the interaction process screen of real-time research to the master device; in response to an interaction end operation transmitted by the master device, exit the research interface, and send an interaction result screen displayed when the secondary device exits the research interface to the master device.

[0043] This application provides a multi-device screen interaction method and a multi-device screen interaction teaching system. The multi-device screen interaction method applied to the main device involves, in the case that at least one auxiliary device is communicatively connected to the main device and the at least one communicatively connected auxiliary device accesses an interactive interface created by the main device, responding to an interaction start operation, instructing each auxiliary device to enter its corresponding discussion interface; displaying the real-time interactive process screen of each auxiliary device; the interactive process screen is the screen of the auxiliary device interacting in the corresponding discussion interface; responding to an interaction end operation, instructing each auxiliary device to exit the corresponding discussion interface and displaying the interactive result screen returned by each auxiliary device; the interactive result screen is the screen displayed when the auxiliary device exits the corresponding discussion interface. As can be seen, the main device provides multiple independent discussion interfaces for different auxiliary devices that join the interactive interface it creates. This allows each auxiliary device to have its own independent interactive interface for conducting interactive activities (discussions) based on entering the corresponding discussion interface, which helps avoid interference problems caused by interactive activities conducted by multiple auxiliary devices. The main device can display the interactive process screens of all auxiliary devices conducting interactive activities based on the interactive interface created by the main device. This allows the user of the main device to know the interactive status of users on each auxiliary device in real time, avoiding the need for the user of the main device to walk around to learn about the interactive activities conducted by each auxiliary device. This improves the flexibility and efficiency of conducting multiple interactive activities. Optionally, the multi-device screen interaction method provided in this application can improve the classroom effect of group discussions in teaching scenarios. In addition, this application can realize that multiple auxiliary devices can enter the same interactive activity with one-click control and exit the same interactive activity with one-click control. When each auxiliary device exits the corresponding discussion interface, the main device displays the interactive results screens returned by each auxiliary device, so as to realize the display and storage of the interactive results screens returned by each auxiliary device in the main device. Attached Figure Description

[0044] To more clearly illustrate the technical solutions in the embodiments of this application or the conventional technology, the drawings used in the description of the embodiments or the conventional technology will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 is a flowchart illustrating a multi-device screen interaction method applied to a master device according to an embodiment of this application.

[0046] Figure 2 shows a schematic diagram of the first interface of the main device provided in an embodiment of this application;

[0047] Figure 3 shows a schematic diagram of a second interface of the main device provided in an embodiment of this application;

[0048] Fig. 4 shows a third interface of a master device according to an embodiment of the present application;

[0049] Fig. 5 shows a fourth interface of a master device according to an embodiment of the present application;

[0050] Fig. 6 shows a fifth interface of a master device according to an embodiment of the present application;

[0051] Fig. 7 shows a sixth interface of a master device according to an embodiment of the present application;

[0052] Fig. 8 shows a flow of a multi-device screen interaction method applied to a slave device according to an embodiment of the present application;

[0053] Fig. 9 shows an architecture of a multi-device screen interaction teaching system according to an embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the accompanying drawings. The preferred embodiments of the present application are shown in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0055] With the continuous popularity of smart tablets or smart blackboards in schools, the intelligent level of school teaching has been improved. In order to adapt to the continuously improved intelligent level, the teaching method of teachers in the classroom has also changed greatly, in which the past group discussion has been changed to the group discussion shared by the master device and the slave device.

[0056] In the traditional technology, the demand of multi-screen group discussion in colleges and universities mainly includes screen sharing collaboration, research results display and research results retention. Among them, screen sharing collaboration refers to that students are grouped according to the number of people and the theme, each group conducts research and collaboration around a large screen, and students can input research information through the large screen corresponding to their use to realize the collaborative research of the group. Research results sharing refers to that after the research is completed, each group needs to take turns to demonstrate the results to other groups and teachers. Research results retention refers to that after the class is over, the research results can be saved for teachers and students to continue to view after class.

[0057] However, in the related art, too many members of the same group may be around a large screen for information input, which is too crowded, leading to inconvenience and smoothness of group discussion activities based on the large screen; and if part of the members of the group do not reach the site where the large screen is located due to various reasons, they cannot participate in the group discussion activity. This obviously leads to insufficient convenience of group discussion activities. In addition, in the related art, when sharing the research results, each student group needs to send the research results to the teacher end in order to display and share the research results of each group to each research group through the teacher end. However, this requires the use of other data transmission methods or other data transmission software to send the research results to the teacher's device end. Obviously, this reduces the flexibility of interactive learning, and the related operations are also relatively complex. In addition, for the saving of the research results produced in the research activities, the related art saves the research results of each group on the student large screen end. If the teacher wants to check the research results of a group, the student end needs to transmit the research results of the group to the teacher's device end through other data transmission methods. This reduces the flexibility of interactive learning, and the related operations are also relatively complex. That is, the teacher cannot modify the research results of each group, cannot view the real-time group research screen in the main device used by himself, and cannot save the research results and other disadvantages. Furthermore, in the traditional technology, the research results of each group are saved on the student large screen end, which requires a relatively high storage capacity of the student large screen end. This increases the production cost of the student large screen device, which increases the difficulty of popularizing the student large screen device, and is not conducive to the popularization of interactive teaching.

[0058] In the current multi-screen grouping discussion scene, students in a group generally sit around a device to conduct research activities, and the teacher needs to approach each research group by walking to observe and guide the research of each research group. This leads to the fact that when there are many research groups, the teacher cannot pay attention to the real-time research of each research group, and cannot timely learn whether each group has produced research results, which leads to low teaching efficiency.

[0059] It's also worth noting that most universities currently use video matrix systems for interactive learning, sharing group screen content across multiple screens via push-pull streaming to meet the needs of group discussions and presentations. However, this approach has drawbacks, including limited flexibility, operational complexity, and the inability to retain results. Limited flexibility refers to the relatively fixed connection method of the video matrix; once installed, adjusting the layout is difficult. During group discussions, if the number, location, or size of groups needs to be changed temporarily, the video matrix struggles to adapt quickly, significantly limiting the flexibility of the discussions. Operational complexity means that operating the video matrix system may require technical knowledge and training for both teachers and students, potentially wasting time due to unfamiliarity with the system, impacting the efficiency and progress of the discussions. The inability to retain results means that the discussion content presented by students on the group screens cannot be uniformly saved to the class document, making it impossible for teachers and students to review and access it collectively after class.

[0060] Therefore, it is necessary to provide a multi-device screen interaction method that can improve the flexibility, ease of operation, and teaching efficiency of interactive learning, addressing the aforementioned technical issues.

[0061] In an exemplary embodiment, as shown in FIG1, this application provides a multi-device screen interaction method. Referring to FIG2, the multiple devices may include a master device and at least one auxiliary device having a communication connection. Taking the application of this method to the master device in the multiple devices as an example, the multi-device screen interaction method includes at least steps 101-103, wherein:

[0062] Step 101: When at least one auxiliary device is in communication connection with the main device and the at least one auxiliary device in communication connection accesses the interactive interface created by the main device, in response to the interaction start operation, each auxiliary device is instructed to enter its corresponding discussion interface.

[0063] In this context, "main device" and "auxiliary device" refer to display devices with display functions, such as interactive smart flat panels. These can also include any product or component with display functions, such as electronic paper, mobile phones, tablets, televisions, monitors, and laptops; the embodiments disclosed in this application do not impose such limitations. Optionally, the main device and auxiliary device may further have touch functionality, which is beneficial for improving the user experience of each device individually, as well as the interaction experience and efficiency between them.

[0064] Further, the main device can allocate a discussion space for the secondary devices that have established a communication connection with the main device based on requirements, and different, independent discussion interfaces can be specified for different secondary devices, so that each secondary device can perform interactive activities in the corresponding independent discussion interface, and the interactive activities performed by two secondary devices are independent of each other. In addition, an alternative embodiment is provided, in which the main device can create the same number of discussion interfaces as the number of secondary devices that have established a communication connection, and then, after receiving an interactive starting operation, each secondary device in the interactive space created by the main device can select one of the pre-created discussion interfaces to enter and use based on requirements, so that each secondary device can perform interactive activities in the corresponding independent discussion interface, and the interactive activities performed by two secondary devices are independent of each other.

[0065] It should also be noted that the interactive interface refers to a private virtual interface constructed by the main device based on the relevant interactive software (an application software) installed thereon, and can also be understood as a virtual space, which can only be entered by the secondary devices that have established a communication connection with the main device, and cannot be entered by other devices. That is, only the main device and the secondary devices that have established a communication connection with the main device can enter the interactive interface (interactive space) created by the main device. The discussion interface can be a discussion palette or a discussion canvas interface that integrates multiple interactive controls (such as annotations, inserted pictures, inserted symbols, etc.). For the discussion interface corresponding to each secondary device, at least the secondary device and the main device that allocates the discussion interface can enter, that is, the user of the secondary device and the user of the corresponding main device can perform interactive activities in the discussion interface.

[0066] Please refer to FIG. 2, the display interface of the main device is shown, which shows the space code (interface code) "***** " that can be used to enter the interactive interface created by the main device. The space code here can be a set of random numbers generated by the main device when creating the interactive space. The "enter space" displayed in the display interface of the main device is only one optional embodiment provided by the present application, and can be adjusted to "enter classroom" and the like according to requirements. The "enter space" in the display interface of the main device is followed by a two-dimensional code button, which can be used to display the two-dimensional code information for entering the interactive space by triggering the two-dimensional code button. The "use scan code to enter space" is also displayed in the display interface of the main device, which can also be used to display the two-dimensional code information for entering the interactive space by triggering the information. The "use scan code to enter space" is also only one optional embodiment provided by the present application, and the user of the main device can adjust the content based on requirements. The main device can also display the number of members and the number of devices accessing the interactive space in the display interface of the main device during the process of creating the interactive space and waiting for the auxiliary device to enter. By triggering the "enter task" button in the display interface of the main device, the display interface of the main device shown in FIG. 3 can be jumped to. The text content of the "enter task" button in FIG. 2 can also be adjusted according to requirements.

[0067] The display interface of the main device shown in FIG. 3 displays a plurality of auxiliary devices participating in the current interactive task, and a "start interaction" button. By triggering the "start interaction" button, the plurality of auxiliary devices can be one-keyed to enter the research interface (research space) assigned by the main device. That is, jump to the display interface of the main device shown in FIG. 4. The text content of the "start interaction" button in FIG. 3 can also be adjusted according to requirements.

[0068] Alternatively, step 101 is performed, in the case that the auxiliary device has already established a communication connection with the main device, and the main device learns that there is at least one auxiliary device that has accessed the interactive interface created by the main device, it is indicated that there is an auxiliary device in the interactive interface (interactive space) that can be arranged by the main device to interact with the task, at this time, the interactive start operation can be applied to the main device, such as touching the interactive start button (such as the "start interaction" button shown in FIG. 3) displayed in the display screen of the main device, so that all auxiliary devices in the interactive space can enter their respective research interfaces (research space) to facilitate each auxiliary device to separately interact with the relevant interaction. The research interface here is that the main device further configures an independent research interface for different auxiliary devices that join the interactive interface created by the main device, or that the main device creates an independent research interface in advance for the auxiliary device to choose to join based on the number of auxiliary devices connected in communication, so that each auxiliary device has an independent interactive space for interactive activities, and the interaction content in the research interface of each auxiliary device does not affect each other, which is beneficial to avoid the interference problem of the interaction of multiple auxiliary devices.

[0069] The application configures an independent research space for each auxiliary device that accesses the interactive space created by the main device, which is beneficial to realize the independence of each auxiliary device during the interactive activity, and avoid the influence of the user of one auxiliary device on the user of another auxiliary device.

[0070] An optional embodiment provided here is that the above-mentioned interactive process can be selected as a research process in a teaching activity, and the existence of the independent research interface of each auxiliary device ensures the independence of each auxiliary device in the research activity, avoids the influence of the research activity on one auxiliary device on the research activity on another auxiliary device, and also avoids the influence of the user of one auxiliary device on the research ideas of the user of another auxiliary device, which is beneficial to ensure the research idea independence of the user of each auxiliary device.

[0071] It should be further supplemented that the content of "in response to the interactive start operation, instructing each auxiliary device to enter the corresponding research interface" performed in step 101 is to start all auxiliary devices in the interactive interface created by the main device to enter the corresponding research interface in a one-key manner, without the need for the main device to instruct each auxiliary device to enter the corresponding research interface one by one, thereby being beneficial to improve the efficiency of starting the interactive activity; when the method is applied to a teaching scene, it is beneficial to further improve the efficiency of multiple student groups entering the same research activity in teaching.

[0072] It also needs to be explained that the "enter task" button shown in Figure 2 can also be replaced with the "interaction start" button in Figure 3 based on requirements, and then in the case of triggering the "interaction start" button in Figure 2, it can be directly jumped to the display interface of the master device shown in Figure 4; this is only one optional embodiment provided by the present application, but the present application is not limited thereto.

[0073] The display interface of the master device shown in Figure 4 shows the interaction process screen of multiple secondary devices, and the "end interaction" button and the "share" button.

[0074] It needs to be explained that the information shown in Figures 2-4 is only part of the information that may exist in the display interface of the master device provided by the present application, and does not mean that only these information can be displayed in the display interface of the master device. The display interface of the master device can also display more content and buttons based on requirements.

[0075] Step 102, show the interaction process screen of each secondary device real-time research; the interaction process screen is the screen of the secondary device interacting in the corresponding research interface.

[0076] Among them, the interaction process screen refers to the content screen edited by the user of the secondary device in the corresponding research interface. The "secondary device 1 screen 1" shown in Figure 4 refers to the interaction process screen displayed by the secondary device numbered 1, and the rest of the content in Figure 4 is similar.

[0077] After each secondary device enters the corresponding research interface by executing step 101, step 102 can be further executed. When the user of the secondary device interacts and edits in the corresponding research interface, not only the relevant interaction process screen is displayed in the secondary device, but the master device can also synchronously display the interaction process screen of each secondary device that is real-time researched in the research interface thereof, that is, the master device displays the interaction process screen of all secondary devices that interact based on the interaction interface created by the master device (research activity) to facilitate the user of the master device to know the interaction of the user of each secondary device in real time.

[0078] It needs to be explained that the period of the master device receiving the interaction process screen returned by the secondary device can be real-time updated based on the editing operation of the user of the secondary device, but this is only one embodiment provided by the present application, and in the case of requirements, it can also be set to be updated based on a preset period, for example, 20 seconds, 30 seconds, 1 minute, etc. The present application does not make specific limitation thereto.

[0079] In the case that the above-mentioned interactive process is a discussion process in a teaching activity, displaying the interactive process pictures in each auxiliary device through the host device is beneficial for the user (teacher) of the host device to learn the discussion ideas of the users (students) of each auxiliary device as early as possible, so as to find out the problems in the discussion ideas of the users (students) of the auxiliary device in time, so that the teacher using the host device can correct the ideas of the relevant users (students) as early as possible, and also to find out the excellent discussion ideas of the users of the auxiliary device in time, so as to share the relevant discussion content with other users of the auxiliary device as early as possible.

[0080] Furthermore, in the teaching scene where the user of the host device is a teacher and the user of the auxiliary device is a student, the application displays the interactive process pictures of each auxiliary device (student end) in the host device (teacher end) in real time, which enables the teacher to learn the discussion situation of each student end based on the host device used by the teacher, and realizes the simultaneous consideration of the discussion situations of multiple student groups without the need to go to each student group to learn their discussion situations. Obviously, the multi-device picture interactive method provided by the application is beneficial for improving the teaching efficiency and the flexibility of the teaching activity.

[0081] Further, since the teacher can learn the discussion situation of each student end based on the host device used by the teacher, the teacher can also learn in time whether the student group corresponding to the student end has completed the current discussion activity, without the need for the teacher to inquire the discussion progress of each student group by inquiring one by one, obviously, the multi-device picture interactive method provided by the application improves the flexibility and simplicity of the teaching activity.

[0082] It should be further supplemented that the application displays the interactive process pictures of each auxiliary device in the host device in real time, which is also beneficial for temporarily changing the participation number, position or scale of the auxiliary device through the host device, thereby improving the flexibility of the multi-device picture interaction.

[0083] In addition, in the case that the user of the host device is a teacher and the user of the auxiliary device is a student, displaying the interactive process pictures of the real-time discussion of each auxiliary device in the host device at the same time also realizes that different students simultaneously show the teacher the real-time discussion situation, which is beneficial for improving the execution efficiency of the discussion task compared with the case that each user of the auxiliary device shows the teacher the discussion situation respectively.

[0084] Please refer to FIG. 4 and FIG. 5, in the case that the “end interaction” button in the display interface of the host device shown in FIG. 4 is triggered, the display interface of the host device shown in FIG. 5 can be jumped to, and the display interface of the host device shown in FIG. 5 shows the interaction result pictures returned by the auxiliary devices. The “result 1” therein refers to the interaction result picture returned by the auxiliary device numbered 1, and the rest of the content in FIG. 5 is similar. The text content in the “end interaction” button in FIG. 5 can also be adjusted based on requirements.

[0085] Step 103, in response to the interaction end operation, instructing each auxiliary device to exit the corresponding research interface and displaying the interaction result pictures returned by each auxiliary device; the interaction result picture is the picture displayed when the auxiliary device exits the corresponding research interface.

[0086] Alternatively, after the interaction process pictures returned by each auxiliary device are displayed in the host device by executing step 102, further step 103 can be executed, in the case that the interaction end operation applied to the host device is received, for example, in the case that the user of the host device touches the interaction end button (for example, the “end interaction” button in FIG. 4) displayed in the display picture of the host device, in response to the interaction end operation, controlling all auxiliary devices in the interaction interface created by the host device to exit the corresponding research interface at the same time, and instructing each auxiliary device that exits the research interface to clear the relevant interaction data about the interaction activity, that is, not storing the interaction result picture and the interaction process data in the auxiliary device, so as to avoid occupying the storage space of the auxiliary device; while each auxiliary device exits the corresponding research interface, the interaction result pictures returned by each auxiliary device are displayed in the host device, so as to realize the display and storage of the interaction result pictures returned by each auxiliary device in the host device, and also facilitate the editing and enlarged display of any one interaction result picture by the user (user) of the host device in the case of subsequent requirements, and also facilitate the review and sharing of the interaction result picture by the host device in the case of subsequent requirements.

[0087] It also needs to be supplemented that the content of “in response to the interaction end operation, instructing each auxiliary device to exit the corresponding research interface” executed in step 103 is equivalent to ending the interaction activity in the interaction interface created by the host device through one-key ending, so that all auxiliary devices that participate in the interaction activity in the interaction interface created by the host device can end the interaction activity and exit the research interface allocated by the host device for each auxiliary device at the same time, and further, all data information about the interaction activity in the auxiliary device can also be cleared at the same time; that is, the host device does not need to instruct each auxiliary device to exit the corresponding research interface, exit the interaction activity, and clear the relevant data one by one, thereby facilitating the improvement of the efficiency of ending the interaction activity; when the method is applied to a teaching scene, it is beneficial to further improve the efficiency of ending the same research activity by multiple student groups in teaching.

[0088] In the case that the above-mentioned interaction process is a kind of discussion process, through the unified storage of the interaction result picture (discussion result picture) by the host device, in the teaching scene, it is convenient for the relevant teachers and students to subsequently view and review the discussion results by entering the storage space (interaction interface) of the host device. Further, in the teaching activity, after a discussion activity is over, that is, after each group produces the discussion results, the discussion results are not displayed on the student's own device, but the discussion result picture is automatically sent to the teacher's device end, so as to facilitate the teacher to check, analyze and explain the discussion results of each group, and also facilitate each group to share and explain the relevant discussion result pictures to other group students based on the discussion results displayed on the teacher's end; by transmitting all the interaction (discussion) result pictures to the teacher's end for storage and display, the flexibility of interactive learning is improved, and the related operation is also relatively simple; furthermore, in the implementation mode provided by the present application, the discussion data can be selected not to be stored based on the student end, which reduces the high demand for the storage capacity of the student end, is beneficial to reduce the manufacturing cost of the student end device, so as to be beneficial to improve the popularization rate of the student large-screen device, so as to be beneficial to improve the popularization rate of the interactive teaching.

[0089] In addition, it also needs to be supplemented that in the multi-device picture interaction method applied to the host device provided by the present application, the communication connection between the host device and the auxiliary device is configured in advance, so that the host device can link the auxiliary device to display the related interaction process picture in the auxiliary device, and to display and store the interaction result picture of the auxiliary device after the interaction is over, so that the picture sharing operation between the multiple devices is simple enough, which is also beneficial to reduce the learning cost of the related users for the implementation of the multi-device picture interaction, and further beneficial to avoid the waste of time due to unskilled operation, and to affect the interaction efficiency and progress.

[0090] The application provides a multi-device picture interaction method applied to a host device, which comprises the following steps: in the case that at least one auxiliary device is in communication connection with the host device and the at least one auxiliary device in communication connection accesses an interaction interface created by the host device, in response to an interaction starting operation, instructing each auxiliary device to enter a corresponding research interface; displaying an interaction process picture of real-time research of each auxiliary device; the interaction process picture is a picture of interaction of the auxiliary device in the corresponding research interface; in response to an interaction ending operation, instructing each auxiliary device to exit the corresponding research interface, and displaying an interaction result picture returned by each auxiliary device; the interaction result picture is a picture displayed when the auxiliary device exits the corresponding research interface. It can be seen that the host device provides a plurality of independent research interfaces for different auxiliary devices that access the interaction interface created by the host device, so that each auxiliary device has an independent interactive interface for interactive activities based on entering the corresponding research interface, which is beneficial to avoiding the interference problem of the interactive activities of the plurality of auxiliary devices; the host device can display the interaction process pictures of all auxiliary devices that perform interactive activities (research activities) based on the interaction interface created by the host device, so that the user of the host device can know the interaction situation of the users of the auxiliary devices in real time, which avoids the need for the user of the host device to know the situation of the interactive activities in each auxiliary device by walking around, and is beneficial to improving the flexibility and efficiency of the development of the plurality of interactive activities; in addition, the application can realize that a plurality of auxiliary devices enter the same interactive activity based on one-key control and exit the same interactive activity based on one-key control, display the interaction result pictures returned by the auxiliary devices in the host device at the same time when the auxiliary devices exit the corresponding research interfaces, so as to realize the display and storage of the interaction result pictures returned by the auxiliary devices in the host device; further, the related data of the research activity in the auxiliary device can also be cleared at the same time when the auxiliary device exits the research interface, which avoids the need for the auxiliary device to store the related interaction result pictures and the related interaction process traces, is beneficial to reducing the storage capacity of the auxiliary device, and thus can reduce the manufacturing cost of the auxiliary device; further, the host device stores a plurality of interaction result pictures produced by participating in the same interactive activity, which is also convenient for the user of the host device to edit and magnify display of any one interaction result picture in the subsequent demand, and is also convenient for the host device to check and share the interaction result picture in the subsequent demand.

[0091] In one exemplary embodiment, the application provides a multi-device picture interaction method applied to a host device, which further comprises the following steps: in response to a media data transmission operation, instructing an auxiliary device pointed by the media data transmission operation to display related media data; wherein the media data comprises at least one of a picture, a video, an audio or a document.

[0092] Optionally, for the multi-device picture interaction method applied to the primary device provided in the present application, the present application further provides an alternative implementation that, in the case that the primary device receives a media data transmission operation applied thereto, the corresponding media data is transmitted to the secondary device to which the media data transmission operation is directed, and the secondary device to which the media data transmission operation is directed is instructed to receive and display the relevant media data. The implementation provided in the present application can realize the transmission of media data from the primary device to a specific secondary device, and can enable the specific secondary device to display the media data on the relevant display interface at the same time when the media data is received.

[0093] It should be noted that the present application does not specifically limit the number of secondary devices to which the media data transmission operation is directed. For example, based on one media data transmission operation initiated by the primary device, only one secondary device can be directed to receive the corresponding media data, or two or three secondary devices can be simultaneously directed to receive the corresponding media data, or all secondary devices that join the same interactive interface can be simultaneously directed to receive the corresponding media data.

[0094] When the multi-device picture interaction method provided in the present application is applied to a teaching scenario, for example, a teacher can select a teaching short film on the primary device, move the selected teaching short film to one side of a secondary device in the display picture of the primary device, and then cancel the selection of the teaching short film, so as to share the teaching short film in the primary device to the corresponding secondary device. Then, the teaching short film will be directly displayed in the display picture of the secondary device. It should be noted that after the teaching short film is displayed in the display picture of the secondary device, the teaching short film will not be automatically played, and the user of the secondary device can choose to play or save the teaching short film based on the demand.

[0095] It should be further noted that in the case that multiple media data are shared to a secondary device in the same time period, the secondary device can display the multiple media data in a layered manner based on the order in which the multiple media data are received. For example, in the case that the secondary device receives a first media data, a second media data and a third media data in sequence, the second media data is displayed above the first media data and covers part of the first media data and leaks part of the first media data, and the third media data is displayed above the second media data and covers part of the second media data and leaks part of the first media data and the second media data. It should be explained that the display manner of the secondary device provided in the present application for receiving multiple media data is only one alternative implementation provided in the present application, but the present application is not limited thereto.

[0096] In an exemplary embodiment, the main device comprises a side display area; the interactive process picture of the real-time research of each auxiliary device displayed by the step 102 can be alternatively displayed in the side display area.

[0097] Alternatively, referring to FIGS. 1-4, in the case that the main device displays the interactive process pictures of the plurality of auxiliary devices, the display picture of the main device can comprise a side display area AA1 and a main display area AA2, and the main display area AA2 and the side display area AA1 are connected. In the case that the display picture of the main device is rectangular, the side display area AA1 can be located on the left side or the right side of the display picture, or can be located on the upper side or the lower side of the display picture, which is not limited in the present application. The present application takes the case that the side display area AA1 is located on the right side of the display picture of the main device as an example.

[0098] Referring to FIG. 4, based on this, for the step of displaying the interactive process pictures of the real-time research of each auxiliary device by the step 102, an alternative execution manner is provided, that is, the interactive process pictures of the real-time research of each auxiliary device are displayed in the side display area AA1 of the display picture of the main device, and the interactive process pictures of the plurality of auxiliary devices are displayed in the side display area AA1 in a divided manner, that is, the interactive process picture of each auxiliary device can be completely displayed in the side display area AA1, so that the main device can obtain the interactive process picture of each auxiliary device.

[0099] In addition, it also needs to be supplemented that in the case that the number of auxiliary devices is too large and the side display area AA1 cannot display the interactive process pictures of all the auxiliary devices at one time, the interactive process pictures of the plurality of auxiliary devices can be displayed in the side display area AA1 in a scrolling manner, or the interactive process pictures of different auxiliary devices can be displayed based on the sliding operation of the user of the main device.

[0100] In an exemplary embodiment, the main device further comprises a main display area connected with the side display area; the multi-device picture interactive method applied to the main device provided by the present application further comprises: displaying an interactive theme (not shown) associated with each interactive process picture in the main display area.

[0101] Alternatively, as described above, in the case that the main device displays the interactive process pictures of the plurality of auxiliary devices, the display picture of the main device can comprise the side display area AA1 and the main display area AA2.

[0102] Based on this, the application further provides an alternative embodiment that, while the side display area AA1 of the main device displays the interactive process pictures of the plurality of auxiliary devices, the main display area AA2 of the main device can display the interactive theme of the current interactive activity, so that the on-site members participating in the interactive activity can reconfirm the interactive theme of the current interactive activity during the interactive activity, so as to avoid the situation that the interactive activity deviates from the interactive theme during the interactive activity.

[0103] It also needs to be supplemented that, while the side display area AA1 of the main device displays the interactive process pictures of the plurality of auxiliary devices, the main display area AA2 of the main device can display some media data in addition to the interactive theme of the current activity, such as some videos, pictures and the like. That is, the application does not specifically limit the type of information displayed in the main display area AA2 of the main device, and the user of the main device can select the information displayed in the main display area AA2 based on the needs, or can choose not to display any information in the main display area AA2.

[0104] In an exemplary embodiment, the multi-device picture interactive method applied to the main device provided by the application further includes: in response to an interactive stop operation for any auxiliary device, instructing the auxiliary device pointed by the interactive stop operation to exit the corresponding discussion interface and clearing the related interactive data.

[0105] Alternatively, for the multi-device picture interactive method applied to the main device provided by the application, the application further provides an alternative embodiment that, in the case that the main device receives an interactive stop operation applied thereto for any auxiliary device, the interactive stop operation is transmitted to the auxiliary device pointed by the interactive stop operation to instruct the auxiliary device to end the current interactive activity, exit the corresponding discussion interface and clear the related interactive data. The embodiment provided by the application can realize that a specific auxiliary device temporarily exits the current interactive activity based on the main device selection, and at the same time instructs the specific auxiliary device to clear the related data about the current interactive activity in the auxiliary device when exiting the current interactive activity, so as to avoid occupying the storage space in the auxiliary device.

[0106] It should be noted that the display interface of the main device can have a related button (not shown) for realizing the interactive stop operation, and the name or number of the auxiliary device participating in the interactive activity can be displayed after the button is triggered, and then the interactive stop operation for an auxiliary device is realized based on the selection of the name or number of the auxiliary device.

[0107] In an exemplary embodiment, the multi-device picture interactive method applied to the main device provided by the application further includes: in response to an editing operation for the interactive result picture, displaying an editing pattern input by the editing operation in the interactive result picture.

[0108] Alternatively, after the interactive activity ends, the interactive result pictures of all the auxiliary devices are saved in the host device, for example, as shown in FIG. 5, when the interactive activity just ends, the interactive result pictures of all the auxiliary devices are arrayed and displayed in the display picture of the host device. Based on this, for the multi-device picture interactive method applied to the host device provided by the present application, an alternative embodiment is that the host device receives a selection operation exerted by a user using the host device and directed to a certain interactive result picture, and displays the interactive result picture in the host device in an enlarged manner, and then receives an editing operation exerted by the user using the host device and directed to the interactive result picture, displays an editing pattern input based on the editing operation on the interactive result picture, and further saves the editing pattern on the corresponding interactive result picture.

[0109] It should be noted that the editing operation can be realized based on touch control, or input based on a mouse or a keyboard, or even realized based on voice control, and the present application does not limit the alternative implementation of the editing operation. The editing pattern can be information such as graphics or text, and the present application does not make specific limitation thereon.

[0110] In an exemplary embodiment, the multi-device picture interactive method applied to the host device provided by the present application further includes: in response to an enlarged display operation of the interactive process picture of any auxiliary device, displaying the corresponding interactive process picture in full screen.

[0111] For the multi-device picture interactive method applied to the host device provided by the present application, an alternative embodiment is that during the interactive activity, the user of the host device can display the interactive process picture of any auxiliary device in an enlarged manner based on demand, so as to clearly learn the interactive process information in the auxiliary device, and avoid the problem that the user of the host device cannot clearly watch the interactive process picture displayed in the auxiliary device due to the fact that the interactive process picture of the auxiliary device displayed in the side display area AA1 is too small. Alternatively, the related execution steps can be that the host device receives an enlarged display operation exerted by a user using the host device and directed to the interactive process picture of a certain auxiliary device (for example, the auxiliary device 1), and displays the selected interactive process picture in full screen in the host device (as shown in FIG. 6), so as to realize the enlarged display of the selected interactive process picture.

[0112] It should be noted that the present application does not make specific limitation on the display of the interactive process picture in the enlarged state in the host device, for example, the interactive process picture in the enlarged state can be displayed in full screen in the display picture of the host device, or the interactive process picture in the enlarged state can occupy most of the area of the display picture of the host device.

[0113] In an example embodiment, the multi-device screen interaction method applied to the primary device provided by the present application further comprises: in response to an editing operation on the full-screen displayed interaction process screen, displaying an editing pattern input by the editing operation in the interaction process screen, and instructing the corresponding secondary device to display the editing pattern in the interaction process screen.

[0114] For the multi-device screen interaction method applied to the primary device provided by the present application, an alternative implementation is that during the interaction activity, the user of the primary device can zoom in the interaction process screen of any secondary device based on the requirement, and after a certain interaction process screen is zoomed in, the user of the primary device can also participate in the interaction activity corresponding to the interaction process screen, which means that the user of the primary device can participate in the same interaction activity with the member of a certain secondary device. Alternatively, when the primary device displays an interaction process screen in a zoomed-in state (e.g., a full-screen display state), the primary device can receive the editing operation applied by the user to the interaction process screen, and then display the editing pattern input based on the editing operation on the interaction process screen, and further save the editing pattern on the corresponding interaction process screen. Meanwhile, the editing pattern input by the primary device for the interaction process screen can be synchronized to the secondary device of the interaction process screen, so that the interaction process screen of the corresponding secondary device can also display the editing pattern input by the primary device for the interaction process screen, thereby realizing the common editing of the interaction process screen of the same activity by the user of the primary device and the user of the secondary device, and improving the participation flexibility and efficiency of the interaction activity, so that the user of the primary device can participate in the interaction activity in the secondary device without going to the side of the secondary device.

[0115] It should be noted that the editing operation can be realized based on touch, mouse or keyboard input, or even voice control, and the present application does not limit the implementation of the editing operation. The editing operation can include, for example, gesture writing, erasing, zooming, graphic, note, text, picture, webpage, table, mind map, audio and video content insertion operation. The editing pattern can be graphic, text and other information, and the present application does not make specific limitation.

[0116] In an example embodiment, the multi-device screen interaction method applied to the primary device provided by the present application further comprises: in response to an interaction interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the interaction interface.

[0117] Alternatively, for the multi-device screen interaction method applied to the host device provided in the present application, an alternative embodiment is that, after the host device creates an interaction interface for a certain interaction activity, if there are other devices that want to access the interaction interface established by the host device in addition to the auxiliary devices that have already established a communication connection with the host device, the user of the host device can click the interaction interface sharing button (such as the "share" button shown in FIG. 4) in the host device interface to input an interaction interface sharing operation, and then, as shown in FIG. 7, the host device can display at least one of the invitation code and the two-dimensional code that can be used for other external devices to join the interaction interface created by the host device in response to the interaction interface sharing operation, so that the other devices can enter the interaction interface created by the host device based on the invitation code or the two-dimensional code displayed by the host device, so as to participate in the interaction activity initiated by the host device subsequently.

[0118] It should be noted that the host device can display the invitation code and the two-dimensional code for joining the interaction interface created by the host device at the same time, wherein the invitation code can facilitate the user using the computer device to join the interaction interface, and the two-dimensional code can facilitate the user using the mobile phone, tablet and other portable display devices to join the interaction interface.

[0119] In an exemplary embodiment, the multi-device screen interaction method applied to the host device provided in the present application further includes: in response to the screenshot operation, intercepting the screenshot picture pointed by the screenshot operation; and in response to the screenshot sharing operation for the screenshot picture, instructing the auxiliary device pointed by the screenshot sharing operation to display the screenshot picture.

[0120] Alternatively, for the multi-device screen interaction method applied to the host device provided in the present application, an alternative embodiment is that the host device receives the screenshot operation applied thereto, and then performs screenshot on the picture area selected by the screenshot operation to obtain a corresponding screenshot picture; after the host device obtains the corresponding screenshot picture in response to the screenshot operation, if a plurality of auxiliary devices are in the process of the interaction activity, the host device can further receive the screenshot sharing operation applied thereto, for example, the user of the host device selects the screenshot picture and moves the selected screenshot picture to one side of the auxiliary device in the display picture of the host device, and then cancels the selection operation on the screenshot picture, so as to share the screenshot picture in the host device to the corresponding auxiliary device, and then the screenshot picture will be directly displayed in the display picture of the auxiliary device.

[0121] The embodiment provided in the present application can realize the transmission of the screenshot picture just intercepted by the host device to the specific auxiliary device, and enable the specific auxiliary device to display the screenshot picture on the related display interface when receiving the screenshot picture.

[0122] Please refer to FIG. 8 in combination with FIG. 1-7, based on the same inventive concept, the application further provides a multi-device picture interaction method applied to a secondary device, which can at least include steps 201-203, wherein:

[0123] Step 201, in the case of accessing the interaction interface created by the primary device, in response to the interaction start operation transmitted by the primary device, entering the corresponding research interface;

[0124] Step 202, in response to the editing operation, displaying the interaction process picture generated by the editing operation in the research interface, and sending the real-time research interaction process picture to the primary device;

[0125] Step 203, in response to the interaction end operation transmitted by the primary device, exiting the research interface, and sending the interaction result picture displayed when exiting the research interface to the primary device.

[0126] Alternatively, step 201 can be performed first, in the case that the secondary device has established a communication connection with the primary device and accessed the interaction interface created by the primary device, it means that the secondary device has made preparations for receiving the interaction task arranged by the primary device at this time, therefore, in the case of receiving the interaction start operation transmitted by the primary device, the secondary device can enter the research interface configured by the primary device for itself (the secondary device) in response to the start instruction corresponding to the interaction start operation, or select one to enter in the research interface created by the primary device in advance; the secondary device can carry out interaction activities in the independent research interface owned by itself, and is not affected by the interaction activities carried out in other secondary devices.

[0127] Further, step 202 can be performed, receiving the editing operation applied to the secondary device by the user (the user) of the secondary device, in response to the received editing operation, displaying the interaction process picture generated by the editing operation in the research interface, and at the same time, transmitting the real-time research interaction process picture to the primary device in real time, so as to realize the real-time sharing of the interaction process picture carried out in the secondary device to the primary device, so that the user of the primary device can timely learn the interaction process picture carried out in the secondary device.

[0128] It needs to be supplemented that the editing operation here can be the information input to the secondary device by the user of the secondary device based on touch, keyboard, mouse, etc., that is, the interaction process picture refers to the content picture edited by the user of the secondary device in the corresponding research interface.

[0129] The auxiliary device can return the interactive process picture to the main device based on the return period of the interactive process picture set by the main device, for example, return the corresponding interactive process picture to the main device in real time based on the editing operation of the user of the auxiliary device, but this is only one embodiment provided by the present application, and in the case of demand, the auxiliary device can also be set to update and return the interactive process picture to the main device based on a preset period, for example, 20 seconds, 30 seconds, 1 minute, etc., and the present application does not make specific limitations here.

[0130] The present application can realize the transmission of the interactive process picture of the interactive activity performed on the auxiliary device to the main device. When the method is applied to a teaching activity, the user (teacher) of the main device can learn the research ideas of the user (student) of the auxiliary device as soon as possible, so as to timely find out the problems in the research ideas of the user (student) of the auxiliary device, facilitate the teacher using the main device to correct the ideas of the user (student) as soon as possible, and also facilitate the timely discovery of the excellent research ideas of the user of the auxiliary device.

[0131] Then step 203 can be performed. In the case that the interactive end operation transmitted by the main device is received, the research interface configured by the main device in which the auxiliary device is originally entered is exited in response to the received interactive end operation. At the same time, the relevant interactive data about the current interactive activity can also be cleared, and the interactive result picture displayed in the auxiliary device when the research interface is exited can be transmitted to the main device. By not storing the interactive result picture and the interactive process data in the auxiliary device, the storage space of the auxiliary device is avoided. By transmitting the interactive result picture to the main device, the display and storage of the interactive result picture in the main device are realized.

[0132] When the multi-device picture interaction method applied to the auxiliary device provided by the present application is applied to a teaching scene, the research data is not stored based on the student end (student end), which reduces the high demand for the storage capacity of the student end, is beneficial to reduce the production cost of the student end device, thereby is beneficial to improve the popularization rate of the student large screen device, and is beneficial to improve the popularization rate of the interactive teaching.

[0133] In one exemplary embodiment, the multi-device picture interaction method applied to the auxiliary device provided by the present application further comprises: in response to the interactive result picture display operation, displaying the interactive result picture called by the interactive interface of the main device.

[0134] Alternatively, in the multi-device picture interaction provided by the present application including the auxiliary device and the main device, the interaction result picture is not stored in the auxiliary device, but is stored based on the main device for the interaction result picture obtained by the interaction in the auxiliary device, so that when the auxiliary device needs to display the interaction result picture generated in the process of participating in the interaction activity, the interaction result picture display operation applied by the user (user) of the auxiliary device is received to transmit the call request of the interaction result picture to the main device, and then the required interaction result picture is called from the interaction interface of the main device and displayed.

[0135] It should be further added that the auxiliary device can not only call and display the interaction result picture generated in the process of participating in the interaction activity based on the main device in communication connection with it, but also can call and display other interaction result pictures stored in the main device based on the main device in communication connection with it; however, the auxiliary device has no editing authority for the called and displayed interaction result picture, that is, it cannot change the information of any interaction result picture called and displayed by the main device, thereby facilitating the stability and integrity of each interaction result picture stored in the main device.

[0136] In an exemplary embodiment, the multi-device picture interaction method applied to the auxiliary device provided by the present application further comprises: transmitting corresponding interaction completion information to the main device in response to the interaction completion operation.

[0137] Alternatively, in the process of the auxiliary device participating in the interaction task initiated by the main device, and before the auxiliary device receives the interaction end operation transmitted by the main device, if the user of the auxiliary device has completed the interaction activity, the interaction completion operation of the auxiliary device can be applied by triggering the interaction completion button in the display interface of the auxiliary device, and then the auxiliary device can transmit the interaction completion information to the main device to enable the user of the main device to know that the group in which the auxiliary device is located has completed the interaction activity, and does not affect the observation and participation of the main device to the interaction activity in other auxiliary devices.

[0138] In an exemplary embodiment, in the multi-device picture interaction method applied to the auxiliary device provided by the present application, after the auxiliary device transmits corresponding interaction completion information to the main device, the further steps that can be further executed include: displaying the interaction process picture generated by the editing operation in the research interface, and sending the interaction process picture to the main device in response to the editing operation.

[0139] Optionally, after the auxiliary device transmits the corresponding interaction completion information to the main device, but before the auxiliary device receives the interaction end operation transmitted by the main device, it indicates that the current interaction activity has not ended, and therefore the auxiliary device can further update and edit the interaction process picture being performed on the auxiliary device based on requirements before the current interaction activity ends. Therefore, when the auxiliary device receives an editing operation applied by a user, the auxiliary device can display the interaction process picture updated based on the editing operation in the discussion interface in response to the received editing operation, and simultaneously transmit the interaction process picture to the main device in real time to further share the updated interaction process picture being performed on the auxiliary device with the main device, so that the user of the main device can learn the updated interaction process picture being performed on the auxiliary device.

[0140] In an exemplary embodiment, after entering the corresponding discussion interface, the method further includes: in response to the video interaction request, connecting the user associated with the video interaction request, displaying the video picture of the user, and instructing the communication device of the user to enter the discussion interface.

[0141] Optionally, in the embodiments provided by the present application, one auxiliary device can perform the interaction activity of one group, and therefore the participants of the interaction activity performed on one auxiliary device can be multiple. Considering the members in one group, if a member cannot be present on the site of the corresponding auxiliary device in one interaction activity due to various reasons, but has to participate in the interaction activity, the present application provides an optional implementation that the member not present on site can participate in the interaction activity performed on the corresponding auxiliary device remotely. For example, the member not present on site can initiate a video interaction request to the auxiliary device, and the auxiliary device can connect the user (the member not present on site) associated with the video interaction request after receiving the video interaction request, so that the member not present on site can also join the discussion interface of the auxiliary device to participate in the discussion activity together with the members present on site. Meanwhile, the video picture of the member not present on site can be displayed on the display interface of the auxiliary device at a suitable position during the performance of the interaction activity, so that the interaction experience of the members present on site and the members not present on site is better.

[0142] In an exemplary embodiment, the multi-device picture interaction method applied to the auxiliary device provided by the present application further includes: in response to the interaction interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the discussion interface; or, in response to the interaction interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the interaction interface created by the main device.

[0143] Alternatively, for the multi-device picture interactive method applied to the auxiliary device provided in the present application, an alternative embodiment is that, in the case that other users want to access the discussion interface in which the auxiliary device is located through the devices used by themselves, the user of the auxiliary device can click the interactive interface sharing button in the display interface of the auxiliary device to input the interactive interface sharing operation, and then the auxiliary device can display at least one of the invitation code and the two-dimensional code that can be used for other devices to join the corresponding discussion interface in response to the interactive interface sharing operation, so that the other devices can enter the discussion interface in which the auxiliary device is located based on the invitation code or the two-dimensional code displayed by the auxiliary device.

[0144] For the multi-device picture interactive method applied to the auxiliary device provided in the present application, an alternative embodiment is that, after the main device creates an interactive interface for a certain interactive activity, if there are other users who want to access the interactive interface established by the main device based on the devices used by themselves in addition to the auxiliary devices that have established communication connection with the main device, at this time, the user of the auxiliary device can click the interactive interface sharing button in the display interface of the auxiliary device to input the interactive interface sharing operation, and then the auxiliary device can display at least one of the invitation code and the two-dimensional code that can be used for other devices to join the interactive interface created by the corresponding main device in response to the interactive interface sharing operation, so that the other devices can enter the interactive interface created by the main device based on the invitation code or the two-dimensional code displayed by the auxiliary device.

[0145] It should be noted that the auxiliary device can display the invitation code and the two-dimensional code for joining the interactive interface created by the corresponding main device at the same time, and the auxiliary device can also display the invitation code and the two-dimensional code for joining the discussion interface of the auxiliary device at the same time, wherein the invitation code can be convenient for users using computer devices, and the two-dimensional code can be convenient for users using portable display devices such as mobile phones and tablets.

[0146] In an exemplary embodiment, after entering the corresponding discussion interface, it further includes: in response to a running operation of a target application, displaying a running picture of the target application; the target application is an application currently installed in the auxiliary device.

[0147] Alternatively, after the auxiliary device has entered the discussion interface individually configured by the corresponding main device, for example, in the case that the interactive activity is being carried out in the auxiliary device and the interactive process picture is displayed, the user of the auxiliary device (user) can still run other application programs installed in the auxiliary device based on the demand; that is, the auxiliary device can display a running picture of a target application in response to a running operation of the target application, so as to facilitate the auxiliary device to still use other application programs based on the demand in the process of participating in the interactive task arranged by the main device, and to improve the user experience of the user of the auxiliary device.

[0148] Further, when the multi-device picture interaction method provided in the application is applied to a teaching scenario, the user (student) of the auxiliary device and the user (student) of other external devices who join the discussion interface of the auxiliary device can send question information to the main device during the interactive activity, the question information including relevant question content, so that the main device can receive the question information without affecting the interactive activity; then, the number of received question information can be displayed on the button for question information in the display interface of the main device, or a prompt that new question information has been received can be displayed on the button for question information, so that the user (teacher) of the main device can find that there is a question to be answered, and then can display the question content included in the relevant question information on the display interface of the main device by clicking the button for question information at a convenient time, so as to facilitate the teacher to read the relevant question content and make appropriate answers.

[0149] Further, after the interactive task initiated by the main device ends, for example, after the teaching activity completely ends, the teacher end (main device) can perform classroom evaluation on the devices (including auxiliary devices and other external devices) participating in the discussion activity based on the installed teaching scoring system, and send the relevant classroom evaluation to the corresponding student device, so that the student can know the score of his / her participation in the teaching activity.

[0150] It should be understood that, although each step in the flowchart involved in each embodiment as described above is displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be alternately executed with at least part of other steps or steps or stages in other steps.

[0151] It should be further supplemented that the multi-device picture interaction method provided by the application can first establish a binding relationship between the main and auxiliary interaction smart tablets, and then make the main device (the main interaction smart tablet) and the auxiliary device (the auxiliary interaction smart tablet) connect to the same space (the interaction interface), the main device can distribute independent research spaces (the research interface) to each auxiliary device, each auxiliary device carries out group research, the main device previews the research content carried out by each auxiliary device, after the main device ends the research activity, each auxiliary device returns the research content to the main device, and the main device can switch and view the research results and share them; the research results are saved to the personal space account of the main device.

[0152] Regarding the establishment of the binding relationship between the main and auxiliary interaction smart tablets, the related implementation mode can include: creating a device group on the management platform, binding the SN codes (Serial Number, product serial number) of the main and auxiliary devices, and configuring the device relationship; when the software is opened, the SN code of the device identity and the binding device relationship are queried in the background through wide area network.

[0153] Regarding the connection of the main and auxiliary devices to the same space, the related implementation mode can include: when the main device software is opened, the device group relationship in the background is identified through networking after the creation of the interaction space, and the auxiliary device is automatically added to the same space; when the auxiliary device software is opened, after receiving the notification of the main device through networking, the auxiliary device is automatically added to the same space of the main device.

[0154] Regarding the distribution of the independent research space of the main device to each auxiliary device, the related implementation mode can include: the main device starts research, and creates a separate research space for each auxiliary device; the auxiliary device automatically joins the group research space, and the canvas data of each space is isolated from each other and does not affect each other.

[0155] Regarding the group research of the auxiliary device and the preview of the main device, the related content can include: students can edit and create on the canvas of the auxiliary device, and cooperatively output research results; teachers can preview the research content of the auxiliary device on the main device, and understand the research progress.

[0156] Regarding the end of the research of the main device and the return of the research content of the auxiliary device, the related content can include: after the main device clicks to end the research, the auxiliary device will automatically exit the group research space; the research content of the auxiliary device is automatically saved to the presentation list of the main device.

[0157] Regarding the switching, viewing and sharing of the research results of the auxiliary device, the related content can include: the main device can view and edit the group research details of the auxiliary device; the main device can switch to view the research content of different groups.

[0158] It can be seen that, by the advance configuration of the main and auxiliary devices, the main device can link the auxiliary devices, without the need to bind the main and auxiliary devices before each seminar activity, and without the need to install a video splitting decoder on the devices. A user (teacher) can generate a seminar space required for the seminar activity by the main device by clicking a start control of an interaction space in the main device, and the auxiliary devices having a communication connection relationship with the main device can automatically join the seminar space, which is simple to use and has low user learning cost. The seminar activity performed in the auxiliary devices can be viewed in real time through the main device, and the main device can select an end time of the seminar according to the observed seminar progress. The seminar editing content of the main and auxiliary devices on the interactive smart tablet can be automatically returned to the main device and saved to a personal account (in the cloud) of the main device after the seminar, for easy viewing and editing at any time.

[0159] Based on the same inventive concept, the embodiments of the present application also provide a multi-device picture interaction teaching system for implementing the multi-device picture interaction method described above. The implementation scheme for solving the problem provided by the teaching system is similar to the implementation scheme described in the above method, and therefore the specific limitations in one or more multi-device picture interaction teaching system embodiments provided below can refer to the limitations of the multi-device picture interaction method described above, which will not be described here again.

[0160] Please refer to FIG. 9 in combination with FIGS. 1-8. In an exemplary embodiment, the present application provides a multi-device picture interaction teaching system 200, the devices in the teaching system 200 include one main device and at least one auxiliary device; the at least one auxiliary device is in communication connection with the main device; wherein,

[0161] The main device is configured to, in the case that the at least one auxiliary device in communication connection accesses an interaction interface created by the main device, in response to an interaction start operation, instruct each auxiliary device to enter a respective seminar interface; display an interaction process picture of real-time seminar of each auxiliary device; the interaction process picture is a picture of interaction of the auxiliary device in the corresponding seminar interface; in response to an interaction end operation, instruct each auxiliary device to exit the corresponding seminar interface, and display an interaction result picture returned by each auxiliary device; the interaction result picture is a picture displayed when the auxiliary device exits the corresponding seminar interface;

[0162] The auxiliary device is configured to, in the case that the auxiliary device accesses the interaction interface created by the main device, in response to the interaction start operation transmitted by the main device, enter the corresponding seminar interface; in response to an editing operation, display an interaction process picture generated by the editing operation in the seminar interface, and send the interaction process picture of real-time seminar to the main device; in response to the interaction end operation transmitted by the main device, exit the seminar interface, and send an interaction result picture displayed when the auxiliary device exits the seminar interface to the main device.

[0163] In an exemplary embodiment, the host device is further configured to instruct the secondary device pointed by the media data transmission operation to display the relevant media data in response to the media data transmission operation.

[0164] In an exemplary embodiment, the host device comprises a side display area; the host device is further configured to display the real-time seminar interactive process pictures returned by the secondary devices in the side display area in a region-by-region manner.

[0165] In an exemplary embodiment, the host device further comprises a main display area connected to the side display area; the host device is further configured to display the interactive theme associated with the interactive process pictures in the main display area.

[0166] In an exemplary embodiment, the host device is further configured to instruct the secondary device pointed by the interactive stop operation to exit the corresponding seminar interface and clear the relevant interactive data in response to the interactive stop operation for any secondary device.

[0167] In an exemplary embodiment, the host device is further configured to display the editing pattern input by the editing operation in the interactive result picture in response to the editing operation for the interactive result picture.

[0168] In an exemplary embodiment, the host device is further configured to display the corresponding interactive process picture in full screen in response to the zoom-in operation for the interactive process picture of any secondary device.

[0169] In an exemplary embodiment, the host device is further configured to display the editing pattern input by the editing operation in the interactive process picture in response to the editing operation for the interactive process picture displayed in full screen, and instruct the corresponding secondary device to display the editing pattern in the interactive process picture synchronously.

[0170] In an exemplary embodiment, the host device is further configured to display at least one of the invitation code and the two-dimensional code for joining the interactive interface in response to the interactive interface sharing operation.

[0171] In an exemplary embodiment, the host device is further configured to capture the screenshot picture pointed by the screenshot operation in response to the screenshot operation, and instruct the secondary device pointed by the screenshot sharing operation to display the screenshot picture in response to the screenshot sharing operation for the screenshot picture.

[0172] In an exemplary embodiment, the secondary device is further configured to display the interactive result picture called by the interactive interface of the host device in response to the interactive result picture display operation.

[0173] In an exemplary embodiment, the secondary device is further configured to transmit the corresponding interactive completion information to the host device in response to the interactive completion operation.

[0174] In an example embodiment, the auxiliary device is further configured to, after transmitting the corresponding interaction completion information to the host device, in response to the editing operation, display an interaction process picture generated by the editing operation in the discussion interface, and send the interaction process picture to the host device.

[0175] In an example embodiment, the auxiliary device is further configured to, after entering the corresponding discussion interface, in response to the video interaction request, connect to a user associated with the video interaction request, display a video picture of the user, and instruct a communication device of the user to enter the discussion interface.

[0176] In an example embodiment, the auxiliary device is further configured to, in response to the interaction interface sharing operation, display at least one of an invitation code and a two-dimensional code for joining the discussion interface; or, in response to the interaction interface sharing operation, display at least one of an invitation code and a two-dimensional code for joining the interaction interface created by the host device.

[0177] In an example embodiment, the auxiliary device is further configured to, after entering the corresponding discussion interface, in response to a running operation on a target application, display a running picture of the target application; the target application is an application currently installed on the auxiliary device.

[0178] The technical features of the above-described embodiments can be combined in any manner. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described, however, as long as the combinations of the technical features do not contradict each other, they should be considered within the scope of the present disclosure.

[0179] The above-described embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that, for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the patent protection scope of the present application should be subject to the appended claims.

Claims

1. A multi-device picture interaction method, characterized in that, Applied to a master device, comprising: In the case that at least one auxiliary device is in communication connection with the master device and the at least one auxiliary device in communication connection accesses the interactive interface created by the master device, in response to an interaction start operation, instructing each auxiliary device to enter a respective corresponding research interface; Displaying an interactive process picture of real-time research of each auxiliary device; the interactive process picture is a picture of interaction of the auxiliary device in the corresponding research interface; In response to an interaction end operation, instructing each auxiliary device to exit the corresponding research interface, and displaying an interaction result picture returned by each auxiliary device; the interaction result picture is a picture displayed when the auxiliary device exits the corresponding research interface.

2. The method of claim 1, wherein, Further comprising: In response to a media data transmission operation, instructing the auxiliary device pointed by the media data transmission operation to display related media data; wherein the media data comprises at least one of a picture, a video, an audio or a document.

3. The method of claim 1, wherein, The master device comprises a side display area; The displaying of the interactive process picture of real-time research of each auxiliary device comprises: Displaying the interactive process picture of real-time research returned by each auxiliary device in the side display area in a region.

4. The method of claim 3, wherein, The master device further comprises a main display area connected with the side display area; The method further comprises displaying an interaction theme associated with each interactive process picture in the main display area.

5. The method of claim 1, wherein, Further comprising: In response to an interaction stop operation for any auxiliary device, instructing the auxiliary device pointed by the interaction stop operation to exit the corresponding research interface and clear related interaction data.

6. The method of claim 1, wherein, Further comprising: In response to an editing operation for the interaction result picture, displaying an editing pattern input by the editing operation in the interaction result picture.

7. The method of claim 1, wherein, Further comprising: In response to a zoom-in operation on the interactive process picture of any auxiliary device, full-screen displaying the corresponding interactive process picture.

8. The method of claim 7, wherein, Further comprising: In response to an editing operation on the full-screen displayed interactive process picture, displaying an editing pattern input by the editing operation in the interactive process picture, and instructing the corresponding auxiliary device to display the editing pattern in the interactive process picture synchronously.

9. The method of claim 1, wherein, Further comprising: In response to an interactive interface sharing operation, displaying at least one of an invitation code and a two-dimensional code for joining the interactive interface.

10. The method according to any one of claims 1 to 9, characterized in that, Further comprising: In response to a screenshot operation, intercepting a screenshot picture pointed by the screenshot operation; In response to a screenshot sharing operation for the screenshot picture, instructing the auxiliary device pointed by the screenshot sharing operation to display the screenshot picture.

11. A multi-device picture interaction method, characterized by, Applied to an auxiliary device, comprising: In the case of accessing an interactive interface created by a master device, in response to an interaction start operation transmitted by the master device, entering a corresponding research interface; In response to an editing operation, displaying an interactive process picture generated by the editing operation in the research interface, and sending the interactive process picture of real-time research to the master device; In response to an interaction end operation transmitted by the master device, exiting the research interface, and sending an interaction result picture displayed when exiting the research interface to the master device.

12. The method of claim 11, wherein, Further comprising: In response to the interaction result picture display operation, display the interaction result picture called by the interaction interface of the host device.

13. The method of claim 11, wherein, Further comprising: In response to the interaction completion operation, transmit corresponding interaction completion information to the host device.

14. The method of claim 13, wherein, After the transmitting corresponding interaction completion information to the host device, further comprising: In response to the editing operation, display the interaction process picture generated by the editing operation in the research interface, and send the interaction process picture to the host device.

15. The method of claim 11, wherein, After the entering the corresponding research interface, further comprising: In response to the video interaction request, connect the user associated with the video interaction request, display the video picture of the user, and instruct the communication device of the user to enter the research interface.

16. The method of claim 11, wherein, Further comprising: In response to the interaction interface sharing operation, display at least one of the invitation code and the two-dimensional code for joining the research interface; Or, In response to the interaction interface sharing operation, display at least one of the invitation code and the two-dimensional code for joining the interaction interface created by the host device.

17. The method of claim 11, wherein, After the entering the corresponding research interface, further comprising: In response to the running operation for the target application, display the running picture of the target application; the target application is an application currently installed in the auxiliary device.

18. A multi-device picture interaction teaching system, characterized in that, The devices in the teaching system include a host device and at least one auxiliary device; the at least one auxiliary device is in communication connection with the host device; wherein, The host device is configured to, in the case that the at least one auxiliary device in communication connection enters the interaction interface created by the host device, in response to an interaction start operation, instruct each auxiliary device to enter a corresponding research interface; display the interaction process picture of real-time research of each auxiliary device; the interaction process picture is a picture of interaction of the auxiliary device in the corresponding research interface; in response to an interaction end operation, instruct each auxiliary device to exit the corresponding research interface, and display the interaction result picture returned by each auxiliary device; the interaction result picture is a picture displayed when the auxiliary device exits the corresponding research interface; The auxiliary device is configured to, in the case that the auxiliary device enters the interaction interface created by the host device, in response to the interaction start operation transmitted by the host device, enter the corresponding research interface; in response to the editing operation, display the interaction process picture generated by the editing operation in the research interface, and send the interaction process picture of real-time research to the host device; in response to the interaction end operation transmitted by the host device, exit the research interface, and send the interaction result picture displayed when the auxiliary device exits the research interface to the host device.

Images