Interactive tablet control method, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an interactive tablet control method, electronic equipment and a storage medium, and the method comprises the steps: confirming that only a function of controlling a function operation state in a first type of application associated with a conference in an interactive tablet is required after the connection between the interactive tablet and conference control equipment is established; obtaining a corresponding function triggering identifier and a corresponding control instruction definition, sending the corresponding function triggering identifier and the corresponding control instruction definition to the conference control equipment, displaying the function triggering identifier on the conference control equipment, and when a triggering operation on the function triggering identifier is received, generating a target instruction according to the target identifier and the control instruction definition, and the target application responds to the target instruction after the target instruction is sent to the interaction panel. In a multi-person communication scene, any person does not need to be close to the interaction panel for operation, a user can quickly control the interaction panel through the conference control equipment, information transmission interruption or participant attention distraction in the multi-person communication process is avoided, the continuity of information transmission in the multi-person communication process is guaranteed, and the user experience is improved. And the multi-person communication effect is improved.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of interactive control technology, and in particular to an interactive tablet control method, an electronic device, and a storage medium. Background Art

[0002] With the continuous development and popularization of information technology, various types of electronic devices continue to emerge, and the connection methods between electronic devices are also rich and varied. For example, in a conference room built based on information technology, there are usually a variety of electronic devices such as interactive tablets, microphones, speakers, mice, keyboards, etc. The interactive tablet is the core of the various electronic devices, and other electronic devices are connected to each other as peripheral devices to achieve information collection, transmission and presentation during the meeting communication process.

[0003] The inventor has conducted an in-depth study of the details of various specific scenarios for using interactive tablets to conduct multi-person communication and found that there is a specific multi-person communication scenario in which the speaker performs a relatively simple one-way output in a relatively static manner, such as knowledge training or lectures. In this relatively static multi-person communication scenario where the speaker is far away from the interactive tablet, there may also be a need to use the interactive tablet to realize information generation and recording during the multi-person communication process. Existing interactive tablets usually require the speaker to stand up and move, or other people to move to the location of the interactive tablet to operate and control it. This method of controlling the interactive tablet causes the interruption of information transmission during the multi-person communication process or the distraction of the participants' attention, affecting the effect of information transmission during the multi-person communication process. Summary of the invention

[0004] The present invention provides an interactive tablet control method, an electronic device and a storage medium to solve the technical problem that the existing control method of the interactive tablet may cause the interruption of information transmission in the multi-person communication process or the distraction of the participants, thereby affecting the information transmission effect in the multi-person communication process.

[0005] In a first aspect, an embodiment of the present invention provides an interactive tablet control method, which is applied to an interactive tablet. The interactive tablet control method includes:

[0006] Receive a control request sent by a conference control device;

[0007] In response to the control request, a control data transmission channel is established with the conference control device, and a function trigger identifier and a corresponding control instruction definition of the first type of application associated with the conference in the interactive tablet are obtained;

[0008] Send the function trigger identifier and the control instruction definition to the conference control device through the control data transmission channel, so that the conference control device displays the function trigger identifier and monitors the trigger operation, and when monitoring the trigger operation of the target identifier in the function trigger identifier, generates the target instruction according to the corresponding control instruction definition and sends it to the interactive tablet through the control data transmission channel;

[0009] When a target instruction is received from the conference control device, the target instruction is distributed to a corresponding target application in the first category of applications, so that the target application controls the function state according to the target instruction.

[0010] As described above, after establishing the connection between the interactive tablet and the conference control device, it is confirmed that only the functions in the first category of applications associated with the conference in the interactive tablet need to control the function running status, and the corresponding function trigger identifier and the corresponding control instruction definition are obtained and sent to the conference control device. The conference control device displays the function trigger identifier, and when receiving the trigger operation on the function trigger identifier, a target instruction that can be directly responded to by the target application corresponding to the target identifier is generated according to the control instruction definition corresponding to the target identifier of the trigger operation. After the conference control device sends the target instruction to the interactive tablet, the target application responds according to the normal response logic. In the multi-person communication scenario, there is no need for anyone to approach the interactive tablet to operate. The interactive tablet can be quickly controlled by the conference control device at the user's hand, avoiding the interruption of information transmission or the distraction of participants during multi-person communication, ensuring the continuity of information transmission during multi-person communication, and improving the multi-person communication effect.

[0011] Based on the above embodiment, before sending the function trigger identifier and the control instruction definition to the conference control device through the control data transmission channel, the method further includes:

[0012] It is confirmed that the acquired function trigger identifier is different from the function trigger identifier sent to the same conference control device last time.

[0013] As described above, by transmitting the function trigger identifier and the control instruction definition only when there is a function control change, repeated transmission of data can be reduced.

[0014] On the basis of the above embodiment, in response to the control request, establishing a control data transmission channel with the conference control device includes:

[0015] In response to the control request, a control data transmission channel is established with the conference control device so that the conference control device displays a function trigger identifier recently received from the same interactive tablet;

[0016] Accordingly, the function trigger identifier and the control instruction definition are sent to the conference control device through the control data transmission channel, so that the conference control device displays the function trigger identifier, and upon receiving a trigger operation on the target identifier in the function trigger identifier, a target instruction is generated according to the corresponding control instruction definition and sent to the interactive flat panel through the control data transmission channel, including:

[0017] The function trigger identifier and control instruction definition are sent to the conference control device through the control data transmission channel, so that the conference control device redisplays and updates the saved function trigger identifier, and when a trigger operation on the target identifier in the function trigger identifier is received, a target instruction is generated according to the corresponding control instruction definition and sent to the interactive tablet through the control data transmission channel.

[0018] As described above, the conference control device is controlled to preferentially display the function trigger identifier stored by itself, and redisplays the function trigger identifier only when a new function trigger identifier is received, so that the function trigger identifier can be quickly displayed.

[0019] Based on the above embodiment, before receiving the control request sent by the conference control device, the method further includes:

[0020] The connection information is multicasted in the local area network so that the conference control device in the local area network can find the interactive tablet and send a control request according to the connection information when receiving a selection operation corresponding to the interactive tablet.

[0021] As described above, multicast within the local area network can quickly establish a control data transmission channel.

[0022] On the basis of the above embodiment, the function triggering mark carries the application information of the corresponding first-category application, so that the conference control device displays the function triggering mark in different regions according to the application information.

[0023] As described above, by displaying in different areas, the user can quickly locate the target identifier that he wants to trigger on the conference control device.

[0024] On the basis of the above embodiment, the control data transmission channel is established based on the socket.

[0025] As mentioned above, socket connection can provide an efficient data transmission channel.

[0026] In a second aspect, an embodiment of the present invention provides an interactive tablet control method for a conference control device, the interactive tablet control method comprising:

[0027] receiving a control target confirmation operation, where the control target confirmation operation is used to confirm a target interactive tablet to be connected;

[0028] In response to the control target confirmation operation, a control request is sent to the target interactive tablet to establish a control data transmission channel with the target interactive tablet;

[0029] When receiving the function trigger identifier and the corresponding control instruction definition sent by the target interactive flat panel through the control data transmission channel, the function trigger identifier is displayed, and the trigger operation on the target identifier in the function trigger identifier is monitored, and the function trigger identifier is the function trigger identifier in the first type of application associated with the conference in the interactive flat panel;

[0030] When a trigger operation is monitored, a target instruction is generated according to the control instruction definition corresponding to the corresponding target identifier, and the target instruction is sent to the interactive flat panel through the control data transmission channel, so that the target application corresponding to the target instruction in the first category of applications controls the function status according to the target instruction.

[0031] As described above, after establishing the connection between the interactive tablet and the conference control device, it is confirmed that only the functions in the first category of applications associated with the conference in the interactive tablet need to control the function running status, and the corresponding function trigger identifier and the corresponding control instruction definition are obtained and sent to the conference control device. The conference control device displays the function trigger identifier, and when receiving the trigger operation on the function trigger identifier, a target instruction that can be directly responded to by the target application corresponding to the target identifier is generated according to the control instruction definition corresponding to the target identifier of the trigger operation. After the conference control device sends the target instruction to the interactive tablet, the target application responds according to the normal response logic. In the multi-person communication scenario, there is no need for anyone to approach the interactive tablet to operate. The interactive tablet can be quickly controlled by the conference control device at the user's hand, avoiding the interruption of information transmission or the distraction of participants during multi-person communication, ensuring the continuity of information transmission during multi-person communication, and improving the multi-person communication effect.

[0032] On the basis of the above embodiment, in response to the control target confirmation operation, sending a control request to the target interactive tablet to establish a control data transmission channel with the target interactive tablet includes:

[0033] When it is confirmed that the control data transmission channel is successfully established, the local searches for the function trigger identifier received from the target interactive tablet, and displays the found function trigger identifier when the search is successful.

[0034] As described above, the conference control device preferentially displays the function trigger identifier stored by itself, and redisplays it only when a new function trigger identifier is received, so that the function trigger identifier can be quickly displayed.

[0035] On the basis of the above embodiment, when a function trigger identifier and a corresponding control instruction definition sent by a target interactive tablet are received through a control data transmission channel, the function trigger identifier is displayed, including:

[0036] When the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is redisplayed according to the received function trigger identifier, and the saved function trigger identifier is updated.

[0037] As described above, when a function trigger identifier is received, the latest function trigger identifier is displayed, which can ensure that the latest version of the application in the corresponding interactive tablet is controlled.

[0038] Based on the above embodiment, before receiving the control target confirmation operation, the method further includes:

[0039] Monitoring connection information multicasted by the interactive tablet through the local area network, the connection information including the interactive tablet identifier;

[0040] Display the interactive tablet logo in all monitored connection information;

[0041] Accordingly, receiving a control target confirmation operation includes:

[0042] A control target confirmation operation acting on a target identifier in the interactive tablet identifier is received, and the interactive tablet corresponding to the target identifier is confirmed as a target interactive tablet to be connected.

[0043] As described above, by monitoring the connection information and initiating the connection in the local area network, a control data transmission channel can be quickly established.

[0044] On the basis of the above embodiment, the function trigger mark carries the application information of the corresponding first category application, and the function trigger mark is displayed in different regions according to the application information and different first category applications.

[0045] As described above, by displaying in different areas, the user can quickly locate the target identifier that he wants to trigger on the conference control device.

[0046] On the basis of the above embodiment, the control data transmission channel is established based on the socket.

[0047] As mentioned above, socket connection can provide an efficient data transmission channel.

[0048] In a third aspect, an embodiment of the present invention provides an electronic device, the electronic device comprising:

[0049] one or more processors;

[0050] a memory for storing one or more computer programs;

[0051] When one or more computer programs are executed by one or more processors, the electronic device implements the interactive tablet control method of the first aspect or the second aspect.

[0052] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the interactive tablet control method of the first aspect or the second aspect.

[0053] The electronic device of the third aspect can be used to execute the interactive tablet control method provided by any of the above embodiments, and the computer program stored in the computer-readable storage medium of the fourth aspect can execute the interactive tablet control method provided by any of the above embodiments when executed by the processor, each having corresponding functions and beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0055] Figure 1 A method flow chart of an interactive tablet control method for an interactive tablet provided in an embodiment of the present application;

[0056] Figure 2 A schematic diagram of the connection status of an interactive tablet and a conference control device provided as an example in an embodiment of the present application;

[0057] Figure 3 A schematic diagram of an interface for displaying a function trigger mark in different regions provided as an example in an embodiment of the present application;

[0058] Figure 4 A schematic diagram of the interface when the function triggering mark of the "Conference Summary" application is displayed for the exemplary embodiment not applied for;

[0059] Figure 5 A schematic diagram of a data transmission process between an interactive tablet and a conference control device provided as an example in an embodiment of the present application;

[0060] Figure 6 A method flow chart of an interactive tablet control method for a conference control device provided in an embodiment of the present application;

[0061] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] In order to make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are used to explain the present invention, rather than to limit the present invention. It should also be noted that, for the sake of ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0063] It should be noted that due to space limitations, this application description does not list all optional implementation methods. After reading this application description, those skilled in the art should be able to understand that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0064] Each embodiment is described in detail below.

[0065] Interactive tablets are electronic devices designed and developed for multi-person communication scenarios. Multi-person communication scenarios are defined based on the number of participants and the type of behavior. Interpersonal communication itself is a relatively complex behavior, and multi-person communication scenarios have different specific scenario details. For example, both conference scenarios and teaching scenarios belong to multi-person communication scenarios, but conference scenarios and teaching scenarios have significantly different communication characteristics. Multi-person communication scenarios can be classified based on the different role positioning methods of the members participating in the multi-person communication. They can be divided into one-way multi-person communication in which a single member (or multiple members in turn) outputs information and other users receive information, and multi-way communication in which multiple members speak freely to cross-output and receive information. In one-way multi-person communication, language or a combination of language and pictures may be used as the way to present information according to the characteristics of the communication topic.

[0066] In different multi-person communication scenarios, there are typical differences in the use requirements of interactive tablets, and there may also be common requirements. For example, in multi-person communication in a visit scenario, the interactive tablet may only need to present the communication topic; in teaching scenarios, especially in teaching scenarios where the teaching content needs to be presented concretely, the input and display of the blackboard on the interactive tablet is an important use requirement. In various multi-person communication scenarios, there may be a need to record the communication process.

[0067] In multi-person communication scenarios such as business presentations, government meetings, and reports, there is usually a speaker at the podium, or a cooperator who assists in controlling the interactive tablet in a less prominent position, controlling the interactive tablet for presentation content based on projection or remote control devices. In these scenarios, the speaker and cooperator are usually relatively static and far away from the interactive tablet. When it is necessary to record the communication process, they need to move to the location of the interactive tablet and operate the application installed in the interactive tablet for communication recording. If it is not determined from the beginning that the communication needs to be recorded from beginning to end, someone needs to move to the location of the interactive tablet as needed during the multi-person communication process to perform operations such as start, pause, and end; whether the speaker or the cooperator performs these operations, it is possible to interrupt the information transmission during the multi-person communication process (such as the speaker's operation) or distract the participants (such as the cooperator's operation), affecting the effect of information transmission during the multi-person communication process.

[0068] In order to solve the above technical problems, the embodiment of the present application proposes an interactive tablet control method. After establishing a connection between the interactive tablet and the conference control device, it is confirmed that only the functions in the first category of applications associated with the conference in the interactive tablet need to control the function running status, and the corresponding function trigger identifier and the corresponding control instruction definition are obtained and sent to the conference control device. The conference control device displays the function trigger identifier, and when receiving a trigger operation on the function trigger identifier, a target instruction that can be directly responded to by the target application corresponding to the target identifier is generated according to the control instruction definition corresponding to the target identifier of the trigger operation. After the conference control device sends the target instruction to the interactive tablet, the target application responds according to the normal response logic. In a multi-person communication scenario, there is no need for anyone to approach the interactive tablet to operate. The interactive tablet can be quickly controlled by the conference control device at the user's hand, avoiding the interruption of information transmission or the distraction of participants during multi-person communication, ensuring the continuity of information transmission during multi-person communication, and improving the multi-person communication effect.

[0069] The interactive tablet used in this solution can be an integrated device that uses touch technology to control the content displayed on the display screen and realize human-computer interaction operations. It integrates one or more functions such as a projector, an electronic whiteboard, a screen, a sound system, a television, and a video conferencing terminal. Of course, the interactive tablet does not include a limitation on the surface characteristics of the display surface. For example, the surface characteristics of the interactive tablet can be a plane, a curved surface, or a combination of multiple planes.

[0070] Typically, the interactive tablet is installed with at least one operating system, wherein the operating system includes but is not limited to Android system, Linux system, Windows system and Huawei Hongmeng system, which is used to control and coordinate the interactive tablet and peripheral devices, so that various independent hardware in the interactive tablet can work in coordination as a stable whole. The interactive tablet includes at least one display screen, for example, the interactive tablet is configured with a display screen with a touch function, that is, a touch-sensitive display screen. The touch-sensitive display screen can be an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen or a pressure-sensitive display screen, etc. On the display screen with a touch function, the user can touch the display screen by touching the finger or a writing pen to achieve touch operation, and accordingly, the interactive tablet detects the touch position and responds according to the touch position to achieve the touch function. When the touch sensing module used on the display screen with a touch function is different, the original touch signal collected by the touch sensing module is different, and the converted touch signal is not exactly the same. In the interactive tablet, in order to realize the quick operation of commonly used functions without exiting the current page, a sidebar is usually set on both sides of the display screen, and multiple function controls are displayed in the sidebar, such as a camera control for starting the camera, a writing control for quickly starting writing, etc.

[0071] For an infrared display screen, the touch sensing module is an infrared touch frame, and the touch signal collected by it may include a signal indicating that the infrared rays are blocked, and the converted touch signal may include a position touch signal, and the position touch signal may include the X coordinate and Y coordinate of the touch position. For a capacitive display screen, the touch sensing module is a capacitive touch panel, and the touch signal collected by it may include the current flowing through each electrode of the touch screen, and the converted touch signal may include a position touch signal, and the position touch signal may include the X coordinate and Y coordinate of the touch position. For a resistive display screen, the touch sensing module is a resistive touch panel, and the touch signal collected by it may include the voltage of the touch position, and the converted touch signal may include a position touch signal, and the position touch signal may include the X coordinate and Y coordinate of the touch position. For an electromagnetic display screen, the touch sensing module is an electromagnetic panel, and the touch signal collected by it may include the change in magnetic flux and the frequency of the received electromagnetic signal, and the converted touch signal may include a position touch signal corresponding to the change in magnetic flux and a pressure signal corresponding to the frequency, and the position touch signal may include the X coordinate and Y coordinate of the touch position; the pressure signal may include a pressure value. For a pressure-sensitive display screen, the touch sensing module is a pressure sensor, and the touch signal collected by the touch sensing module may include a pressure signal. The converted touch signal may include a position touch signal, and the position touch signal may include an X coordinate and a Y coordinate of the touch position.

[0072] The interactive tablet described in the embodiments of this application may also be called an all-in-one machine, a smart tablet, a conference tablet, a conference board, etc. It should be understood that electronic devices used in multi-person communication scenarios to support information, presentation, recording, and sharing in the process of multi-person communication are not out of the scope of the interactive tablet. Moreover, the need to use an interactive tablet to record meetings described in the previous text is only an exemplary presentation of a functional control requirement of the speaker or cooperating personnel for the interactive tablet. Other control requirements such as video conferencing, screen projection, etc. that require state switching of the interactive tablet can all be achieved through this solution.

[0073] Figure 1 is a method flow chart of an interactive tablet control method provided by an embodiment of the present application, such as Figure 1 As shown, the interactive tablet control method includes but is not limited to step S110-step S140. The interactive tablet control method is described from the perspective of the interactive tablet. For a clearer description, the corresponding implementation process of the conference control device will be described.

[0074] Step S110: receiving a control request sent by a conference control device.

[0075] Conference control device refers to an electronic device used to control an interactive tablet in a multi-person communication scenario. Specifically, it can be a dedicated control device installed in the space where the interactive tablet is located, such as a podium host installed in the podium to control the electronic devices specially arranged in the conference space; it can also be a user's personal terminal device, such as a laptop, smart phone, etc. The conference control device can be installed with downloaded applications or embedded applications, so that it can establish a connection with the interactive tablet and parse, present, interact and process the data provided by the interactive tablet. The control request is a request generated after the speaker or the cooperating personnel operates the conference control device and selects a certain interactive tablet as the connection target on the basis of the conference control device discovering the interactive tablet. The control request will be sent to the selected interactive tablet. After the selected interactive tablet receives the control request, it directly establishes a data channel dedicated to controlling the interactive tablet. In the specific data processing process after the conference control device discovers the interactive tablet, the control target confirmation operation is first received. The control target confirmation operation is used to confirm the target interactive tablet to be connected; then in response to the control target confirmation operation, the control request is sent to the target interactive tablet to establish a control data transmission channel with the target interactive tablet. The control data transmission channel refers to a dedicated data channel for various data required for interactive tablet control between the interactive tablet and the conference control device, such as the data channel for the interactive tablet to send function trigger identification and control instruction definition, and the conference control device to send target instructions in the following text.

[0076] For the interactive tablet, after power-on, it multicasts connection information to the local area network so that the conference control device in the local area network can find the interactive tablet and send a control request according to the connection information when receiving the selection operation corresponding to the interactive tablet. For the conference control device, after power-on, it monitors the connection information multicast by the interactive tablet through the local area network, and the connection information includes the interactive tablet identifier; displays the interactive tablet identifier in all the monitored connection information; receives the control target confirmation operation acting on the target identifier in the interactive tablet identifier, and confirms the interactive tablet corresponding to the target identifier as the target interactive tablet to be connected.

[0077] In the interactive tablet, the connection, data transmission, and instruction reception process in the embodiment of the present application can be a dedicated management service application. After the interactive tablet is powered on, the management service application will automatically start running and register the mDNS (multicast Domain Name System) service, and multicast the connection information of the interactive tablet to each electronic device in the local area network. Connection information refers to the network information of the interactive tablet required for other electronic devices to communicate with the interactive tablet, which may specifically include information such as IP (Internet Protocol) address, port, hotspot, device identification, etc. The connection information broadcast by the interactive tablet includes the interactive tablet identification, such as a user-defined or system-default system user account. For the conference control device, the connection information multicasted by other electronic devices in the local area network can be monitored, and the device identification therein can be extracted and presented to the user. When the user operates according to the device information displayed in the interactive tablet configured in the environment, after selecting the corresponding target identification, the conference control device receives the control target confirmation operation and correspondingly confirms the target exchange tablet. Then a control request is sent to the target interactive tablet according to the corresponding connection information.

[0078] Please refer to Figure 2 The conference control device 20 and the interactive tablet 10 in the same electronic conference room are usually connected to the same local area network, and based on this connection relationship, the entire process of discovery, connection and control in the embodiment of the present application can be implemented.

[0079] Step S120: In response to the control request, a control data transmission channel is established with the conference control device, and a function trigger identifier and a corresponding control instruction definition in the first type of application associated with the conference in the interactive tablet are obtained.

[0080] The interactive tablet that receives the control request is the target interactive tablet. After receiving the control request, the target interactive tablet establishes a control data transmission channel with the conference control device that sends the control request. The control request is specifically a request for a function with a state switching requirement in the application associated with the conference in the control interactive tablet. In the specific implementation process, the control request can be received to establish a control data transmission channel, which is equivalent to the user being able to establish a connection for control at any time during multi-person communication. It can also be that the user needs to confirm the control authority of the conference control device on the interactive tablet, and then establish a connection after the operation confirms the connection, so as to improve the security of the connection between devices. This method generally requires the user to establish a connection before the multi-person communication activity officially starts, and the conference control device flexibly controls the interactive tablet to avoid the need to confirm the connection on the interactive tablet during the multi-person communication activity. The operation affects the communication effect. The establishment of a dedicated control data transmission channel under the condition of known connection information can refer to the communication-related technology implementation, such as establishing it based on socket, so as to quickly establish a connection in the local area network and obtain an efficient data transmission channel, which will not be explained in detail here.

[0081] In order to realize the cross-device control process of the interactive tablet, the interactive tablet needs to obtain the corresponding function trigger identifier and the corresponding control instruction definition. In the embodiment of the present application, the application associated with the meeting is defined as the first type of application. The application associated with the meeting does not refer to the application used in the current meeting, but refers to the application in the interactive tablet that supports various functions of the meeting, such as a video conference application for video conferencing, a whiteboard application for blackboard display during multi-person communication, and a conference record application for recording various information generated during multi-person communication. For each application belonging to the first type of application, under the framework of the overall function realization, there are specific functions to be realized, and the complete realization of some specific functions requires multiple interactions between the user and the interactive tablet, such as the writing operation in the whiteboard application. The whiteboard application cannot independently realize the data processing process required for the specific function after the user confirms that the specific function needs to be used to obtain the corresponding result; in addition, some specific functions only require the user to control the running state, and the interactive tablet can independently complete the whole process of data collection, processing and output when these specific functions are in the running state, such as the recording function, which only requires the user to control the start, pause and end. In the embodiment of the present application, the control identifier for state control corresponding to the function that only needs the user to control the running state and can independently complete data collection, processing and result generation is defined as a function trigger identifier, that is, the "trigger" in the function trigger identifier does not only refer to triggering the operation, but also includes triggering all state switches of a function. The underlying data expression definition of the control instruction generated when a function trigger identifier is triggered is defined as a control instruction definition.

[0082] The function trigger identifier carries the application information of the corresponding first-category application, so that the conference control device displays the function trigger identifier in different regions according to the application information. Displaying the function trigger identifier in different regions on the conference control device according to the source of the function trigger identifier can effectively increase the speed at which the user locates the desired target identifier and improve the operation efficiency.

[0083] In order to reduce unnecessary repeated data transmission, before sending the function trigger identifier and control instruction definition, you can first confirm whether the obtained function trigger identifier is the same as the function trigger identifier sent to the same conference control device last time. Only when they are different, you need to send the function trigger identifier and control instruction definition. This is equivalent to sending the function trigger identifier and control instruction definition only when the application version is updated or the conference control device that initiates the control request is connected for the first time, thereby improving data transmission efficiency and reducing unnecessary repeated transmission.

[0084] Step S130: Send the function trigger identifier and control instruction definition to the conference control device through the control data transmission channel, so that the conference control device displays the function trigger identifier and monitors the trigger operation, and when monitoring the trigger operation of the target identifier in the function trigger identifier, generates the target instruction according to the corresponding control instruction definition and sends it to the interactive tablet through the control data transmission channel.

[0085] For the conference control device, when the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the data transmission channel, the function trigger identifier is displayed, and the trigger operation of the target identifier in the function trigger identifier is listened to. The function trigger identifier is the function trigger identifier in the first type of application associated with the conference in the interactive tablet.

[0086] If the function trigger identifier carries the application information of the corresponding first-category application, the function trigger identifier is displayed in the conference control device in different regions according to the application information and different first-category applications, so that the user can quickly find the target identifier and trigger it as needed.

[0087] The specific sub-areas can be displayed in the sub-areas of the same interface or in the sub-areas of different interfaces. The sub-area display in the same interface means that all function triggering marks are displayed in the same interface, and the interface is divided into multiple small areas. Each small area is marked with an application name of the first category application and displays the corresponding function triggering mark. The sub-area display of different interfaces can refer to Figure 3 The first category of applications in the interactive tablet 10 includes two video conferencing applications, "AB Conference" and "CD Conference", developed by different software companies, and a conference record application, "Conference Summary". Each first category application displays an icon 211 in the interactive interface 21 in the conference control device 20. When one of the icons 211 is triggered, the function trigger mark in the corresponding first category application is displayed.

[0088] Similar to the management service application in the interactive tablet, a conference control application is also installed in the conference control tablet. The conference control application itself may not have too many interactive functions, and can independently receive connection information, present the interactive tablet, and confirm the connection target. The various function trigger identifiers for specific control are not provided during the application development of the conference control application, but are parsed and displayed based on the data received from the interactive tablet. The trigger operation of the function trigger identifier is not completed by the conference control device. The conference control device only needs to complete the generation process from the target identifier of the trigger operation to the target instruction according to the control instruction definition, and send the target instruction.

[0089] The specific display strategy of the conference control device displaying the function trigger identifier is determined by the pre-preservation strategy. If the interactive tablet sends the function trigger identifier each time it is connected, the conference control device will display the function trigger identifier according to the received data each time. This strategy can effectively reduce the data judgment process and data preservation. If the interactive tablet only transmits the function trigger identifier when necessary (i.e., the version of the first type of application changes or the connected conference control device changes), the conference control device needs to locally search for the function trigger identifier received from the target interactive tablet when confirming that the data transmission channel is successfully established, and display the found function trigger identifier when the search is successful. If the search fails, it means that the function trigger identifier sent by the interactive tablet has not been received before. The interactive tablet will inevitably send the function trigger identifier accordingly, and will display and save the function trigger identifier normally later, and can be directly displayed at the next connection. In addition, when the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the data transmission channel, the function trigger identifier should be redisplayed according to the received function trigger identifier, and the saved function trigger identifier should be updated. It is equivalent to the interactive tablet responding to the control request and establishing a control data transmission channel with the conference control device, which will trigger the conference control device to display the function trigger identifier recently received from the same interactive tablet; the function trigger identifier and the control instruction definition are sent to the conference control device through the control data transmission channel, which will trigger the conference control device to redisplay and update the saved function trigger identifier, and when receiving a trigger operation on the target identifier in the function trigger identifier, it generates a target instruction according to the corresponding control instruction definition and sends it to the interactive tablet through the control data transmission channel. The conference control device can quickly display according to the function trigger identifier received last time. It should be understood that the function trigger identifier and the control instruction definition are sent in association. When describing in detail in the embodiments, it may be simplified to describe the sending of the function trigger identifier, but in fact, the control instruction definition is also sent at the same time.

[0090] In the specific implementation process, some function trigger identifiers may not be a single identifier, but a combination of multiple identifiers. For example, the function trigger identifier for starting a certain function may include a graphic identifier composed of a triangle surrounded by a circle, and a text identifier (such as "Start") displayed near the graphic identifier. There may also be corresponding animation displays during the function operation process, as well as animation state changes when the function state is switched. The animation changes during the function operation process may need to be displayed in real time. At this time, the interactive tablet can continuously send the animation through the control data transmission channel, and the interactive tablet can synchronously display the animation when implementing the target function. That is, the interactive tablet not only sends the function trigger identifier and the data corresponding to the control instruction definition when establishing the control data transmission channel, but also sends the data corresponding to the identifier indicating the current function operation status during the control process.

[0091] Step S140: When a target instruction is received from the conference control device, the target instruction is distributed to a corresponding target application in the first category of applications, so that the target application controls the function state according to the target instruction.

[0092] When the target command generated based on the command standard corresponding to the first category of applications is distributed to the corresponding target application, it can be directly responded to according to the local operation, that is, the corresponding functional state switching is completed. For the conference control device, it is equivalent to generating the target command according to the control command definition corresponding to the corresponding target identifier when monitoring the trigger operation, and sending the target command to the interactive flat panel through the control data transmission channel, so that the target application corresponding to the target command in the first category of applications controls the functional state according to the target command.

[0093] For example, Figure 3 Based on the received icon 211 for "Conference Summary", enter Figure 4 The interactive interface 21 shown in the figure. The "Conference Summary" mainly realizes the fully automatic processing process from voice collection to text recognition, and from text recognition results to meeting summary during the meeting through voice collection, voice recognition, and generative model interfaces. The user only needs to control the status of the processing process. Figure 4 The interactive interface 21 in the presents a recording progress bar 212, a recording animation 213 and a function trigger mark 214, wherein the function trigger mark 214 is received and displayed when the control-related connection is completed, and changes accordingly during the control process. The recording progress bar 212 and the recording animation 213 are synchronously transmitted to the conference control device 20 for display during the function implementation process of the interactive tablet 10. While displaying various status information in the conference control device 20, the interactive tablet 10 can also display them synchronously in the form of thumbnail windows.

[0094] The above is a detailed description of the interactive tablet control method mainly from the perspective of the interactive tablet 10, and is supplemented by the corresponding implementation in the conference control device 20. The data transmission process between the interactive tablet 10 and the conference control device 20 in this complete implementation process can be referred to. Figure 5 .

[0095] In the above-mentioned interactive tablet control method, a control request sent by a conference control device is received; in response to the control request, a control data transmission channel is established with the conference control device, and a function trigger identifier and a corresponding control instruction definition in a first type of application associated with the conference in the interactive tablet are obtained; the function trigger identifier and the control instruction definition are sent to the conference control device through the control data transmission channel, so that the conference control device displays the function trigger identifier and listens for the trigger operation, and when a trigger operation on a target identifier in the function trigger identifier is listened to, a target instruction is generated according to the corresponding control instruction definition and sent to the interactive tablet through the control data transmission channel; when the target instruction is received from the conference control device, the target instruction is distributed to the corresponding target application in the first type of application, so that the target application controls the function state according to the target instruction. After establishing the connection between the interactive tablet and the conference control device, confirm that only the functions in the first category of applications associated with the conference in the interactive tablet need to control the function running status, obtain the corresponding function trigger identifier and the corresponding control instruction definition and send them to the conference control device, display the function trigger identifier on the conference control device, and when receiving the trigger operation on the function trigger identifier, generate a target instruction that can be directly responded to by the target application corresponding to the target identifier according to the control instruction definition corresponding to the target identifier of the trigger operation, and after the conference control device sends the target instruction to the interactive tablet, the target application responds according to the normal response logic. In the multi-person communication scenario, there is no need for anyone to approach the interactive tablet to operate, and the interactive tablet can be quickly controlled by the conference control device at the user's hand, avoiding the interruption of information transmission or the distraction of participants during multi-person communication, ensuring the continuity of information transmission during multi-person communication, and improving the multi-person communication effect.

[0096] The present application also provides an interactive tablet control method applied to a conference control device. Specifically, the process of implementing the interactive tablet control method is described from the perspective of the conference control device. The interactive tablet control method applied to an interactive tablet can be referred to in the previous text. Figure 6 As shown, the interactive tablet control method includes but is not limited to steps S210 to S240:

[0097] Step S210: receiving a control target confirmation operation, where the control target confirmation operation is used to confirm the target interactive tablet to be connected.

[0098] Step S220: In response to the control target confirmation operation, a control request is sent to the target interactive tablet to establish a control data transmission channel with the target interactive tablet.

[0099] Step S230: When the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is displayed, and the trigger operation on the target identifier in the function trigger identifier is monitored. The function trigger identifier is the function trigger identifier in the first type of application associated with the meeting in the interactive tablet.

[0100] Step S240: When a trigger operation is monitored, a target instruction is generated according to the control instruction definition corresponding to the corresponding target identifier, and the target instruction is sent to the interactive flat panel through the control data transmission channel, so that the target application corresponding to the target instruction in the first category of applications controls the functional state according to the target instruction.

[0101] On the basis of the above embodiment, in response to the control target confirmation operation, sending a control request to the target interactive tablet to establish a control data transmission channel with the target interactive tablet includes:

[0102] When it is confirmed that the control data transmission channel is successfully established, the local searches for the function trigger identifier received from the target interactive tablet, and displays the found function trigger identifier when the search is successful.

[0103] On the basis of the above embodiment, when a function trigger identifier and a corresponding control instruction definition sent by a target interactive tablet are received through a control data transmission channel, the function trigger identifier is displayed, including:

[0104] When the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is redisplayed according to the received function trigger identifier, and the saved function trigger identifier is updated.

[0105] Based on the above embodiment, before receiving the control target confirmation operation, the method further includes:

[0106] Monitoring connection information multicasted by the interactive tablet through the local area network, the connection information including the interactive tablet identifier;

[0107] Display the interactive tablet logo in all monitored connection information;

[0108] Accordingly, receiving a control target confirmation operation includes:

[0109] A control target confirmation operation acting on a target identifier in the interactive tablet identifier is received, and the interactive tablet corresponding to the target identifier is confirmed as a target interactive tablet to be connected.

[0110] On the basis of the above embodiment, the function trigger mark carries the application information of the corresponding first category application, and the function trigger mark is displayed in different regions according to the application information and different first category applications.

[0111] On the basis of the above embodiment, the control data transmission channel is established based on the socket.

[0112] In the above-mentioned interactive tablet control method, a control target confirmation operation is received, and the control target confirmation operation is used to confirm the target interactive tablet to be connected; in response to the control target confirmation operation, a control request is sent to the target interactive tablet to establish a control data transmission channel with the target interactive tablet; when a function trigger identifier and a corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is displayed, and a trigger operation on a target identifier in the function trigger identifier is monitored, and the function trigger identifier is a function trigger identifier in a first type of application associated with the meeting in the interactive tablet; when a trigger operation is monitored, a target instruction is generated according to the control instruction definition corresponding to the corresponding target identifier, and the target instruction is sent to the interactive tablet through the control data transmission channel, so that the target application corresponding to the target instruction in the first type of application controls the function state according to the target instruction. After establishing the connection between the interactive tablet and the conference control device, confirm that only the functions in the first category of applications associated with the conference in the interactive tablet need to control the function running status, obtain the corresponding function trigger identifier and the corresponding control instruction definition and send them to the conference control device, display the function trigger identifier on the conference control device, and when receiving the trigger operation on the function trigger identifier, generate a target instruction that can be directly responded to by the target application corresponding to the target identifier according to the control instruction definition corresponding to the target identifier of the trigger operation, and after the conference control device sends the target instruction to the interactive tablet, the target application responds according to the normal response logic. In the multi-person communication scenario, there is no need for anyone to approach the interactive tablet to operate, and the interactive tablet can be quickly controlled by the conference control device at the user's hand, avoiding the interruption of information transmission or the distraction of participants during multi-person communication, ensuring the continuity of information transmission during multi-person communication, and improving the multi-person communication effect.

[0113] Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 7 As shown, the electronic device includes a processor 310 and a memory 320. The interactive tablet and conference control device mentioned above are both electronic devices in terms of hardware architecture. In a common electronic device product form, an input device 330, an output device 340 and a communication device 350 may also be included. The number of processors 310 in the electronic device may be one or more. Figure 7A processor 310 is taken as an example; the processor 310, the memory 320, the input device 330, the output device 340 and the communication device 350 in the electronic device can be connected via a bus or other means. Figure 7 The example of connecting through bus is taken in the following.

[0114] The memory 320 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the interactive tablet control method in the embodiment of the present application. The processor 310 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 320, that is, realizing the above-mentioned interactive tablet control method.

[0115] The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 320 may further include a memory remotely arranged relative to the processor 310, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0116] The input device 330 may be used to receive network configuration information. The output device 340 may include a display device such as a display screen.

[0117] The electronic device described above can be used to execute any interactive tablet control method and has corresponding functions and beneficial effects.

[0118] An embodiment of the present invention also provides a storage medium containing computer executable instructions. When the computer executable instructions are executed by a computer processor, they are used to perform relevant operations in the interactive tablet control method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0119] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0120] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0121] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0122] Computer readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0123] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0124] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. Interactive tablet control method, used for interactive tablet, It is characterized in that include: Receive a control request sent by a conference control device; In response to the control request, establish a control data transmission channel with the conference control device, and obtain a function trigger identifier and a corresponding control instruction definition of the first type of application associated with the conference in the interactive tablet; The function trigger identifier and the control instruction definition are sent to the conference control device through the control data transmission channel, so that the conference control device displays the function trigger identifier and monitors the trigger operation, and when monitoring the trigger operation of the target identifier in the function trigger identifier, generates a target instruction according to the corresponding control instruction definition and sends it to the interactive tablet through the control data transmission channel; When a target instruction is received from the conference control device, the target instruction is distributed to a corresponding target application in the first category of applications, so that the target application controls a functional state according to the target instruction.

2. The interactive tablet control method according to claim 1, It is characterized in that Before sending the function trigger identifier and the control instruction definition to the conference control device through the control data transmission channel, the method further includes: It is confirmed that the acquired function trigger identifier is different from the function trigger identifier sent to the same conference control device last time.

3. The interactive tablet control method according to claim 2, It is characterized in that The establishing a control data transmission channel with the conference control device in response to the control request includes: In response to the control request, establishing a control data transmission channel with the conference control device so that the conference control device displays a function trigger identifier recently received from the same interactive tablet; Correspondingly, the function trigger identifier and the control instruction definition are sent to the conference control device through the control data transmission channel so that the conference control device displays the function trigger identifier, and upon receiving a trigger operation on a target identifier in the function trigger identifier, a target instruction is generated according to the corresponding control instruction definition and sent to the interactive tablet through the control data transmission channel, including: The function trigger identifier and control instruction definition are sent to the conference control device through the control data transmission channel, so that the conference control device redisplays and updates the saved function trigger identifier, and when a trigger operation on the target identifier in the function trigger identifier is received, a target instruction is generated according to the corresponding control instruction definition and sent to the interactive tablet through the control data transmission channel.

4. The interactive tablet control method according to any one of claims 1 to 3, It is characterized in that Before receiving the control request sent by the conference control device, the method further includes: The connection information is multicasted into the local area network so that the conference control device in the local area network can find the interactive tablet, and send the control request according to the connection information when receiving the selection operation corresponding to the interactive tablet.

5. The interactive tablet control method according to any one of claims 1 to 3, It is characterized in that The function trigger identifier carries the application information of the corresponding first category application, so that the conference control device displays the function trigger identifier in different regions according to the application information.

6. The interactive tablet control method according to any one of claims 1 to 3, It is characterized in that The control data transmission channel is established based on socket.

7. Interactive tablet control method for conference control equipment, It is characterized in that include: receiving a control target confirmation operation, wherein the control target confirmation operation is used to confirm a target interactive tablet to be connected; In response to the control target confirmation operation, sending a control request to the target interactive tablet to establish a control data transmission channel with the target interactive tablet; When receiving the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet through the control data transmission channel, displaying the function trigger identifier and monitoring the trigger operation of the target identifier in the function trigger identifier, the function trigger identifier being the function trigger identifier in the first type of application associated with the conference in the interactive tablet; When the trigger operation is monitored, a target instruction is generated according to the control instruction definition corresponding to the corresponding target identifier, and the target instruction is sent to the interactive tablet through the control data transmission channel, so that the target application corresponding to the target instruction in the first type of application controls the functional state according to the target instruction.

8. The interactive tablet control method according to claim 7, It is characterized in that In response to the control target confirmation operation, sending a control request to the target interactive tablet to establish a control data transmission channel with the target interactive tablet includes: When it is confirmed that the control data transmission channel is successfully established, the function trigger identifier received from the target interactive tablet is searched locally, and the found function trigger identifier is displayed when the search is successful.

9. The interactive tablet control method according to claim 8, It is characterized in that When the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is displayed, including: When the function trigger identifier and the corresponding control instruction definition sent by the target interactive tablet are received through the control data transmission channel, the function trigger identifier is redisplayed according to the received function trigger identifier, and the saved function trigger identifier is updated.

10. The interactive tablet control method according to any one of claims 7 to 9, It is characterized in that Before the receiving control target confirmation operation, the method further includes: Monitoring connection information multicasted by the interactive tablet through the local area network, wherein the connection information includes an interactive tablet identifier; Display the interactive tablet logo in all monitored connection information; Accordingly, the receiving control target confirmation operation includes: A control target confirmation operation acting on a target identifier in the interactive tablet identifier is received, and the interactive tablet corresponding to the target identifier is confirmed as a target interactive tablet to be connected.

11. The interactive tablet control method according to any one of claims 7 to 9, It is characterized in that The function trigger identifier carries application information of the corresponding first category application, and the function trigger identifier is displayed in different regions according to the application information and different first category applications.

12. The interactive tablet control method according to any one of claims 7 to 9, It is characterized in that The control data transmission channel is established based on socket.

13. Electronic equipment, It is characterized in that include: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the electronic device implements the interactive tablet control method as described in any one of claims 1-12.

14. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the interactive tablet control method as described in any one of claims 1 to 12 is implemented.

Images