Interactive tablet control method and device, interactive tablet and storage medium

Abstract

The embodiment of the invention discloses an interactive tablet control method and device, an interactive tablet and a storage medium. In the interactive panel control method, a first interactive window is displayed on an interactive panel; semantic data are received through the first interaction window; performing semantic analysis on the semantic data through a pre-trained semantic control model to obtain instruction parameter information; performing instruction matching from a pre-stored instruction set according to the instruction parameter information to obtain at least one alternative instruction, and displaying an option corresponding to each alternative instruction in a first interaction window; receiving an instruction confirmation operation on the at least one option through the first interaction window; and in response to the instruction confirmation operation, sending at least one target instruction confirmed from the at least one alternative instruction to the corresponding target application for instruction response. The user does not need to operate without deviation according to a designed operation path to perform application control, and can efficiently and smoothly use the interaction panel to assist multi-person communication under the condition that the operation on the application is not very skilled.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of device control technology, and in particular to an interactive tablet control method, device, interactive tablet, and storage medium. Background Art

[0002] On existing interactive tablets, if a user needs to use a certain function of the software, he or she needs to manually open the application to display the application interface, and then operate step by step according to the preset operation path on the application interface until the specific function is triggered.

[0003] For applications developed for interactive tablets, they are usually only used in multi-person communication scenarios such as teaching, meetings, and training, and users use this type of application relatively infrequently. Moreover, as a public electronic device, the cost of becoming proficient in using interactive tablets over a long period of time is relatively high. When using interactive tablets to assist in multi-person communication, the operation is not smooth enough and the efficiency is low. Summary of the Invention

[0004] The present invention provides an interactive tablet control method, device, interactive tablet and storage medium to solve the technical problems in the prior art of using interactive tablets to assist multi-person communication, such as insufficient operation fluency and low efficiency.

[0005] In a first aspect, an embodiment of the present application provides an interactive tablet control method, comprising:

[0006] Displaying a first interactive window on the interactive tablet;

[0007] receiving semantic data through the first interaction window;

[0008] Performing semantic analysis on the semantic data using a pre-trained semantic control model to obtain instruction parameter information;

[0009] Matching instructions from a pre-stored instruction set according to the instruction parameter information to obtain at least one candidate instruction, and displaying each candidate instruction corresponding to an option in the first interactive window;

[0010] receiving, through the first interactive window, an instruction confirmation operation for at least one of the selected items;

[0011] In response to the instruction confirmation operation, at least one target instruction confirmed from the at least one candidate instruction is sent to a corresponding target application for instruction response.

[0012] In a second aspect, an embodiment of the present application provides an interactive tablet control device, comprising:

[0013] A window display unit, configured to display a first interactive window on the interactive tablet;

[0014] a data receiving unit, configured to receive semantic data through the first interactive window;

[0015] a parameter acquisition unit, configured to perform semantic analysis on the semantic data using a pre-trained semantic control model to obtain instruction parameter information;

[0016] an instruction matching unit, configured to match instructions from a pre-stored instruction set according to the instruction parameter information, obtain at least one candidate instruction, and display each candidate instruction corresponding to an option in the first interactive window;

[0017] an instruction confirmation unit, configured to receive, through the first interactive window, an instruction confirmation operation for at least one of the selected items;

[0018] The instruction sending unit is used to send at least one target instruction confirmed from the at least one candidate instruction to a corresponding target application for instruction response in response to the instruction confirmation operation.

[0019] In a third aspect, an embodiment of the present application provides an interactive tablet, comprising:

[0020] one or more processors;

[0021] a memory for storing one or more computer programs;

[0022] When one or more computer programs are executed by one or more processors, the interactive tablet implements the interactive tablet control method of the first aspect.

[0023] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the interactive tablet control method as described in the first aspect.

[0024] In the above-mentioned interactive tablet control method, device, interactive tablet, and storage medium, a first interactive window is displayed on the interactive tablet; semantic data is received through the first interactive window; semantic analysis is performed on the semantic data using a pre-trained semantic control model to obtain instruction parameter information; instructions are matched from a pre-stored instruction set based on the instruction parameter information to obtain at least one candidate instruction, and each candidate instruction is displayed in the first interactive window corresponding to an option; an instruction confirmation operation for the at least one option is received through the first interactive window; and in response to the instruction confirmation operation, at least one target instruction confirmed from the at least one candidate instruction is sent to a corresponding target application for instruction response. By receiving semantic data in the interactive window provided by the interactive tablet, instruction parameter information is obtained based on the semantic data by the pre-trained semantic control model, and an alternative instruction that is compatible with the instruction parameter information is matched from the pre-stored instruction set, the user can directly confirm the target instruction from the alternative instructions, and the interactive tablet directly sends the target instruction to the corresponding target application for instruction response. In this process, the user does not need to operate the application exactly according to the designed operation path to control the application, and can use the interactive tablet to efficiently and smoothly assist multi-person communication even when the user is not familiar with the application operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a flow chart of the method for controlling an interactive tablet provided in an embodiment of the present application.

[0026] Figure 2 It is a surface diagram of the interactive flat panel;

[0027] Figure 3 A schematic diagram of the effect of displaying the first interactive window on an interactive tablet provided in an embodiment of the present application.

[0028] Figure 4 For Figure 3 A schematic diagram of the effect of interactive operations performed in the first interactive window is shown.

[0029] Figure 5 This is a schematic diagram showing the effect of displaying speech recognition text during sound collection.

[0030] Figure 6 Schematic diagram of the effect of receiving text data through a text input operation via a virtual keyboard.

[0031] Figure 7 This is a schematic diagram showing the effect of displaying alternative items corresponding to alternative instructions in the first interactive window.

[0032] Figure 8 This is a diagram showing the effect of displaying record summaries in text boxes on an interactive tablet.

[0033] Figure 9This is a schematic diagram of the structure of the interactive tablet control device provided in an embodiment of the present application.

[0034] Figure 10 A schematic diagram of the structure of the interactive tablet provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended to explain the present invention, not to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.

[0036] It should be noted that this application specification does not enumerate all optional implementation methods. After reading this application specification, those skilled in the art should be able to understand that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0037] The interactive tablet control method described in the embodiments of the present application can be applied to an interactive tablet. An interactive tablet can be an integrated device that uses touch technology to control content displayed on a display screen and implement human-computer interaction. It integrates one or more functions such as a projector, electronic whiteboard, screen, audio, television, and video conferencing terminal. Of course, an interactive tablet does not include any restrictions on the surface characteristics of the display surface. For example, the surface characteristics of an interactive tablet can be flat, curved, or a combination of multiple flat surfaces.

[0038] Typically, the interactive tablet is installed with at least one operating system, wherein the operating system includes but is not limited to Android system, Linux system, Windows system and Huawei Hongmeng system, which is used to control and coordinate the interactive tablet and external devices so that the various independent hardware in the interactive tablet can work in coordination as a stable whole. The architectural layer where the operating system is located is defined as the system layer. On the basis of the system layer, the interactive tablet is installed with applications developed to meet different fields and different problems of users, and the corresponding architectural layer is the application layer. In the description of the specific embodiment of this scheme, the interactive tablet can install at least one application with a writing function. Among them, the application with a writing function can be an application that comes with the operating system, and it can also be an application downloaded from a third-party device or server. Optionally, in addition to the writing function based on touch operation, the application also has other editing functions, such as deletion function, inserting tables, inserting pictures, illustration graphics, drawing tables, drawing graphics and other functions.

[0039] The range covered by the graphical interface displayed on the display screen of the interactive tablet can be a touch detection area for detecting user operations, that is, the range of the graphical interface and the touch detection area basically overlaps or does not overlap. Various touch operations can be performed in the touch detection area, such as writing operations and click trigger operations (which can be single-point or multi-point). When writing by touching a display screen with a touch function with a writing pen or a finger, the touch sensing module of the display screen can sense changes in infrared light, current, voltage, magnetic flux or pressure (corresponding to the specific setting type of infrared display screen, capacitive display screen, resistive display screen, electromagnetic display screen or pressure-sensitive display screen), thereby converting and obtaining a touch signal containing the coordinates of the touch position and the trigger time of the touch signal. According to the coordinates of the touch position and the trigger time of the touch signal, the trajectory data of the writing trajectory input by the writing pen or the user's finger each time it is pressed to write and lifted to stop writing can be obtained, and the writing trajectory input by the user is displayed in real time on the graphical interface of the display screen according to the trajectory data. Of course, the writing process is not limited to writing. Any input process for displaying the operation trajectory implemented on the display screen of the interactive tablet can be regarded as a writing process. Furthermore, depending on the display element where the touch operation occurs, the touch operation can be responded to as a click, a drag, or other user actions. These different response methods use the same underlying coordinate processing. Based on the hardware implementation of basic touch and display functions, various interactive display designs can be realized on interactive tablets.

[0040] like Figure 2 As shown, the interactive tablet 1 includes at least one display screen 10. For example, the interactive tablet 1 is configured with a display screen 10 with a touch function, that is, a touch-sensitive display screen. The touch-sensitive display screen can be an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen or a pressure-sensitive display screen, etc. On the display screen 10 with a touch function, the user can implement touch operations by touching the display screen 10 with a finger or a writing pen. Accordingly, the interactive tablet 1 detects the touch position and responds according to the touch position to implement the touch function. When the touch sensing modules used on the display screen 10 with a touch function are different, the original touch signals collected by the touch sensing modules are different, and the converted touch signals are not exactly the same. In order to simplify the content of the accompanying drawings, the display content in the interactive tablet 1 is illustrated, and only the display screen 10 is represented and explained as the display area. The area outside the display screen 10 in the interactive tablet 1 is not displayed repeatedly.

[0041] For infrared displays, the touch sensor module is an infrared touch frame. The touch signal it collects may include a signal indicating that infrared rays are blocked. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For capacitive displays, the touch sensor module is a capacitive touch pad. The touch signal it collects may include the current flowing through the electrodes of the touch screen. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For resistive displays, the touch sensor module is a resistive touch pad. The touch signal it collects may include the voltage at the touch location. The converted touch signal may include a position touch signal, which may include the X and Y coordinates of the touch location. For electromagnetic displays, the touch sensor module is an electromagnetic pad. The touch signal it collects may include the change in magnetic flux and the frequency of the received electromagnetic signal. The converted touch signal may include a position touch signal corresponding to the change in magnetic flux and a pressure signal corresponding to the frequency. The position touch signal may include the X and Y coordinates of the touch location; the pressure signal may include a pressure value. For a pressure-sensitive display screen, the touch sensing module is a pressure sensor, and the touch signal collected by the touch sensing module may include a pressure signal. The converted touch signal may include a position touch signal, and the position touch signal may include the X coordinate and Y coordinate of the touch position.

[0042] These touch-sensitive interactive tablets can facilitate online multi-person communication through video conferencing applications. In multi-person communication scenarios, their cameras can capture live footage in real time for sharing, providing participants with a better communication experience and improving the effectiveness of information transfer during multi-person communication. They can also open various files locally and then send the corresponding display window to a remote location for screen sharing. Overall, the various applications developed based on the product form factors of interactive tablets can meet the various needs of digital presentation, digital recording, and digital interaction in multi-person communication scenarios, providing strong support for accurate information transfer and rapid recording, thereby improving the efficiency of multi-person communication.

[0043] Although interactive tablets and applications developed for their application scenarios can effectively improve the efficiency of multi-person communication, the effectiveness of interactive tablets in assisting multi-person communication cannot be fully realized due to users' lack of familiarity with the applications due to reasons such as frequency of use.

[0044] In response to the above technical problems, the embodiments of the present application propose an interactive tablet control method. By receiving semantic data in the interactive window provided by the interactive tablet, a pre-trained semantic control model obtains instruction parameter information based on the semantic data, and matches alternative instructions that are compatible with the instruction parameter information from a pre-stored instruction set, the user can directly confirm the target instruction from the alternative instructions, and the interactive tablet directly sends the target instruction to the corresponding target application for instruction response. In this process, the user does not need to follow the designed operation path without deviation to control the application. Even if the user is not very proficient in the operation of the application, the interactive tablet can be used to efficiently and smoothly assist in multi-person communication.

[0045] Please refer to Figure 1 , which is a flow chart of a method for controlling an interactive tablet provided by an embodiment of the present application, and the interactive tablet control method is implemented by an interactive tablet. Figure 1 The interactive tablet control method includes steps S110 to S160:

[0046] Step S110: Displaying a first interactive window on the interactive tablet.

[0047] The first interactive window is a window displayed on the interactive tablet, used to receive user data related to the control of the interactive tablet in the embodiment of the present application. Compared with the conventional large size of the interactive tablet, the first interactive window occupies a relatively small area within the display range of the interactive tablet's display screen.

[0048] The first interactive window is a window for receiving user data related to the interactive tablet control in the embodiment of the present application, and is also a window for interactively displaying information to assist the user in confirming the control target. That is, the first interactive window may display the data entered by the user during the control process, and also display the data generated by the interactive tablet based on the data entered by the user. In order to facilitate the user to view the data during the control process, the data entered by the user and the corresponding generated data can be displayed separately, for example, by different colors and / or different display positions (close to different sides of the first interactive window respectively).

[0049] In interactive tablets, to quickly access commonly used functions without exiting the current page, sidebars are typically provided on both sides of the display screen. The sidebars display multiple functional controls, such as a camera control for launching a camera or a writing control for quickly starting writing. In an embodiment of the present application, the display of the first interactive window and the functional controls do not affect each other. For example, the sidebars on both sides are displayed on the left and right sides, and the first interactive window is displayed adjacent to the side of one sidebar near the center of the display screen.

[0050] The first interactive window can be displayed normally or according to a trigger. For example, an interactive trigger control can be set in the sidebar. When the interactive trigger control on either side is triggered, the first interactive window is displayed adjacent to the sidebar. If the sidebars on both sides are provided with interactive trigger controls, then only the side where the interactive trigger control that was most recently triggered is located can be kept displaying the first interactive window. Of course, if the first interactive window is originally in a display state, the display can be ended when the same interactive trigger control is triggered again. When the display state or display position of the first interactive window changes due to the triggering of the interactive trigger control, the original display content remains unchanged. By switching the display state, the user can adjust the display state of the first interactive window according to the operation needs in the multi-person communication scenario. Keeping the display content in the first interactive window unchanged can ensure that the user has a coherent view of the existing information.

[0051] Please refer to Figure 3 , which is a schematic diagram of the effect of the first interactive window 11 provided by an embodiment of the present application being displayed on an interactive tablet. On the display screen 10, the first interactive window 11 is displayed on the right side, and specifically displays various content elements, including a function identifier 111 of the first interactive window 11, a welcome message 112, a usage guide 113, a first input control 114 for triggering voice input, and a second input control 115 for triggering text input. The usage guide 113 describes various functions that can be implemented (such as video conferencing), such as the specific input content required to implement various functions.

[0052] Step S120: receiving semantic data through the first interactive window.

[0053] Semantic data refers to data that represents information through text. Depending on how it is generated, semantic data can be divided into voice data and text data. For an interactive tablet control operation, the corresponding semantic data is voice data or text data. Semantic data is generated by user input through the first interactive window that has data reception capabilities.

[0054] As mentioned above, the first interactive window displays a first input control and a second input control. Accordingly, the semantic data received through the first interactive window includes data input when the two controls are triggered, that is, when a trigger operation acting on the first input control is received, sound collection is performed through the sound collection module to obtain voice data; when a trigger operation acting on the second input control is received, a virtual keyboard is displayed, and text input operations are received through the virtual keyboard to obtain text data.

[0055] like Figure 4As shown, when a trigger operation on the first input control 114 is detected in the first interactive window 11, the sound collection module performs sound collection to obtain voice data. In specific implementation, it can be designed to maintain the trigger operation on the first input control 114 during the sound collection process, and end the sound collection when the trigger operation on the first input control 114 ends, that is, the trigger operation on the first input control 114 is a continuous long press operation, and the sound collection is maintained in the continuous pressing state. The trigger operation on the first input control 114 can also be designed as a click operation. When the click operation on the first input control 114 is received, the sound collection module performs sound collection to obtain voice data, and the sound collection ends when the time when the text cannot be recognized reaches a preset time. As shown Figure 5 As shown, during the sound collection process, text 117 obtained by performing voice recognition on the collected voice data can be displayed at the same time.

[0056] exist Figure 5 The first interactive window 11 shown further displays a second input control 115, an input prompt 116, a cancel control 117, and a return control 119, wherein the second input control 115 and the Figure 3 as well as Figure 4 The second input control 115 shown in FIG is the same as that of FIG, and is used to trigger the display of the virtual keyboard; the function of the input prompt 116 is similar to that of the use guide 113, and the input prompt 116 more specifically describes the content to be input in one control; the cancel control 117 is used to cancel the current voice input, and the user can reorganize the voice to input voice data; the return control 119 is used to return Figure 4 The first interactive window 11 is shown as open. Figure 5 The controls and layouts shown in the diagrams and other diagrams are merely exemplary presentations. When the specific types, quantities, and forms of the controls change partially, they still fall within the design concepts of the embodiments of the present application. For example, the input prompt 116 is not displayed, and the semantic data and usage guide 113 are displayed and updated in the same window screen.

[0057] When a trigger operation is received on the second input control 115, a virtual keyboard is displayed, and text data is obtained by receiving a text input operation through the virtual keyboard. The corresponding input effect is as follows: Figure 6 The virtual keyboard displayed on the display screen 10 of the interactive tablet 1 can be displayed in a larger size outside the first interactive window 11 for the convenience of user operation. Figure 6The first interactive window 11 shown does not show a virtual keyboard. When entering text data through the virtual keyboard, another prompt for switching to voice input can be displayed. That is, by using specific voice content (such as "wheat wheat"), you can switch to using voice collection to enter semantic data. Of course, the virtual keyboard can also be displayed at the bottom of the first interactive window 11.

[0058] As an optional implementation method, the usage guidance when the first interactive window is started can also serve as an entry for receiving instruction parameter information. For example, when the usage guidance corresponding to the video conference is triggered, a secondary window can be displayed in the first interactive window, and the instruction parameter information required for implementing the video conference is displayed in the secondary window. If you want to join the meeting, you need to enter the meeting code and set the enable status of the microphone and camera; if you want to create a meeting, you need to set the meeting start time and the enable status of the microphone and camera. After the instruction parameter information is set, the interactive tablet control can also be quickly implemented. At this time, the usage guidance can be equivalent to an option determined by the instruction parameter information or an option semi-determined by the instruction parameter information.

[0059] Step S130: performing semantic analysis on the semantic data using a pre-trained semantic control model to obtain instruction parameter information.

[0060] Step S140: performing instruction matching from a pre-stored instruction set according to the instruction parameter information to obtain at least one candidate instruction, and displaying each candidate instruction corresponding to an option in the first interactive window.

[0061] The semantic control model can be a pre-trained artificial intelligence model for semantic recognition. The semantic control model can perform semantic analysis on semantic data to obtain instruction parameter information, and perform instruction matching from a pre-stored instruction set based on the instruction parameter information to obtain at least one alternative instruction, and display each alternative corresponding to an option in the first interactive window. That is to say, the semantic analysis and matching of alternative instructions can be completed by the semantic control model, or by different functional components. The instruction set refers to a collection of instructions that can instruct a specified application to perform a specified function, such as an instruction to instruct a video conferencing application to execute a join conference function, and an instruction to instruct a video conferencing application to execute a file sending function. The instructions in the instruction set require specific instruction parameters to obtain the final executable target instruction. For example, instructing a video conferencing application to execute a join conference function requires the conference number as an instruction parameter to join the conference.

[0062] The semantic control model suitable for the scenario of this solution can be one that processes relatively limited semantic data. The final semantic control model may be relatively small in size and can be stored and run smoothly locally on the interactive tablet. If it is a large-scale commercial voice control model, it will run on the cloud. The voice data needs to be sent to the cloud for analysis to obtain command parameter information. The command parameter information is used to represent the entire content of a control operation extracted from the voice data. For example, a control operation as a whole can be defined as joining a video conference, but specific parameters are required to implement the control operation, including the conference number of the video conference to be joined and whether to turn on the microphone and camera when joining. The only command parameter information that can be extracted from the semantic data actually input by the user is the general goal and conference number of joining the video conference.

[0063] During the specific implementation process, the instruction parameter information extracted from the semantic data (for example, only joining a video conference and the conference number) may not be able to clearly complete a control operation. At this time, based on the instructions that may be supported by the extracted instruction parameter information, or the instructions that can be supported but the information is incomplete, at least one alternative instruction can be obtained, and each alternative instruction corresponding to an option is displayed in the first interactive window.

[0064] When the candidate instructions are displayed in the first interactive window, the execution content of the candidate instructions displayed first in the first interactive window is the execution basis of the candidate instructions displayed later, for example Figure 7 The option list 120 shown shows all the alternative instructions corresponding to the semantic data of "I want to hold a video conference and share the project summary document during the conference". In terms of the specific execution order, it is necessary to first start the video conference application (i.e., the application named "Meeting"), and then join an existing meeting. Only by joining the existing meeting can the window be shared and the meeting record be enabled. According to the above execution relationship, the following is presented: Figure 7 The layout of the selection items in the option list 120 is shown.

[0065] Step S150: receiving an instruction confirmation operation for at least one selection item through the first interactive window.

[0066] Step S160: In response to the instruction confirmation operation, at least one target instruction confirmed from the at least one candidate instruction is sent to the corresponding target application for instruction response.

[0067] exist Figure 7Based on the displayed multiple options, the user can directly select an option to confirm the target instruction and confirm the execution of the target instruction. In response, the interactive tablet receives the instruction confirmation operation in the option list 120. After receiving the confirmation operation, a specific instruction is generated and sent to the target application for response. The specific control process is a conventional implementation of application interactive simulation control and will not be repeated here.

[0068] In another specific implementation, when the first interactive window is started and / or the alternative instructions are synchronously displayed, there is an option corresponding to at least one preset commonly used instruction. The option of "video conferencing" when the first interactive window is started is an option corresponding to a commonly used instruction. This type of commonly used instruction can consider the commonly used specific operations after an application is opened as the instruction content, which serves as a supplement to the function controls for quick launch of various applications in the sidebar. Users can directly use the commonly used functions of the application in the first interactive window without entering semantic data.

[0069] The commonly used instructions may optionally include recording instructions; accordingly, the interactive tablet control method further includes step S170:

[0070] Step S170: When it is confirmed through the instruction confirmation operation that the target instruction includes a recording instruction, start recording.

[0071] In an embodiment of the present application, although the first interactive window does not receive semantic data when it is in the open state, and does not display alternative instructions generated based on the semantic data, it can also receive an instruction confirmation operation based on the default selection items displayed in the open state. When the target instruction is confirmed through the instruction confirmation operation, including a recording instruction, the target instruction does not require other specific instruction information and can be responded to directly, and the recording is turned on to record the sound in the multi-person communication scenario, thereby achieving a complete record of the speech content during the multi-person communication process.

[0072] Step S170 may be followed by steps S181 and S182, thereby realizing the key points of the speech content during the multi-person communication process.

[0073] Step S181: performing speech recognition on the recorded data to obtain a recorded text.

[0074] By performing speech recognition on the recorded data, a textual record of the spoken content during multi-person communication can be obtained.

[0075] Step S182: Send the recorded text to a pre-trained summary generation model to obtain a record summary corresponding to at least one topic.

[0076] To improve the efficiency of subsequent information processing for multiple-person communication review, task assignment, and progress tracking, the transcript is fed into a pre-trained summary generation model, generating a summary for at least one topic. The number of topics depends on the transcript content. For example, if a conversation included three topics and detailed work arrangements, the summary generation model could generate summary data for four topics. This allows users to quickly review key insights from the conversation without having to re-listen to the entire recording or transcript.

[0077] In the actual processing process, at the end of multi-person communication, it may be necessary to summarize the communication process and confirm and adjust the task assignment. For the generated record text, the record summaries corresponding to different topics can be displayed through different text boxes. On the basis of displaying the record summary through the text box, the record summary can also be adjusted through step S190.

[0078] Step S190: receiving an editing operation on the text box corresponding to the target subject, and updating the content of the record summary corresponding to the target subject according to the editing operation.

[0079] For example, in the process of multi-person communication, task allocation is initially only a temporary arrangement, and there are constant adjustments in the communication process. The repetitive and variable related voice content brought about by multiple discussions may result in the final record summary not being able to accurately present the final arrangement plan. At this time, the accurate arrangement plan can be finally obtained by editing the text box.

[0080] Please refer to Figure 4 and Figure 7 , the option corresponding to the record instruction is marked as "meeting record", please refer to Figure 8 As shown, the text box 12 is displayed on the display screen 10, which also includes a save control and an exit control. By triggering the save control, the content of the record summary in the text box can be saved for subsequent viewing; by triggering the exit control, the content of the record summary can be abandoned and cleared when the user confirms that the multi-person communication information is conveyed accurately.

[0081] In the above, a first interactive window is displayed on the interactive tablet; semantic data is received through the first interactive window; semantic analysis is performed on the semantic data using a pre-trained semantic control model to obtain instruction parameter information; instruction matching is performed from a pre-stored instruction set based on the instruction parameter information to obtain at least one candidate instruction, and each candidate instruction is displayed in the first interactive window corresponding to an option; an instruction confirmation operation for the at least one option is received through the first interactive window; in response to the instruction confirmation operation, at least one target instruction confirmed from the at least one candidate instruction is sent to a corresponding target application for instruction response. By receiving semantic data in the interactive window provided by the interactive tablet, instruction parameter information is obtained based on the semantic data by the pre-trained semantic control model, and an alternative instruction that is compatible with the instruction parameter information is matched from the pre-stored instruction set, the user can directly confirm the target instruction from the alternative instructions, and the interactive tablet directly sends the target instruction to the corresponding target application for instruction response. In this process, the user does not need to operate the application without deviation according to the designed operation path. Even if the user is not very proficient in the operation of the application, the interactive tablet can be used to efficiently and smoothly assist multi-person communication.

[0082] Figure 9 This is a schematic diagram of the structure of the interactive tablet control device provided in the embodiment of the present application. Figure 9 The interactive tablet control device includes a window display unit 210, a data receiving unit 220, a parameter acquiring unit 230, an instruction matching unit 240, an instruction confirming unit 250 and an instruction sending unit 260.

[0083] Among them, the window display unit 210 is used to display the first interactive window on the interactive tablet; the data receiving unit 220 is used to receive semantic data through the first interactive window; the parameter acquisition unit 230 is used to perform semantic analysis on the semantic data through a pre-trained semantic control model to obtain instruction parameter information; the instruction matching unit 240 is used to match instructions from a pre-stored instruction set according to the instruction parameter information to obtain at least one alternative instruction, and display each alternative instruction corresponding to an option in the first interactive window; the instruction confirmation unit 250 is used to receive an instruction confirmation operation for at least one of the options through the first interactive window; the instruction sending unit 260 is used to send at least one target instruction confirmed from the at least one alternative instruction to the corresponding target application for instruction response in response to the instruction confirmation operation.

[0084] Based on the above embodiment, the semantic data is voice data or text data.

[0085] Based on the above embodiment, the first interactive window displays a first input control and a second input control;

[0086] Accordingly, the data receiving unit 220 includes:

[0087] A first acquisition module is configured to acquire voice data by collecting sound through a sound acquisition module upon receiving a trigger operation acting on the first input control;

[0088] The second acquisition module is configured to display a virtual keyboard upon receiving a trigger operation acting on the second input control, and receive text input operations through the virtual keyboard to obtain text data.

[0089] Based on the above embodiment, the interactive tablet control device further includes:

[0090] The speech recognition display unit is used to display the text obtained by speech recognition of the collected speech data during the sound collection process.

[0091] On the basis of the above embodiment, when the first interactive window is started and / or the alternative instructions are synchronously displayed, there is at least one selection item corresponding to a preset common instruction.

[0092] Based on the above embodiment, the commonly used instructions include recording instructions;

[0093] Correspondingly, the interactive tablet control device further includes:

[0094] The recording starting unit is used to start recording when it is confirmed through the instruction confirmation operation that the target instruction includes a recording instruction.

[0095] Based on the above embodiment, the interactive tablet control device further includes:

[0096] A text recognition unit, configured to perform speech recognition on the recorded data to obtain a recorded text;

[0097] The summary generation unit is used to send the record text to the pre-trained summary generation model to obtain a record summary corresponding to at least one topic.

[0098] Based on the above embodiment, record summaries of different topics are displayed through different text boxes;

[0099] Correspondingly, the interactive tablet control device further includes:

[0100] The summary updating unit is used to receive an editing operation on a text box corresponding to a target subject, and update the content of the record summary corresponding to the target subject according to the editing operation.

[0101] Based on the above embodiment, the execution content of the candidate instruction displayed in the front in the first interactive window serves as the execution basis of the candidate instruction displayed in the back.

[0102] The interactive tablet control device provided in the embodiment of the present application is included in an interactive tablet and can be used to execute any interactive tablet control method provided in the above embodiments, and has corresponding functions and beneficial effects.

[0103] It is worth noting that in the embodiment of the above-mentioned interactive flat-panel control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0104] Figure 10 This is a schematic diagram of the structure of an interactive tablet provided in an embodiment of the present application. Figure 10 As shown, the interactive tablet includes a processor 310 and a memory 320, and may also include an input device 330, an output device 340 and a communication device 350; the number of processors 310 in the interactive tablet may be one or more, Figure 10 In the figure, a processor 310 is used as an example; the processor 310, memory 320, input device 330, output device 340 and communication device 350 in the interactive tablet can be connected via a bus or other means. Figure 10 The bus connection is taken as an example.

[0105] Memory 320, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the interactive tablet control method in the embodiments of the present application. Processor 310 executes the software programs, instructions, and modules stored in memory 320 to execute various functional applications and data processing of the interactive tablet, thereby implementing the interactive tablet control method described above.

[0106] The memory 320 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data generated based on the use of the interactive tablet, etc. Furthermore, the memory 320 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state memory device. In some instances, the memory 320 may further include memory remotely located relative to the processor 310, and these remote memories may be connected to the interactive tablet via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0107] The input device 330 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the interactive tablet. The output device 340 may include a display device such as a display screen.

[0108] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it is used to perform the relevant operations in the interactive tablet control method provided in any embodiment of the present application, and has corresponding functions and beneficial effects.

[0109] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0110] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including the instruction device, which implements the function specified in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0111] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-permanent storage in a computer-readable medium, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0112] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0113] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0114] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments, and substitutions are possible for those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. An interactive tablet control method, characterized in that: include: Displaying a first interactive window on the interactive tablet; receiving semantic data through the first interaction window; Performing semantic analysis on the semantic data through a pre-trained semantic control model to obtain instruction parameter information; Performing instruction matching from a pre-stored instruction set according to the instruction parameter information to obtain at least one candidate instruction, and displaying each candidate instruction corresponding to an option in the first interactive window; Receiving, through the first interactive window, an instruction confirmation operation for at least one of the selected items; In response to the instruction confirmation operation, at least one target instruction confirmed from the at least one candidate instruction is sent to a corresponding target application for instruction response.

2. The interactive tablet control method according to claim 1, characterized in that: The semantic data is voice data or text data.

3. The interactive tablet control method according to claim 2, characterized in that: The first interactive window displays a first input control and a second input control; Accordingly, receiving semantic data through the first interactive window includes: When receiving a trigger operation acting on the first input control, collecting sound through a sound collection module to obtain voice data; When a trigger operation acting on the second input control is received, a virtual keyboard is displayed, and a text input operation is received through the virtual keyboard to obtain text data.

4. The interactive tablet control method according to claim 3, characterized in that: Also includes: During the sound collection process, the text obtained by performing speech recognition on the collected voice data is displayed.

5. The interactive tablet control method according to claim 1, characterized in that: When the first interactive window is started and / or the alternative instructions are synchronously displayed, at least one selection item corresponding to a preset common instruction is displayed.

6. The interactive tablet control method according to claim 5, characterized in that: The commonly used instructions include recording instructions; Accordingly, the interactive tablet control method further includes: When it is confirmed through the instruction confirmation operation that the target instruction includes the recording instruction, recording is started.

7. The interactive tablet control method according to claim 6, characterized in that: In the case where it is confirmed through the instruction confirmation operation that the target instruction includes the recording instruction, after starting the recording, the method further includes: Performing speech recognition on the recorded data to obtain a recorded text; The record text is sent to a pre-trained summary generation model to obtain a record summary corresponding to at least one topic.

8. The interactive tablet control method according to claim 7, characterized in that: Record summaries of different topics are displayed in different text boxes; Accordingly, after sending the recorded text to the pre-trained summary generation model to obtain a record summary corresponding to at least one topic, the method further includes: An editing operation on a text box corresponding to a target subject is received, and content of a record summary corresponding to the target subject is updated according to the editing operation.

9. The interactive tablet control method according to claim 1, characterized in that: The execution content of the candidate instructions displayed in the front in the first interactive window is the execution basis of the candidate instructions displayed in the back.

10. An interactive tablet control device, characterized in that: include: A window display unit, used to display a first interactive window on the interactive tablet; A data receiving unit, configured to receive semantic data through the first interactive window; A parameter acquisition unit, used to perform semantic analysis on the semantic data through a pre-trained semantic control model to obtain instruction parameter information; An instruction matching unit, configured to match instructions from a pre-stored instruction set according to the instruction parameter information, obtain at least one candidate instruction, and display each candidate instruction corresponding to an option in the first interactive window; an instruction confirmation unit, configured to receive, through the first interactive window, an instruction confirmation operation for at least one of the selected items; The instruction sending unit is used to send at least one target instruction confirmed from the at least one candidate instruction to the corresponding target application for instruction response in response to the instruction confirmation operation.

11. Interactive tablet, characterized in that: include: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the interactive tablet implements the interactive tablet control method according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interactive tablet control method according to any one of claims 1 to 9 is implemented.

Images