Control instruction processing method and device and interaction panel

Abstract

The invention relates to the technical field of computers, and discloses a control instruction processing method and device and an interaction panel. The method comprises the steps of obtaining a target control instruction input by a user; analyzing the target control instruction, and querying interface content matched with the target control instruction by using a document index; obtaining an interface method corresponding to the interface content according to the interface content, the keyword stored in the document index and the position information of the interface method corresponding to the keyword; and executing the interface method to respond to a control function corresponding to the target control instruction. According to the method, the target control instruction is analyzed and the document index is inquired, so that the system can accurately match the keyword and the interface method, and an accurate control instruction processing result is provided; and by using document indexes and keyword matching, interface contents and interface methods related to the target control instruction can be quickly positioned and acquired, so that the processing efficiency is improved, and the requirements of a user are quickly responded.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and particularly relates to a control instruction processing method and device and an interactive panel. BACKGROUND

[0002] The interactive panel can be used as a conference room device, which is an interactive panel with high interactivity and rich functions, and is used for assisting conferences and cooperation activities. In a traditional method, when the interactive panel is used as the conference room device, a user needs to be familiar with and execute specific operation instructions to achieve the required functions and operations. The instructions can be input and executed through a touch screen, a gesture, a button, an option, etc. If the user is not familiar with the specific operation instructions or related function buttons, the user cannot use the related conference functions provided by the interactive panel. SUMMARY

[0003] An object of an embodiment of the present application is to provide a control instruction processing method and device and an interactive panel, so as to solve the technical problem of how to reduce the threshold of using conference functions while improving the accuracy and processing efficiency of control instruction processing results.

[0004] To solve the above technical problems, one technical solution adopted by the embodiments of the present application is to provide a control instruction processing method, comprising: obtaining a target control instruction input by a user; parsing the target control instruction and querying interface content matching the target control instruction using a document index, the document index being used to store keywords in an interface document, position information of interface methods corresponding to the keywords, and the interface methods being implementation manners of a function corresponding to the target control instruction; obtaining an interface method corresponding to the interface content according to the interface content and the position information of the interface methods corresponding to the keywords stored in the document index; and executing the interface method to respond to a control function corresponding to the target control instruction. In the method corresponding to the embodiments, the user does not need to be familiar with specific operation instructions or related function buttons, but only needs to input a target control instruction to use a corresponding conference function, so that the user can use the conference function more easily and the use threshold is lowered. The document index in the method stores keywords in an interface document and position information of interface methods corresponding to the keywords, the system can accurately find an interface method related to an instruction by parsing a target control instruction and matching keywords, so that the accuracy of a processing result of the target control instruction can be ensured and the system can provide a conference function meeting the expectation of the user. In addition, the document index provides position information of keywords and interface methods, which enables the system to quickly locate and obtain interface content related to a target control instruction, the system can avoid linear search in the entire interface document by using the document index and keyword matching, and compared with real-time processing and matching in related technologies, the embodiments of the present application directly locate a target position, so that the processing efficiency is improved and the response time is accelerated.

[0005] Optionally, the parsing the target control instruction and querying the interface content matching the target control instruction using the document index comprises: parsing the target control instruction to obtain a first keyword corresponding to the target control instruction; finding a second keyword associated with the first keyword and recorded in the document index using the first keyword in the document index; comparing the first keyword and the second keyword to obtain a matching degree of the keywords; and determining the second keyword as the interface content matching the target control instruction when the matching degree is greater than or equal to a first preset threshold. By comparing the first keyword and the second keyword, the matching degree of the keywords can be calculated, and the matching degree evaluation can help the system to judge the similarity and relevance between the keywords, so that the matched interface content can be more accurately determined. In addition, the matching accuracy can be improved by setting the matching degree threshold, and irrelevant or less similar results can be filtered out.

[0006] Optionally, the method further comprises: when the matching degree is less than the first preset threshold and greater than a second preset threshold, obtaining a conference instruction corresponding to the second keyword, and feeding back the conference instruction corresponding to the second keyword to the user to enable the user to select a conference instruction; receiving the conference instruction selected by the user, and taking the keyword of the conference instruction selected by the user as the interface content matched with the target control instruction. In the case that the keyword matching degree is not high enough, the method helps the user to further refine or specify the conference instruction, thereby improving the accuracy of instruction processing and user experience.

[0007] Optionally, the method further comprises: when the matching degree is less than or equal to the second preset threshold, outputting prompt information to prompt the user to specify the instruction; receiving the user instruction input by the user in response to the prompt information; parsing the user instruction, querying the keyword matched with the user instruction using the document index, and calculating the matching degree of the user instruction and the keyword; when the matching degree of the user instruction and the keyword is less than or equal to the second preset threshold, outputting updated prompt information to enable the user to input updated user instruction according to the updated prompt information, and parsing the updated user instruction, querying the keyword matched with the updated user instruction using the document index, and calculating the matching degree of the updated user instruction and the keyword; repeating the process of obtaining the updated user instruction and calculating the matching degree of the updated user instruction and the updated keyword until the matching degree is greater than the first preset threshold, or greater than the second preset threshold and less than the first preset threshold; when the matching degree is greater than the first preset threshold, taking the keyword corresponding to the matching degree greater than the first preset threshold as the interface content matched with the target control instruction; when the matching degree is greater than the second preset threshold and less than the first preset threshold, obtaining the keyword corresponding to the matching degree greater than the second preset threshold and less than the first preset threshold, and feeding back the conference instruction corresponding to the obtained keyword to the user to enable the user to select a conference instruction; receiving the conference instruction selected by the user, and taking the keyword of the conference instruction selected by the user as the interface content matched with the target control instruction. For the case that the keyword matching degree is lower, through the output of prompt information, iterative parsing and matching process, and the provision of updated prompt information, the system can realize multiple rounds of dialogue, gradually improve the matching accuracy, increase the user participation, improve the user satisfaction, and finally provide the interface content matched with the target control instruction, thereby helping to handle the case with lower matching degree and improving the user experience.

[0008] Optionally, the obtaining the interface method corresponding to the interface content according to the interface content and the position information of the keywords corresponding to the interface method stored in the document index comprises: finding the keywords of the interface content through the document index to obtain the position information of the interface method corresponding to the keywords; and obtaining the interface method corresponding to the interface content from the interface document according to the position information. The position information of the keywords and the interface method corresponding to the keywords stored in the document index provides accurate index, which can ensure that the interface method most relevant to the interface content is obtained, thereby improving the accuracy of the conference function matching.

[0009] Optionally, before the step of obtaining the target control instruction of the user input, the method further comprises: obtaining an interface document, the interface document comprising an interface name and an applicable scenario; and establishing a document index according to the interface name and the applicable scenario. The process of obtaining the interface document and establishing the document index enables the system to obtain detailed information about the interface, such as parameters, return values, etc., and organizes and structures these information, which provides a basis for subsequent control instruction processing. This method is an important prerequisite for ensuring the accuracy of the conference function matching.

[0010] Optionally, the establishing the document index according to the interface name and the applicable scenario comprises: obtaining the interface name and the applicable scenario corresponding to the interface name; performing word segmentation processing on the content corresponding to the interface name and the applicable scenario to generate independent words and record the source of each word; obtaining the vector of each word after the word segmentation processing, the vector being used to represent the semantic relationship between the words so that similar words have similar vectors in the vector space; establishing an index data structure for associating each word with the interface name, the applicable scenario corresponding to the word, and the position information of the word in the interface document; and traversing each word in the interface document, associating the vector of each word with the position information of the word in the interface document and the interface name and the applicable scenario corresponding to the word according to the index data structure to generate the document index. Through word segmentation, vector representation, index data structure and association operation, the accuracy, efficiency and retrieval function of the document index can be improved, which will help to quickly locate and match the interface method.

[0011] Optionally, the method further comprises: periodically updating the interface document and establishing the document index according to the updated interface document. The method of this embodiment can ensure the accuracy and real-time performance of the interface information, support the indexing and retrieval of new functions, and improve the maintainability of the system, thereby providing better function support and service quality.

[0012] To solve the above technical problems, one of the technical solutions adopted by the embodiments of the present application is to provide a control instruction processing device, comprising: a target control instruction acquisition module, configured to acquire a target control instruction input by a user; an interface content acquisition module, configured to parse the target control instruction, and use a document index to query interface content matched with the target control instruction, the document index being configured to store keywords in an interface document, position information of interface methods corresponding to the keywords, and the interface methods being implementation manners of a function corresponding to the target control instruction; an interface method acquisition module, configured to acquire an interface method corresponding to the interface content according to the interface content and the position information of the interface methods corresponding to the keywords stored in the document index; and a conference function implementation module, configured to execute the interface method to respond to a control function corresponding to the target control instruction. The beneficial effects of the device embodiment can refer to the beneficial effects of the corresponding control instruction processing method described above.

[0013] To solve the above technical problems, one of the technical solutions adopted by the embodiments of the present application is to provide an interactive panel, comprising: a memory and a processor, the memory being connected to the processor, the processor being configured to execute one or more computer programs stored in the memory, and the processor being configured to make the interactive panel implement a control instruction processing method applied to an interactive panel when executing the one or more computer programs. The interactive panel has the beneficial effects corresponding to the control instruction processing method applied to an interactive panel described above. BRIEF DESCRIPTION OF DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without any creative labor.

[0015] Figure 1 is a flowchart of a control instruction processing method provided by the embodiments of the present application;

[0016] Figure 2 is a flowchart of a method for parsing a target control instruction and using a document index to query interface content matched with the target control instruction provided by the embodiments of the present application;

[0017] Figure 3 is a flowchart of a method for establishing a document index according to an interface document provided by the embodiments of the present application;

[0018] Figure 4 is a structural schematic diagram of a control instruction processing device provided by the embodiments of the present application;

[0019] Figure 5 is a structural schematic diagram of an interactive tablet provided by an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and do not limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0021] It should be noted that the various features in the embodiments of the present application can be combined with each other without conflict, and all fall within the scope of protection of the present application. In addition, although the functional modules are divided in the device schematic diagram, and the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than the module division in the device or the order in the flowchart. Furthermore, the "first", "second", "third" and the like used in the present application do not limit the data and execution order, but only distinguish the same items or similar items with basically the same function and effect.

[0022] It should be noted that in each of the following embodiments, the following steps do not necessarily have a certain order, and those of ordinary skill in the art can understand from the description of the embodiments of the present application that the following steps in different embodiments can have different execution orders, that is, they can be executed in parallel, or exchanged, etc.

[0023] The control instruction processing method provided by the embodiments of the present application can be applied to an interactive tablet. The interactive tablet can realize human-computer interaction operation through touch technology, and it is a device integrating multiple functions, such as a projector, an electronic whiteboard, a screen, a sound, a television and a video conference terminal.

[0024] The interactive panel can be used as a conference room device, which is a highly interactive and functional interactive panel used to assist meetings and collaboration activities. For example, it allows users to record and annotate meeting content in real time through the touch screen, and users can use a digital pen or their fingers to write, draw, and mark directly on the screen to better understand and participate in the discussion. The interactive panel has a digital whiteboard function, which can simulate the use experience of a traditional whiteboard, and users can write, draw, mark, and erase content without using paper and pens. Users can control the content displayed on the interactive panel, such as switching slides, adjusting the volume, and playing videos. The interactive panel also supports remote collaboration and sharing functions, allowing users to share screens, documents, and applications with remote participants in real time while communicating and editing. The interactive panel also provides convenient file and document management functions, allowing users to easily access and share conference-related files. Users can view and open PDF, Word, Excel, and other file formats, make annotations, markups, and edits, and save or share them with other participants.

[0025] When users operate the interactive panel during a meeting, they often need to perform a series of complex operation instructions to achieve a certain function. For example, when a user wants to record and annotate meeting content, they can use a digital pen or their fingers on the touch screen to write, draw, and mark, which requires the user to select a writing tool, adjust the pen color and thickness, and perform direct operations on the screen according to specific operation instructions. Similarly, when a user wants to switch slides, adjust the volume, or play a video, they need to use the control buttons or gestures on the interactive panel according to specific operation instructions, which may involve sliding, tapping, long pressing, and other gesture actions, or operating through icons and buttons on the interface. Remote collaboration and sharing functions also require specific operation instructions to be implemented, and users may need to share screens, documents, and applications with remote participants through specific gestures or options on the interface, and communicate and edit in real time. In summary, when using the interactive panel as a conference room device, users need to be familiar with and perform specific operation instructions to achieve the desired functions and operations. These instructions can be input and executed through touch screens, gestures, buttons, options, and other methods to provide a highly interactive and rich conference experience.

[0026] However, there are some challenges and limitations in the current operation mode when using interactive tablets as conference room equipment, which can lead to cumbersome and inefficient operation, especially for users who are not familiar or first-time users of the equipment. For example, users may need to remember specific gestures, button positions, or interface options to achieve the desired operation, and if they do not remember or misremember, they will not be able to achieve their desired operation. In addition, due to the sensitivity of the touch screen and the characteristics of multi-point touch, users may accidentally trigger certain functions or perform unwanted operations, which can lead to unexpected results or misoperations, requiring users to be careful in operation. Furthermore, sometimes users may not be able to accurately know whether their operation is successful or not, or they may not get clear feedback, and for some operations, the lack of intuitive visual or audio feedback can lead to user uncertainty and confusion.

[0027] To solve the above problems, the related technology provides a function service by voice instruction control of multimedia conference equipment, effectively reduces the human-computer interaction threshold of multimedia conference equipment, and improves the conference efficiency. It mainly converts the voice instruction into a text instruction through automatic speech recognition technology for voice recognition, and then determines the user's user intent through natural language processing technology for natural language understanding of the text instruction, and then determines the target control instruction matched with the text instruction according to the user's user intent, that is, determines the target control instruction matched with the voice instruction. The related technology of using voice instruction to control multimedia conference equipment can indeed reduce the human-computer interaction threshold and improve the efficiency of the conference, but there are still some problems, including: the related technology may have accuracy and semantic understanding limitations in the conversion of voice instructions and the understanding of text instructions. Due to the limitations of speech recognition and natural language processing, it may lead to incorrect recognition, misunderstanding or ambiguity of instructions, thereby affecting the accuracy of subsequent results. Moreover, the related technology needs to process in real time in the speech recognition, text processing and matching links, which means that after the user issues an instruction, the system needs to immediately perform operations such as voice-to-text conversion, instruction analysis and matching. These real-time requirements may affect the response time and performance of the system, and the real-time processing process may involve multiple links and complex algorithms, and speech recognition, natural language processing and other processes require high computing resources and algorithm complexity, which may affect the processing efficiency and performance of the system.

[0028] Therefore, the related technology has some limitations in accuracy, processing efficiency, etc., which may affect the performance, accuracy and user experience of the system.

[0029] To address the defects in the related art, the embodiments of the present application creatively propose a new technical solution, which improves the problems in the above-mentioned related art. The scheme of the embodiments of the present application establishes an interface document related to the interface of the interactive panel, establishes a document index for the interface document; when the user uses the interactive panel to participate in the conference, the document index is used to query the interface content related to the target control instruction, and the interface method corresponding to the target control instruction is output; the interface method is processed, thereby realizing the control of the interactive panel to provide related conference functions through the target control instruction. The scheme provided by the embodiments of the present application introduces the concepts of interface document and document index, stores and manages the information in the interface document by establishing an index database, so that the interface content related to the target control instruction can be queried through the document index, bypassing the limitations of voice-to-text conversion and natural language understanding in the related art, and the accuracy and matching precision are improved. By integrating the interface content into a comprehensive interface document and establishing a document index, the document index is used for querying and matching the interface content related to the target control instruction. Compared with real-time processing and matching in the related art, using the document index for matching can more efficiently locate the interface content related to the target control instruction, thereby improving the query and matching efficiency and speeding up the response time.

[0030] In addition, when using the document index to query and match the interface content related to the target control instruction, the target control instruction may not be consistent with the system-defined instruction, for example, the user may input different expressions such as "start recording", "start recording", "start recording", etc. The inconsistent target control instruction may not be accurately matched to the system-defined instruction, resulting in a decrease in matching degree, which will affect the understanding of the user's intention by the system and the selection of correct interface content. Moreover, due to inconsistency, the system may select the wrong interface or output the wrong result, for example, the user input "start recording" may be misinterpreted by the system as starting the recording function instead of recording the conference. If the system cannot understand the user's inconsistent expression, the user may feel confused and feel that the system cannot meet his needs, which may reduce the user experience and the trust of the system.

[0031] To address the above technical problems, the embodiments of the present application also propose an improved way. In the construction process of the document index, the use of synonym and near-synonym expansion is considered, and similar words are mapped to the same vector representation, which can improve the matching degree of inconsistent instructions. The document index contains the keywords and description information of the interface document. The target control instruction can be processed by word segmentation, and the word segmentation result is matched with the words in the document index. Through the matching degree calculation, the system can evaluate the relevance of the target control instruction and the interface content, and output the matching degree and the sorting result, so as to select the most relevant interface method as the output result. In addition, more context information can be obtained through multiple rounds of dialogue with the user, so as to more accurately understand the user's intention. Through questioning, clarification and confirmation, the system can obtain a clearer instruction expression, and make corresponding adjustments according to the user's feedback. During the interaction with the user, all matched interface methods can be returned to the user, and the user can select the appropriate interface method from the returned results according to the specific needs. Alternatively, in addition to returning the interface method, more context information such as parameter description, return result, etc. can be provided to the user, so that the user can better understand the specific function and use of each interface method, thereby making more accurate selection. Alternatively, based on the user instruction and the matched interface name, the system can provide some suggestions or recommendations to help the user select from multiple interface methods, such as this can be recommended based on the user's historical use records, popular interface methods, etc. Especially for users who are not familiar with how to use the interactive tablet to obtain related conference functions.

[0032] Through the above solution, the target control instruction can be matched to the appropriate interface method, improving the matching accuracy, enabling the user to more easily obtain the required interface method, and improving user satisfaction and system usability.

[0033] In addition, the document index and interface document of the embodiments of the present application can be dynamically updated and maintained, which can timely reflect the interface changes, improve the flexibility of the system, reduce the maintenance cost and workload, and improve the response ability of the system.

[0034] When implementing the control instruction processing method of the embodiments of the present application based on the interactive tablet, the user can select the control instruction processing function on the interactive tablet. When the function is selected, the corresponding conference service can be obtained by inputting the relevant instruction. Among them, the user can select and use the control instruction processing function through a software application or a web page. If the control instruction processing function is not started, the default function is provided, such as when starting the conference recording, the user still needs to select the corresponding key to start the conference recording.

[0035] In addition, during the implementation of the control instruction processing method, the user can interact with the interactive tablet through a software application or a webpage. For example, the user inputs the target control instruction through voice or text on the software application or the webpage, and the system feedback interface method or the interface method containing the matching degree and the sorting result can be fed back on the software application or the webpage. In addition, during the multi-round dialogue with the user, the target control instruction and the corresponding system response content involved in the multi-round dialogue can also be fed back on the software application or the webpage. Thus, a more convenient, intuitive and traceable interaction mode is provided for the user, thereby improving the control instruction processing effect and user experience.

[0036] Based on the above software logic of the embodiment, the embodiment is further described in combination with a specific scene.

[0037] Please refer to Figure 1 , Figure 1 is a flowchart of a control instruction processing method provided by the embodiment of the present application. The method can be applied to the above interactive tablet, and the method comprises the following steps:

[0038] Step S11, obtaining a target control instruction input by a user.

[0039] The target control instruction refers to a specific operation request issued by the user to the conference system, which is used to realize a specific conference function or execute a specific conference operation. For example, the target control instruction can include instructions such as "create a new conference", "invite participants", "start a conference", "share a screen", "end a conference", "open a whiteboard software", etc. These instructions represent the specific operation that the user wants the conference system to execute to meet his conference needs.

[0040] Among them, the conference system can be installed on the interactive tablet and enabled when the meeting is started. The conference system on the interactive tablet can provide a series of functions and tools to support the conduct and management of the meeting. The conference system also has a user-friendly interface, so that the participants can easily interact with the conference system. By enabling the conference system on the interactive tablet, the user can use the functions provided by the conference system to realize various conference operations, such as creating a conference, inviting participants, displaying a presentation, sharing a screen, recording conference content, managing a conference agenda, etc.

[0041] Users can input target control commands into the conference system in various ways. For example, users can type the command into the system's interface or input boxes using a physical or virtual keyboard, directly entering the text representation of the command, such as "Start meeting recording" or "Invite participants." Alternatively, the system may support voice recognition, allowing users to input target control commands verbally using a microphone or voice recognition device. The system will then convert the speech to text, parse and process it. Another option is touchscreen interaction, where users can use gestures or touch input to send target control commands, such as drawing specific gestures on the screen to indicate specific operations, like "Switch input source" or "Share screen." Finally, the system can pair with external control devices (such as remote controls, touchpads, or handheld devices), allowing users to send the target control command through these devices, such as pressing buttons, sliding on a touchpad, or using specific gestures on the device.

[0042] Users can flexibly choose one or more of the above methods to input different target control commands.

[0043] The aforementioned conferencing system can be implemented as a website, webpage, or application and installed on an interactive flat panel. Users can access the conferencing system's website or webpage version through a browser, or by downloading and installing the application. The interactive flat panel's touchscreen and interface allow users to easily operate the conferencing system and input target control commands. The conferencing system on the interactive flat panel leverages the tablet's hardware capabilities and mobility to provide a convenient conferencing experience. Users can interact via the touchscreen, using the flat panel's camera, microphone, and speakers for video conferencing, voice calls, and content sharing.

[0044] The control command processing method of this application embodiment can be implemented by installing a conference system on an interactive flat panel. Alternatively, the control command processing method can be executed based on the backend server corresponding to the conference system. In this case, the target control command input by the user through the interactive flat panel is uploaded to the backend server corresponding to the conference system. Specifically, the backend server is used to: parse the target control command; use a document index to query interface content matching the target control command; the document index stores keywords in the interface document and the location information of the corresponding interface methods; obtain the interface method corresponding to the interface content based on the interface content and the keywords and their corresponding interface methods stored in the document index; and then send the interface method to the interactive flat panel where the conference system is located. The interactive flat panel executes the interface method, thereby responding to the control function corresponding to the target control command. This backend server-based control command processing method can provide powerful and flexible control functions, while allowing the interactive flat panel to interact as a client device and achieve collaboration with the backend server. Of course, the control command processing method can also be executed entirely on the interactive flat panel. In this case, the interactive flat panel assumes all responsibility for parsing, processing, and executing the target control command without relying on the backend server. By executing control commands on the interactive whiteboard, offline operation and rapid response can be achieved without relying on the network connection and processing capabilities of an external server. This may be very convenient and practical for mobile devices and meeting needs in specific scenarios.

[0045] Step S12: Parse the target control instruction and use the document index to query the interface content that matches the target control instruction. The document index is used to store the keywords in the interface document and the location information of the interface methods corresponding to the keywords.

[0046] Interface methods are the implementation methods of the specific functions corresponding to the target control commands. They define how the system responds to user control commands and performs corresponding operations. Each interface method is associated with a specific function or task, such as starting meeting recording, adjusting volume, or sharing the screen. For example, the target control command is a user-input command, such as "start meeting recording" or "adjust volume"; the corresponding interface method is a specific function implemented to respond to these commands, such as: startRecording(): used to start meeting recording; adjustVolume(level): used to adjust the volume level, where level is the input parameter.

[0047] The interface documentation can be a detailed document provided by the interactive flat panel service provider, containing various operation instructions for the interactive flat panel and their corresponding interface descriptions. The interface documentation may include the interface name, interface function, applicable scenarios, parameter descriptions, etc. The interface name can be the interface name or external name corresponding to each operation instruction listed in the documentation, to facilitate user understanding and invocation. The interface function can be the purpose and function of each interface described in the documentation, such as starting meeting recording or stopping screen sharing. The applicable scenarios can be the scenarios or usage situations in which each interface is applicable, such as the start recording interface being suitable for scenarios where meeting content needs to be recorded. The parameter descriptions can be the parameter descriptions that may be involved in each interface provided in the documentation. These parameters may be required or optional, used to specify the behavior or configuration of the interface.

[0048] A document index is a data structure or storage method used to manage and retrieve documents, associating keywords in interface documentation with their corresponding interface methods. Interface documentation is detailed documentation describing the available interfaces in an interactive whiteboard or conferencing system. It includes information such as the interface's name, function, and parameter descriptions to help developers, integration partners, or other users correctly understand and use the interface. Interface documentation can be part of a document index, where keywords can be the interface's name, function, or other relevant information. By associating keywords in interface documentation with their corresponding interface methods and building a document index, faster and more accurate interface query and retrieval capabilities can be provided. For example, in a document index, the interface name in the interface documentation can be used as a keyword, and the corresponding interface method as the index value. When a user searches for specific keywords in the document index, they can quickly find the corresponding interface method and access relevant interface documentation for reference.

[0049] When used as a data structure, a document index stores the location information of keywords and their corresponding interface methods within an API document. For example, a Map object can be used to implement a document index. A Map is a data structure in JavaScript that allows key-value pairs to be associated; in the document index, keywords are the keys, and the corresponding interface methods are the values. Besides using Map objects, other storage methods can also be used to store keywords and their corresponding interface methods. For instance, relational databases (such as MySQL) or non-relational databases (such as MongoDB) can be used to store the document index. A table or collection can be created to store keywords and their corresponding interface methods, and queries can be performed using SQL or a database query language.

[0050] By storing keywords and corresponding interface methods in the document index, matching interface methods can be quickly found when executing meeting instructions. This process avoids traversing all interface documents one by one to find matching content, thereby speeding up the query and improving the system's response performance.

[0051] For details, please refer to Figure 2 The process involves parsing the target control instructions and using the document index to query the interface content that matches the target control instructions, including:

[0052] Step S1201: Parse the target control instruction to obtain the first keyword corresponding to the target control instruction.

[0053] For example, if the target control instruction is a text string, the first keyword can be extracted by following these steps: preprocess the target control instruction, including removing special characters, punctuation marks, and stop words; segment the preprocessed target control instruction into words, that is, split the text into individual words or phrases; perform part-of-speech tagging on the segmented words to more accurately determine the semantics and function of each word; and extract the first keyword according to specific needs and semantic rules. For example, a noun can be selected as the first keyword based on part-of-speech tagging, or the first non-stop word can be selected as the first keyword according to specific rules, etc.

[0054] For example, if the target control instruction is "create a new meeting", the word segmentation result is ["create", "new", "meeting"]. You can use "create" as the first keyword, or you can use "create" and "meeting" as the first keyword, or you can use "create", "new", and "meeting" as the first keyword.

[0055] Step S1202: Use the first keyword to search in the document index and obtain the second keyword that is associated with the first keyword and recorded in the document index.

[0056] As we know, the document index stores a large number of keywords. When searching for a second keyword related to the first keyword, you can query the document index. For each keyword in the document index, if the first keyword is the same as or similar to one of the keywords, then that same or similar keyword can be used as the second keyword. For example, if the first keyword is "create," searching the document index for words like "create," "new," and "establish" can all be used as second keywords. Similarly, if the first keywords are "create" and "meeting," when searching for related second keywords in the document index, you can treat "create" and "meeting" as a whole and search for related second keywords such as ["create," "video," "meeting"] and ["create," "remote," "meeting"]. Here, ["create," "video," "meeting"] can be used as a second keyword, and ["create," "remote," "meeting"] can also be used as a second keyword.

[0057] Different methods can be used to determine the similarity or closeness of keywords, such as string matching, string edit distance, and word vector similarity.

[0058] Step S1203: Compare the first keyword and the second keyword to obtain the keyword matching degree.

[0059] Calculating the matching degree between the first keyword and the second keyword, also known as similarity, can be done by considering both keywords as a whole. For example, to calculate the similarity between the first keyword ["create", "meeting"] and the second keyword ["create", "video", "meeting"], similarity measurement methods can be used to calculate the similarity between the two keywords, such as string matching algorithms (e.g., edit distance) or word vector-based similarity measures (e.g., cosine similarity), comparing the two keywords as a whole.

[0060] In this embodiment, by comparing the first keyword and the second keyword, the keyword matching degree can be calculated. The matching degree evaluation can help the conference system determine the similarity and relevance between keywords, thereby more accurately determining the matching interface content.

[0061] Additionally, setting a matching threshold to determine the interface content to match the target control command can improve matching accuracy and filter out irrelevant or insufficiently similar results. See the steps below for details.

[0062] Step S1204: Compare the keyword matching degree with the first preset threshold and the second preset threshold respectively.

[0063] The first preset threshold is greater than the second preset threshold. The first preset threshold can be set to a relatively high value to filter out very similar or highly matching keyword pairs. For example, the first preset threshold can be set to 90%, meaning that two keywords will only be considered a match if the keyword match rate exceeds 90%. The second preset threshold is set to a lower value to include a wider range of matches, including relatively similar but not perfectly matching keyword pairs. For example, the second preset threshold can be set to 50%, meaning that two keywords will be considered a match as long as the keyword match rate exceeds 50%, even if the match rate is not as high as the first preset threshold.

[0064] Both the first and second preset thresholds can be adjusted according to specific application scenarios. For example, if more emphasis is placed on high-quality matching results, the first preset threshold can be set higher; if more emphasis is placed on inclusive and broad matching results, the second preset threshold can be set lower.

[0065] In this embodiment, when the matching degree is greater than or equal to the first preset threshold, step S1205 is executed. When the matching degree is less than the first preset threshold but greater than the second preset threshold, steps S1206 and S1207 are executed. When the matching degree is less than or equal to the second preset threshold, steps S1208 to S1215 are executed.

[0066] Step S1205: Determine the second keyword as the interface content that matches the target control command. The interface content can be considered the second keyword.

[0067] Step S1206: Obtain the meeting instruction corresponding to the second keyword and provide feedback to the user so that the user can select the meeting instruction. This meeting instruction refers to a specific operation or command related to the second keyword, such as a specific operation the user can perform, like "start meeting," "end meeting," or "invite members"; instructions the user can use to obtain information, such as "view meeting schedule" or "get participant list"; instructions the user can use to adjust meeting parameters, such as "set meeting time" or "modify meeting topic"; and instructions related to control during the meeting, such as "mute all participants" or "share screen."

[0068] Step S1207: Receive the meeting instruction selected by the user, and use the keywords of the meeting instruction selected by the user as the interface content that matches the target control instruction.

[0069] To address situations where keyword matching is insufficient, this method helps users further refine or clarify meeting instructions, thereby improving the accuracy of instruction processing and user experience. For example, the second keyword might be ["create", "video", "meeting"], corresponding to a meeting instruction: "create video conference." This instruction indicates that the user wants to create a video conference through the conferencing system, potentially including setting meeting parameters and inviting participants. Therefore, the keywords corresponding to the meeting instruction "create video conference" are used as the interface content for target control instruction matching. These keywords can include ["create", "video", "meeting"], ["create", "video conference"], or ["create video conference"]. Furthermore, the interface content can also include the meeting parameters and participant invitation details related to the "create video conference" instruction.

[0070] In this embodiment, by using specific meeting instructions and their keywords as interface content, and combining them with other relevant information, users can better express and clarify their meeting instructions, thereby improving the accuracy of instruction processing.

[0071] For cases with lower keyword matching accuracy, the system can implement multi-turn dialogue by outputting prompts, iteratively parsing and matching, and providing updated prompts. This gradually improves matching accuracy, increases user engagement, enhances user satisfaction, and ultimately provides interface content that matches the target control command. This helps handle cases with low matching accuracy and improves user experience. For details, refer to the steps below.

[0072] Step S1208: Output a prompt message to guide the user to clarify the instruction. The prompt message may contain information about possible operations, usage of specific keywords, optional parameters, etc.

[0073] Step S1209: Receiving user instructions input when receiving user response prompts. These user instructions refer to the specific operations or requests entered by the user based on the prompts provided by the system.

[0074] Step S1210: Parse the user command, use the document index to query keywords that match the user command, and calculate the matching degree between the user command and the keywords.

[0075] Step S1211: When the matching degree between the user instruction and the keyword is less than or equal to the second preset threshold, output the updated prompt information so that the user can input the updated user instruction according to the updated prompt information, parse the updated user instruction, use the document index to query the keywords that match the updated user instruction, and calculate the matching degree between the updated user instruction and the keywords.

[0076] Step S1212: Determine whether the matching degree between the updated user command and the keyword is greater than the second preset threshold.

[0077] If the value is greater than the second preset threshold, then proceed with steps S1213 to S1215.

[0078] If the value is less than or equal to the second preset threshold, then proceed to steps S1208 to S1212.

[0079] Step S1213: Determine whether the matching degree between the updated user instruction and the keyword is greater than or equal to the first preset threshold.

[0080] If the threshold is greater than or equal to the first preset threshold, then proceed to step S1214; if the threshold is less than the first preset threshold, then proceed to step S1215.

[0081] Step S1214: Use the keywords corresponding to the matching degree when it is greater than the first preset threshold as the interface content that matches the target control command.

[0082] Step S1215: Obtain the keywords corresponding to the matching degree when it is greater than the second preset threshold and less than the first preset threshold, and feed back the meeting instructions corresponding to the obtained keywords to the user so that the user can select the meeting instructions; receive the meeting instructions selected by the user, and use the keywords of the meeting instructions selected by the user as the interface content for matching the target control instructions.

[0083] In this embodiment, the accuracy of matching user commands with keywords is gradually improved through multi-turn dialogue, thereby increasing user participation, improving user satisfaction, and ultimately providing interface content that matches the target control command.

[0084] In some embodiments, after performing step S1214 or step S1215, the method further includes: recording the matching result between the keyword and the target control instruction, and updating the keyword in the document index to optimize existing index entries and ensure the accuracy of the document index.

[0085] Optionally, when the match between a user instruction and a keyword is less than a third preset threshold, the conferencing system can provide a response to the user instruction but not execute the system instruction. This third preset threshold is less than the second preset threshold and is used to determine cases where the match is even smaller. For example, if the third preset threshold is 10%, and the match between the user instruction and the keyword is less than 10%, and the user inputs the instruction "make a phone call," the system will display the message "The conferencing tablet does not support the phone call function."

[0086] Step S13: Based on the interface content and the keywords stored in the document index, as well as the location information of the interface methods corresponding to the keywords, obtain the interface methods corresponding to the interface content.

[0087] Specifically, the process involves searching for keywords in the interface content using the document index to obtain the location information of the interface method corresponding to the keyword; then, based on the location information, the interface method corresponding to the interface content is retrieved from the interface document. The keywords and their corresponding interface method location information stored in the document index provide an accurate index, ensuring that the most relevant interface method is obtained, thereby improving the accuracy of meeting function matching.

[0088] Step S14: Execute the interface method to respond to the control function corresponding to the target control command.

[0089] The specific implementation of the interface methods is determined based on the system's programming language, framework, and requirements. For example, if the user's input target control command is to start meeting recording, the corresponding interface method is `startRecording()`. This method is used to initiate the meeting recording function and can call the corresponding recording component or service to start recording the meeting's audio and video. Another example is if the user's input target control command is to adjust the volume, the corresponding interface method is `adjustVolume(level)`. This method is used to adjust the meeting's volume level, where the parameter `level` represents the volume level and can be a numerical value or an enumeration type to specify the specific volume setting.

[0090] In the control command processing method provided in this application embodiment, users do not need to be familiar with specific operation commands or related function keys. They can use the corresponding meeting function simply by inputting the target control command, making it easier for users to use the meeting function and lowering the barrier to entry. The document index in this method stores keywords in the interface document and the location information of the corresponding interface methods. By parsing the target control command and matching keywords, the system can accurately find the interface method related to the command, thereby ensuring the accuracy of the target control command processing results and providing meeting functions that meet user expectations. Furthermore, the document index provides the location information of keywords and interface methods, enabling the system to quickly locate and obtain the interface content related to the target control command. By using the document index and keyword matching, the system can avoid linear searching throughout the entire interface document. Moreover, compared to the real-time processing and matching of related technologies, this application embodiment directly locates the target position, thereby improving processing efficiency and accelerating response time.

[0091] The following example illustrates the control instruction processing method of this application embodiment.

[0092] For example, a user inputs the target control command: "Start recording meeting". This command is parsed to obtain the first keyword: "Start", "Record", "Meeting". Then, this first keyword is used to search the document index and obtain the second keyword associated with it: "Start", "Meeting", "Record". Next, the first and second keywords are compared, and the keyword matching degree is calculated. If the matching degree is greater than or equal to a first preset threshold, then "Start", "Meeting", and "Record" are determined to be interface content matching the target control command. The next step is to search the document index for the location information of the interface methods corresponding to "Start", "Meeting", and "Record", and obtain the corresponding interface methods from the relevant interface documents based on this location information. Then, the interface methods are executed to respond to the control function corresponding to the target control command, such as starting meeting recording, thus completing the control command processing flow and realizing the meeting recording function. Finally, it can also announce "Meeting recording has started" or display "Meeting recording has started" on the interface.

[0093] If the second keyword associated with the first keyword is a word with a matching degree less than the first preset threshold but greater than the second preset threshold, such as "start", "create", or "meeting", then meeting instructions related to "start", "create", or "meeting" can be fed back to the user. For example, meeting instructions include "create a new meeting", "start meeting creation", "start meeting recording", "start meeting summary", etc. The user can then select the corresponding meeting instruction, such as "start meeting recording". Next, based on the keyword corresponding to "start meeting recording", the location information of the interface method corresponding to the keyword is found in the document index. Then, the interface method is obtained based on the location information, and the interface method is executed to realize the control function corresponding to the target control instruction.

[0094] In some embodiments, before performing step S11, the method further includes: obtaining an interface document; and establishing a document index based on the interface document. The processes of obtaining the interface document and establishing the document index enable the conference system to obtain detailed descriptions, parameters, return values, and other information about the interface, and to organize and structure this information, providing a foundation for subsequent control command processing. This step is a crucial prerequisite for ensuring accurate matching of conference functions.

[0095] Please see Figure 3 The API documentation includes the API name and applicable scenarios. A documentation index is created based on the API name and applicable scenarios, including:

[0096] Step S21: Obtain the interface name and the applicable scenarios corresponding to the interface name.

[0097] An interface name is an identifier for a specific function, used to describe the operations or services available in the system. An interface name can be a concise and easy-to-understand phrase, facilitating user or developer identification and invocation. The applicable scenario refers to the conditions under which a specific interface name can be used; it provides context for users to understand when and how to use the relevant interface. An interface name can correspond to multiple applicable scenarios to cover different use cases.

[0098] For example, the interface name "Start Meeting Recording" is applicable when "meeting content needs to be recorded". The interface name "Get Current Speaker" has no applicable scenario at present, as this interface is only used to query the current status. The interface name "Set Speaker" is applicable in scenarios such as "Switch Speakers" and "Switch Speakers".

[0099] Step S22: Perform word segmentation on the content corresponding to the interface name and applicable scenarios to generate independent words, and record the source of each word. The interface name and applicable scenarios in the interface document are split into independent words. The purpose of word segmentation is to divide long text segments into a sequence of words for subsequent processing and indexing. At the same time, the source of each word is recorded, such as from the interface name or applicable scenario.

[0100] Step S23: Obtain the vector of each word after word segmentation. This vector is used to represent the semantic relationship between words so that similar words have similar vectors in the vector space.

[0101] Word embeddings can be used to obtain the vector representation of each segmented word. Word embeddings map each word to a high-dimensional vector space, where similar words have similar vectors, thus capturing the semantic relationships between words. This allows for accurate retrieval of relevant interface content during subsequent indexing and matching. Other vectorization methods can also be used to convert each word into a vector.

[0102] Step S24: Establish an index data structure. This index data structure is used to associate each word with its corresponding interface name, applicable scenario, and the word's position information in the interface document. For example, the index data structure is an inverted index, which can quickly retrieve interface documents containing a certain word and the word's position in the document.

[0103] Step S25: Traverse each word in the interface document, and according to the index data structure, associate the vector of each word with its position information in the interface document, as well as its corresponding interface name and applicable scenario, to generate a document index.

[0104] A document index is an efficient data structure used to organize and store key information in interface documents for rapid retrieval and matching of relevant content. By associating keywords, interface names, applicable scenarios, and location information, it helps the system quickly find the information needed by the user during a query. Therefore, in subsequent target instruction processing, matching interface content can be quickly retrieved based on the user-input keywords. This embodiment improves the accuracy, efficiency, and retrieval functionality of the document index through word segmentation, vector representation, index data structures, and association operations, all of which contribute to the rapid location and matching of interface methods.

[0105] Table 1

[0106]

[0107] Table 1 above is the interface documentation for examples of embodiments of this application. A documentation index is created based on the above interface documentation.

[0108] For example, as shown in Table 1, the interface names included in the interface documentation include: Third-party application capability list, Get current speaker, and Set speaker; the applicable scenario for the Third-party application capability list is "What capabilities do you have? What can you do?"; the applicable scenario for Get current speaker is null; the applicable scenario for Set speaker is "Switch speaker, switch speaker". Based on this, the document index includes:

[0109] First, obtain the interface name and its corresponding applicable scenarios, including:

[0110] Interface Name: List of Third-Party Application Capabilities;

[0111] Corresponding applicable scenarios: What skills do you have? What can you do?

[0112] Then, each interface name and its corresponding applicable scenario are segmented into words to generate independent words, and the source of each word is recorded, i.e.:

[0113] Interface name: Third-party application capability list; Word segmentation: ["third-party", "application", "capability", "list"];

[0114] Applicable scenarios: What skills do you have? What can you do?

[0115] Word segmentation: [“you”, “have”, “which”, “ability”, “you”, “can”, “do”, “what”.

[0116] Next, a vector representation is generated for each word, and the source of each word is labeled:

[0117] For example, the vector for the word "ability" is v1, which comes from "third-party application capability list" and "what capabilities do you have?".

[0118] Next, establish an index data structure (such as an inverted index) to associate each term with its corresponding API name, applicable scenarios, and location information in the API documentation. For example:

[0119] {

[0120] "Third party":{

[0121] "Interface Name":"List of Third-Party Application Capabilities",

[0122] "Position":[0]

[0123] },

[0124] "application":{

[0125] "Interface Name":"List of Third-Party Application Capabilities",

[0126] "Location":[1]

[0127] },

[0128] "ability":{

[0129] "Interface Name":"List of Third-Party Application Capabilities",

[0130] "Applicable Scenarios": "What skills do you have? What can you do?"

[0131] "Position":[2,4]

[0132] },

[0133] "List":{

[0134] "Interface Name":"List of Third-Party Application Capabilities",

[0135] "Location":[3]

[0136] }

[0137] Finally, the vector of each word is associated with its position in the document, interface name, and applicable scenario to generate a complete document index.

[0138] Through the steps described above, a complete document index is constructed, enabling rapid retrieval of API content relevant to user queries. This index includes API names and applicable scenarios; by incorporating keywords and their locations, relevant API names and applicable scenarios can be quickly located without traversing the entire document. Furthermore, multi-dimensional queries can be performed based on keywords, API names, or applicable scenarios to meet diverse needs.

[0139] In some embodiments, the method further includes: periodically updating the interface document and building a document index based on the updated interface document. This method ensures the accuracy and real-time nature of interface information, supports the indexing and retrieval of new features, improves system maintainability, and thus provides better functional support and service quality.

[0140] Please see Figure 4 , Figure 4 This is a schematic diagram of a control command processing device provided in an embodiment of this application. The device 30 includes:

[0141] The target control instruction acquisition module 301 is used to acquire target control instructions input by the user.

[0142] The interface content acquisition module 302 is used to parse the target control instruction and use a document index to query the interface content that matches the target control instruction. The document index is used to store keywords in the interface document and the location information of the interface methods corresponding to the keywords. The interface methods are the implementation methods of the functions corresponding to the target control instruction.

[0143] The interface method acquisition module 303 is used to obtain the interface method corresponding to the interface content based on the interface content and the keywords and the location information of the interface methods corresponding to the keywords stored in the document index.

[0144] The conference function implementation module 304 is used to execute the interface method to respond to the control function corresponding to the target control command.

[0145] The control instruction processing device 30 can be a software module, which includes several instructions stored in a memory. The processor can access the memory and execute the instructions to complete the control instruction processing methods described in the above embodiments.

[0146] In some embodiments, the control instruction processing device 30 can also be constructed from hardware devices. For example, the control instruction processing device 30 can be constructed from one or more chips, and the chips can work in coordination to complete the control instruction processing methods described in the various embodiments. As another example, the control instruction processing device 30 can also be constructed from various logic devices, such as general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), microcontrollers, ARM (Acorn RISC Machine) or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination of these components.

[0147] It should be noted that the control command processing device 30 described above can execute the control command processing method for interactive flat panels provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects of the method. Technical details not described in detail in the embodiments of the control command processing device 30 can be found in the control command processing method for interactive flat panels provided in the embodiments of this application.

[0148] Please see Figure 5 , Figure 5 This is a schematic diagram of an interactive flat panel provided in an embodiment of this application. The interactive flat panel 40 includes one or more processors 401 and a memory 402. The memory 402 is connected to one or more processors 401, for example, via a bus.

[0149] Processor 401 is configured to support the interactive flat panel 40 in performing the corresponding functions in the methods described in the above method embodiments. Processor 401 may be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof. The aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The aforementioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0150] Memory 402 is used to store program code, etc. Memory 402 may include volatile memory (VM), such as random access memory (RAM); memory may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); memory may also include combinations of the above types of memory.

[0151] The memory 402 can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the control instruction processing method in the embodiments of this application. The processor 401 executes various functional applications and data processing of the control instruction processing method and control instruction processing device by running the non-volatile software programs, instructions, and modules stored in the memory, that is, it realizes the functions of the various modules or units of the control instruction processing method and control instruction processing device provided in the above method embodiments.

[0152] Memory 402 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function. The data storage area may store data created according to the use of the control instruction processing device. In some embodiments, the memory may optionally include memory remotely located relative to the processor, which can be connected to the control instruction processing device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0153] The one or more modules are stored in the memory. When executed by the one or more processors, they execute the control instruction processing method in any of the above method embodiments. For example, they execute the method steps described in the above method embodiments to realize the functions of the modules described in the above device embodiments.

[0154] The interactive flat panel 40 in this application embodiment can be an ultra-mobile personal computer device, a smart display, or an all-in-one machine, etc.

[0155] This application also provides a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the method described in the foregoing embodiments.

[0156] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0157] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A control command processing method, characterized in that, include: Obtain the target control commands input by the user; The target control instruction is parsed, and the document index is used to query the interface content that matches the target control instruction. The document index is used to store the keywords in the interface document, the location information of the interface methods corresponding to the keywords, and the interface methods are the implementation methods of the functions corresponding to the target control instruction. Based on the interface content and the keywords and the location information of the interface methods corresponding to the keywords stored in the document index, the interface method corresponding to the interface content is obtained; The interface method is executed to respond to the control function corresponding to the target control command.

2. The method according to claim 1, characterized in that, The process of parsing the target control instruction and using a document index to query interface content that matches the target control instruction includes: Parse the target control command to obtain the first keyword corresponding to the target control command; Using the first keyword, search in the document index to obtain a second keyword that is associated with the first keyword and recorded in the document index; Compare the first keyword with the second keyword to obtain the keyword matching degree; When the matching degree is greater than or equal to the first preset threshold, the second keyword is determined to be interface content that matches the target control instruction.

3. The method according to claim 2, characterized in that, The method further includes: When the matching degree is less than the first preset threshold and greater than the second preset threshold, the meeting instruction corresponding to the second keyword is obtained, and the meeting instruction corresponding to the second keyword is fed back to the user so that the user can select the meeting instruction; Receive the meeting instruction selected by the user, and use the keywords of the meeting instruction selected by the user as the interface content that matches the target control instruction.

4. The method according to claim 3, characterized in that, The method further includes: When the matching degree is less than or equal to the second preset threshold, a prompt message is output to prompt the user to specify the instruction; Receive user commands input by the user when responding to the prompt information; Parse the user instruction, use the document index to query keywords that match the user instruction, and calculate the matching degree between the user instruction and the keywords; When the matching degree between the user instruction and the keyword is less than or equal to the second preset threshold, an updated prompt message is output so that the user can input an updated user instruction according to the updated prompt message. The updated user instruction is parsed, the document index is used to query the keywords that match the updated user instruction, and the matching degree between the updated user instruction and the keyword is calculated. The process of obtaining the updated user instruction and calculating the matching degree between the updated user instruction and the updated keyword is repeated until the matching degree is greater than the first preset threshold, or greater than the second preset threshold and less than the first preset threshold. When the matching degree is greater than the first preset threshold, the keyword corresponding to the matching degree when it is greater than the first preset threshold is used as the interface content that matches the target control instruction; When the matching degree is greater than the second preset threshold and less than the first preset threshold, obtain the keyword corresponding to the matching degree when it is greater than the second preset threshold and less than the first preset threshold, and feed back the meeting instruction corresponding to the obtained keyword to the user so that the user can select the meeting instruction; receive the meeting instruction selected by the user, and use the keyword of the meeting instruction selected by the user as the interface content that matches the target control instruction.

5. The method according to claim 1, characterized in that, The step of obtaining the interface method corresponding to the interface content based on the interface content and the location information of the keywords and corresponding interface methods stored in the document index includes: By searching for keywords in the interface content using the document index, the location information of the interface method corresponding to the keywords can be obtained; Based on the location information, obtain the interface method corresponding to the interface content from the interface document.

6. The method according to any one of claims 1 to 5, characterized in that, Before executing the step of acquiring the target control instruction input by the user, the method further includes: Obtain the API documentation, which includes the API name and applicable scenarios; A document index is created based on the interface name and the applicable scenario.

7. The method according to claim 6, characterized in that, The step of establishing a document index based on the interface name and the applicable scenario includes: Obtain the interface name and the applicable scenarios corresponding to the interface name; The interface name and the content corresponding to the applicable scenario are segmented into words to generate independent words, and the source of each word is recorded. Obtain the vector of each word after word segmentation. The vector is used to represent the semantic relationship between words so that similar words have similar vectors in the vector space. An index data structure is established, which is used to associate each word with its corresponding interface name, applicable scenario, and the word's position information in the interface document; Iterate through each word in the interface document, and according to the index data structure, associate the vector of each word with its position information in the interface document, as well as its corresponding interface name and applicable scenario, to generate a document index.

8. The method according to claim 6, characterized in that, The method further includes: The interface documentation is updated periodically, and an index of the documentation is built based on the updated interface documentation.

9. A control command processing device, characterized in that, include: The target control command acquisition module is used to acquire the target control commands input by the user. The interface content acquisition module is used to parse the target control instruction and use a document index to query the interface content that matches the target control instruction. The document index is used to store keywords in the interface document, the location information of the interface methods corresponding to the keywords, and the interface methods are the implementation methods of the functions corresponding to the target control instruction. The interface method acquisition module is used to obtain the interface method corresponding to the interface content based on the interface content and the keywords and the location information of the interface methods corresponding to the keywords stored in the document index. The meeting function implementation module is used to execute the interface method to respond to the control function corresponding to the target control command.

10. An interactive flat panel, characterized in that, include: A memory and a processor, the memory being connected to the processor, the processor being configured to execute one or more computer programs stored in the memory, wherein, when executing the one or more computer programs, the processor causes the interactive flat panel to implement the control instruction processing method as described in any one of claims 1-8.

Images