Interactive method for a terminal, electronic whiteboard, and computer non-transitory readable storage medium

Abstract

An interaction method for a terminal, an electronic whiteboard, and a computer non-transitory readable storage medium. The terminal includes at least one electronic whiteboard. The interaction method of the terminal includes: identifying and obtaining information recorded by the electronic whiteboard (S101); obtaining information to be sent according to the obtained information (S102); and sending the information to be sent to a target object according to a user operation instruction (S103).

Description

Technical Field

[0001] The present disclosure relates to the field of electronic technologies, and particularly to an interaction method for a terminal, an electronic whiteboard, and a computer non-transitory readable storage medium. Background Art

[0002] In the use of existing conference whiteboards, a writing board and sticky notes are generally used to record the content of a meeting. After the meeting, the content of the meeting is manually sorted to form a meeting minutes and then sent. However, currently, the degree of intelligence in the entire process from meeting content recording, meeting minutes sorting to sending meeting minutes needs to be improved, and the user experience is poor. Summary of the Invention

[0003] Embodiments of the present application provide an interaction method for a terminal, an electronic whiteboard, and a computer non-transitory readable storage medium, so as to improve the degree of interaction intelligence between a user and a terminal.

[0004] An interaction method for a terminal provided by an embodiment of the present application, the terminal includes at least one electronic whiteboard, and the method includes:

[0005] Identify and obtain the information recorded by the electronic whiteboard, and obtain the text information in the information;

[0006] Obtain the information to be sent according to the obtained information;

[0007] Send the information to be sent to the target object according to the user operation instruction.

[0008] In some embodiments, the information recorded by the electronic whiteboard includes at least one of the following:

[0009] The text information displayed on the electronic whiteboard, the written text information in the writing area of the electronic whiteboard, and the voice information of the current interaction scenario.

[0010] In some embodiments, the writing area includes: the writing interface of the electronic whiteboard or at least one sticky note interface established on the writing interface;

[0011] Identifying and obtaining the written text information in the writing area of the electronic whiteboard specifically includes:

[0012] Identify and obtain the written text information recorded by the writing interface and the written text information recorded by the sticky note interface.

[0013] In some embodiments, obtaining the information to be sent according to the obtained information specifically includes:

[0014] Group the obtained information to obtain at least one information group;

[0015] Obtain the information to be sent including at least one information group.

[0016] In some embodiments, the acquired information is grouped, specifically including:

[0017] Select the text information in at least part of the information displayed on the electronic whiteboard according to the user operation instruction as an information group.

[0018] In some embodiments, when the recognized information includes text information, the acquired information is grouped, specifically including:

[0019] Perform semantic parsing on the text information, and divide the sentences with related semantics in the text information into one information group.

[0020] In some embodiments, when the acquired information further includes voice information, before grouping the acquired information, the method further includes:

[0021] Convert the voice information into text information;

[0022] Perform semantic parsing on the text information, and divide the sentences with related semantics in the text information into one information group, specifically including:

[0023] Adopt a machine learning method to process the acquired text information and the text information converted from the voice information, perform semantic parsing on the acquired text information and the text information converted from the voice information, merge the sentences with the same semantics in the acquired text information and the text information converted from the voice information into one sentence, and divide the sentences with related semantics in the text information into one information group.

[0024] In some embodiments, when the acquired information only includes voice information, the acquired information is grouped, specifically including:

[0025] Convert the voice information into text information;

[0026] Perform semantic parsing on the text information, and divide the sentences with related semantics in the text information into one information group.

[0027] In some embodiments, when the acquired information includes handwritten text information, the acquired information is grouped, specifically including:

[0028] Adopt handwriting recognition to process the handwritten text information, and form a group of information groups for the sentences with the same handwriting in the handwritten text information.

[0029] In some embodiments, when the writing area of the electronic whiteboard includes a sticky note interface, the method further includes:

[0030] Obtain the association information between sticky note interfaces;

[0031] Group the acquired information, specifically including:

[0032] Group the information in the sticky note interface where associations are to be established into a group of information.

[0033] In some embodiments, the information to be sent includes multiple groups of information. After grouping the obtained information, it further includes:

[0034] Determine the importance level of each group of information;

[0035] Sort the multiple groups of information in descending order according to the importance level.

[0036] In some embodiments, according to the user operation instruction, send the information to be sent to the target object, specifically including:

[0037] Determine at least one target object;

[0038] According to the user operation instruction, send at least one group of information to at least one target object.

[0039] In some embodiments, determining at least one target object specifically includes:

[0040] Take all the participants in the current interaction scenario as the target object;

[0041] Alternatively, determine the target object corresponding to the information to be sent from all the participants in the current interaction scenario.

[0042] In some embodiments, determining the target object corresponding to the information to be sent from all the participants in the current interaction scenario specifically includes:

[0043] According to the user operation instruction, select the target object corresponding to the information to be sent;

[0044] Alternatively, process the information to be sent to determine the target object that matches the information to be sent.

[0045] In some embodiments, the electronic whiteboard further includes: a user information area, and the user information area includes a user avatar. According to the user operation instruction, sending the information to be sent that matches the target object specifically includes:

[0046] Drag the information to be sent to the user avatar of the target object that matches it to send the information to be sent to the target object corresponding to the user avatar;

[0047] Alternatively, send the information to be sent to the target object that matches it through an email or a chat tool.

[0048] An electronic whiteboard provided by an embodiment of the present disclosure includes:

[0049] A memory and a processor;

[0050] The processor is used to execute the interaction method of the above terminal provided by the embodiments of the present disclosure.

[0051] A computer non-transitory readable storage medium provided by the embodiments of the present disclosure includes a memory for storing instructions, which, when executed by a processor, cause the device including the readable storage medium to complete the interaction method of the above terminal provided by the embodiments of the present disclosure. Description of the Drawings

[0052] To more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0053] Figure 1 It is a schematic diagram of an interaction method of a terminal provided by the embodiments of the present disclosure;

[0054] Figure 2 It is a schematic diagram of an electronic whiteboard provided by the embodiments of the present disclosure;

[0055] Figure 3 It is a schematic diagram of another electronic whiteboard provided by the embodiments of the present disclosure;

[0056] Figure 4 It is a schematic diagram of another interaction method of a terminal provided by the embodiments of the present disclosure;

[0057] Figure 5 It is a schematic diagram of an electronic whiteboard provided by the embodiments of the present disclosure. Detailed Embodiments

[0058] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following clearly and completely describes the technical solutions of the embodiments of the present application with reference to the drawings of the embodiments of the present application. Obviously, the described embodiments are some, rather than all, of the embodiments of the present application. And without conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. Based on the described embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present application.

[0059] Unless otherwise defined, the technical terms or scientific terms used in this application shall have the ordinary meanings as understood by those of ordinary skill in the art to which this application pertains. The terms "first", "second" and similar terms used in this application do not denote any order, quantity or importance, but are only used to distinguish different components. Words such as "including" or "comprising" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. Words such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

[0060] It should be noted that the sizes and shapes of the various figures in the drawings do not reflect the true scale, and the purpose is only to schematically illustrate the content of this application. Also, the same or similar reference numerals throughout denote the same or similar elements or elements having the same or similar functions.

[0061] An embodiment of this application provides an interaction method for a terminal. The terminal includes at least one electronic whiteboard. Among them, as Figure 1 shown, the method includes:

[0062] S101. Identify and obtain the information recorded on the electronic whiteboard;

[0063] S102. Obtain the information to be sent according to the obtained information;

[0064] S103. Send the information to be sent to the target object according to the user operation instruction.

[0065] The interaction method for the terminal provided by the embodiment of this disclosure obtains the information recorded on the electronic whiteboard, generates the information to be sent according to the obtained text information, and then sends the information to be sent to the target object according to the user operation instruction, so that the interaction between the user and the terminal is flexible, and the degree of intelligence of the interaction between the user and the terminal is high, which can improve the user experience.

[0066] It should be noted that the terminal provided by the embodiment of this disclosure can be applied to, for example, a meeting scenario. Specifically, the information to be sent can be a meeting minutes. The meeting minutes can include, for example, at least one to-do item. Of course, the terminal provided by the embodiment of this disclosure can also be applied to a brainstorming scenario, and the information to be sent can include the ideas of each participant. Of course, the terminal provided by the embodiment of this disclosure can also be applied to a teaching scenario, and the information to be sent can be, for example, teaching notes.

[0067] It should be noted that an electronic whiteboard is a display device with a touch module. The electronic whiteboard can have functions such as display, writing, recording, and sharing. For example, the electronic whiteboard can display pictures, slides (PPTs), or other documents prepared in advance by the user. The user can also write on the electronic whiteboard. Specifically, the user can write independently of the displayed information or make annotations on the displayed information. In the current interaction scenario, at the start of an activity, the user can also trigger the recording function of the electronic whiteboard, so as to record the audio or video of the current activity. In the current interaction scenario, when multiple electronic whiteboards are included, the electronic whiteboards can, for example, establish a communication connection wirelessly, such as through a wireless local area network connection, a Wi-Fi connection, etc., to enable real-time interaction among the participants in the current interaction scenario.

[0068] In some embodiments, the information recorded by the electronic whiteboard includes at least one of the following:

[0069] The text information displayed on the electronic whiteboard, the written text information in the writing area of the electronic whiteboard, and the voice information of the current interaction scenario.

[0070] In some embodiments, the written text information, for example, includes text, doodles, etc. Doodles, for example, include information such as circles, underlines, symbols, etc.

[0071] It should be noted that in specific implementations, the information recorded by the electronic whiteboard in different interaction scenarios may be different. For a certain interaction scenario, in addition to displaying and writing, the electronic whiteboard can also trigger the recording function to obtain the text information displayed on the electronic whiteboard, the written text information in the writing area of the electronic whiteboard, and the voice information of the current interaction scenario, so as to avoid missing other important types of information when only obtaining a single type of information. For example, obtaining voice information can avoid missing important information that is not recorded in the displayed text information and the written text information.

[0072] In some embodiments, where, as Figure 2 shown, the writing area of the electronic whiteboard 1 includes: the writing interface 2 of the electronic whiteboard or at least one sticky note interface 3 established on the writing interface 2;

[0073] Identifying and obtaining the written text information in the writing area of the electronic whiteboard specifically includes:

[0074] Identifying and obtaining the written text information recorded by the writing interface and the written text information recorded by the sticky note interface.

[0075] Of course, if the user does not create a label on the writing interface, that is, when only the writing interface includes written text information, directly obtain the written text information recorded by the writing interface.

[0076] In some embodiments, obtaining the written text information recorded in the sticky note interface specifically includes any of the following methods:

[0077] Method 1:

[0078] Embed the written text information recorded in different layers of the sticky note interface into the writing interface.

[0079] Method 2:

[0080] According to the user's operation instruction, embed the written text information recorded in the layer specified by the user in the sticky note interface into the writing interface.

[0081] It should be noted that when the user writes information on the electronic whiteboard and creates a sticky note interface in the writing interface, the sticky note interface can include multiple layers, and the information generated at different time periods will be automatically divided into different layers. For example, if the time interval between the generation of information exceeds 2 minutes, the newly generated information will generate a new layer.

[0082] In some embodiments, according to the user's operation instruction, embed the written text information recorded in the layer of the specified sticky note into the writing interface area. For example, the written text information recorded in a certain layer specified by the user can be embedded into the writing interface area.

[0083] It should be noted that the user's operations on the sticky note include generating a new sticky note, copying the sticky note, deleting, combining, etc.; specifically, an existing label can be divided into two sticky notes by gesture cutting, and the text to be copied can be circled by drawing a circle, and then a new sticky note can be copied for the circled text.

[0084] In some embodiments, in step S102, according to the obtained information, obtain the information to be sent, specifically including:

[0085] S1021. Group the obtained information to obtain at least one information group;

[0086] S1022. Obtain the information to be sent including at least one information group.

[0087] The interaction method of the terminal provided by the embodiments of the present disclosure can automatically classify and group the obtained information to obtain the information to be sent, thereby improving the intelligence level of the collation of the information to be sent and further enhancing the user experience.

[0088] In some embodiments, grouping the obtained information specifically includes:

[0089] Select at least part of the text information in the information displayed on the electronic whiteboard as an information group according to the user's operation instruction.

[0090] In specific implementation, the user operation instruction can be, for example, an operation where the user uses a rectangular box to mark out part of the information displayed on the electronic whiteboard. The content marked out by the rectangular box is used as the information to be sent. Subsequently, the content marked out by the rectangular box can be directly sent to the target object. Of course, the user operation instruction can also be an operation of drawing a line for marking, or an operation of associating information with an arrow or other images and symbols. That is, in the interaction method of the terminal provided by the embodiments of the present disclosure, the user can manually group the acquired information.

[0091] In some embodiments, when the acquired information includes text information, grouping the acquired information specifically includes:

[0092] Performing semantic analysis on the text information, and dividing the sentences with mutually related semantics in the text information into one information group.

[0093] In some embodiments, a machine learning method is used to process the text information, perform semantic analysis on the text information, and divide the sentences with mutually related semantics in the text information into one information group. That is, in the interaction method of the terminal provided by the embodiments of the present disclosure, a machine learning method can be used to automatically group the acquired information.

[0094] In specific implementation, the machine learning method can be, for example, a deep learning method. Performing semantic analysis on the text information, and dividing the sentences with mutually related semantics in the text information into one information group specifically includes:

[0095] Using the deep learning method to process the text information, performing semantic analysis on the text information and dividing all the text information into multiple sentences, and using a text classification model to process each sentence, and dividing the sentences with mutually related semantics into one information group.

[0096] In some embodiments, when the acquired information includes voice information, before grouping the acquired information, the method further includes:

[0097] Converting the voice information into text information.

[0098] In specific implementation, for example, a machine learning method can be used to process the voice information and convert the voice information into text information.

[0099] In specific implementation, for example, a deep learning method can be used to process the voice information. Specifically, signal processing is performed on the voice information, and the information subjected to signal processing is decoded by a decoder based on an acoustic model and a language model to obtain text information, thereby realizing the conversion of voice information into text information. After converting the voice information into text information, the deep learning method can still be used to process the text information.

[0100] In some embodiments, when the acquired information only includes voice information, the acquired information is grouped, specifically including:

[0101] Perform semantic analysis on the text information;

[0102] Divide the sentences in the text information with semantically related meanings into one information group.

[0103] In some embodiments, performing semantic analysis on the text information specifically includes: processing the text information using a machine learning method to perform semantic analysis on the text information.

[0104] In some embodiments, when the acquired information includes both text information and voice information, perform semantic analysis on the text information, and divide the sentences in the text information with semantically related meanings into one information group, specifically including:

[0105] Use a machine learning method to process the acquired text information and the text information converted from the voice information, perform semantic analysis on the acquired text information and the text information converted from the voice information, merge the sentences with the same semantics in the acquired text information and the text information converted from the voice information into one sentence, and divide the sentences in the text information with semantically related meanings into one information group.

[0106] It should be noted that in the voice information of the current interaction scenario, there may be voice information corresponding to the directly acquired text information, and there may also be voice information different from the directly acquired text information. For example, when the current interaction scenario is a meeting scenario, there may be a situation where the to-do items displayed on the electronic whiteboard are dictated, or there may be a situation where tasks not displayed on the electronic whiteboard are verbally conveyed. Organizing the directly acquired text information and the text information converted from the voice information can avoid the loss of important information. When there is voice information corresponding to the directly acquired text information, the directly acquired text information and the voice information with a corresponding relationship can be integrated to avoid duplicate information in the information to be sent. When there is voice information different from the directly acquired text information, the interaction method of the terminal provided by the embodiments of the present disclosure can obtain the most complete information to be sent corresponding to the previous interaction scenario by organizing the directly acquired text information and the voice information. In some embodiments, when the acquired information includes handwritten text information, grouping the acquired information further includes:

[0107] Use handwriting recognition to process the handwritten text information, and form a group of information from the sentences with the same handwriting in the handwritten text information.

[0108] In specific implementation, handwriting recognition can adopt machine learning methods, for example, deep learning methods. In the current application scenario, when a user writes on an electronic whiteboard, the terminal records the user's handwriting and inputs the notes into a preset note recognition model. After grouping the sentences with the same handwriting in the interaction scenario into an information group, the handwriting of the information group is matched with the recorded handwriting to determine the user corresponding to each information group. For example, in a brainstorming scenario, determining the user corresponding to each information group can determine the person in charge of each idea.

[0109] In some embodiments, when the writing area of the electronic whiteboard includes a sticky note interface, the interaction method of the terminal further includes: obtaining the association information between the sticky note interfaces;

[0110] Grouping the obtained information specifically includes:

[0111] Grouping the information in the sticky note interfaces with established associations into an information group.

[0112] The association between sticky note interfaces can be established in the form of a mind map. In this way, when a new sticky note is created, the relationship with the previously created sticky notes will be displayed, and the association information between the sticky notes can be obtained while detecting and obtaining the information recorded by the electronic whiteboard.

[0113] In some embodiments, when the information to be sent includes multiple information groups, after obtaining the information to be sent including the information groups, the interaction method of the terminal further includes:

[0114] Determining the importance level of each information group;

[0115] Sorting the multiple information groups in descending order of importance level.

[0116] The interaction method of the terminal provided by the embodiments of the present disclosure can sort the importance levels of the information to be sent. Subsequently, the sorted information can be sent to the target object. Especially for a meeting scenario, when each information group corresponds to a to-do item, sending the to-do items sorted according to the importance level to the target object allows the target object to clearly understand the importance of each to-do item and arrange the schedule according to the importance level.

[0117] In specific implementation, determine the importance level of each group of information. For example, the number of preset keywords included in each group of information can be identified. The more preset keywords in each group of information, the higher the importance level of this group of information. In specific implementation, a keyword library matching the interaction scenario can be preset for the specific interaction scenario. Or, machine learning methods can be used to process the voice information to obtain the tone information corresponding to the voice information, and according to the magnitude of the tone of the voice information, determine the importance level of the group of information corresponding to the voice information; among them, the greater the tone of the voice information, the higher the importance level of the group of information corresponding to the voice information. The tones of the voice information corresponding to each statement in each group of information can be sorted. It is also possible to identify whether the voice information corresponding to each statement includes keywords and sort the tones of the keywords. Or, it is also possible to identify whether the statements in the group of information include emphasis marks, and the importance level of the group of information including emphasis marks is higher than that of the group of information not including emphasis marks. In specific implementation, the emphasis mark can be, for example, an emphasis symbol or an underline, etc.

[0118] In some embodiments, step S103 sends the information to be sent to the target object according to the user operation instruction, which specifically includes:

[0119] S1031. Determine at least one target object;

[0120] S1032. Send at least one group of information to at least one target object according to the user operation instruction.

[0121] In some embodiments, step S1031 determines at least one target object, which specifically includes:

[0122] Take all the participants in the current interaction scenario as the target objects;

[0123] Or, determine the target object corresponding to the information to be sent from all the participants in the current interaction scenario.

[0124] It should be noted that for the current interaction scenario, for example, the participants in the current interaction scenario can be added by means of obtaining through email, adding user names, scanning QR codes, etc. In specific implementation, the information to be sent needs to be sent to at least one of the participants in the current interaction scenario, that is, the participants in the current interaction scenario include the target objects corresponding to the groups of information to be sent.

[0125] In specific implementation, all the information to be sent can be sent to all the participants in the current interaction scenario. Or, the target objects can be determined among all the participants in the current interaction scenario, that is, all the information to be sent can be sent to some of the participants in the current interaction scenario. Or, the responsible object is determined among all the participants in the current interaction scenario, and the information in the information to be sent that matches it is sent to the responsible object.

[0126] In specific implementation, for a meeting scenario, the target object can be, for example, the department head among the participants. For a brainstorming scenario, the target object can be the person in charge corresponding to each idea. For a teaching scenario, the target object can be each student participating in the teaching activity.

[0127] In some embodiments, step S1032 determines the target object corresponding to the information to be sent from all the participants in the current interaction scenario, specifically including:

[0128] Select the target object corresponding to the information to be sent according to the user operation instruction.

[0129] In some embodiments, the project leader can be used as the target object, and the user can send the information of each information group in the information to be sent to the corresponding person in charge respectively. In some embodiments, the user can also judge the target object corresponding to the information to be sent. In specific implementation, when the user selects the text information in at least part of the information displayed on the electronic whiteboard as an information group, the user can determine the target object corresponding to the information group and send the information to the target object.

[0130] Alternatively, in some embodiments, step S1032 determines the target object corresponding to the information to be sent from all the participants in the current interaction scenario, specifically including:

[0131] Process the information to be sent to determine the target object matching the information to be sent.

[0132] In specific implementation, a machine learning method can be used to process the information to be sent to determine the target object matching the information to be sent. The machine learning method is, for example, a deep learning method.

[0133] The interaction method of the terminal provided by the embodiments of the present disclosure can automatically match the information to be sent with the target object, further improving the intelligence level of the interaction of the terminal and further enhancing the user experience.

[0134] In some embodiments, processing the information to be sent to determine the responsible object matching the information to be sent specifically includes:

[0135] Use a machine learning method to process the information to be sent to identify whether the information to be sent includes a responsible object. When the information to be sent includes a responsible object, determine the responsible object corresponding to the information to be sent and use the responsible object as the target object.

[0136] Taking the current interaction scenario as a meeting scenario as an example, the information to be sent may include task information and information about the responsible object corresponding to the task information. The information about the responsible object may be, for example, name information. In specific implementation, when it is recognized by a machine learning method that the information to be sent includes the name information of the current participant, the responsible object of the information to be sent can be determined.

[0137] Alternatively, in some embodiments, determining the responsible object matching the information to be sent specifically includes:

[0138] According to the responsible matters and proficient businesses of all participants in the preset current interaction scenario, using a machine learning method to process the information to be sent, determining the responsible matters and proficient businesses matching the information to be sent, and determining the responsible object matching the information to be sent, and taking the responsible object as the target object.

[0139] In specific implementation, for example, a deep learning method can be used to process the information to be sent, perform semantic parsing on the information to be sent, determine the responsible matters and proficient businesses matching the information to be sent, so as to determine the responsible object matching the information to be sent.

[0140] The interaction method of the terminal provided by the embodiments of the present disclosure can automatically match the target object of the information to be sent according to the responsible matters and proficient businesses of the pre-recorded participants. In this way, the information to be sent can be automatically matched with the responsible matters and proficient businesses of the target object according to the preset rules, further improving the intelligent level of the interaction of the terminal and further enhancing the user experience.

[0141] In specific implementation, the target object matching each information group in the information to be sent can be determined.

[0142] In some embodiments, as Figure 3 shown, the electronic whiteboard further includes: a user information area 4. The user information area includes a user avatar. According to the user operation instruction, sending the information to be sent matching the target object to the target object specifically includes any of the following methods:

[0143] Method 1:

[0144] Drag the information to be sent to the user avatar of the target object matching it to send the information to be sent to the target object corresponding to the user avatar.

[0145] Method 2:

[0146] Send the information to be sent to the target object matching it through an email or a chat tool.

[0147] It should be noted that for the current interaction scenario, after adding the participants of the current interaction scenario, the information of the participants can be obtained. The information of the participants can include, for example, the participant username, the participant email, or other contact information, and the avatars of the participants in the current interaction scenario can be displayed in the user information area of the electronic whiteboard. In some embodiments, the electronic whiteboard can also include an email software or other chat software, and the electronic whiteboard software can be associated with the email software or other chat software, so that the information to be sent can be sent to the matching target object through the email or chat tool.

[0148] In specific implementation, the user operation instruction can be, for example, the operation of the user dragging the information to be sent. The user operation instruction can also be that the user triggers the activity end operation, and when the user triggers the activity end operation, the information to be sent is sent to the matching target object through the email or chat tool.

[0149] In specific implementation, when the information obtained is manually grouped by the user, after selecting the text information in at least part of the information displayed on the electronic whiteboard as an information group according to the user operation instruction, the user can directly drag the selected text information to the user avatar of the target object matching the information, so as to send the selected information to the matching target object. Of course, the selected text information can also be sent to the matching target object through the email or chat tool.

[0150] In specific implementation, when the information obtained is automatically grouped and the information to be sent is automatically matched with the target object, the user can drag the information to be sent to the user avatar of the target object matching the information, so as to send the information to be sent to the matching target object. Of course, the information to be sent can also be sent to the matching target object through the email or chat tool.

[0151] In some embodiments, before identifying and obtaining the information recorded on the electronic whiteboard, it further includes:

[0152] According to the preset time arrangement, set the duration corresponding to each activity of the current interaction scenario;

[0153] At the start time of the activity and when the remaining duration of the activity is less than the preset value, trigger an activity reminder.

[0154] The interaction method of the terminal provided by the embodiments of the present disclosure can set activity reminders according to the duration corresponding to each activity of the interaction scenario, which can improve the activity efficiency.

[0155] In specific implementation, the electronic whiteboard can also have a countdown function. Triggering the activity reminder can, for example, trigger a countdown at the start of the activity, and set reminders to be triggered at the start time and when it is about to end of the countdown.

[0156] In some embodiments, it further includes:

[0157] Identifying whether the information to be sent includes time information;

[0158] When the information to be sent includes time information, when the target object receives the information to be sent, the time information and the information corresponding to the time information are synchronized to the schedule module in the terminal.

[0159] In this way, the schedule software can remind the user according to the time information. For example, when the information sent to the user includes task information, the user can be reminded to complete the task as soon as possible before the time information corresponding to the task information.

[0160] Next, taking the interaction scenario as a meeting scenario as an example, the interaction method of the terminal provided by the embodiments of the present disclosure will be illustrated. As Figure 4 shown, the interaction method of the terminal includes the following steps:

[0161] S201. Conduct each activity in the meeting in sequence;

[0162] During the meeting, relevant meeting information can be displayed on the electronic whiteboard. Participants can write relevant meeting information on the electronic whiteboard and can also trigger the recording function of the electronic whiteboard to record the meeting; specifically, participants can directly write meeting information on the writing board of the electronic whiteboard, or create a sticky note on the writing board and write meeting information on the sticky note; when participants create multiple sticky notes, they can also establish associations between the sticky notes;

[0163] S202. Identify and obtain the meeting information recorded on the electronic whiteboard;

[0164] S203. Group different sentences in the meeting information, and each group corresponds to a to-do item;

[0165] Specifically, different sentences in the meeting information can be grouped according to the degree of semantic association, the degree of association between handwriting, whether association information is established between sticky notes, etc., or the user can manually divide some content in the meeting information into a to-do item; specifically, when the obtained information includes the correspondence between time information and text information, the time information of the to-do item is determined according to the correspondence between time information and text information;

[0166] S204. Sort the importance levels of each to-do item;

[0167] S205. Obtain a meeting minutes including the sorted to-do items;

[0168] S206. Determine the target object matching the meeting minutes to be sent;

[0169] Specifically, all participants in the current meeting scenario can be used as the target objects; alternatively, some participants in the current meeting scenario can be used as the target objects. Specifically, the user can determine the target objects that match the specific content of the to-do items in the meeting minutes, or use machine learning methods to identify the names of the participants in the to-do items. Machine learning methods can also be used to match the to-do items with the responsible matters and proficient businesses of the participants to determine the target objects that match the to-do items.

[0170] S207. Drag the to-do items in the meeting minutes that match the target objects to their user avatars and send the to-do items; or send the to-do items that match the target objects through email or chat software.

[0171] When the time information of the to-do items is included in the meeting minutes received by the target objects, synchronize the time information of the to-do items to the schedule of the target objects' terminals to remind the users to complete the to-do items on time.

[0172] Based on the same inventive concept, an embodiment of the present disclosure further provides an electronic whiteboard, as Figure 5 shown, including:

[0173] A memory 01 and a processor 02;

[0174] The processor is used to execute the above-mentioned interaction method of the terminal provided by the embodiment of the present disclosure.

[0175] In some embodiments, the processor may specifically be a central processing unit or an application specific integrated circuit (ASIC), and may be one or more integrated circuits for controlling program execution.

[0176] In some embodiments, the memory may include a read only memory (ROM), a random access memory (RAM), and a disk memory. The memory is used to store the data required for the processor to run, that is, a computer program that can be executed by the processor is stored. The processor executes the computer program stored in the memory to execute the above-mentioned interaction method of the terminal provided by the embodiment of the present disclosure. Among them, the number of memories is one or more, and the number of processors is one or more.

[0177] An embodiment of the present disclosure further provides a computer non-transitory readable storage medium, which includes a memory. The memory is used to store instructions. When the instructions are executed by the processor, the device including the readable storage medium completes the above-mentioned interaction method provided by the embodiment of the present disclosure.

[0178] The interactive method, electronic whiteboard, and computer non-transitory readable storage medium provided by the embodiments of the present disclosure obtain the information recorded by the electronic whiteboard, organize the obtained text information to generate the information to be sent, and then send the information to be sent to the target object according to the user operation instruction, so that the interaction between the user and the terminal is flexible, the degree of intelligence of the interaction between the user and the terminal is high, and the user experience can be improved.

[0179] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0180] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram can be implemented by computer program instructions, and the combination of processes and / or blocks in the flowchart and / or block diagram can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the specified functions in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0181] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured product including an instruction device, and the instruction device implements the specified functions in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0182] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the specified functions in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0183] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to include these modifications and variations.

Claims

1. An interaction method for a terminal, where the terminal includes at least one electronic whiteboard, wherein, the method includes: Identifying and obtaining the information recorded by the electronic whiteboard; the information at least includes the text information written in the writing area; the writing area includes: the writing interface of the electronic whiteboard or at least one sticky note interface established on the writing interface; Grouping the obtained information to obtain at least one information group; Obtaining a to-be-sent information including at least one of the information groups, and sending the to-be-sent information to a target object according to a user operation instruction; wherein, grouping the obtained information specifically includes: When the obtained information is the written text information, using handwriting recognition to process the written text information, and forming a group of information with the sentences having the same handwriting in the written text information; When the writing area includes the sticky note interface, constructing the association relationship between the sticky note interfaces with a mind map, and forming a group of information with the information recorded in the sticky note interfaces having an association relationship.

2. The method according to claim 1, wherein, the information recorded by the electronic whiteboard further includes at least one of the following: the text information displayed on the electronic whiteboard, voice information.

3. The method according to claim 2, wherein, Identifying and obtaining the written text information in the writing area of the electronic whiteboard specifically includes: Identifying and obtaining the written text information recorded in the writing interface or the written text information recorded in the sticky note.

4. The method according to claim 1, wherein, Grouping the obtained information specifically includes: Selecting, according to a user operation instruction, at least part of the text information in the information displayed on the electronic whiteboard as an information group.

5. The method according to claim 1, wherein, When the identified information includes text information, grouping the obtained information specifically includes: Performing semantic parsing on the text information, and dividing the sentences with mutually related semantics in the text information into one information group.

6. The method according to claim 1, wherein, When the obtained information further includes voice information, before grouping the obtained information, the method further includes: Converting the voice information into text information; Performing semantic parsing on the text information, and dividing the sentences with mutually related semantics in the text information into one information group, specifically including: Using a machine learning method to process the obtained text information and the text information converted from the voice information, performing semantic parsing on the obtained text information and the text information converted from the voice information, merging the sentences with the same semantics in the obtained text information and the text information converted from the voice information into one sentence, and dividing the sentences with mutually related semantics in the text information into one information group.

7. The method according to claim 1, wherein, When the obtained information only includes voice information, grouping the obtained information specifically includes: Converting the voice information into text information; Performing semantic parsing on the text information, and dividing the sentences with mutually related semantics in the text information into one information group.

8. The method according to claim 1, wherein, the information to be sent includes a plurality of information groups. After obtaining the information to be sent including the information groups, the method further includes: determining the importance level of each group of information groups; sorting the multiple groups of information groups in descending order according to the importance level.

9. The method according to any one of claims 1 to 8, wherein, sending the information to be sent to the target object according to the user operation instruction specifically includes: determining at least one of the target objects; sending at least one information group to at least one of the target objects according to the user operation instruction.

10. The method according to claim 9, wherein, determining at least one of the target objects specifically includes: taking all the participants in the current interaction scenario as the target objects; or, determining the target objects corresponding to the information to be sent from all the participants in the current interaction scenario.

11. The method according to claim 10, wherein, determining the target objects corresponding to the information to be sent from all the participants in the current interaction scenario specifically includes: selecting the target objects corresponding to the information to be sent according to the user operation instruction; or, processing the information to be sent to determine the target objects matching the information to be sent.

12. The method according to claim 9, wherein, the electronic whiteboard further includes: a user information area, and the user information area includes user avatars. Sending the information to be sent matching the target object to the target object according to the user operation instruction specifically includes: dragging the information to be sent to the user avatar of the target object matching it to send the information to be sent to the target object corresponding to the user avatar; or, sending the information to be sent to the target object matching it through an email or a chat tool.

13. An electronic whiteboard, wherein, comprising: a memory and a processor; the processor is configured to execute the method according to any one of claims 1 - 12.

14. A computer non - transient readable storage medium, wherein, comprising a memory, and the memory is used for storing instructions. When the instructions are executed by a processor, it enables the device including the readable storage medium to complete the method according to any one of claims 1 - 12.

Images