Tablet computer with intelligent interaction assistant and interaction control method thereof

Abstract

The invention provides a tablet computer with an intelligent interaction assistant and an interaction control method thereof, and the method comprises the steps: displaying the intelligent interaction assistant in a user interaction interface, monitoring and recording an operation gesture of a user on a touch screen, and responding to a response instruction executed by an operation system or an application program in response to the operation gesture, the method comprises the following steps: generating a first operation gesture sequence and a first response instruction sequence with an association relationship by taking time as an association element, analyzing the first operation gesture sequence and the first response instruction sequence to determine whether corresponding convenient operation exists or not, and when the corresponding convenient operation exists, sending an interaction suggestion through an intelligent interaction assistant, a user can easily learn and receive differentiated interaction modes, and the learning cost of the user is not increased too much.

Description

Technical Field

[0001] The present invention relates to the technical field of interaction of intelligent terminals, and in particular to a tablet computer with an intelligent interaction assistant and an interaction control method thereof. Background Art

[0002] Beyond screen size, tablets and smartphones share significant similarities in hardware, operating systems, and applications. Consequently, their user interaction methods are also very similar, making them very easy to use for frequent smartphone users. However, precisely because of this difference in screen size, operating a tablet using smartphone-style methods is often inconvenient. To enhance the user experience, manufacturers often incorporate additional, larger-screen interaction methods beyond the native operating system. However, to differentiate their products, tablet interaction methods across different brands are not universal. This means that different tablet brands often differ in their interaction methods, increasing the learning curve and making it more difficult for new users to get started. While many products offer step-by-step user guides for first-time users, these only cover simple, basic operations and are inadequate for tablets with a wide range of different interaction methods. Lengthy tutorials often wear down users' patience and cause discomfort. Therefore, finding a way to differentiate tablet interaction methods that enhances the user experience without excessively increasing the learning curve remains a pressing issue. Summary of the Invention

[0003] It is based on the above problems that the present invention proposes a tablet computer with an intelligent interactive assistant and an interactive control method thereof, which can allow users to easily learn and accept differentiated interactive methods without excessively increasing the user's learning cost.

[0004] In view of this, a first aspect of the present invention provides a tablet computer with an intelligent interactive assistant, comprising: An interactive assistant display module, used to display the intelligent interactive assistant in the user interaction interface; An operation gesture monitoring module is used to monitor and record the user's operation gestures on the touch screen, as well as the response instructions executed by the operating system or application in response to the operation gestures; A first sequence generating module, configured to generate a first operation gesture sequence and a first response instruction sequence having an associated relationship with time as an associated element; a convenient operation analysis module, configured to analyze the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists; The interaction suggestion display module is used to issue interaction suggestions through the intelligent interaction assistant when there is a corresponding convenient operation.

[0005] A second aspect of the present invention provides a method for controlling a tablet computer with an intelligent interactive assistant, comprising: Displaying an intelligent interactive assistant in the user interface; Monitor and record user gestures on the touch screen, as well as the response instructions executed by the operating system or application in response to the gestures; Generate a first operation gesture sequence and a first response instruction sequence with an associated relationship using time as an associated factor; Analyzing the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists; When there is a corresponding convenient operation, an interaction suggestion is issued through the intelligent interaction assistant.

[0006] Furthermore, the step of analyzing the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists specifically includes: identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention, wherein the operation type includes an independent operation and a series operation; When the last operation gesture in the first operation gesture sequence is a series of operations, generating the series of operations sequence to which the last operation gesture belongs; Read the pre-configured convenient operation gesture correspondence table; Matching the series of operation sequences with a second operation gesture sequence in the convenient operation gesture correspondence table; Determining whether a second operation gesture sequence of any convenient operation gesture matches the series of operation sequences; When a second operation gesture sequence of an operation gesture sequence of any convenient operation gesture matches the series of operation sequences, it is determined that a convenient operation corresponding to the first operation gesture sequence and the first response instruction sequence exists.

[0007] Furthermore, the step of identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention specifically includes: Read the pre-configured operation intention correspondence table; Matching the first response instruction sequence with a third response instruction sequence in the operation intention correspondence table; Determining whether any third operation gesture sequence of operation intention matches the first response instruction sequence; When there is a third response instruction sequence of any operation intention that matches the first response instruction sequence, determining that the last operation gesture in the first operation gesture sequence is a series operation; Otherwise, it is determined that the last operation gesture in the first operation gesture sequence is an independent operation.

[0008] Furthermore, the step of matching the first response instruction sequence with the third response instruction sequence in the operation intention correspondence table specifically includes: Get the pre-configured sequence matching instruction number threshold ; Sequentially traverse each operation intention in the operation intention correspondence table; Determine the traversed operation intention as the target operation intention; Obtain the number of response instructions in the third response instruction sequence of the target operation intention ; Taken from the end of the first response instruction sequence The subsequences are respectively compared with the third response instruction sequence of the target operation intention; When intercepted from the end of the first response instruction sequence When any one of the subsequences matches the third response instruction sequence of the target operation intention, it is determined that the third response instruction sequence of the target operation intention matches the first response instruction sequence.

[0009] Further, intercepting from the end of the first response instruction sequence The step of comparing the subsequences with the third response instruction sequence of the target operation intention respectively includes: Initialize the count variable ; Taken from the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The response instruction in the subsequence is combined with the first response instruction in the third response instruction sequence Compare consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence A subsequence is constructed by using a continuous response instruction and the response instruction in the subsequence is combined with the first response instruction of the third response instruction sequence. A step of comparing consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the three consecutive response instructions are completely consistent, it is determined that the subsequence matches the third response instruction sequence of the target operation intention.

[0010] Further, the response instruction in the subsequence is combined with the first The steps of comparing consecutive response instructions specifically include: The same value is used to compare the subsequence and the first part of the third response instruction sequence. The consecutive response instructions are numbered; Combine the subsequence with the first part of the third response instruction sequence The response instructions with the same number in the consecutive response instructions are compared.

[0011] Furthermore, the step of generating the series of operation sequences to which the last operation gesture belongs specifically includes: When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the consecutive response instructions are completely consistent, the subsequence is determined as the series of operation sequences to which the last operation gesture belongs.

[0012] Furthermore, the step of determining whether a second operation gesture sequence of an operation gesture sequence of any convenient operation gesture matches the series of operation sequences specifically includes: Sequentially traverse each convenient gesture in the convenient operation gesture correspondence table; Determine the traversed convenient gestures as target convenient gestures; Obtain the number of response instructions in the second response instruction sequence corresponding to the second operation gesture sequence of the target convenient gesture ; Taken from the end of the first response instruction sequence subsequences are compared with the second response instruction sequence respectively; When intercepted from the end of the first response instruction sequence When any one of the subsequences matches the second response instruction sequence, it is determined that the second response instruction sequence of the target convenient gesture matches the series of operation sequences.

[0013] Furthermore, the step of issuing interaction suggestions through the intelligent interaction assistant specifically includes: generating a fourth response instruction sequence corresponding to the series of operation sequences; Determining, based on the fourth response instruction sequence, whether the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence; When the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence, the corresponding convenient operation gesture sequence is displayed through the intelligent interaction assistant.

[0014] The present invention proposes a tablet computer with an intelligent interaction assistant and an interaction control method thereof. The intelligent interaction assistant is displayed in a user interaction interface, the user's operation gestures on the touch screen, and the response instructions executed by the operating system or application in response to the operation gestures are monitored and recorded, a first operation gesture sequence and a first response instruction sequence with an associated relationship are generated with time as the associated element, the first operation gesture sequence and the first response instruction sequence are analyzed to determine whether there is a corresponding convenient operation. When a corresponding convenient operation exists, interaction suggestions are issued through the intelligent interaction assistant, so that the user can easily learn and receive differentiated interaction methods without excessively increasing the user's learning cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a schematic block diagram of a tablet computer with an intelligent interactive assistant provided by one embodiment of the present invention; Figure 2 The present invention is a flowchart of a method for controlling a tablet computer with an intelligent interactive assistant provided by one embodiment of the present invention. DETAILED DESCRIPTION

[0016] In order to more clearly understand the above-mentioned objects, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the absence of conflict, the embodiments of the present application and the features therein can be combined with each other.

[0017] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the scope of protection of the present invention is not limited to the specific embodiments disclosed below.

[0018] In the description of the present invention, the term "plurality" refers to two or more. Unless otherwise specified, the terms "upper" and "lower" are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate and simplify the description of the present invention. They are not intended to indicate or imply that the devices or components referred to must have a specific orientation, be constructed, or operate in a specific manner. Therefore, they should not be construed as limiting the present invention. The terms "connected," "mounted," and "fixed," etc., should be interpreted broadly. For example, "connected" can refer to fixed, removable, or integral connections; directly or indirectly through an intermediary. A person of ordinary skill in the art will understand the specific meanings of these terms in the present invention based on the specific circumstances. Furthermore, the terms "first," "second," etc., etc., are used for descriptive purposes only and should not be construed to indicate or imply relative importance or to implicitly specify the number of the technical features indicated. Therefore, a feature designated "first," "second," etc., may explicitly or implicitly include one or more of such features. In the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0019] Throughout this specification, terms such as "one embodiment," "some implementations," and "specific examples" indicate that the specific features, structures, materials, or characteristics described in conjunction with that embodiment or example are included in at least one embodiment or example of the present invention. In this specification, schematic representations of these terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0020] The following describes a tablet computer with an intelligent interactive assistant and its interactive control method according to some embodiments of the present invention with reference to the accompanying drawings. like Figure 1 As shown, the first aspect of the present invention provides a tablet computer with an intelligent interactive assistant, comprising: An interactive assistant display module, used to display the intelligent interactive assistant in the user interaction interface; An operation gesture monitoring module is used to monitor and record the user's operation gestures on the touch screen, as well as the response instructions executed by the operating system or application in response to the operation gestures; A first sequence generating module, configured to generate a first operation gesture sequence and a first response instruction sequence having an associated relationship with time as an associated element; a convenient operation analysis module, configured to analyze the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists; The interaction suggestion display module is used to issue interaction suggestions through the intelligent interaction assistant when there is a corresponding convenient operation.

[0021] Specifically, the enable / disable switch of the intelligent interaction assistant function is configured in the settings menu of the tablet computer. After the switch is turned on, the user's operation gestures on the touch screen are monitored by the intelligent interaction assistant, and interaction suggestions are provided based on the user's operation gestures. Depending on the structure of the tablet computer, the intelligent interaction assistant can be presented in different forms. For example, for a tablet computer with a secondary screen, the intelligent interaction assistant can be displayed on the secondary screen. For a tablet computer without a secondary screen, the intelligent interaction assistant can be displayed in the top or bottom notification bar of the tablet computer's interactive interface, or the intelligent interaction assistant can be displayed as a floating icon on the top layer of the tablet computer's interactive interface.

[0022] In the technical solutions of some embodiments of the present invention, the first operation gesture sequence is composed of the operation gestures performed by the user on the touch screen of the tablet computer and their corresponding operation times; the first response instruction sequence is composed of the response instructions executed by the operating system or application in response to the operation gestures and their corresponding response times. Generating a first operation gesture sequence and a first response instruction sequence with an associated relationship using time as an associated element refers to establishing an associated relationship between each operation gesture in the first operation gesture sequence and each response instruction in the first response instruction sequence, as well as the operation time and response time in the sequence, that is, each operation gesture establishes a one-to-one correspondence with a response instruction having a response time that is the same as or similar to its operation time.

[0023] The convenient operation referred to in the present invention refers to an operation with fewer operation gestures or a shorter operation time than a non-convenient operation.

[0024] Furthermore, the convenient operation analysis module includes: an operation intention recognition module, configured to recognize the user's operation intention according to the first response instruction sequence, and determine the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention, wherein the operation type includes an independent operation and a series of operations; an operation sequence generating module, configured to generate, when the last operation gesture in the first operation gesture sequence is a series of operations, a series of operation sequences to which the last operation gesture belongs; A convenient operation correspondence reading module is used to read a pre-configured convenient operation gesture correspondence table; An operation sequence matching module, configured to match the series of operation sequences with a second operation gesture sequence in the convenient operation gesture correspondence table; a gesture matching result judgment module, configured to judge whether a second operation gesture sequence of any convenient operation gesture matches the series of operation sequences; The convenient operation determination module is used to determine whether there is a convenient operation corresponding to the first operation gesture sequence and the first response instruction sequence when a second operation gesture sequence of any convenient operation gesture matches the series of operation sequences.

[0025] Specifically, gestures can be divided into two types, independent operations and series operations, depending on the different operational intentions they correspond to. Independent operations refer to gestures that can independently complete an operational intention. That is, for independent operations, a single gesture can complete its operational intention, and has no or a weak correlation with the preceding and following gestures in terms of completing the operational intention. This correlation includes a temporal sequence and a correlation in terms of completing the operational intention. For example, if clicking the Bluetooth switch button is intended to turn the Bluetooth module on or off, then the single gesture of clicking the Bluetooth switch button completes its operational intention, and has no or a weak correlation with the preceding and following gestures in terms of completing the operational intention. Series operations refer to gestures that require the cooperation of preceding and / or following gestures to complete a single operational intention. That is, for a series operation, each gesture has a strong correlation with the preceding and / or following gestures in terms of operational intention, and they are performed in a certain temporal sequence to jointly complete a single operational intention. Taking text message sharing as an example, the user first selects a text message (depending on the application's operation method, this may be a long press or a click), calls up the operation menu (click the menu button), selects the sharing function (click the share menu item), selects the sharing channel (click the target application icon), and executes the sharing (click the send button).

[0026] It should be known that the operation type of an operation gesture is determined based on the operation intention. An operation gesture can be both an independent operation and a series of operations, not just one of them. An operation intention completed by a series of operations must be jointly realized by the operation intentions corresponding to multiple independent operations, that is, when an operation gesture is a series of operations, it is also an independent operation. Conversely, when an operation gesture is an independent operation, it is not necessarily a series of operations. In the technical solution of the present invention, when an operation gesture is both an independent operation and a series of operations, it is determined as a series of operations rather than an independent operation.

[0027] The series of operation sequences includes the last operation gesture in the first operation gesture sequence and several operation gestures before it, and also includes a response instruction corresponding to each operation gesture in the series of operation sequences.

[0028] The convenient operation gesture correspondence is a pre-configured data table that stores the correspondence between convenient operation gestures and non-convenient operation gestures. The convenient operation gesture correspondence table includes a convenient operation gesture sequence and at least one second operation gesture sequence. The convenient operation gesture correspondence table also includes a convenient operation response instruction sequence and a second response instruction sequence corresponding to the convenient operation gesture sequence and the second operation gesture sequence, respectively. It should be understood that the convenient operation gesture sequence can be an operation gesture sequence containing one or more operation gestures.

[0029] Furthermore, the operation intention recognition module includes: An operation intention correspondence relationship reading module is used to read a pre-configured operation intention correspondence relationship table; an instruction sequence matching module, configured to match the first response instruction sequence with a third response instruction sequence in the operation intention correspondence table; An instruction matching result judgment module, used to judge whether there is any third operation gesture sequence of the operation intention that matches the first response instruction sequence; a series operation determination module, configured to determine that the last operation gesture in the first operation gesture sequence is a series operation when a third response instruction sequence having any operation intention matches the first response instruction sequence; The independent operation determination module is configured to determine that the last operation gesture in the first operation gesture sequence is an independent operation when a third response instruction sequence in which no operation intention matches the first response instruction sequence.

[0030] The operation intention correspondence table is a preconfigured data table that stores the correspondence between operation intentions and response instruction sequences. The operation intention correspondence table includes a third response instruction sequence and its corresponding operation intention information. The operation intention information can be natural language text used to describe the operation intention, or a specific identifier with a one-to-one correspondence with the operation intention. The third response instruction sequence is a complete response instruction sequence that completes the corresponding operation intention.

[0031] Furthermore, the instruction sequence matching module includes: The instruction threshold acquisition module is used to obtain the pre-configured sequence matching instruction number threshold ; An operation intention traversal module, used for sequentially traversing each operation intention in the operation intention correspondence table; A target intention determination module is used to determine the traversed operation intention as the target operation intention; A first instruction quantity acquisition module is used to acquire the number of response instructions in the third response instruction sequence of the target operation intention ; A first subsequence comparison module is used to intercept the end of the first response instruction sequence The subsequences are respectively compared with the third response instruction sequence of the target operation intention; The first instruction matching result determination module is used to intercept the first response instruction sequence from the end When any one of the subsequences matches the third response instruction sequence of the target operation intention, it is determined that the third response instruction sequence of the target operation intention matches the first response instruction sequence.

[0032] Specifically, the first response instruction sequence intercepted Each subsequence is a response instruction sequence consisting of continuous response instructions intercepted from the end of the first response instruction sequence, The number of response instructions contained in each subsequence is different, ranging from to And all subsequences use the last response instruction at the end of the first response instruction sequence as the last response instruction at their end.

[0033] Preferably, the sequence matching instruction quantity threshold .

[0034] It should be known that It is a storage variable for the number of response instructions in the third response instruction sequence in the customized target operation intention, and its subscript It is only for the convenience of identifying that it corresponds to the third response instruction sequence, and does not have a specific numerical value or order meaning, that is, it does not necessarily exist. 、 or Of course, in the actual implementation process, you can use 、 to represent the number of response instructions in the first response instruction sequence and the second response instruction sequence.

[0035] Furthermore, the first subsequence comparison module includes: The first counting variable initialization module is used to initialize the counting variable ; A first subsequence building module is used to intercept from the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The first response instruction comparison module is used to compare the response instruction in the subsequence with the first response instruction in the third response instruction sequence. Compare consecutive response instructions; The first loop execution module is used to execute the first response instruction of the subsequence when the response instruction in the subsequence is the same as the first response instruction in the third response instruction sequence. When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence A subsequence is constructed by using a continuous response instruction and the response instruction in the subsequence is combined with the first response instruction of the third response instruction sequence. A step of comparing consecutive response instructions; The first subsequence comparison result determination module is used to determine the response instruction in the subsequence when the response instruction in the subsequence is the same as the first response instruction in the third response instruction sequence. When the three consecutive response instructions are completely consistent, it is determined that the subsequence matches the third response instruction sequence of the target operation intention.

[0036] With a As an example, the first response instruction sequence of the response instructions is numbered as follows: , then intercept from the end of the first response instruction sequence The step of constructing a subsequence of consecutive response instructions is specifically to convert the first response instruction sequence numbered The response instructions are extracted to construct the subsequence, and the order of each response instruction in the subsequence is consistent with its order in the first response instruction sequence.

[0037] Furthermore, the first subsequence comparison module further includes: The loop ending module is configured to end the loop and determine the last operation gesture of the first operation gesture sequence as a series of operations.

[0038] Furthermore, the first response instruction comparison module includes: The first response instruction numbering module is used to use the same value to identify the subsequence and the first part of the third response instruction sequence. The consecutive response instructions are numbered; The first response instruction comparison module is specifically configured to compare the subsequence with the first subsequence of the third response instruction sequence. The response instructions with the same number in the consecutive response instructions are compared.

[0039] In the technical solution of the above embodiment, the number of response instructions in the subsequence is Taking the numerical number as an integer number starting from 1 as an example, the subsequence The response instructions are numbered 1, 2, ..., , the first of the third response instruction sequence The consecutive response instructions are also numbered 1, 2, ..., , then the subsequence is combined with the first Comparing the response instructions with the same number in the consecutive response instructions is specifically comparing the response instruction numbered 1 in the subsequence with the response instruction numbered 1 in the third response instruction sequence, comparing the response instruction numbered 2 in the subsequence with the response instruction numbered 2 in the third response instruction sequence, and so on.

[0040] Before placing the third response command sequence After comparing each response instruction with the response instructions in the subsequence one by one, if the response instructions and instruction sequence of the two are exactly the same, then the two are determined to be completely consistent, thereby determining that the subsequence matches the third response instruction sequence of the target operation intention. Conversely, if any numbered response instruction in the two is different, then the two are determined to be not completely consistent, thereby determining that the subsequence does not match the third response instruction sequence of the target operation intention.

[0041] Furthermore, the operation sequence generation module is specifically configured to generate a response instruction in the subsequence and a preceding instruction in the third response instruction sequence. When the consecutive response instructions are completely consistent, the subsequence is determined as the series of operation sequences to which the last operation gesture belongs.

[0042] Specifically, in the operation intention correspondence table, the third response instruction sequence corresponding to each operation intention is the complete instruction sequence to complete the operation intention. However, corresponding to the first response instruction sequence, the last operation gesture in the first operation gesture sequence is not necessarily the last operation gesture to complete the operation intention. Therefore, when the last operation gesture in the first operation gesture sequence is a series of operations, the series of operation sequence it belongs to is not necessarily the complete instruction sequence to complete the operation intention, but rather a portion of the previous one.

[0043] Furthermore, the gesture matching result judgment module includes: A convenient gesture traversal module, used to sequentially traverse each convenient gesture in the convenient operation gesture correspondence table; A target gesture determination module, configured to determine the traversed convenient gestures as target convenient gestures; The second instruction quantity acquisition module is used to obtain the number of response instructions in the second response instruction sequence corresponding to the second operation gesture sequence of the target convenient gesture ; The second subsequence comparison module is used to intercept the end of the first response instruction sequence subsequences are compared with the second response instruction sequence respectively; The second instruction matching result determination module is used to intercept the first response instruction sequence from the end When any one of the subsequences matches the second response instruction sequence, it is determined that the second response instruction sequence of the target convenient gesture matches the series of operation sequences.

[0044] Furthermore, the second subsequence comparison module includes: The second counting variable initialization module is used to initialize the counting variable ; The second subsequence building module is used to intercept the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The second response instruction comparison module is used to compare the response instruction in the subsequence with the first response instruction sequence of the second response instruction sequence. Compare consecutive response instructions; The second loop execution module is used to execute the second response instruction sequence when the response instruction in the subsequence is the same as the first response instruction sequence. When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence A subsequence is constructed by using a continuous response instruction and the response instruction in the subsequence is combined with the first response instruction sequence of the second response instruction sequence. A step of comparing consecutive response instructions; The second subsequence comparison result determination module is used to determine the response instruction in the subsequence when the response instruction in the subsequence is the same as the first response instruction in the second response instruction sequence. When the two consecutive response instructions are completely consistent, it is determined that the subsequence matches the second response instruction sequence of the convenient operation.

[0045] Furthermore, the second response instruction comparison module includes: The second response instruction numbering module is used to use the same value to identify the subsequence and the first part of the second response instruction sequence. The consecutive response instructions are numbered; The second response instruction comparison module is specifically configured to compare the subsequence with the preceding subsequence of the second response instruction sequence. The response instructions with the same number in the consecutive response instructions are compared.

[0046] Furthermore, the interactive suggestion display module includes: a fourth response instruction sequence generating module, configured to generate a fourth response instruction sequence corresponding to the series of operation sequences; a complete instruction sequence determination module, configured to determine, based on the fourth response instruction sequence, whether the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence; The interaction suggestion display module is specifically used to display the corresponding convenient operation gesture sequence through the intelligent interaction assistant when the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence.

[0047] Specifically, when the last operation gesture in the first operation gesture sequence is a series of operations, the series of operation sequences to which it belongs must correspond to an operation intention in the operation intention correspondence table. Therefore, when the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence, it indicates that the user is in the process of completing the operation intention, but has not completed all operations of the operation intention. Conversely, when the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence, it indicates that the user has completed all operations of the operation intention.

[0048] Furthermore, the complete instruction sequence judgment module includes: a consistency determination module, configured to determine whether the fourth response instruction sequence is completely consistent with the third response instruction sequence corresponding to the operation intention in the operation intention correspondence table, where the term "complete consistency" includes the number and order of the response instructions being completely consistent; The complete instruction sequence judgment module is specifically configured to determine that the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence when the fourth response instruction sequence is completely consistent with the third response instruction sequence.

[0049] Furthermore, the interaction suggestion display module is also used to stop issuing repeated prompts when the user continues to perform operations according to the operation gestures in the second operation gesture sequence.

[0050] like Figure 2 As shown, the second aspect of the present invention provides a control method for a tablet computer with an intelligent interactive assistant, comprising: Displaying an intelligent interactive assistant in the user interface; Monitor and record user gestures on the touch screen, as well as the response instructions executed by the operating system or application in response to the gestures; Generate a first operation gesture sequence and a first response instruction sequence with an associated relationship using time as an associated factor; Analyzing the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists; When there is a corresponding convenient operation, an interaction suggestion is issued through the intelligent interaction assistant.

[0051] Specifically, the enable / disable switch of the intelligent interaction assistant function is configured in the settings menu of the tablet computer. After the switch is turned on, the user's operation gestures on the touch screen are monitored by the intelligent interaction assistant, and interaction suggestions are provided based on the user's operation gestures. Depending on the structure of the tablet computer, the intelligent interaction assistant can be presented in different forms. For example, for a tablet computer with a secondary screen, the intelligent interaction assistant can be displayed on the secondary screen. For a tablet computer without a secondary screen, the intelligent interaction assistant can be displayed in the top or bottom notification bar of the tablet computer's interactive interface, or the intelligent interaction assistant can be displayed as a floating icon on the top layer of the tablet computer's interactive interface.

[0052] In the technical solutions of some embodiments of the present invention, the first operation gesture sequence is composed of the operation gestures performed by the user on the touch screen of the tablet computer and their corresponding operation times; the first response instruction sequence is composed of the response instructions executed by the operating system or application in response to the operation gestures and their corresponding response times. Generating a first operation gesture sequence and a first response instruction sequence with an associated relationship using time as an associated element refers to establishing an associated relationship between each operation gesture in the first operation gesture sequence and each response instruction in the first response instruction sequence, as well as the operation time and response time in the sequence, that is, each operation gesture establishes a one-to-one correspondence with a response instruction having a response time that is the same as or similar to its operation time.

[0053] The convenient operation referred to in the present invention refers to an operation with fewer operation gestures or a shorter operation time than a non-convenient operation.

[0054] Furthermore, the step of analyzing the first operation gesture sequence and the first response instruction sequence to determine whether a corresponding convenient operation exists specifically includes: identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention, wherein the operation type includes an independent operation and a series operation; When the last operation gesture in the first operation gesture sequence is a series of operations, generating the series of operations sequence to which the last operation gesture belongs; Read the pre-configured convenient operation gesture correspondence table; Matching the series of operation sequences with a second operation gesture sequence in the convenient operation gesture correspondence table; Determining whether a second operation gesture sequence of any convenient operation gesture matches the series of operation sequences; When there is an operation gesture sequence of any convenient operation gesture that matches the series of operation sequences, it is determined that there is a convenient operation corresponding to the first operation gesture sequence and the first response instruction sequence.

[0055] Specifically, gestures can be divided into two types, independent operations and series operations, depending on the different operational intentions they correspond to. Independent operations refer to gestures that can independently complete an operational intention. That is, for independent operations, a single gesture can complete its operational intention, and has no or a weak correlation with the preceding and following gestures in terms of completing the operational intention. This correlation includes a temporal sequence and a correlation in terms of completing the operational intention. For example, if clicking the Bluetooth switch button is intended to turn the Bluetooth module on or off, then the single gesture of clicking the Bluetooth switch button completes its operational intention, and has no or a weak correlation with the preceding and following gestures in terms of completing the operational intention. Series operations refer to gestures that require the cooperation of preceding and / or following gestures to complete a single operational intention. That is, for a series operation, each gesture has a strong correlation with the preceding and / or following gestures in terms of operational intention, and they are performed in a certain temporal sequence to jointly complete a single operational intention. Taking text message sharing as an example, the user first selects a text message (depending on the application's operation method, this may be a long press or a click), calls up the operation menu (click the menu button), selects the sharing function (click the share menu item), selects the sharing channel (click the target application icon), and executes the sharing (click the send button).

[0056] It should be known that the operation type of an operation gesture is determined based on the operation intention. An operation gesture can be both an independent operation and a series of operations, not just one of them. An operation intention completed by a series of operations must be jointly realized by the operation intentions corresponding to multiple independent operations, that is, when an operation gesture is a series of operations, it is also an independent operation. Conversely, when an operation gesture is an independent operation, it is not necessarily a series of operations. In the technical solution of the present invention, when an operation gesture is both an independent operation and a series of operations, it is determined as a series of operations rather than an independent operation.

[0057] The series of operation sequences includes the last operation gesture in the first operation gesture sequence and several operation gestures before it, and also includes a response instruction corresponding to each operation gesture in the series of operation sequences.

[0058] The convenient operation gesture correspondence is a pre-configured data table that stores the correspondence between convenient operation gestures and non-convenient operation gestures. The convenient operation gesture correspondence table includes a convenient operation gesture sequence and at least one second operation gesture sequence. The convenient operation gesture correspondence table also includes a convenient operation response instruction sequence and a second response instruction sequence corresponding to the convenient operation gesture sequence and the second operation gesture sequence, respectively. It should be understood that the convenient operation gesture sequence can be an operation gesture sequence containing one or more operation gestures.

[0059] Furthermore, the step of identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention specifically includes: Read the pre-configured operation intention correspondence table; Matching the first response instruction sequence with a third response instruction sequence in the operation intention correspondence table; Determining whether any third operation gesture sequence of operation intention matches the first response instruction sequence; When there is a third response instruction sequence of any operation intention that matches the first response instruction sequence, determining that the last operation gesture in the first operation gesture sequence is a series operation; Otherwise, it is determined that the last operation gesture in the first operation gesture sequence is an independent operation.

[0060] The operation intention correspondence table is a preconfigured data table that stores the correspondence between operation intentions and response instruction sequences. The operation intention correspondence table includes a third response instruction sequence and its corresponding operation intention information. The operation intention information can be natural language text used to describe the operation intention, or a specific identifier with a one-to-one correspondence with the operation intention. The third response instruction sequence is a complete response instruction sequence that completes the corresponding operation intention.

[0061] Furthermore, the step of matching the first response instruction sequence with the third response instruction sequence in the operation intention correspondence table specifically includes: Get the pre-configured sequence matching instruction number threshold ; Sequentially traverse each operation intention in the operation intention correspondence table; Determine the traversed operation intention as the target operation intention; Obtain the number of response instructions in the third response instruction sequence of the target operation intention ; Taken from the end of the first response instruction sequence The subsequences are respectively compared with the third response instruction sequence of the target operation intention; When intercepted from the end of the first response instruction sequence When any one of the subsequences matches the third response instruction sequence of the target operation intention, it is determined that the third response instruction sequence of the target operation intention matches the first response instruction sequence.

[0062] Specifically, the first response instruction sequence intercepted Each subsequence is a response instruction sequence consisting of continuous response instructions intercepted from the end of the first response instruction sequence, The number of response instructions contained in each subsequence is different, ranging from to And all subsequences use the last response instruction at the end of the first response instruction sequence as the last response instruction at their end.

[0063] Preferably, the sequence matching instruction quantity threshold .

[0064] It should be known that It is a storage variable for the number of response instructions in the third response instruction sequence in the customized target operation intention, and its subscript It is only for the convenience of identifying that it corresponds to the third response instruction sequence, and does not have a specific numerical value or order meaning, that is, it does not necessarily exist. 、 or Of course, in the actual implementation process, you can use 、 to represent the number of response instructions in the first response instruction sequence and the second response instruction sequence.

[0065] Further, intercepting from the end of the first response instruction sequence The step of comparing the subsequences with the third response instruction sequence of the target operation intention respectively includes: Initialize the count variable ; Taken from the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The response instruction in the subsequence is combined with the first response instruction in the third response instruction sequence Compare consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence A subsequence is constructed by using a continuous response instruction and the response instruction in the subsequence is combined with the first response instruction of the third response instruction sequence. A step of comparing consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the three consecutive response instructions are completely consistent, it is determined that the subsequence matches the third response instruction sequence of the target operation intention.

[0066] With a As an example, the first response instruction sequence of the response instructions is numbered as follows: , then intercept from the end of the first response instruction sequence The step of constructing a subsequence of consecutive response instructions is specifically to convert the first response instruction sequence numbered The response instructions are extracted to construct the subsequence, and the order of each response instruction in the subsequence is consistent with its order in the first response instruction sequence.

[0067] Furthermore, after the step of determining that the subsequence matches the third response instruction sequence of the target operation intention, the loop is ended and the last operation gesture of the first operation gesture sequence is determined as a series of operations.

[0068] Further, the response instruction in the subsequence is combined with the first The steps of comparing consecutive response instructions specifically include: The same value is used to compare the subsequence and the first part of the third response instruction sequence. The consecutive response instructions are numbered; Combine the subsequence with the first part of the third response instruction sequence The response instructions with the same number in the consecutive response instructions are compared.

[0069] In the technical solution of the above embodiment, the number of response instructions in the subsequence is Taking the numerical number as an integer number starting from 1 as an example, the subsequence The response instructions are numbered 1, 2, ..., , the first of the third response instruction sequence The consecutive response instructions are also numbered 1, 2, ..., , then the subsequence is combined with the first Comparing the response instructions with the same number in the consecutive response instructions is specifically comparing the response instruction numbered 1 in the subsequence with the response instruction numbered 1 in the third response instruction sequence, comparing the response instruction numbered 2 in the subsequence with the response instruction numbered 2 in the third response instruction sequence, and so on.

[0070] Before placing the third response command sequence After comparing each response instruction with the response instructions in the subsequence one by one, if the response instructions and instruction sequence of the two are exactly the same, then the two are determined to be completely consistent, thereby determining that the subsequence matches the third response instruction sequence of the target operation intention. Conversely, if any numbered response instruction in the two is different, then the two are determined to be not completely consistent, thereby determining that the subsequence does not match the third response instruction sequence of the target operation intention.

[0071] Furthermore, the step of generating the series of operation sequences to which the last operation gesture belongs specifically includes: When the response instruction in the subsequence is the same as the previous one in the third response instruction sequence When the consecutive response instructions are completely consistent, the subsequence is determined as the series of operation sequences to which the last operation gesture belongs.

[0072] Specifically, in the operation intention correspondence table, the third response instruction sequence corresponding to each operation intention is the complete instruction sequence to complete the operation intention. However, corresponding to the first response instruction sequence, the last operation gesture in the first operation gesture sequence is not necessarily the last operation gesture to complete the operation intention. Therefore, when the last operation gesture in the first operation gesture sequence is a series of operations, the series of operation sequence it belongs to is not necessarily the complete instruction sequence to complete the operation intention, but rather a portion of the previous one.

[0073] Furthermore, the step of determining whether a second operation gesture sequence of an operation gesture sequence of any convenient operation gesture matches the series of operation sequences specifically includes: Sequentially traverse each convenient gesture in the convenient operation gesture correspondence table; Determine the traversed convenient gestures as target convenient gestures; Obtain the number of response instructions in the second response instruction sequence corresponding to the second operation gesture sequence of the target convenient gesture ; Taken from the end of the first response instruction sequence subsequences are compared with the second response instruction sequence respectively; When intercepted from the end of the first response instruction sequence When any one of the subsequences matches the second response instruction sequence, it is determined that the second response instruction sequence of the target convenient gesture matches the series of operation sequences.

[0074] Further, intercepting from the end of the first response instruction sequence The step of comparing each subsequence with the second response instruction sequence specifically includes: Initialize the count variable ; Taken from the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The response instruction in the subsequence is combined with the first response instruction sequence of the second response instruction sequence Compare consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the second response instruction sequence When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence A subsequence is constructed by using a continuous response instruction and the response instruction in the subsequence is combined with the first response instruction sequence of the second response instruction sequence. A step of comparing consecutive response instructions; When the response instruction in the subsequence is the same as the previous one in the second response instruction sequence When the two consecutive response instructions are completely consistent, it is determined that the subsequence matches the second response instruction sequence of the convenient operation.

[0075] Further, the response instruction in the subsequence is combined with the first The steps of comparing consecutive response instructions specifically include: The same value is used to compare the subsequence and the first part of the second response instruction sequence. The consecutive response instructions are numbered; The subsequence is combined with the first part of the second response instruction sequence The response instructions with the same number in the consecutive response instructions are compared.

[0076] Furthermore, the step of issuing interaction suggestions through the intelligent interaction assistant specifically includes: generating a fourth response instruction sequence corresponding to the series of operation sequences; Determining, based on the fourth response instruction sequence, whether the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence; When the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence, the corresponding convenient operation gesture sequence is displayed through the intelligent interaction assistant.

[0077] Specifically, when the last operation gesture in the first operation gesture sequence is a series of operations, the series of operation sequences to which it belongs must correspond to an operation intention in the operation intention correspondence table. Therefore, when the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence, it indicates that the user is in the process of completing the operation intention, but has not completed all operations of the operation intention. Conversely, when the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence, it indicates that the user has completed all operations of the operation intention.

[0078] Furthermore, the step of determining whether the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence based on the fourth response instruction sequence specifically includes: Determine whether the fourth response instruction sequence is completely consistent with the third response instruction sequence of the operation intention corresponding to the operation intention correspondence table, where the term "completely consistent" includes that the number and order of the response instructions are also completely consistent; When the fourth response instruction sequence is completely consistent with the third response instruction sequence, it is determined that the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence.

[0079] Furthermore, after the step of the intelligent interactive assistant displaying the corresponding convenient operation gesture sequence, when the user continues to perform operations according to the operation gestures in the second operation gesture sequence, no repeated prompts are issued.

[0080] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0081] While embodiments of the present invention have been described above, these embodiments do not exhaustively describe all details and do not limit the invention to the specific embodiments described. Obviously, many modifications and variations are possible based on the above description. These embodiments are selected and described in detail in this specification in order to better explain the principles and practical applications of the present invention, thereby enabling those skilled in the art to better utilize the present invention and its modifications. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A tablet computer with an intelligent interactive assistant, characterized in that: include: An interactive assistant display module, used to display the intelligent interactive assistant in the user interaction interface; An operation gesture monitoring module is used to monitor and record the user's operation gestures on the touch screen, as well as the response instructions executed by the operating system or application program in response to the operation gestures; A first sequence generating module, used to generate a first operation gesture sequence and a first response instruction sequence having an associated relationship with time as an associated element; A convenient operation analysis module, used to analyze the first operation gesture sequence and the first response instruction sequence to determine whether there is a corresponding convenient operation; The interaction suggestion display module is used to issue interaction suggestions through the intelligent interaction assistant when there is a corresponding convenient operation.

2. A control method for a tablet computer with an intelligent interactive assistant, characterized in that: include: Displaying an intelligent interactive assistant in the user interaction interface; Monitor and record the user's operation gestures on the touch screen, and the response instructions executed by the operating system or application in response to the operation gestures; Generate a first operation gesture sequence and a first response instruction sequence with an associated relationship by taking time as an associated element; Analyzing the first operation gesture sequence and the first response instruction sequence to determine whether there is a corresponding convenient operation; When there is a corresponding convenient operation, an interaction suggestion is issued through the intelligent interaction assistant.

3. The control method of a tablet computer with an intelligent interactive assistant according to claim 2, characterized in that: The step of analyzing the first operation gesture sequence and the first response instruction sequence to determine whether there is a corresponding convenient operation specifically includes: identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention, wherein the operation type includes an independent operation and a series operation; When the last operation gesture in the first operation gesture sequence is a series operation, generating the series operation sequence to which the last operation gesture belongs; Read the pre-configured convenient operation gesture correspondence table; Matching the series of operation sequences with a second operation gesture sequence in the convenient operation gesture correspondence table; Determining whether there is a second operation gesture sequence of any convenient operation gesture that matches the series of operation sequences; When there is a second operation gesture sequence of the operation gesture sequence of any convenient operation gesture that matches the series of operation sequences, it is determined that there is a convenient operation corresponding to the first operation gesture sequence and the first response instruction sequence.

4. The control method of a tablet computer with an intelligent interactive assistant according to claim 3, characterized in that: The step of identifying the user's operation intention according to the first response instruction sequence, and determining the operation type of the last operation gesture in the first operation gesture sequence based on the operation intention specifically includes: Reading a pre-configured operation intention correspondence table; Matching the first response instruction sequence with a third response instruction sequence in the operation intention correspondence table; Determining whether there is any third operation gesture sequence of operation intention that matches the first response instruction sequence; When there is a third response instruction sequence of any operation intention that matches the first response instruction sequence, determining that the last operation gesture in the first operation gesture sequence is a series operation; Otherwise, it is determined that the last operation gesture in the first operation gesture sequence is an independent operation.

5. The control method of a tablet computer with an intelligent interactive assistant according to claim 4, characterized in that: The step of matching the first response instruction sequence with the third response instruction sequence in the operation intention correspondence table specifically includes: Get the pre-configured sequence matching instruction number threshold ; Sequentially traverse each operation intention in the operation intention correspondence table; Determine the traversed operation intention as the target operation intention; Obtain the number of response instructions in the third response instruction sequence of the target operation intention ; Taken from the end of the first response instruction sequence The subsequences are respectively compared with the third response instruction sequence of the target operation intention; When intercepted from the end of the first response command sequence When any one of the subsequences matches the third response instruction sequence of the target operation intention, it is determined that the third response instruction sequence of the target operation intention matches the first response instruction sequence.

6. The control method of a tablet computer with an intelligent interactive assistant according to claim 5, characterized in that: Taken from the end of the first response instruction sequence The step of comparing the subsequences with the third response instruction sequence of the target operation intention respectively comprises: Initialize the count variable ; Taken from the end of the first response instruction sequence A subsequence is constructed by a series of response instructions; The response instruction in the subsequence is combined with the first part of the third response instruction sequence Compare consecutive response instructions; When the response instruction in the subsequence is the same as the first response instruction in the third response instruction sequence When the consecutive response instructions are not completely consistent, After that, execute again the command from the end of the first response sequence. The third response instruction sequence is constructed by constructing a subsequence of consecutive response instructions and combining the response instructions in the subsequence with the first response instruction of the third response instruction sequence. A step of comparing consecutive response instructions; When the response instruction in the subsequence is the same as the first response instruction in the third response instruction sequence When the three consecutive response instructions are completely consistent, it is determined that the subsequence matches the third response instruction sequence of the target operation intention.

7. The control method of a tablet computer with an intelligent interactive assistant according to claim 6, characterized in that: The response instruction in the subsequence is combined with the first part of the third response instruction sequence The steps of comparing consecutive response instructions specifically include: The same value is used to compare the subsequence and the first part of the third response instruction sequence. The consecutive response instructions are numbered; The subsequence is combined with the first part of the third response instruction sequence The response instructions with the same number in the consecutive response instructions are compared.

8. The control method of a tablet computer with an intelligent interactive assistant according to claim 6, characterized in that: The steps of generating the series of operation sequences to which the last operation gesture belongs specifically include: When the response instruction in the subsequence is the same as the first response instruction in the third response instruction sequence When the consecutive response instructions are completely consistent, the subsequence is determined as the series of operation sequences to which the last operation gesture belongs.

9. The control method of a tablet computer with an intelligent interactive assistant according to claim 5, characterized in that: The step of determining whether a second operation gesture sequence of an operation gesture sequence of any convenient operation gesture matches the series of operation sequences specifically includes: Sequentially traverse each convenient gesture in the convenient operation gesture correspondence table; Determine the traversed convenient gesture as the target convenient gesture; Obtain the number of response instructions in the second response instruction sequence corresponding to the second operation gesture sequence of the target convenient gesture ; Taken from the end of the first response instruction sequence compare the subsequences with the second response instruction sequence respectively; When intercepted from the end of the first response command sequence When any one of the subsequences matches the second response instruction sequence, it is determined that the second response instruction sequence of the target convenient gesture matches the series of operation sequences.

10. The control method of a tablet computer with an intelligent interactive assistant according to claim 3, characterized in that: The step of issuing interaction suggestions through the intelligent interaction assistant specifically includes: generating a fourth response instruction sequence corresponding to the series of operation sequences; Determining, based on the fourth response instruction sequence, whether the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is a complete instruction sequence; When the series of operation sequences to which the last operation gesture in the first operation gesture sequence belongs is not a complete instruction sequence, the corresponding convenient operation gesture sequence is displayed through the intelligent interaction assistant.

Images