Interaction methods, interaction devices, computing systems, and storage media

Abstract

The present disclosure relates to an interaction method, an interaction device, a computing system and a storage medium. The interaction method comprises: in a state where an interaction input is activated, recognizing a gesture input, the gesture input comprising: rotation of a thumb; displaying, in an interaction interface, a set of options comprising a plurality of interaction objects; and in accordance with the recognition of the rotation of the thumb, performing a first operation to show an indication that an interaction object corresponding to a different rotation orientation of the thumb is preselected.

Description

Technical Field

[0001] This disclosure belongs to the field of interactive technology, and specifically relates to an interactive method, interactive device, computing system, and storage medium. Background Technology

[0002] The development of smart glasses is gradually changing people's lifestyles and work methods, playing an important role in many fields such as education, healthcare, industry, and tourism. It provides users with a more intuitive, convenient, and immersive interactive experience, bringing humans and computing technology closer together.

[0003] Interactive technologies enable users to interact with glasses more naturally and efficiently, greatly expanding the functionality and application areas of smart glasses. Summary of the Invention

[0004] In some embodiments, this disclosure provides an interaction method, including: recognizing gesture input, the gesture input including: thumb rotation, in an interactive input active state; displaying an option set including multiple interactive objects in an interactive interface; and performing a first operation to display an indication that interactive objects corresponding to different rotation positions of the thumb are pre-selected based on the recognized thumb rotation.

[0005] In some embodiments, this disclosure also provides another interaction method, including: recognizing a gesture input, the gesture input including: rotation of the thumb, in a state where the interaction input is activated; and performing a first operation based on recognizing that the thumb is rotating in a first rotation direction.

[0006] In some embodiments, this disclosure provides another interaction method, including: recognizing a gesture input, the gesture input including: rotation of the thumb, while the interaction input is active; and performing a first operation based on a first rotation speed of the thumb.

[0007] In some embodiments, this disclosure provides another interaction method, including: recognizing a gesture input while the interaction input is active, the gesture input including: rotation of the thumb; the rotation range of the thumb including: a comfortable rotation range and an edge rotation range outside the comfortable rotation range; displaying an option set including multiple interaction objects in the interaction interface; performing a first operation to display an indication that the interaction object corresponding to different rotation positions of the thumb is pre-selected based on the recognized rotation of the thumb within the comfortable rotation range; and performing a second operation different from the first operation based on the recognized rotation of the thumb to the edge rotation range.

[0008] In some embodiments, this disclosure provides another interaction method, including: recognizing a gesture input, the gesture input including: rotation of the thumb, in a state where the interaction input is activated; and, based on the recognition of continuous rotation of the thumb in a predetermined direction, sequentially performing a first operation and a second operation at a first position and a second position through which the thumb passes, respectively, to display an indication that the object to be executed changes from a pre-selected state to a selected state.

[0009] In some embodiments, this disclosure provides a computer-readable storage medium for storing at least one instruction, which, when executed by a computer, causes the computer to perform an interaction method according to any of the above embodiments.

[0010] In some embodiments, this disclosure provides an interactive device, including: an image acquisition component configured to acquire user gestures; a display generation component configured to generate an interactive interface and display interactive objects; and an interactive control device coupled to the display generation component and the image acquisition component, and configured to execute the interactive method of any of the above embodiments.

[0011] In some embodiments, this disclosure provides a computing system, including:

[0012] A processor; and a memory, the memory storing one or more programs configured for execution by the processor, the one or more programs including instructions for performing the interactive methods of any of the above embodiments. Attached Figure Description

[0013] Figure 1 This illustrates interaction methods according to some embodiments of the present disclosure;

[0014] Figure 2 This illustrates interaction methods according to other embodiments of the present disclosure;

[0015] Figure 3 This illustrates interaction methods according to other embodiments of the present disclosure;

[0016] Figure 4 This illustrates interaction methods according to other embodiments of the present disclosure;

[0017] Figure 5 Interaction methods according to other embodiments of this disclosure are shown. Detailed Implementation

[0018] Exemplary embodiments of this disclosure are described below with reference to the accompanying drawings. Those skilled in the art will understand that the scope of this disclosure is not limited to these embodiments. Various modifications and variations can be made to this disclosure based on the following embodiments. All such modifications and variations are included within the scope of this disclosure.

[0019] In this disclosure, thumb rotation includes: thumb movement resulting from wrist movement and / or thumb rotation resulting from movement of the thumb itself. In this disclosure, wrist movement includes at least one of: wrist flexion, wrist extension, wrist dorsiflexion, wrist palmar flexion, wrist radial deviation, and wrist ulnar deviation. In this disclosure, thumb movement includes at least one of: thumb extension, thumb abduction, thumb medial rotation, and thumb lateral rotation.

[0020] Figure 1 An interaction method 100 according to some embodiments of the present disclosure is shown.

[0021] See Figure 1 In step 101, while the interactive input is active, gesture input is recognized. In some embodiments, gesture input includes: rotation of the thumb. In this disclosure, gesture input includes: rotation of the thumb suspended above the index finger while the index finger is bent; and / or, thumb rotation caused by wrist movement.

[0022] In this disclosure: interactive input is activated based on the determination of a set sports scenario; and / or, interactive input is deactivated based on the determination of the end of the set sports scenario, such as cycling or skiing. In this disclosure, the set sports scenarios include any one of: swimming, hiking, rock climbing, running, cycling, skiing, golf, diving, walking, and rowing.

[0023] In some embodiments, the interaction method 100 further includes: activating the interactive input based on the recognition of a first gesture change; and / or deactivating the interactive input based on the recognition of a second gesture change. In some embodiments, recognizing the first gesture change includes: recognizing a thumb raising; or, recognizing a thumb lifting; or, recognizing a thumb opening. In some embodiments, recognizing the second gesture change includes: recognizing a gesture change that is the opposite of the first gesture change. In some embodiments, recognizing the second gesture change includes: recognizing a thumb retracting.

[0024] refer to Figure 1In step 103, an option set including multiple interactive objects is displayed in the interactive interface. In some embodiments, step 103 may be before or after step 101. In some embodiments, the interaction method 100 further includes: performing the operation of displaying the option set in the interactive interface based on the recognition of a first gesture change. In some embodiments, the interaction method 100 further includes: performing the operation of displaying the option set in the interactive interface in response to the recognition of gesture input. In some embodiments, the multiple interactive objects include at least three or three groups of interactive objects. In some embodiments, the display position of the option set is related to the physical position of the hand that inputs the gesture. In some embodiments, such as in an augmented reality scenario, the interaction method 100 further includes: determining the display position of the option set in the interactive interface based on the physical position of the hand, so as to visually display the option set in front of the hand. In some embodiments, the interaction method 100 further includes: displaying a virtual representation corresponding to the gesture input in the interactive interface in response to the recognition of gesture input. In some embodiments, the interaction method 100 further includes: displaying the option set in front of the virtual representation. In some embodiments, the multiple interactive objects are distributed in an arc shape in the interactive interface, and the position of each interactive object in the arc shape corresponds to the rotation position of the thumb within a predetermined range.

[0025] See Figure 1 In step 105, based on the detected rotation of the thumb, a first operation is performed to display an indication that an interactive object corresponding to different rotation positions of the thumb is pre-selected. In some embodiments, the interaction method 100 further includes: based on the detected thumb rotation in a first rotation position, displaying an indication that a first interactive object in the option set is pre-selected. In some embodiments, the interaction method 100 further includes: based on the detected thumb changing from the first rotation position to a second rotation position, displaying an indication that a second interactive object in the option set is pre-selected and / or deselecting the first interactive object.

[0026] In some embodiments, each of the plurality of interactive objects is mapped to a rotational orientation within a set range; or, each group of the plurality of interactive objects is mapped to a rotational orientation within a set range. In some embodiments, the interaction method 100 further includes: determining a rotational reference line for the thumb. In some embodiments, the rotational orientation of the thumb is determined based on the rotational reference line. In some embodiments, the rotational reference line passes through a rotational reference point; the rotational reference point includes: a wrist joint feature point on the wrist; or, a joint feature point near the metacarpophalangeal joint of the thumb; or, a radial feature point of the palm. In some embodiments, the rotational reference line passes through the fingertip of the thumb in a natural hand gesture state; or, the rotational reference line is parallel to the extension of the forearm. In some embodiments, the rotational orientation of the thumb is determined based on the position of the thumb. In some embodiments, the interaction method further includes: determining different rotational orientations of the thumb according to the position of the thumb. In some embodiments, the rotational angle of the thumb is used to represent the rotational orientation of the thumb, and each of the plurality of interactive objects is mapped to a rotational angle within a set range; or, each group of the plurality of interactive objects is mapped to a rotational angle within a set range. In some embodiments, the range of thumb rotation includes: thumb rotation in the direction of the palm [0, 35°]; or, thumb rotation in the direction of the palm [0, 45°]; or, thumb rotation in the direction of the palm [0, 85°]. In some embodiments, the range of thumb rotation includes: thumb rotation in the direction of the back of the hand (0, 25°); or, thumb rotation in the direction of the back of the hand (0°, 30°); or, thumb rotation in the direction of the back of the hand (0, 35°); or, thumb rotation in the direction of the back of the hand (0°, 70°).

[0027] In some embodiments, the interaction method 100 further includes: based on detecting input that satisfies the operation execution conditions, performing a second operation associated with the pre-selected interactive object. In some embodiments, the operation execution conditions include at least one of: maintaining the rotation position of the thumb within a set range for a predetermined time, a thumb tap, a thumb long press, a thumb double tap, a drag, and a hover gesture. In some embodiments, the interaction method 100 further includes: adjusting the pre-selected interactive object from a first state to a second state to display an indication that the interactive object has been pre-selected. In some embodiments, the interaction method 100 further includes: after performing the second operation, displaying a secondary interactive object corresponding to the pre-selected interactive object.

[0028] In some embodiments, the interaction method 100 further includes: performing a third operation associated with a pre-selected interaction object, and closing the interaction input.

[0029] In some embodiments, the interaction method 100 further includes: performing a fourth operation based on the recognition that the rotation speed of the thumb satisfies the option set update condition; and updating the current option set in the interactive interface to a first option set corresponding to the execution of the fourth operation. In some embodiments, the first option set includes a plurality of first interactive objects, and the interaction method 100 further includes: performing a fifth operation based on the recognition of thumb rotation to display an indication that the first interactive object corresponding to different rotation orientations of the thumb is preselected. In some embodiments, the interaction method 100 further includes: after displaying a secondary interactive object, performing a sixth operation associated with the secondary interactive object based on the recognition of a predefined gesture. In some embodiments, the predefined gesture includes at least one of: a click action, a long press action, a double click action, and a drag action.

[0030] Figure 2 An interaction method 200 according to other embodiments of this disclosure is shown.

[0031] See Figure 2 In step S201, when interactive input is active, gesture input is recognized. In some embodiments, gesture input includes: rotation of the thumb. In some embodiments, gesture input includes: rotation of the thumb suspended above the index finger while the index finger is bent; and / or, rotation of the thumb caused by lateral rotation of the wrist.

[0032] In step S203, based on the recognition that the thumb is rotating in a first rotation direction, a first operation is performed. In some embodiments, the first rotation direction is, for example, clockwise or counterclockwise rotation. In some embodiments, the first rotation direction is, for example, upward or downward rotation. In some embodiments, the first rotation direction is, for example, leftward or rightward rotation. In some embodiments, the first rotation direction is, for example, forward or backward rotation. In some embodiments, the first operation in interaction method 200 is the same as or different from the first operation in interaction method 100.

[0033] In some embodiments, the interaction method 200 further includes: displaying visual changes in the interactive interface corresponding to the execution of the first operation.

[0034] In some embodiments, the interaction method 200 further includes: displaying a first set of options corresponding to the execution of the first operation in the interactive interface. In some embodiments, the first set of options includes a plurality of first interactive objects, and the interaction method 200 further includes: after executing the first operation, performing a second operation based on the detected rotation of the thumb to display an indication that the first interactive object corresponding to different rotation positions of the thumb is pre-selected. In some embodiments, the second operation in the interaction method 200 is the same as or different from the second operation in the interaction method 100.

[0035] In some embodiments, the interaction method 200 further includes: performing a third operation different from the first operation based on the recognition that the thumb rotates in a second rotation direction different from the first rotation direction. In some embodiments, the interaction method 200 further includes: displaying a second set of options corresponding to the execution of the third operation in the interactive interface. In some embodiments, the second rotation direction is the opposite direction to the first rotation direction. In some embodiments, the third operation in the interaction method 200 is the same as or different from the third operation in the interaction method 100. In some embodiments, the interaction method 200 further includes: performing a fourth operation based on the recognition of a first rotation speed of the thumb. In some embodiments, the interaction method 200 further includes: displaying a visual change corresponding to the execution of the fourth operation in the interactive interface. In some embodiments, the fourth operation in the interaction method 200 is the same as or different from the fourth operation in the interaction method 100.

[0036] Figure 3 An interaction method 300 according to other embodiments of this disclosure is shown.

[0037] See Figure 3 In step 301, while the interactive input is active, gesture input is recognized. In some embodiments, gesture input includes: rotation of the thumb. In some embodiments, gesture input includes: rotation of the thumb suspended above the index finger while the index finger is bent; and / or, rotation of the thumb caused by lateral rotation of the wrist.

[0038] In step 303, a first operation is performed based on the detected first rotation speed of the thumb. In some embodiments, the interaction method 300 further includes displaying a visual change corresponding to the execution of the first operation in the interactive interface. In some embodiments, the first operation in the interaction method 300 may be the same as or different from the first operation in the interaction method 100 or the interaction method 200.

[0039] In some embodiments, the interaction method 300 further includes: displaying a first set of options corresponding to performing the first operation in the interactive interface.

[0040] In some embodiments, the first option set includes a plurality of first interactive objects, and the interaction method 300 further includes: after performing the first operation, performing a second operation based on the detected rotation of the thumb to display an indication that the first interactive object corresponding to different rotation positions of the thumb is pre-selected. In some embodiments, the second operation in the interaction method 300 is the same as or different from the second operation in the interaction method 100 or the interaction method 200.

[0041] In some embodiments, the interaction method 300 further includes: performing a third operation different from the first operation based on a second rotation speed of the thumb that is recognized as different from the first rotation speed. In some embodiments, the third operation in the interaction method 300 is the same as or different from the third operation in the interaction method 100 or the interaction method 200. In some embodiments, the interaction method 300 further includes: displaying a second set of options corresponding to the execution of the third operation in the interactive interface.

[0042] Figure 4 An interaction method 400 according to other embodiments of this disclosure is shown.

[0043] See Figure 4 In step 401, when interactive input is active, gesture input is recognized. In some embodiments, gesture input includes: rotation of the thumb.

[0044] In some embodiments, the range of thumb rotation includes a comfortable range of rotation and an edge range of rotation outside the comfortable range of rotation. In some embodiments, the edge range of rotation includes an edge range of rotation in the direction of the inner palm and / or an edge range of rotation in the direction of the back of the hand. In some embodiments, the comfortable range of rotation is, for example, a range in which the user controls the rotation of the thumb within easy reach or a range in which the user feels comfortable. In some embodiments, the edge range of rotation is, for example, a range in which the user controls the rotation of the thumb within difficult reach or a range in which the user feels uncomfortable. In some embodiments, the comfortable range of rotation is, for example, part or all of the range covered by thumb rotation caused by the movement of the thumb itself. In some embodiments, the edge range of rotation is, for example, part or all of the range covered by thumb movement caused by wrist movement outside the comfortable range of rotation.

[0045] In some embodiments, the comfortable rotation range corresponding to thumb rotation generated by the movement of the thumb itself includes: thumb rotation in the palmar direction [0, 35°] and / or thumb rotation in the palmar direction [0, 25°]. In some embodiments, the edge rotation range corresponding to thumb rotation generated by the movement of the thumb itself includes: thumb rotation in the palmar direction [35°, 45°] and / or thumb rotation in the palmar direction [25°, 30°]. In some embodiments, the comfortable rotation range corresponding to thumb rotation generated by thumb movement resulting from thumb movement combined with wrist movement includes: thumb rotation in the palmar direction [0, 45°] and / or thumb rotation in the palmar direction [0, 35°]. In some embodiments, the edge rotation range corresponding to thumb rotation generated by thumb movement resulting from thumb movement combined with wrist movement includes: thumb rotation in the palmar direction [45°, 80°] and / or thumb rotation in the palmar direction [35°, 70°].

[0046] See Figure 4 Step 403 involves displaying an option set comprising multiple interactive objects in the interactive interface. In some embodiments, the interaction method 400 further includes: performing the operation of displaying the option set in the interactive interface based on the recognition of a first gesture change. In some embodiments, the interaction method 400 further includes: performing the operation of displaying the option set in the interactive interface in response to the recognition of gesture input. In some embodiments, the multiple interactive objects include at least three or three groups of interactive objects. In some embodiments, the display position of the option set is related to the physical position of the hand that inputs the gesture. In some embodiments, such as in an augmented reality scenario, the interaction method 400 further includes: determining the display position of the option set in the interactive interface based on the physical position of the hand, so as to visually display the option set in front of the hand. In some embodiments, the interaction method 400 further includes: displaying a virtual representation corresponding to the gesture input in the interactive interface in response to the recognition of gesture input. In some embodiments, the interaction method 400 further includes: displaying the option set in front of the virtual representation. In some embodiments, the multiple interactive objects are distributed in an arc shape in the interactive interface, and the position of each interactive object in the arc shape corresponds to the rotation direction of the thumb within a predetermined range. In some embodiments, step 403 may be before or after step 401.

[0047] refer to Figure 4 In step 405, based on the detected rotation of the thumb within a comfortable rotation range, a first operation is performed to display an indication that an interactive object corresponding to different rotation positions of the thumb is pre-selected. In some embodiments, the interaction method 400 further includes: based on the detected thumb rotation in a first rotation position, displaying an indication that a first interactive object in the option set is pre-selected. In some embodiments, the interaction method 400 further includes: based on the detected thumb rotation changing from the first rotation position to a second rotation position, displaying an indication that a second interactive object in the option set is pre-selected and / or deselecting the first interactive object.

[0048] refer to Figure 4 In step 407, based on the recognition that the thumb has rotated to the edge rotation range, a second operation different from the first operation is performed. In some embodiments, the interaction method 400 further includes updating the current option set in the interactive interface to a first option set corresponding to the execution of the second operation.

[0049] In some embodiments, the first option set includes a plurality of first interactive objects, and the interaction method 400 further includes: based on the recognition of the thumb's rotation within a comfortable rotation range, performing a third operation to display an indication that the first interactive object corresponding to different rotation orientations of the thumb is pre-selected.

[0050] In some embodiments, the comfortable range of rotation of the thumb corresponds to the main functional area, and the range of rotation of the edge of the thumb corresponds to the auxiliary functional area.

[0051] Figure 5 An interaction method 500 according to other embodiments of this disclosure is shown.

[0052] See Figure 5 In step 501, while the interactive input is active, a gesture input is recognized, including the rotation of the thumb. In step 503, based on the recognized continuous rotation of the thumb in a predetermined direction, a first operation and a second operation are executed sequentially at the first and second positions through which the thumb passes, respectively, to display an indication that the object being executed has changed from a pre-selected state to a selected state.

[0053] In some embodiments, the interaction method 500 further includes: switching the state of the object being executed after performing the second operation.

[0054] In some embodiments, the interaction method 500 further includes: after performing the second operation, displaying an option set including multiple interactive objects in the interactive interface; and performing a third operation based on the detected rotation of the thumb to display an indication that the interactive object corresponding to different rotation positions of the thumb is pre-selected.

[0055] In some embodiments, this disclosure provides a computer-readable storage medium for storing at least one instruction, which, when executed by a computer, causes the computer to perform some or all of the steps in the interaction method according to any of the above embodiments.

[0056] In some embodiments, this disclosure provides an interactive device, including:

[0057] The image acquisition component is configured to capture the user's gestures;

[0058] The display generation component is configured to generate an interactive interface and display interactive objects.

[0059] An interactive control device, coupled to a display generation component and an image acquisition component, is configured to perform some or all of the steps in the interactive method of any of the above embodiments.

[0060] In some embodiments, this disclosure provides a computing system, including:

[0061] processor; and

[0062] The memory stores one or more programs configured for execution by a processor, the one or more programs including instructions for performing some or all of the steps in the interactive method of any of the above embodiments.

[0063] This disclosure provides the following methods:

[0064] Example 1. An interaction method, comprising:

[0065] When interactive input is active, recognize gesture input, which includes: thumb rotation;

[0066] Display a set of options including multiple interactive objects in the interactive interface; and

[0067] Based on the detected rotation of the thumb, the corresponding operation is executed to display the pre-selected indicator of the interactive object corresponding to different rotation positions of the thumb.

[0068] Example 2. An interaction method, comprising:

[0069] When interactive input is active, gesture input is recognized, including: thumb rotation; and

[0070] Based on the recognition that the thumb is rotating in the first rotation direction, the corresponding operation is executed.

[0071] Example 3. An interaction method, comprising:

[0072] When interactive input is active, gesture input is recognized, including: thumb rotation; and

[0073] Based on the first rotation speed of the thumb, the corresponding operation is executed.

[0074] Example 4. An interaction method, comprising:

[0075] When interactive input is active, gesture input is recognized, including: thumb rotation; the range of thumb rotation includes: a comfortable rotation range and an edge rotation range outside the comfortable rotation range.

[0076] Display a set of options including multiple interactive objects in the interactive interface;

[0077] Based on the detected rotation of the thumb within a comfortable range, the corresponding operation is executed to display a pre-selected indicator showing the interactive object corresponding to different rotation positions of the thumb; and

[0078] Based on the recognition of the thumb's rotation to the edge rotation range, a corresponding operation that is different from the corresponding operation is executed.

[0079] Example 5. An interaction method, comprising:

[0080] When interactive input is active, gesture input is recognized, including: thumb rotation; and

[0081] Based on the recognition of continuous rotation of the thumb in a predetermined direction, corresponding operations are executed sequentially at the first and second positions through which the thumb passes, respectively, to display an indication that the object being executed changes from a pre-selected state to a selected state.

[0082] Example 6. In conjunction with any example of this disclosure, each of the plurality of interactive objects is mapped to a rotational orientation within a defined range; or, each group of the plurality of interactive objects is mapped to a rotational orientation within a defined range.

[0083] Example 7. In conjunction with any example of the present disclosure, rotation of the thumb includes: thumb movement resulting from wrist movement and / or thumb rotation resulting from movement of the thumb itself.

[0084] Example 8. In conjunction with any example of this disclosure, wrist movements include at least one of: wrist flexion, wrist extension, wrist dorsiflexion, wrist palmar flexion, wrist radial deviation, and wrist ulnar deviation. Thumb movements include at least one of: thumb extension, thumb abduction, thumb medial rotation, and thumb lateral rotation.

[0085] Example 9. A method incorporating any example of this disclosure, comprising:

[0086] Based on the detected input that meets the operation execution conditions, the corresponding operation associated with the pre-selected interactive object is executed.

[0087] Example 10. The operation execution conditions for any method in conjunction with any example of this disclosure include:

[0088] The thumb rotation position is maintained within a set range for a predetermined time, and the thumb click action, thumb long press action, thumb double click action, drag action, or hover gesture is at least one of the following:

[0089] Example 11. In conjunction with any example of this disclosure, the display position of the option set is related to the physical position of the hand used for input gestures.

[0090] Example 12. In an augmented reality scenario, the method, in conjunction with any example of this disclosure, includes:

[0091] Based on the physical position of the hand, determine the display position of the option set in the interactive interface so that the option set is visually displayed in front of the hand.

[0092] Example 13. A method incorporating any example of this disclosure, comprising:

[0093] In response to the recognition of gesture input, a virtual representation corresponding to the gesture input is displayed in the interactive interface; and

[0094] Display the option set at the front of the virtual representation.

[0095] Example 14. A method in conjunction with any Example 1 of this disclosure, comprising:

[0096] Determine the rotation reference line for the thumb; the rotation direction of the thumb is determined based on the rotation reference line.

[0097] Example 15. Using the method of any example of this disclosure, the rotation reference line passes through a rotation reference point; the rotation reference point includes:

[0098] The wrist joint feature point; or the joint feature point near the metacarpophalangeal joint of the thumb; or the radial side feature point of the palm.

[0099] Example 16. Using any example of this disclosure, rotate the reference line through the tip of the thumb in a natural hand gesture state; or rotate the reference line parallel to the extension of the forearm.

[0100] Example 17. In conjunction with any example of this disclosure, gesture input includes:

[0101] Rotation of the thumb while it is suspended above the index finger with the index finger bent; and / or rotation of the thumb caused by wrist movement.

[0102] Example 18. In conjunction with any example of this disclosure, the range of rotational orientation of the thumb includes:

[0103] The thumb rotates [0, 35°] in the direction of the inside of the palm; or, the thumb rotates [0, 45°] in the direction of the inside of the palm; or, the thumb rotates [0, 85°] in the direction of the inside of the palm.

[0104] Example 19. In conjunction with any example of this disclosure, the range of rotational orientation of the thumb includes:

[0105] The thumb is rotated in the direction of the back of the hand (0, 25°); or, the thumb is rotated in the direction of the back of the hand (0°, 30°); or, the thumb is rotated in the direction of the back of the hand (0, 35°); or, the thumb is rotated in the direction of the back of the hand (0°, 70°).

[0106] Example 20. Using the method of any example of this disclosure, multiple interactive objects are arranged in an arc shape on the interactive interface, and the position of each interactive object in the arc shape corresponds to the rotation position of the thumb within a predetermined range.

[0107] Example 21. A method incorporating any example of this disclosure, comprising:

[0108] The pre-selected interactive object is changed from the first state to the second state to display an indication that the interactive object has been pre-selected.

[0109] Example 22. A method incorporating any example of this disclosure, comprising:

[0110] Based on the recognition of thumb rotation in the first rotation position, an indication is displayed that the first interactive object in the option set is pre-selected; and

[0111] Based on the recognition that the thumb has changed from a first rotation position to a second rotation position, an indication is displayed that the second interactive object in the option set has been pre-selected and / or the first interactive object is de-pre-selected.

[0112] Example 23. In conjunction with any example of this disclosure, the rotation angle of the thumb is used to represent the rotation direction of the thumb, and each of the multiple interactive objects has a mapping relationship with a rotation angle within a set range; or, each group of the multiple interactive objects has a mapping relationship with a rotation angle within a set range.

[0113] Example 24. A method incorporating any example of this disclosure, comprising:

[0114] Determine the different directions of thumb rotation based on the thumb's position.

[0115] Example 25. A method incorporating any example of this disclosure, comprising:

[0116] The interactive input is activated when the set sports scenario is determined; and / or the interactive input is deactivated when the set sports scenario, such as cycling or skiing, ends.

[0117] Example 26. The motion scenario set in conjunction with any example of this disclosure includes:

[0118] Any one of the following: swimming, hiking, rock climbing, running, cycling, skiing, golf, diving, walking, or rowing.

[0119] Example 27. A method incorporating any example of this disclosure, comprising:

[0120] Based on the recognition of the first gesture change, interactive input is activated; and / or,

[0121] Interactive input was disabled upon detecting a change in the second gesture.

[0122] Example 28. The method in conjunction with any example of this disclosure identifies the first gesture change as including:

[0123] It can detect the process of the thumb raising; or, the process of the thumb lifting; or, the process of the thumb opening.

[0124] Example 29. A method incorporating any example of this disclosure further includes:

[0125] Based on the detected change in the first gesture, the operation of displaying a set of options in the interactive interface is executed.

[0126] Example 30. The method in conjunction with any example of this disclosure identifies the second gesture change as including:

[0127] It recognizes the process of the thumb retracting.

[0128] Example 31. A method incorporating any example of this disclosure, comprising:

[0129] The corresponding operation associated with the pre-selected interactive object is executed, and the interactive input is turned off.

[0130] Example 32. A method incorporating any example of this disclosure, comprising:

[0131] In response to the recognition of gesture input, perform the operation of displaying a set of options in the interactive interface.

[0132] Example 33. In conjunction with any example of this disclosure, the multiple interaction objects include at least three or three groups of interaction objects.

[0133] Example 34. A method incorporating any example of this disclosure, including:

[0134] Based on the detected thumb rotation speed meeting the option set update conditions, the corresponding operation is executed; and

[0135] In the interactive interface, update the current option set to the first option set corresponding to the operation to be performed.

[0136] Example 35. In conjunction with any example of this disclosure, the first option set includes multiple first interaction objects, and the method includes:

[0137] Based on the detected rotation of the thumb, the corresponding operation is executed to display an indication that the first interactive object corresponding to the different rotation positions of the thumb has been pre-selected.

[0138] Example 36. A method incorporating any example of this disclosure, comprising:

[0139] After the corresponding operation is performed, the secondary interactive object corresponding to the pre-selected interactive object is displayed.

[0140] Example 37. A method incorporating any example of this disclosure, comprising:

[0141] After displaying the secondary interactive object, the corresponding operation associated with the secondary interactive object is executed based on the recognition of the predefined gesture.

[0142] Example 38. In conjunction with any example of this disclosure, the predefined gestures include:

[0143] At least one of the following actions: click, long press, double click, drag.

[0144] Example 39. A method incorporating any example of this disclosure, comprising:

[0145] The interactive interface displays the visual changes corresponding to the actions performed.

[0146] Example 40. A method incorporating any example of this disclosure, comprising:

[0147] The interactive interface displays the first set of options corresponding to the operation being performed.

[0148] Example 41. In conjunction with any example of this disclosure, the first option set includes multiple first interaction objects, and the method includes:

[0149] After the corresponding operation is performed, based on the detected rotation of the thumb, the corresponding operation is performed to display the indication that the first interactive object corresponding to the different rotation positions of the thumb is pre-selected.

[0150] Example 42. A method incorporating any example of this disclosure, comprising:

[0151] Based on the recognition that the thumb is rotating in a second rotation direction different from the first rotation direction, a corresponding operation that is different from the corresponding operation is executed.

[0152] Example 43. A method incorporating any example of this disclosure, comprising:

[0153] Based on the first rotation speed of the thumb, the corresponding operation is executed.

[0154] Example 44. A method incorporating any example of this disclosure, comprising:

[0155] The interactive interface displays the visual changes corresponding to the actions performed.

[0156] Example 45. A method incorporating any example of this disclosure, comprising:

[0157] The interactive interface displays the visual changes corresponding to the actions performed.

[0158] Example 46. A method incorporating any example of this disclosure, comprising:

[0159] The interactive interface displays the first set of options corresponding to the operation being performed.

[0160] Example 47. In conjunction with any example of this disclosure, the first option set includes multiple first interaction objects, and the method includes:

[0161] After the corresponding operation is performed, based on the detected rotation of the thumb, the corresponding operation is performed to display an indication that the first interactive object corresponding to the different rotation positions of the thumb has been pre-selected.

[0162] Example 48. A method incorporating any example of this disclosure, comprising:

[0163] Based on the recognition of a second rotation speed of the thumb that is different from the first rotation speed, a corresponding operation that is different from the corresponding operation is executed.

[0164] Example 49. A method incorporating any example of this disclosure, comprising:

[0165] In the interactive interface, update the current option set to the first option set corresponding to the operation to be performed.

[0166] Example 50. In conjunction with any example of this disclosure, the first option set includes multiple first interaction objects, and the method includes:

[0167] Based on the detected rotation of the thumb within a comfortable range of motion, the corresponding operation is executed to display an indication that the first interactive object corresponding to the different rotation positions of the thumb has been pre-selected.

[0168] Example 51. In conjunction with any example of the present disclosure, the edge rotation range includes: the edge rotation range in the palmar direction and / or the edge rotation range in the back of the hand direction.

[0169] Example 52. A method incorporating any example of this disclosure, comprising:

[0170] After performing the corresponding operation, switch the state of the object being executed.

[0171] Example 53. A method incorporating any example of this disclosure, comprising:

[0172] After performing the corresponding operation, a set of options including multiple interactive objects is displayed in the interactive interface; and

[0173] Based on the detected rotation of the thumb, the corresponding operation is executed to display the pre-selected indicator of the interactive object corresponding to different rotation positions of the thumb.

[0174] While specific embodiments of this disclosure have been illustrated and described by way of example, it will be apparent to those skilled in the art that many other changes and modifications can be made without departing from the spirit and scope of this disclosure. Therefore, all such changes and modifications falling within the scope of this disclosure are included in the appended claims.

Claims

1. An interaction method, comprising: When interactive input is active, gesture input is recognized, including: rotation of the thumb; Display a set of options including multiple interactive objects in the interactive interface; and Based on the detected rotation of the thumb, a first operation is performed to display an indication that an interactive object corresponding to different rotation positions of the thumb has been pre-selected.

2. The method according to claim 1, comprising: Based on the detection of input that meets the operation execution conditions, a second operation associated with the pre-selected interactive object is executed.

3. The method according to claim 1, comprising: Based on the recognition that the thumb is rotating in the first rotation position, an indication is displayed that the first interactive object in the option set is pre-selected; and Based on the recognition that the thumb has changed from the first rotation position to the second rotation position, an indication is displayed that the second interactive object in the option set has been pre-selected and / or the first interactive object is de-pre-selected.

4. The method according to claim 1, comprising: The interactive input is activated based on the recognition of the first gesture change; And / or, The interactive input is turned off based on the recognition of the second gesture change.

5. The method according to claim 5, comprising: After performing the second operation, the secondary interaction object corresponding to the pre-selected interaction object is displayed.

6. An interaction method, comprising: When interactive input is active, gesture input is recognized, including: rotation of the thumb; and Based on the recognition that the thumb is rotating in the first rotation direction, the first operation is performed.

7. An interaction method, comprising: When interactive input is active, gesture input is recognized, including: rotation of the thumb; and Based on the first rotational speed of the thumb, the first operation is performed.

8. The method of claim 7, comprising: The visual changes corresponding to the execution of the first operation are displayed in the interactive interface.

9. An interaction method, comprising: When interactive input is active, gesture input is recognized, including: rotation of the thumb; the rotation range of the thumb includes: a comfortable rotation range and an edge rotation range outside the comfortable rotation range; Display a set of options including multiple interactive objects in the interactive interface; Based on the detected rotation of the thumb within the comfortable rotation range, a first operation is performed to display an indication that an interactive object corresponding to different rotation orientations of the thumb has been pre-selected; and Based on the recognition that the thumb has rotated to the edge rotation range, a second operation, different from the first operation, is performed.

10. An interaction method, comprising: When interactive input is active, gesture input is recognized, including: rotation of the thumb; and Based on the continuous rotation of the thumb in a predetermined direction, a first operation and a second operation are sequentially performed at the first and second positions that the thumb passes through, respectively, to display an indication that the object being executed changes from a pre-selected state to a selected state.

Images