Human-computer interaction method and device, electronic equipment and storage medium

Abstract

The invention provides a man-machine interaction method and device, electronic equipment and a storage medium, and belongs to the field of computers. According to the invention, a man-machine interaction scheme based on continuous gesture operation is realized around the floating button. Wherein a user can activate the function selection mode by triggering the suspension button, and then the function menu of the first level is unfolded. Under the condition that the finger of the user does not leave the screen, the scheme supports the user to sequentially unfold the function menus of the subsequent levels through continuous sliding gestures (starting from the floating button), so that dozens of functions on the equipment can be quickly accessed through a single button. In other words, under the condition that the user does not interrupt sliding, the user can slide to the button position corresponding to the needed function all the time, and after sliding is finished at the position, the scheme will automatically trigger the needed function of the user. According to the scheme, expansion and function selection of the function menu are simplified into intuitive and continuous gesture actions, so that the operation convenience of the user is remarkably improved, and the operation efficiency is high.

Description

Technical Field

[0001] This disclosure relates to the field of computers, and in particular to a human-computer interaction method, apparatus, electronic device, and storage medium. Background Technology

[0002] A floating ball, also known as a floating button, floating navigation, or assisted touch, integrates multiple functions to provide users with a more convenient way to operate the device. In other words, users can bring up a function menu by floating the button displayed on the device screen, allowing them to expand and select multiple levels of functions.

[0003] In related technologies, function selection relies on click operations. For example, after a user clicks a floating button, a first-level function menu pops up; after the user selects a function in the first-level function menu (by clicking the button corresponding to that function), a second-level function menu will pop up; in the second-level function menu, the user may need to perform a further click operation to bring up a third-level function menu to complete the selection of the desired function.

[0004] The above-mentioned function selection method often results in low operational efficiency because users frequently need to perform multiple clicks to access the desired function. Summary of the Invention

[0005] This disclosure provides a human-computer interaction method, apparatus, electronic device, and storage medium. The technical solution of this disclosure is as follows:

[0006] According to a first aspect of the present disclosure, a human-computer interaction method is provided, comprising:

[0007] In response to a trigger operation of a floating button on the human-computer interaction interface, a first-level function menu is displayed on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button;

[0008] In response to a sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first level function menu;

[0009] In response to the end of the swipe, the function corresponding to the target function button is executed; wherein the swipe operation terminates within the response area of ​​the target button.

[0010] In some embodiments, the response to a swipe operation starting from the floating button, based on the acquired swipe trajectory, sequentially expands subsequent levels of function menus on top of the first-level function menu, including:

[0011] If the triggering operation is a press operation, and the floating button is in a pressed state, in response to a sliding operation starting from the floating button, based on the acquired sliding trajectory, the subsequent levels of the function menu are sequentially expanded from the first-level function menu; or,

[0012] If the triggering operation is a click operation, after the first-level function menu is expanded, in response to the sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first-level function menu.

[0013] In other embodiments, the response to a swipe operation starting from the floating button, based on the acquired swipe trajectory, sequentially expands subsequent levels of function menus on top of the first-level function menu, including:

[0014] In response to the sliding trajectory pointing from the floating button to the first function button and extending towards the target direction after passing the first function button, a second-level function menu is displayed on the basis of the first-level function menu; wherein, the first function button is any function button in the first-level function menu; the second-level function menu is used to display the function branch corresponding to the first function button;

[0015] In response to the sliding trajectory extending to the second function button and then continuing to extend towards the target direction, a third-level function menu is displayed based on the second-level function menu; wherein, the second function button is any function button in the second-level function menu; the third-level function menu is used to display the function branch corresponding to the second function button.

[0016] In other embodiments, displaying the second-level function menu includes:

[0017] Based on the current operating environment of the device, the function buttons included in the second-level function menu are displayed in sequence; among them, the function buttons that match the current operating environment of the device more closely are displayed earlier.

[0018] In other embodiments, the method further includes:

[0019] When displaying the second-level function menu, the control device vibrates at the first intensity.

[0020] When displaying the third-level function menu, the control device vibrates at a second intensity, which is greater than the first intensity.

[0021] In other embodiments, the method further includes:

[0022] For any level of function menu, in response to the function configuration operation of any button in the function menu, a mapping relationship is established between the button and the currently configured function.

[0023] In other embodiments, the method further includes:

[0024] The floating button and at least one selected function button are displayed in a manner distinct from the remaining function buttons;

[0025] The at least one function button is located on the sliding trajectory; the remaining function buttons refer to the other function buttons on the human-computer interaction interface besides the at least one function button.

[0026] In other embodiments, the step of displaying a first-level function menu on the human-computer interaction interface in response to a trigger operation of a floating button on the human-computer interaction interface includes:

[0027] In response to the triggering operation of the floating button, a recommended path is displayed on the human-computer interaction interface according to the current operating environment of the device;

[0028] In response to the abandonment of the recommended path, the first-level function menu is displayed on the human-computer interaction interface.

[0029] In other embodiments, the method further includes:

[0030] In response to the confirmation operation of the recommended path, a specified function is executed; wherein the specified function is the function corresponding to the last function button on the recommended path.

[0031] In other embodiments, the sequential expansion of subsequent levels of the function menu includes:

[0032] For any level of function menu, in response to entering the response range of the function menu, the function buttons included in the function menu are displayed in a carousel.

[0033] In other embodiments, when the local device and other devices are currently logged into the same user account and are on the same local area network, the method further includes:

[0034] In response to a preset gesture operation on the floating button, a control command is sent to other devices currently logged in with the same user account; wherein the control command is used to instruct other devices to perform the function corresponding to the preset gesture operation.

[0035] In other embodiments, the method further includes:

[0036] In response to the triggering operation of the floating button, a multi-level function menu is displayed on the human-computer interaction interface;

[0037] In response to a swipe operation from the floating button to the expanded function menu, the swipe trajectory is acquired and the function corresponding to the target function button is executed after the swipe ends.

[0038] In other embodiments, the method further includes:

[0039] In response to zooming in on any level of the expanded function menu, the zoomed-in function menu is displayed on the human-computer interaction interface.

[0040] According to a second aspect of the present disclosure, a human-computer interaction device is provided, comprising:

[0041] The first display module is configured to display a first-level function menu on the human-computer interaction interface in response to a trigger operation of a floating button on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button.

[0042] The first display module is also configured to respond to a sliding operation starting from the floating button, and based on the obtained sliding trajectory, sequentially expand the subsequent levels of function menus on the basis of the first level function menu;

[0043] The execution module is configured to execute the function corresponding to the target function button in response to the end of the swipe; wherein the swipe operation terminates within the response area of ​​the target button.

[0044] In some embodiments, the first display module is further configured to:

[0045] If the triggering operation is a press operation, and the floating button is in a pressed state, in response to a sliding operation starting from the floating button, based on the acquired sliding trajectory, the subsequent levels of the function menu are sequentially expanded from the first-level function menu; or,

[0046] If the triggering operation is a click operation, after the first-level function menu is expanded, in response to the sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first-level function menu.

[0047] In other embodiments, the first display module is further configured to:

[0048] In response to the sliding trajectory pointing from the floating button to the first function button and extending towards the target direction after passing the first function button, a second-level function menu is displayed on the basis of the first-level function menu; wherein, the first function button is any function button in the first-level function menu; the second-level function menu is used to display the function branch corresponding to the first function button;

[0049] In response to the sliding trajectory extending to the second function button and then continuing to extend towards the target direction, a third-level function menu is displayed based on the second-level function menu; wherein, the second function button is any function button in the second-level function menu; the third-level function menu is used to display the function branch corresponding to the second function button.

[0050] In other embodiments, the first display module is further configured to:

[0051] Based on the current operating environment of the device, the function buttons included in the second-level function menu are displayed in sequence; among them, the function buttons that match the current operating environment of the device more closely are displayed earlier.

[0052] In other embodiments, the device further includes:

[0053] The function configuration module is configured to, for any level of function menu, respond to a function configuration operation on any button in the function menu, establish a mapping relationship between the button and the currently configured function.

[0054] In other embodiments, the first display module is further configured to:

[0055] The floating button and at least one selected function button are displayed in a manner distinct from the remaining function buttons;

[0056] The at least one function button is located on the sliding trajectory; the remaining function buttons refer to the other function buttons on the human-computer interaction interface besides the at least one function button.

[0057] In other embodiments, the first display module is further configured to:

[0058] In response to the triggering operation of the floating button, a recommended path is displayed on the human-computer interaction interface according to the current operating environment of the device;

[0059] In response to the abandonment of the recommended path, the first-level function menu is displayed on the human-computer interaction interface.

[0060] In other embodiments, the execution module is further configured to execute a specified function in response to a confirmation operation on the recommended path; wherein the specified function is the function corresponding to the last function button on the recommended path.

[0061] In other embodiments, the first display module is further configured to:

[0062] For any level of function menu, in response to entering the response range of the function menu, the function buttons included in the function menu are displayed in a carousel.

[0063] In other embodiments, when the local device and other devices are currently logged into the same user account, the apparatus further includes:

[0064] The sending module is configured to send control commands to other devices currently logged in with the same user account in response to a preset gesture operation on the floating button; wherein the control commands are used to instruct other devices to perform the function corresponding to the preset gesture operation.

[0065] In other embodiments, the first display module is further configured to display a multi-level function menu on the human-computer interaction interface in response to a trigger operation of the floating button.

[0066] The execution module is further configured to, in response to a sliding operation from the floating button to the expanded function menu, acquire the sliding trajectory and, after the sliding ends, execute the function corresponding to the target function button.

[0067] According to a third aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0068] One or more processors;

[0069] Memory used to store the executable program code of the processor;

[0070] The processor is configured to execute the program code to implement the aforementioned human-computer interaction method.

[0071] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein program code in the computer-readable storage medium is executed by a processor of an electronic device, enabling the electronic device to perform the human-computer interaction method described above.

[0072] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor of an electronic device, implements the human-computer interaction method described above.

[0073] This disclosure implements a human-computer interaction scheme based on continuous gesture operation, centered around a floating button. By triggering the floating button, the user activates a function selection mode, subsequently expanding the first-level function menu. Without lifting the user's finger from the screen, this scheme allows the user to sequentially expand subsequent levels of the function menu through continuous swipe gestures (starting from the floating button), thereby enabling quick access to dozens of functions on the device via a single button. In other words, without interrupting the swipe, the user can continue swiping until reaching the button corresponding to the desired function; upon ending the swipe at that point, the scheme automatically triggers the desired function. Because this scheme simplifies the expansion of the function menu and function selection into intuitive, continuous gesture actions, it not only reduces the user's operational steps, significantly improving user convenience and efficiency, but also better aligns with user habits, meeting the user's need for efficient interaction.

[0074] In summary, the embodiments disclosed herein provide a human-computer interaction solution that integrates multiple functions, is more intuitive and convenient to operate, and is adapted to user habits. This solution is applicable to devices of various screen sizes, especially small-screen devices, and can significantly improve the user experience with excellent human-computer interaction effects.

[0075] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0076] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0077] Figure 1 This is a schematic diagram illustrating the implementation environment of a human-computer interaction method according to an exemplary embodiment.

[0078] Figure 2 This is a flowchart illustrating a human-computer interaction method according to an exemplary embodiment.

[0079] Figure 3 This is a schematic diagram illustrating a human-computer interaction interface according to an exemplary embodiment.

[0080] Figure 4 This is a schematic diagram illustrating another human-computer interaction interface according to an exemplary embodiment.

[0081] Figure 5 This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment.

[0082] Figure 6This is a schematic diagram illustrating another human-computer interaction interface according to an exemplary embodiment.

[0083] Figure 7 This is a schematic diagram illustrating another human-computer interaction interface according to an exemplary embodiment.

[0084] Figure 8 This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment.

[0085] Figure 9 This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment.

[0086] Figure 10 This is a block diagram illustrating a human-computer interaction device according to an exemplary embodiment.

[0087] Figure 11 This is a block diagram illustrating a terminal according to an exemplary embodiment. Detailed Implementation

[0088] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0089] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0090] The information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by the parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0091] With the increasing prevalence of smart devices (such as smartphones, tablets, and wearable devices), human-computer interaction technology has become increasingly important. Existing human-computer interaction methods, such as menu-style button layouts or linear arrangement patterns, often suffer from drawbacks such as cluttered interfaces and cumbersome operations when faced with an increase in functionality, causing visual burdens and interaction barriers for users.

[0092] Therefore, gesture recognition-based interaction methods have developed rapidly in recent years, such as hover navigation or assisted touch technology. With hover navigation or assisted touch functions, users can open a function menu integrating multiple functions and select functions with a single button (also known as a hover button or hover ball), thereby reducing the number of interface elements, ensuring interface simplicity, and reducing the user's visual burden.

[0093] However, existing assisted touch and other interaction methods still have many shortcomings. For example, the operation hierarchy is complex: users often need to click multiple times to bring up the function menu containing the desired function, resulting in a lengthy operation path and low efficiency. Another example is limited functional scalability: existing assisted touch or floating navigation usually only supports expanding a limited number of functions, making it difficult to meet users' needs for quick access to multiple functions. Yet another example is the lack of gesture support: existing assisted touch or floating navigation relies on click operations and lacks support for natural interaction methods such as swipe gestures, limiting the user's freedom of operation.

[0094] Based on the above description, it is crucial to develop a human-computer interaction solution that integrates multiple functions, offers more intuitive and convenient operation, and adapts to user habits. In other words, by using continuous gestures around a floating button to sequentially expand multi-level function menus and quickly select functions, not only can the number of operation steps be significantly reduced, but the intuitiveness and convenience of operation can also be greatly improved, thereby meeting users' needs for efficient interaction.

[0095] In this embodiment of the disclosure, a main button (also known as a floating button) is designed. By triggering this button (such as a long press), the user can activate the function selection mode, which will then expand the first-level function menu. Then, by performing a swipe gesture, the user can gradually expand the subsequent levels of function menus based on the first-level function menu, so that the user can select the desired function.

[0096] Main button design: Set a movable main button on the human-computer interaction interface, which users can place anywhere on the device screen according to their personal habits.

[0097] Activate function selection mode: When the user triggers the main button, they enter the function selection mode, which then displays the first-level function menu, such as showing the three function buttons included in the first-level function menu.

[0098] Function expansion mechanism: If a user presses and holds the main button while sliding in a certain direction, the device will expand the function menu level by level according to the sliding direction. In other words, after entering the response range of a function button, continuing to slide will expand the function button to the next level. The function at this level is the function branch corresponding to that function button.

[0099] Function Selection and Execution: During the swipe, the device highlights the main button and all function buttons the swipe gesture passes over. After the user releases their finger, the device executes the function corresponding to the endpoint of the swipe path.

[0100] Function configuration and customization: This solution allows users to customize the function of each button according to their individual needs, achieving personalized configuration.

[0101] In summary, by using continuous swipe gestures around the main button, users can quickly access dozens of functions. Furthermore, this solution simplifies the click-based multi-level menu expansion and function selection into intuitive, continuous gestures, resulting in smoother operation and a shorter path for function access, eliminating the need to navigate between multiple levels through clicks. Additionally, this solution supports continuous swipe gestures to expand function buttons level by level, achieving a natural transition in the operation flow, effectively improving operational efficiency and better adapting to user habits. Moreover, the function corresponding to each button can be customized to meet the needs of different users, enhancing usability and providing a more personalized human-computer interaction experience.

[0102] The human-computer interaction scheme provided by the present disclosure will be described in detail below through the following embodiments.

[0103] Figure 1 This is a schematic diagram illustrating the implementation environment of a human-computer interaction method according to an exemplary embodiment.

[0104] See Figure 1 The implementation environment includes a terminal 101 and a user 102. The terminal 101 is an electronic device used by the user 102. In this embodiment, the terminal 101 has floating navigation or assisted touch functions. For example, a floating ball or floating button is displayed on the screen of the terminal 101.

[0105] In some embodiments, the terminal 101 may be a small-screen device such as a smartphone or tablet computer, but this disclosure does not limit this. Figure 1 This example uses the Terminal 101 as a smartphone for illustration only.

[0106] Furthermore, those skilled in the art will understand that the number of the aforementioned terminals may be more or less. For example, there may be only a few terminals, and this disclosure does not limit the number or type of terminals.

[0107] Figure 2 This is a flowchart illustrating a human-computer interaction method according to an exemplary embodiment, such as... Figure 2 As shown, this human-computer interaction method is applied to electronic devices, such as... Figure 1 In the terminal 101 shown, the human-computer interaction method includes the following steps:

[0108] In 201, in response to a trigger operation on a floating button on the human-computer interaction interface, the electronic device displays a first-level function menu on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button.

[0109] In this embodiment, the floating button is movable, and the user can place it anywhere on the device screen according to their personal habits. Furthermore, the floating button can be an icon of any shape, such as a circular icon; this disclosure does not limit its shape. Figure 3 This is a schematic diagram illustrating a human-computer interaction interface according to an exemplary embodiment. See also... Figure 3 The bottom right corner of the screen displays a circular icon, namely the floating button 1. Since the user's finger has not yet touched the button, the floating button 1 is in standby mode, and there are currently no function buttons on the screen.

[0110] In some embodiments, the above-described triggering operation of the floating button is a pressing operation, and this disclosure does not limit this to.

[0111] Figure 4 This is a schematic diagram illustrating another human-computer interaction interface according to an exemplary embodiment. See also Figure 4 Taking a long press as an example, when a user presses and holds the floating button 1, the function expansion mode is activated, and the first-level function menu 2 is then displayed around the floating button 1. For example, the function buttons included in the first-level function menu 2 expand radially around the floating button 1.

[0112] Each function button corresponds to a function branch. In other words, a swipe gesture over a function button and extending it can bring up the sub-functions included under that function button, that is, further expand the function menu to the next level.

[0113] It should be noted that, in addition to a radial layout, the expanded function buttons can also be arranged in a circular layout, a fan-shaped twisted layout, or a dynamically tracking display layout, etc., and this disclosure does not limit this. Regardless of whether the function buttons are arranged in a straight line, arc, fan shape, or other structure, as long as the user can select functions by swiping, they fall within the protection scope of this disclosure.

[0114] In 202, in response to a sliding operation starting from the floating button, the electronic device, based on the acquired sliding trajectory, sequentially expands the subsequent levels of function menus on the basis of the first-level function menu.

[0115] In this embodiment of the disclosure, the user can perform a swipe gesture while pressing and holding the floating button, so as to trigger the device to expand the function buttons step by step through the gesture operation, thereby completing the function selection.

[0116] In this context, expanding the function menu to the next level based on the first-level function menu refers to:

[0117] Starting from the floating button, if you slide to the location of any function button in the first-level menu and continue sliding, the second-level menu will appear after sliding a certain distance. The first-level menu will remain displayed and will not disappear automatically. The second-level menu displays the function branch corresponding to the selected function button in the first-level menu.

[0118] Next, after sliding to the location of any function button in the second-level function menu, if the sliding action continues, the third-level function menu will be displayed after sliding a certain distance. At this time, the first-level and second-level function menus will still be displayed and will not disappear automatically. The third-level function menu is used to display the function branch corresponding to the selected function button in the second-level function menu.

[0119] Similarly, by performing a swipe gesture, the user can trigger the device to expand the function buttons step by step in the form of a function menu.

[0120] In step 203, in response to the end of the slide, the electronic device executes the function corresponding to the target function button in the expanded function menu; wherein the slide operation terminates within the response area of ​​the target button.

[0121] In this embodiment of the disclosure, once the user releases their finger during the swipe, it signifies the end of the swipe and the user has located the desired function through continuous gesture operations. At this time, the device will automatically trigger the function corresponding to the current path endpoint.

[0122] This disclosure implements a human-computer interaction scheme based on continuous gesture operation, centered around a floating button. By triggering the floating button, the user activates a function selection mode, subsequently expanding the first-level function menu. Without lifting the user's finger from the screen, this scheme allows the user to sequentially expand subsequent levels of the function menu through continuous swipe gestures (starting from the floating button), thereby enabling quick access to dozens of functions on the device via a single button. In other words, without interrupting the swipe, the user can continue swiping until reaching the button corresponding to the desired function; upon ending the swipe at that point, the scheme automatically triggers the desired function. Because this scheme simplifies the expansion of the function menu and function selection into intuitive, continuous gesture actions, it not only reduces the user's operational steps, significantly improving user convenience and efficiency, but also better aligns with user habits, meeting the user's need for efficient interaction.

[0123] In summary, the embodiments disclosed herein provide a human-computer interaction solution that integrates multiple functions, is more intuitive and convenient to operate, and is adapted to user habits. This solution is applicable to devices of various screen sizes, especially small-screen devices, and can significantly improve the user experience with excellent human-computer interaction effects.

[0124] The above Figure 2 The diagram shown is merely the basic process of this disclosure. The following section will further elaborate on the solution provided in this disclosure based on a specific implementation method. Figure 5 This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment, such as... Figure 5 As shown, this human-computer interaction method is applied to electronic devices, such as... Figure 1 In the terminal 101 shown, taking the trigger operation of the floating button as a press operation as an example, this human-computer interaction method includes the following steps:

[0125] In 501, in response to a press operation on a floating button on the human-computer interaction interface, the electronic device displays a first-level function menu on the human-computer interaction interface.

[0126] As an example, in response to a press of a floating button on the human-computer interaction interface, a first-level function menu is displayed on the human-computer interaction interface, including but not limited to the following methods:

[0127] In response to a press of the floating button, a recommended path is displayed on the human-machine interface based on the current operating environment of the device; in response to an abandonment of the recommended path, the electronic device displays a first-level function menu on the human-machine interface.

[0128] The recommended path mentioned above is also referred to as the function selection path. The current operating environment of the device is a comprehensive representation of the physical conditions, system state, and interaction scenario of the electronic device, used to fully reflect the device's operating conditions and usage context. For example, the aforementioned interaction scenario includes, but is not limited to: usage scenarios (such as office / game / navigation / movie watching), and peripheral device (such as headphones / keyboard) connection status; this disclosure does not limit these aspects.

[0129] For example, when displaying the recommended path, the electronic device will also display two options: one is a "Confirm / Yes" option, and the other is a "Cancel / No" option. In response to the user's click on the "Confirm / Yes" option, indicating that the user has canceled the recommended path, the electronic device displays a first-level function menu on the human-computer interaction interface.

[0130] Furthermore, in response to the user's click on the "Confirm / Yes" option, if it is determined that the user accepts the recommended path, the function corresponding to the end point of the recommended path is directly accessed. That is, the embodiments of this disclosure also include: in response to the confirmation operation of the recommended path, executing a specified function; wherein, the specified function is the function corresponding to the last function button on the recommended path.

[0131] As described above, this embodiment can also automatically recommend routes to the user based on the device's current operating environment. If the user does not accept the recommendation, the first-level function menu is still displayed. If the user accepts the recommendation, they can directly access the function corresponding to the end of the recommended path, without needing to perform continuous swiping to select a function. This recommendation method is more flexible and enables users to access functions more quickly.

[0132] In 502, when the floating button is pressed, in response to a sliding operation starting from the floating button, the electronic device sequentially expands the subsequent levels of function menus based on the acquired sliding trajectory, building upon the first-level function menu.

[0133] In some embodiments, in response to a sliding operation starting from the floating button, based on the obtained sliding trajectory, subsequent levels of function menus are sequentially expanded from the first-level function menu, including but not limited to the following steps:

[0134] In response to the sliding trajectory pointing from the floating button to the first function button and extending towards the target direction after passing the first function button, a second-level function menu is displayed on the basis of the first-level function menu; in response to the sliding trajectory extending to the second function button and continuing to extend towards the target direction, a third-level function menu is displayed on the basis of the second-level function menu.

[0135] The first function button is any function button in the first-level function menu; the second function button is any function button in the second-level function menu; the second-level function menu is used to display the function branches corresponding to the first function button; and the third-level function menu is used to display the function branches corresponding to the second function button.

[0136] In other embodiments, when a user switches from one level of function menu to another, the electronic device provides vibration feedback of appropriate intensity to prompt the user. For example, when displaying a second-level function menu, the electronic device vibrates at a first intensity; and when displaying a third-level function menu, the electronic device vibrates at a second intensity. Exemplarily, the second intensity is greater than the first intensity, that is, the vibration intensity increases as the later the function menu level is expanded, but this disclosure is not limited thereto. This method of providing vibration feedback to the user effectively reminds the user of the current function menu display progress, facilitating the user to perform subsequent swiping operations, which lays the foundation for the user to quickly select functions.

[0137] In other embodiments, to facilitate user confirmation of the selected function button, the electronic device may also display a floating button 1 and the selected at least one function button on the human-computer interaction interface in a manner distinct from the remaining function buttons. This display method can significantly improve the user's information acquisition efficiency. The selected at least one function button is located on the sliding trajectory, i.e., the user's sliding gesture passes over these function buttons. The remaining function buttons refer to other function buttons displayed on the human-computer interaction interface besides these. As an example, the electronic device may highlight the selected at least one function button; this disclosure does not limit this.

[0138] The following is combined Figure 4 , Figure 6-7 Examples are provided to illustrate how to expand the function menu to the next level in sequence.

[0139] See Figure 4 When the user long-presses the floating button 1, the function expansion mode is activated, and the first-level function menu 2, which includes three function buttons, expands around the floating button 1 in a radial layout. Each of these three function buttons corresponds to a function branch.

[0140] Next, see Figure 6 When a user holds down the floating button 1 and slides their finger upwards, upon entering the response area of ​​a function button, the electronic device will expand the function buttons included in the second-level function menu 3. In other words, after recognizing a continuous sliding operation, the electronic device will further expand the second-level function menu 3 based on the first-level function menu 1, forming the next level of sub-function branches.

[0141] In addition, the electronic device will highlight the function buttons located along the swipe path in real time based on the direction of the finger swipe. Since the user has not yet released their finger, the electronic device will continue to perform gesture recognition and will not enter the function execution stage.

[0142] Next, see Figure 7 After swiping past a function button in the first-level function menu 2, the user continues to swipe upwards. Without interrupting the swipe, the user can directly swipe upwards to the location of a function button in the second-level function menu 3. If the user releases their finger at this location, the electronic device will automatically trigger the function corresponding to the current path endpoint.

[0143] In other embodiments, this solution can also adjust the order of the function buttons in the currently expanded function menu according to the device's real-time operating environment. For example, if a message is received while a video is playing, the message reading function will be displayed at the beginning of this function menu to facilitate user operation and further improve user efficiency. Taking the display of the second-level function menu as an example, the electronic device can display the function buttons included in the second-level function menu in sequence according to the current operating environment. Among them, the function button that matches the current operating environment of the device the most closely is displayed at the beginning.

[0144] In other embodiments, during a finger swipe, the currently displayed function buttons on the menu may not be what the user needs. To facilitate quick selection without interrupting the swipe operation to switch function buttons, the electronic device can automatically switch the display of function buttons in the menu, thereby further improving user efficiency. That is, it sequentially expands subsequent levels of the menu, including but not limited to methods such as:

[0145] For any level of function menu, in response to entering the response range of that function menu, the function buttons included in that function menu are displayed in a carousel format.

[0146] In 503, in response to the end of the slide, the electronic device executes the function corresponding to the target function button; wherein the slide operation terminates within the response area of ​​the target button.

[0147] In this embodiment of the disclosure, the target function button is located in the last level of the expanded function menu.

[0148] In some embodiments, this disclosure allows users to customize the function of each button according to their individual needs, thereby achieving personalized function configuration. That is, for any level of function menu, in response to a function configuration operation on any button in the function menu, a mapping relationship is established between the button and the currently configured function.

[0149] For example, users can configure the function of any button based on the function configuration interface, and this disclosure does not limit this.

[0150] In other embodiments, the floating button can also enable cross-device collaborative interaction. This cross-device collaborative interaction requires that the local device and other devices are currently logged into the same user account and are on the same local area network. Once this prerequisite is met, in response to a user's preset gesture operation on the floating button, the solution sends control commands to other devices currently logged into the same user account. These control commands instruct other devices to perform the function corresponding to the preset gesture operation.

[0151] It should be noted that the functions corresponding to the preset gesture operations can be set by the user, and this disclosure does not limit this. Furthermore, other devices can be home appliances such as televisions, air conditioners, or refrigerators, or office equipment such as computers; this disclosure also does not limit this. For example, taking music playback as an example, a user can control other devices to play music by performing a preset gesture operation on the floating button.

[0152] In summary, the embodiments of this disclosure provide a human-computer interaction solution that integrates multiple functions, offers more intuitive and convenient operation, and is adapted to user habits. This solution can achieve at least the following aspects:

[0153] High operational efficiency: Users can expand multi-level function menus and quickly select functions through continuous gesture operations, reducing the number of click operations required during function selection and significantly improving user operational efficiency.

[0154] Simple interface: Dozens of functions can be expanded through a floating button, reducing the number of buttons on the human-computer interaction interface, effectively improving the aesthetics of the interface, and reducing the visual burden and interaction barriers for users.

[0155] Personalized configuration: Users can customize the functions of each button according to their personal usage habits, which can adapt to the needs of different users, enhance usability, and provide users with a more personalized human-computer interaction experience.

[0156] Highly adaptable: This solution is suitable for devices of various screen sizes, especially small screen devices, and can significantly improve the user experience.

[0157] Figure 8 This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment, such as... Figure 8 As shown, this human-computer interaction method is applied to electronic devices, such as... Figure 1 In the terminal 101 shown, taking the trigger operation of the floating button as a click operation as an example, this human-computer interaction method includes the following steps:

[0158] In 801, in response to a click on a floating button on the human-computer interaction interface, the electronic device displays a first-level function menu on the human-computer interaction interface.

[0159] This step can be referred to in the aforementioned steps 201 or 501, and will not be repeated here.

[0160] In 802, after the first-level function menu is expanded, in response to the sliding operation starting from the floating button, the electronic device expands the subsequent levels of function menus sequentially based on the obtained sliding trajectory.

[0161] In this embodiment of the disclosure, after a user clicks the floating button once, the first-level function menu is brought up. After the first-level function menu is expanded, if the user presses and holds the floating button and performs a continuous swipe gesture, the device can trigger the function buttons to expand level by level, thereby completing the function selection.

[0162] In this context, expanding the function menu to the next level based on the first-level function menu refers to:

[0163] After the first-level function menu is expanded, the user presses and holds the floating button and begins to slide. Once the user slides to any function button within the first-level menu and continues sliding, the second-level function menu will be displayed after a short distance. The first-level function menu remains visible and does not disappear automatically.

[0164] Next, after sliding to the location of any function button in the second-level function menu, if the sliding action continues, the third-level function menu will be displayed after sliding a certain distance. At this time, the first-level and second-level function menus will still be displayed and will not disappear automatically. The third-level function menu is used to display the function branch corresponding to the selected function button in the second-level function menu.

[0165] Similarly, by performing a swipe gesture, the user can trigger the device to expand the function buttons step by step in the form of a function menu.

[0166] In 803, in response to the end of the slide, the electronic device executes the function corresponding to the target function button; wherein the slide operation terminates within the response area of ​​the target button.

[0167] In summary, in addition to the human-computer interaction method of pressing + continuous swiping gestures, the embodiments of this disclosure also support the following human-computer interaction method: clicking the floating button once → bringing up the first-level function menu → after expanding the first-level function menu, triggering the display of more levels of function menus and making function selections through continuous swiping gestures.

[0168] Figure 9This is a flowchart illustrating another human-computer interaction method according to an exemplary embodiment, such as... Figure 9 As shown, this human-computer interaction method is applied to electronic devices, such as... Figure 1 In the terminal 101 shown, taking the trigger operation of the floating button as a click operation as an example, this human-computer interaction method includes the following steps:

[0169] In 901, in response to a click on a floating button on the human-computer interaction interface, the electronic device displays a multi-level function menu on the human-computer interaction interface.

[0170] In this embodiment of the disclosure, after clicking the floating button once, the user can also bring up multiple levels of function menus at once. For example, if the set number of levels is less than or equal to N, all levels of function menus are brought up at once; if the set number of levels is greater than N, the first N levels of function menus are brought up at once. Here, N is a positive integer.

[0171] In 902, in response to a swipe operation from the floating button to the expanded function menu, the electronic device acquires the swipe trajectory and executes the function corresponding to the target function button after the swipe ends; wherein the swipe operation terminates within the response area of ​​the target button.

[0172] With multiple levels of function menus expanded, users can select functions by continuously swiping from the floating button.

[0173] In summary, in addition to the human-computer interaction method of pressing + continuous swiping gestures, the embodiments of this disclosure also support the following human-computer interaction method: clicking a floating button once → bringing up a multi-level function menu → with the multi-level function menu in an expanded state, the user then selects a function by continuous swiping gestures.

[0174] It should be noted that, apart from the three human-computer interaction methods described above, any method that combines function expansion and sliding selection into a single continuous operation falls within the protection scope of this disclosure.

[0175] Figure 10 This is a block diagram illustrating a human-computer interaction device according to an exemplary embodiment. (Refer to...) Figure 10 The device includes:

[0176] The first display module 1001 is configured to display a first-level function menu on the human-computer interaction interface in response to a trigger operation of a floating button on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button.

[0177] The first display module 1001 is also configured to respond to a sliding operation starting from the floating button, and based on the obtained sliding trajectory, sequentially expand the subsequent levels of function menus on the basis of the first level function menu.

[0178] The execution module 1002 is configured to execute the function corresponding to the target function button in response to the end of the sliding operation; wherein the sliding operation terminates within the response area of ​​the target button.

[0179] This disclosure implements a human-computer interaction scheme based on continuous gesture operation, centered around a floating button. By triggering the floating button, the user activates a function selection mode, subsequently expanding the first-level function menu. Without lifting the user's finger from the screen, this scheme allows the user to sequentially expand subsequent levels of the function menu through continuous swipe gestures (starting from the floating button), thereby enabling quick access to dozens of functions on the device via a single button. In other words, without interrupting the swipe, the user can continue swiping until reaching the button corresponding to the desired function; upon ending the swipe at that point, the scheme automatically triggers the desired function. Because this scheme simplifies the expansion of the function menu and function selection into intuitive, continuous gesture actions, it not only reduces the user's operational steps, significantly improving user convenience and efficiency, but also better aligns with user habits, meeting the user's need for efficient interaction.

[0180] In summary, the embodiments disclosed herein provide a human-computer interaction solution that integrates multiple functions, is more intuitive and convenient to operate, and is adapted to user habits. This solution is applicable to devices of various screen sizes, especially small-screen devices, and can significantly improve the user experience with excellent human-computer interaction effects.

[0181] In some embodiments, the first display module is further configured to:

[0182] If the triggering operation is a press operation, and the floating button is in a pressed state, in response to a sliding operation starting from the floating button, based on the acquired sliding trajectory, the subsequent levels of the function menu are sequentially expanded from the first-level function menu; or,

[0183] If the triggering operation is a click operation, after the first-level function menu is expanded, in response to the sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first-level function menu.

[0184] In other embodiments, the first display module is further configured to:

[0185] In response to the sliding trajectory pointing from the floating button to the first function button and extending towards the target direction after passing the first function button, a second-level function menu is displayed on the basis of the first-level function menu; wherein, the first function button is any function button in the first-level function menu; the second-level function menu is used to display the function branch corresponding to the first function button;

[0186] In response to the sliding trajectory extending to the second function button and then continuing to extend towards the target direction, a third-level function menu is displayed based on the second-level function menu; wherein, the second function button is any function button in the second-level function menu; the third-level function menu is used to display the function branch corresponding to the second function button.

[0187] In other embodiments, the first display module is further configured to:

[0188] Based on the current operating environment of the device, the function buttons included in the second-level function menu are displayed in sequence; among them, the function buttons that match the current operating environment of the device more closely are displayed earlier.

[0189] In other embodiments, the device further includes:

[0190] The function configuration module is configured to, for any level of function menu, respond to a function configuration operation on any button in the function menu, establish a mapping relationship between the button and the currently configured function.

[0191] In other embodiments, the first display module is further configured to:

[0192] The floating button and at least one selected function button are displayed in a manner distinct from the remaining function buttons;

[0193] The at least one function button is located on the sliding trajectory; the remaining function buttons refer to the other function buttons on the human-computer interaction interface besides the at least one function button.

[0194] In other embodiments, the first display module is further configured to:

[0195] In response to the triggering operation of the floating button, a recommended path is displayed on the human-computer interaction interface according to the current operating environment of the device;

[0196] In response to the abandonment of the recommended path, the first-level function menu is displayed on the human-computer interaction interface.

[0197] In other embodiments, the execution module is further configured to execute a specified function in response to a confirmation operation on the recommended path; wherein the specified function is the function corresponding to the last function button on the recommended path.

[0198] In other embodiments, the first display module is further configured to:

[0199] For any level of function menu, in response to entering the response range of the function menu, the function buttons included in the function menu are displayed in a carousel.

[0200] In other embodiments, when the local device and other devices are currently logged into the same user account, the apparatus further includes:

[0201] The sending module is configured to send control commands to other devices currently logged in with the same user account in response to a preset gesture operation on the floating button; wherein the control commands are used to instruct other devices to perform the function corresponding to the preset gesture operation.

[0202] In other embodiments, the first display module is further configured to display a multi-level function menu on the human-computer interaction interface in response to a trigger operation of the floating button.

[0203] The execution module is further configured to, in response to a sliding operation from the floating button to the expanded function menu, acquire the sliding trajectory and, after the sliding ends, execute the function corresponding to the target function button.

[0204] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0205] It should be noted that the human-computer interaction device provided in the above embodiments is only illustrated by the division of the above functional units when performing human-computer interaction. In practical applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device can be divided into different functional units to complete all or part of the functions described above. In addition, the human-computer interaction device and the human-computer interaction method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0206] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0207] In some embodiments, an electronic device is also provided, the electronic device comprising:

[0208] One or more processors;

[0209] Memory used to store the executable program code of the processor;

[0210] The processor is configured to execute the program code to implement the aforementioned human-computer interaction method.

[0211] In response to the electronic device being provided as a terminal, Figure 11 This is a block diagram illustrating a terminal 1100 according to an exemplary embodiment.

[0212] Typically, terminal 1100 includes a processor 1101 and a memory 1102.

[0213] Processor 1101 includes one or more processing cores, such as a 4-core processor or an 8-core processor. Processor 1101 is implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Alternatively, processor 1101 includes a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state.

[0214] In some embodiments, processor 1101 integrates a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1101 also includes an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0215] The memory 1102 includes one or more computer-readable storage media, which are non-transitory. The memory 1102 also includes high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1102 are used to store at least one program code, which is executed by the processor 1101 to implement the human-computer interaction method provided in the method embodiments of this disclosure.

[0216] In some embodiments, the terminal 1100 further includes a peripheral device interface 1103 and at least one peripheral device. The processor 1101, memory 1102, and peripheral device interface 1103 are connected via a bus or signal line. Each peripheral device is connected to the peripheral device interface 1103 via a bus, signal line, or circuit board. The peripheral device includes at least one of the following: a radio frequency circuit 1104, a display screen 1105, a camera assembly 1106, an audio circuit 1107, and a power supply 1108.

[0217] Peripheral device interface 1103 is used to connect at least one I / O (Input / Output) related peripheral device to processor 1101 and memory 1102. In some embodiments, processor 1101, memory 1102 and peripheral device interface 1103 are integrated on the same chip or circuit board; in other embodiments, any one or two of processor 1101, memory 1102 and peripheral device interface 1103 are implemented on separate chips or circuit boards, which is not limited in this disclosure.

[0218] The radio frequency (RF) circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. In some embodiments, the RF circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1104 communicates with other terminals via at least one wireless communication protocol. Wireless communication protocols include, but are not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1104 also includes circuitry related to NFC (Near Field Communication), which is not limited in this disclosure.

[0219] Display screen 1105 is used to display a UI (User Interface). The UI includes graphics, text, icons, videos, and any combination thereof. When display screen 1105 is a touch display, it also has the ability to collect touch signals on or above its surface. These touch signals are input as control signals to processor 1101 for processing. In this case, display screen 1105 also provides virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there is one display screen 1105, disposed on the front panel of terminal 1100; in other embodiments, there are at least two display screens 1105, disposed on different surfaces of terminal 1100 or in a folded design; in still other embodiments, display screen 1105 is a flexible display screen, disposed on a curved or folded surface of terminal 1100. Alternatively, display screen 1105 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 1105 is made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0220] The camera assembly 1106 is used to acquire images or videos. In some embodiments, the camera assembly 1106 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In other embodiments, the camera assembly 1106 also includes a flash. The flash is a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, used for light compensation at different color temperatures.

[0221] The audio circuit 1107 includes a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals that are input to the processor 1101 for processing, or input to the radio frequency circuit 1104 to realize voice communication. For stereo acquisition or noise reduction purposes, multiple microphones are used, each located at a different part of the terminal 1100. Alternatively, the microphones may be array microphones or omnidirectional acquisition microphones. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. The speaker may be a conventional thin-film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into sound waves that are audible to humans, but also into sound waves that are inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1107 also includes a headphone jack.

[0222] Power supply 1108 is used to power the various components in terminal 1100. Power supply 1108 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. If power supply 1108 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is charged via a wired connection, while a wireless rechargeable battery is charged via a wireless coil. The rechargeable battery also supports fast charging technology.

[0223] Those skilled in the art will understand that Figure 11 The structure shown does not constitute a limitation on terminal 1100 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0224] In some embodiments, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, which are executed by a processor of an electronic device to implement the human-computer interaction method described above. In other embodiments, the computer-readable storage medium is a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0225] In some embodiments, a computer program product is also provided, including a computer program that, when executed by a processor of an electronic device, implements the human-computer interaction method described above.

[0226] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0227] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A human-computer interaction method, characterized in that, The method includes: In response to a trigger operation of a floating button on the human-computer interaction interface, a first-level function menu is displayed on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button; In response to a sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first level function menu; In response to the end of the swipe, the function corresponding to the target function button is executed; wherein the swipe operation terminates within the response area of ​​the target button.

2. The human-computer interaction method according to claim 1, characterized in that, The response to the swipe operation starting from the floating button, based on the acquired swipe trajectory, sequentially expands the subsequent levels of the function menu on top of the first-level function menu, including: If the triggering operation is a press operation, and the floating button is in a pressed state, in response to a sliding operation starting from the floating button, based on the acquired sliding trajectory, the subsequent levels of the function menu are sequentially expanded from the first-level function menu; or, If the triggering operation is a click operation, after the first-level function menu is expanded, in response to the sliding operation starting from the floating button, based on the obtained sliding trajectory, the subsequent levels of function menus are sequentially expanded on the basis of the first-level function menu.

3. The human-computer interaction method according to claim 1 or 2, characterized in that, The response to the swipe operation starting from the floating button, based on the acquired swipe trajectory, sequentially expands the subsequent levels of the function menu on top of the first-level function menu, including: In response to the sliding trajectory pointing from the floating button to the first function button and extending towards the target direction after passing the first function button, a second-level function menu is displayed on the basis of the first-level function menu; wherein, the first function button is any function button in the first-level function menu; the second-level function menu is used to display the function branch corresponding to the first function button; In response to the sliding trajectory extending to the second function button and then continuing to extend towards the target direction, a third-level function menu is displayed based on the second-level function menu; wherein, the second function button is any function button in the second-level function menu; the third-level function menu is used to display the function branch corresponding to the second function button.

4. The human-computer interaction method according to claim 3, characterized in that, The second-level function menu is displayed, including: Based on the current operating environment of the device, the function buttons included in the second-level function menu are displayed in sequence; among them, the function buttons that match the current operating environment of the device more closely are displayed earlier.

5. The human-computer interaction method according to claim 3, characterized in that, The method further includes: When displaying the second-level function menu, the control device vibrates at the first intensity. When displaying the third-level function menu, the control device vibrates at a second intensity, which is greater than the first intensity.

6. The human-computer interaction method according to claim 1, characterized in that, The method further includes: For any level of function menu, in response to the function configuration operation of any button in the function menu, a mapping relationship is established between the button and the currently configured function.

7. The human-computer interaction method according to claim 1, characterized in that, The method further includes: The floating button and at least one selected function button are displayed in a manner distinct from the remaining function buttons; The at least one function button is located on the sliding trajectory; the remaining function buttons refer to the other function buttons on the human-computer interaction interface besides the at least one function button.

8. The human-computer interaction method according to claim 1, characterized in that, The response to a triggering operation of a floating button on the human-computer interaction interface displays a first-level function menu on the human-computer interaction interface, including: In response to the triggering operation of the floating button, a recommended path is displayed on the human-computer interaction interface according to the current operating environment of the device; In response to the abandonment of the recommended path, the first-level function menu is displayed on the human-computer interaction interface.

9. The human-computer interaction method according to claim 8, characterized in that, The method further includes: In response to the confirmation operation of the recommended path, a specified function is executed; wherein the specified function is the function corresponding to the last function button on the recommended path.

10. The human-computer interaction method according to claim 1, characterized in that, The sequential expansion of subsequent levels of function menus includes: For any level of function menu, in response to entering the response range of the function menu, the function buttons included in the function menu are displayed in a carousel.

11. The human-computer interaction method according to claim 1, characterized in that, When the local device and other devices are currently logged into the same user account and are on the same local area network, the method further includes: In response to a preset gesture operation on the floating button, a control command is sent to other devices currently logged in with the same user account; wherein the control command is used to instruct other devices to perform the function corresponding to the preset gesture operation.

12. The human-computer interaction method according to claim 1, characterized in that, The method further includes: In response to the triggering operation of the floating button, a multi-level function menu is displayed on the human-computer interaction interface; In response to a swipe operation from the floating button to the expanded function menu, the swipe trajectory is acquired and the function corresponding to the target function button is executed after the swipe ends.

13. A human-computer interaction device, characterized in that, The device includes: The first display module is configured to display a first-level function menu on the human-computer interaction interface in response to a trigger operation of a floating button on the human-computer interaction interface; wherein, for any level of function menu, the function menu includes at least one function button. The first display module is also configured to respond to a sliding operation starting from the floating button, and based on the obtained sliding trajectory, sequentially expand the subsequent levels of function menus on the basis of the first level function menu; The execution module is configured to execute the function corresponding to the target function button in response to the end of the swipe; wherein the swipe operation terminates within the response area of ​​the target button.

14. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the human-computer interaction method as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the human-computer interaction method as described in any one of claims 1 to 12.

16. A computer program product, characterized in that, It includes a computer program that, when executed by a processor of an electronic device, implements the human-computer interaction method as described in any one of claims 1 to 12.

Images