Menu interaction method and related equipment

Abstract

The embodiment of the invention discloses a menu interaction method and related equipment, which are used for shortening an interaction path and interaction time delay and enhancing user experience. The method is applied to equipment comprising a display screen and comprises the steps that a first menu is displayed in a first display area of the display screen, and the first menu comprises at least one menu item. And determining a first menu item, wherein the first menu item is any menu item in the at least one menu item. A first position is obtained, the first position indicates the position of a control tool of the display screen on the display screen, the submenu of the first menu item is displayed in a second display area of the display screen, and the second display area is an area associated with the first position.

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to a menu interaction method and related equipment. Background Art

[0002] Nowadays, people's lives are inseparable from electronic screens, and the content displayed on the electronic screens facilitates users to obtain information. Devices carrying electronic screens can provide multiple input methods to change the display content of the electronic screen or operate the content displayed on the electronic screen. Among them, the screen display content can be operated through a menu.

[0003] In the traditional implementation, when a submenu of a menu item in a menu is expanded, the display area of ​​the submenu is fixed near the parent menu, that is, the display area of ​​the submenu is bound to the display area of ​​the parent menu, and the two are closely related.

[0004] In this way, if the user needs to use the function of the submenu, the input position of the user's operation is always required to be near the parent menu. If the user's operation is located elsewhere, it is necessary to move to the vicinity of the parent menu to operate the function in the submenu, which has the problems of long interaction path and high interaction delay, reducing the user experience. Summary of the invention

[0005] The present application provides a menu interaction method and related devices. In the menu interaction method, a second display area for displaying a submenu of a first menu item is associated with a first position, and there is no necessary connection between the first position and the first display area of ​​the first menu (i.e., the parent menu). In other words, the display area of ​​the submenu has nothing to do with the display area of ​​the parent menu, but the first position is considered, so that the display area of ​​the submenu is closer to the needs of actual applications, which can shorten the interaction path and interaction delay, and enhance the user experience.

[0006] In a first aspect, the present application provides a menu interaction method, which is applied to a device including a display screen. For simplicity of explanation, in the following description, a target device is used to indicate a device including a display screen. The menu interaction method includes:

[0007] The target device displays a first menu in a first display area of ​​a display screen, and the first menu includes at least one menu item. There are many possible forms of expression of the first menu, which may be a radial menu, a column menu, a radial menu, etc., which are not specifically limited here. In addition, the first menu may be a system-level menu or an application-level menu, which are not specifically limited here. Among them, a system-level menu refers to a menu displayed on the system desktop, and at least one menu item reflects the function of the device system level. An application-level menu refers to a menu displayed on an application interface, and at least one menu item reflects the function of the application level. Determine the first menu item in at least one menu item of the first menu, that is, hit the first menu item. Hitting the first menu item means that the first menu item is selected at the current moment, and the function of the first menu item is to be executed. The device may also obtain a first position, which indicates the position of the control tool of the display screen on the display screen. There are many possible ways for the device to obtain the first position, which may be obtained in response to an operation on the display screen, or obtained through an interface in response to an operation of an external device of the target device, which are not specifically limited here. Based on the first position, a submenu of the first menu item is displayed in a second display area of ​​the display screen, and the second display area is an area associated with the first position.

[0008] It can be seen from the above technical solution that the present application has the following advantages: the second display area for displaying the submenu of the first menu item is associated with the first position, and there is no necessary connection between the first position and the first display area of ​​the first menu (i.e., the parent menu). In other words, the display area of ​​the submenu has nothing to do with the display area of ​​the parent menu, but the first position is taken into consideration, so that the display area of ​​the submenu is closer to the needs of actual applications, which can shorten the interaction path and interaction delay, and enhance the user experience.

[0009] In a possible implementation of the first aspect, there are many possibilities for the manipulation tool of the display screen, which may include a stylus or a user's hand. In this case, the first position includes the hovering position of the manipulation tool on the display screen, or the contact position of the manipulation tool and the display screen. Whether it is a hovering position or a contact position depends on the manipulation method of the manipulation tool on the display screen. Normally, when the manipulation tool manipulates the displayed content of the display screen by hovering, it can be determined that the first position includes the hovering position of the manipulation tool on the display screen. When the manipulation tool manipulates the displayed content of the display screen by contacting the display screen, it can be determined that the first position includes the contact position of the manipulation tool and the display screen.

[0010] In a possible implementation of the first aspect, the control tool of the display screen may further include a mouse, and when the content displayed on the display screen is controlled by the mouse, a mouse cursor is displayed on the display screen. In this case, the first position includes the position of the mouse cursor on the display screen.

[0011] In a possible implementation of the first aspect, the control tool of the display screen may also include a robotic arm, a simulated hand, a remote control, or other tools that can operate the display screen or can be detected by the target device, which are not specifically limited here.

[0012] In a possible implementation of the first aspect, when it is detected that the manipulation tool is hovering, the first position can be determined as the hovering position of the manipulation tool on the display screen. When it is detected that the manipulation tool is in contact with the display screen, the first position can be determined as the contact position of the manipulation tool with the display screen. The target device can also respond to a click operation from the manipulation tool to determine that the first position includes a display position of a cursor corresponding to the manipulation tool on the display screen.

[0013] In this application, there are multiple possibilities for the control tools of the display screen, which enriches the implementation methods and application scenarios of the technical solution of this application. At the same time, for different control tools, there are also different possibilities for obtaining the first position, which further enhances the feasibility of the technical solution of this application.

[0014] In a possible implementation of the first aspect, there are multiple possibilities for associating the second display area with the first position, and the first position may be included in the second display area, or the distance between the first position and the center of the second display area is less than a first threshold, or the second display area surrounds the first position. The second display area surrounds the first position, which means that the second display area is an annular area, and the submenu of the first menu item is a radial menu.

[0015] In the present application, the association between the second display area and the first position has multiple forms of expression, which further enriches the implementation methods and application scenarios of the present application.

[0016] In a possible implementation of the first aspect, displaying the first menu in the first display area of ​​the display screen may be displayed in response to the first operation. That is, the target device may display the first menu in the first display area in response to the first operation. In other words, the first operation is an operation to invoke the display of the first menu, and the operation type of the operation may be a preset operation type, such as long pressing the display screen, hovering for a long time at a certain position on the display screen, continuously clicking the mouse at a certain position on the display screen, etc. The preset operation type may be set according to the needs of the actual application, and is not specifically limited here. In addition, it should be noted that the position on the display screen corresponding to the first operation is included in the non-control area of ​​the display screen, and the non-control area refers to an area where a certain function control in the current display interface of the display screen is not triggered. In addition, the position on the display screen corresponding to the first operation is not a fixed position, that is, invoking the first menu does not need to be performed at a fixed position.

[0017] In the present application, the position corresponding to the first operation that triggers display of the first menu on the display screen is not fixed. In other words, the technical solution of the present application does not require the first operation to correspond to a fixed position on the display screen, which makes it easier to meet user needs and improves the flexibility and practicality of the technical solution of the present application.

[0018] In a possible implementation of the first aspect, the first display area is symmetrically arranged about an axis of symmetry, and the axis of symmetry of the first area may be different for different types of first operations. Optionally, when the area corresponding to the first operation on the display screen is a linear area, the axis of symmetry of the first display area may be a straight line passing through the vertex of the linear area. The linear area includes lines. Optionally, when the area corresponding to the first operation on the display screen is a nonlinear area, the axis of symmetry of the first display area may be a straight line passing through the center point of the nonlinear area.

[0019] In the present application, when the first display area is symmetrical about the axis of symmetry, the first operation is performed in different areas on the display screen, and the straight line where the axis of symmetry is located is also different, which is closer to the actual application scenario and further enhances the practicality of the technical solution of the present application.

[0020] In a possible implementation of the first aspect, the first display area is symmetrically arranged about an axis of symmetry, and the axis of symmetry includes any one of the following: a long axis of an area of ​​the first operation on the display screen, a vertical line of an edge of the display screen, a diagonal line of the display screen, a symmetry center line of the display screen, and an angular center line of the display screen.

[0021] In the present application, there are multiple possibilities for the symmetry axis of the first display area, which can be determined according to actual applications, enriching the implementation methods of the technical solution of the present application and also improving the flexibility of the technical solution of the present application.

[0022] In a possible implementation of the first aspect, the first menu may be a radial menu, and the center of the radial menu includes the position of the first operation on the display screen. Specifically, when the first operation is a touch operation, the center of the radial menu includes the touch position of the touch operation on the display screen. The touch position includes the contact position between the manipulation tool and the display screen, or the center point of the area of ​​the touch operation on the display screen. When the first operation is a hovering operation, the center of the radial menu includes the center position of the hovering operation on the display screen. The center position includes the center point or vertex of the area of ​​the hovering operation on the display screen.

[0023] In the present application, when the first menu is a radial menu, the center of the radial menu is the position of the first operation on the display screen, and the position of the first operation on the display screen varies with different first operations. It can be flexibly adapted to a variety of application scenarios, further enriching the implementation methods of the technical solutions of the present application.

[0024] In a possible implementation manner of the first aspect, the target device may determine the first menu item from at least one menu item of the first menu in response to the second operation. The target device can determine the first menu item because the second operation points to the first menu item.

[0025] In a possible implementation of the first aspect, the second operation points to the first menu item, and there are multiple forms of expression. If the second operation is a sliding operation, then the direction of the sliding operation points to the first menu item. It should be noted that the sliding mentioned here not only includes sliding operations in contact with the display screen (such as the user's hand, stylus, etc. sliding on the screen), but also includes sliding operations that are not in contact with the display screen (such as the manipulation tool moving within the height range where hovering is detected). In addition, it can also be other types of sliding, such as the cursor of an external device such as a mouse moving on the display screen. If the second operation is a touch operation, then the long axis of the area of ​​the touch operation on the display screen points to the first menu item.

[0026] In this application, the target device can determine the first menu item from at least one menu item based on the direction of the second operation. In other words, in this application, it is not required that the position of the second operation on the display screen reaches the position of the first menu item to hit the first menu item, thereby shortening the interaction path, that is, achieving short-distance interaction, reducing latency, and enhancing user experience.

[0027] In a possible implementation of the first aspect, the target device may also determine the second menu item from at least one menu item of the first menu in response to a third operation. The third operation points to the second menu item, which is similar to the second operation pointing to the first menu item described above, and will not be described in detail here. The target device displays the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item.

[0028] In a possible implementation of the first aspect, the third operation may be a sliding operation. According to the distance between the position of the third operation on the display screen and the display position of the second menu item, the window interface of the second menu item is displayed, including: when the window interface of the second menu item is not displayed in full screen, and the distance between the position of the third operation end point and the display position of the second menu item is detected to be reduced, the display area of ​​the window interface of the second menu item increases. That is, in the process of the third operation moving in the direction close to the display position of the second menu item, the display area of ​​the window interface of the second menu item increases. Alternatively, in the case where the distance between the position of the third operation end point and the display position of the second menu item is detected to be increased, the display area of ​​the window interface of the second menu item is reduced. That is, in the process of the third operation moving in the direction away from the display position of the second menu item, the display area of ​​the window interface of the second menu item is reduced.

[0029] In the present application, the first menu may also include a second menu item. When the second menu item is determined based on the third operation, the display mode of the window interface of the second menu item may also be determined based on the distance between the position of the third operation on the display screen and the display position of the second menu item. The smaller the distance between the position of the third operation on the display screen and the display position of the second menu item, the larger the display area of ​​the window interface of the second menu item, which is closer to the needs of actual applications and further improves the practicality of the technical solution of the present application.

[0030] In a possible implementation of the first aspect, the window interface of the second menu item is displayed according to the distance between the position of the third operation on the display screen and the display position of the second menu item, including: when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold, the window interface of the second menu item is displayed in full screen. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, the window interface of the second menu item is displayed in non-full screen. The second threshold can be set according to the needs of actual application, and is not specifically limited here.

[0031] In a possible implementation of the first aspect, the window interface of the second menu item is displayed in a non-full screen, including: split screen display or floating window display of the window interface of the second menu item. Generally, the display area of ​​the split screen display is larger than the display area of ​​the floating window display. When the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, the window interface of the second menu item is displayed in a non-full screen, including: when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold and less than the third threshold, the window interface of the second menu item is displayed in a split screen. Or, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the third threshold, the floating window displays the window interface of the second menu item. Among them, the third threshold can be set according to the needs of actual application, and is not specifically limited here. In view of this implementation and the previous implementation, in the process of gradually reducing the distance between the position of the third operation on the display screen and the display position of the second menu item, the display of the second menu item changes from floating window display to split screen display, and then to full screen display.

[0032] In the present application, there are multiple implementation methods for displaying the window interface of the second menu item based on the distance between the position of the third operation on the display screen and the display position of the second menu item, which provides multiple possibilities for practical applications and further enriches the application scenarios of the technical solution of the present application.

[0033] In a possible implementation manner of the first aspect, a distance between a position of the third operation on the display screen and a display position of the second menu item is less than a second threshold, including that the position of the third operation on the display screen overlaps with the display position of the second menu item.

[0034] In a possible implementation of the first aspect, the function of the second menu item includes a first sub-function and a second sub-function. The target device displays the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item, including: when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fourth threshold, the window interface of the first sub-function is displayed. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than the fourth threshold, the window interface of the second sub-function is displayed. That is to say, as the relationship between the distance between the position of the third operation on the display screen and the display position of the second menu item and the fourth threshold is different, the window interface of different sub-functions of the second menu item can be displayed on the display screen.

[0035] In the present application, the distance between the position of the third operation of the second menu item on the display screen and the display position of the second menu item is determined. When the relationship with the fourth threshold is different, the window interface of different sub-functions of the second menu item can be displayed on the display screen. In other words, the sub-function switching of the second menu item can be achieved by adjusting the position of the third operation on the display screen and the distance between the display position of the second menu item, further enriching the interaction mode between the operation and the menu, and improving the flexibility of the technical solution of the present application.

[0036] The second aspect of the present application provides a menu interaction method, which is applied to a device including a display screen. For simplicity of explanation, in the following description, a target device is used to indicate a device including a display screen. The menu interaction method includes:

[0037] The target device may determine the first menu item in response to the second operation, where the first menu item is any one of the at least one menu item in the first menu, wherein the second operation points to the first menu item.

[0038] In the present application, the first menu item can be determined from at least one menu item based on the direction of the second operation. That is, in the present application, it is not required that the position of the second operation on the display screen reaches the position of the first menu item to hit the first menu item, thereby shortening the interaction path, that is, realizing short-distance interaction, reducing latency, and enhancing user experience.

[0039] The second aspect of the present application also includes some optional implementation methods, the specific contents and beneficial effects of which are similar to those of the aforementioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0040] The third aspect of the present application provides a menu interaction method, which is applied to a device including a display screen. For simplicity of explanation, in the following description, a target device indicates a device including a display screen. The menu interaction method includes:

[0041] The target device can respond to the third operation and determine the second menu item from at least one menu item of the first menu. The target device displays the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item. The third operation points to the second menu item, which is similar to the second operation pointing to the first menu item described above, and will not be repeated here.

[0042] The third aspect of the present application also includes some optional implementation methods, the specific contents and beneficial effects of which are similar to those of the aforementioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0043] In a fourth aspect, the present application provides a menu interaction method, which is applied to a device including a display screen. For simplicity of explanation, in the following description, a target device is used to indicate a device including a display screen. The menu interaction method includes:

[0044] The target device displays a first menu in a first display area of ​​a display screen, and the first menu includes at least one menu item. The first menu item among the at least one menu item of the first menu is determined, that is, the first menu item is hit. Hitting the first menu item means that the first menu item is currently selected and the function of the first menu item is to be executed. The target device can also obtain a first position, and the first position indicates a preset position of the display screen. Based on the first position, a submenu of the first menu item is displayed in a second display area of ​​the display screen, and the second display area is an area associated with the first position.

[0045] From the above technical solution, it can be seen that the present application has the following advantages: the first position indicates a preset position of the display screen, and there is a certain correlation between the first position and the second display area. Then, after determining that the first menu item is hit, the target device can display the submenu in the second display area, which increases the convenience of submenu display and operation.

[0046] A fifth aspect of the present application provides an electronic device, including a display unit and a processing unit.

[0047] The display unit is used to display a first menu in a first display area of ​​a display screen of the electronic device, where the first menu includes at least one menu item.

[0048] The processing unit is used to determine a first menu item, where the first menu item is any menu item of at least one menu item of the first menu.

[0049] The processing unit is further used to obtain a first position, where the first position indicates a position of a manipulation tool of the display screen on the display screen.

[0050] The display unit is further used to display a submenu of the first menu item in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

[0051] In some optional implementations of the fifth aspect, the manipulation tool includes a stylus or a user's hand, and the first position includes a hovering position of the manipulation tool on the display screen or a contact position of the manipulation tool and the display screen.

[0052] In some optional implementations of the fifth aspect, the manipulation tool includes a mouse, and the first position includes a position of a cursor of the mouse on the display screen.

[0053] In some optional implementations of the fifth aspect, the first position is included in the second display area, the distance between the first position and the center of the second display area is less than a first threshold, or the second display area surrounds the first position.

[0054] In some optional implementations of the fifth aspect, the first display area is symmetrically arranged about the axis of symmetry. When the area of ​​the first operation on the display screen is a linear area, the axis of symmetry is a straight line passing through the vertex of the linear area; or, when the area of ​​the first operation on the display screen is a nonlinear area, the axis of symmetry is a straight line passing through the center point of the nonlinear area.

[0055] In some optional implementations of the fifth aspect, the processing unit is specifically configured to determine the first menu item in response to the second operation, and the second operation points to the first menu item.

[0056] In some optional embodiments of the fifth aspect, the second operation points to the first menu item, including when the second operation is a sliding operation, the direction of the sliding operation points to the first menu item; or, when the second operation is a touch operation, the long axis of the area of ​​the touch operation on the display screen points to the first menu item.

[0057] In some optional implementations of the fifth aspect, the processing unit is further configured to determine the second menu item in response to a third operation, the third operation pointing to the second menu item, and the second menu item is any menu item of at least one menu item of the first menu. The display unit is further configured to display a window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item.

[0058] In some optional implementations of the fifth aspect, the third operation is a sliding operation. The display unit is specifically configured to increase the display area of ​​the window interface of the second menu item when the window interface of the second menu item is not displayed in full screen and the distance between the position of the end point of the third operation and the display position of the second menu item is detected to be reduced; or, when the distance between the position of the end point of the third operation and the display position of the second menu item is detected to be increased, the display area of ​​the window interface of the second menu item is reduced.

[0059] In some optional embodiments of the fifth aspect, the display unit is specifically used to display the window interface of the second menu item in full screen when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold; or to display the window interface of the second menu item in non-full screen when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold.

[0060] In some optional implementations of the fifth aspect, the function of the second menu item includes a first sub-function and a second sub-function. The display unit is specifically configured to display a window interface of the first sub-function when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fourth threshold; or display a window interface of the second sub-function when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than the fourth threshold.

[0061] The electronic device is used to execute the method shown in the first aspect and any possible implementation of the first aspect, or the method shown in the second aspect and any possible implementation of the second aspect, or the method shown in the third aspect and any possible implementation of the third aspect, and its beneficial effects are similar to those above and will not be repeated here.

[0062] A sixth aspect of an embodiment of the present application provides an electronic device, including a display unit and a processing unit.

[0063] The display unit is used to display a first menu in a first display area of ​​a display screen of the electronic device, where the first menu includes at least one menu item.

[0064] The processing unit is used to determine a first menu item, where the first menu item is any menu item of at least one menu item of the first menu.

[0065] The processing unit is further used to obtain a first position, where the first position indicates a preset position of the display screen.

[0066] The display unit is further used to display a submenu of the first menu item in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

[0067] The electronic device is used to execute the method shown in the aforementioned fourth aspect and any possible implementation of the fourth aspect, and its beneficial effects are similar to those mentioned above and will not be repeated here.

[0068] In a seventh aspect, the present application provides an electronic device, including a processor and a memory, wherein the processor stores instructions. When the instructions stored in the memory are executed on the processor, the method shown in the aforementioned first aspect and any possible implementation of the first aspect, or the method shown in the second aspect and any possible implementation of the second aspect, or the method shown in the third aspect and any possible implementation of the third aspect, or the method shown in the fourth aspect and any possible implementation of the fourth aspect is implemented.

[0069] In an eighth aspect of the present application, a computer-readable storage medium is provided, in which instructions are stored. When the instructions are executed on a processor, the method shown in the first aspect and any possible implementation of the first aspect, or the method shown in the second aspect and any possible implementation of the second aspect, or the method shown in the third aspect and any possible implementation of the third aspect, or the method shown in the fourth aspect and any possible implementation of the fourth aspect is implemented.

[0070] In a ninth aspect, the present application provides a computer program product. When the computer program product is executed on a processor, it implements the method shown in the first aspect and any possible implementation of the first aspect, or the method shown in the second aspect and any possible implementation of the second aspect, or the method shown in the third aspect and any possible implementation of the third aspect, or the method shown in the fourth aspect and any possible implementation of the fourth aspect.

[0071] The beneficial effects shown in the seventh to ninth aspects are similar to the methods shown in the first aspect and any possible implementation of the first aspect, or the second aspect and any possible implementation of the second aspect, or the third aspect and any possible implementation of the third aspect, or the fourth aspect and any possible implementation of the fourth aspect, and are not repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] Figure 1 A schematic diagram of the system architecture provided for an embodiment of the present application;

[0073] Figure 2 A flowchart of a menu interaction method provided in an embodiment of the present application;

[0074] Figure 3 A schematic diagram of an interface provided for an embodiment of the present application;

[0075] Figure 4 Another interface schematic diagram provided for an embodiment of the present application;

[0076] Figure 5 Another interface schematic diagram provided for an embodiment of the present application;

[0077] Figure 6 Another interface schematic diagram provided for an embodiment of the present application;

[0078] Figure 7 Another interface schematic diagram provided for an embodiment of the present application;

[0079] Figure 8 Another interface schematic diagram provided for an embodiment of the present application;

[0080] Fig. 9 A schematic diagram provided for an embodiment of the present application;

[0081] Fig.10 Another interface schematic diagram provided for an embodiment of the present application;

[0082] Fig.11 Another interface schematic diagram provided for an embodiment of the present application;

[0083] Fig.12 Another interface schematic diagram provided for an embodiment of the present application;

[0084] Fig.13 Another interface schematic diagram provided for an embodiment of the present application;

[0085] Fig.14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0086] Fig.15 Another schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0087] The present application provides a menu interaction method and related devices. In the menu interaction method, a second display area for displaying a submenu of a first menu item is associated with a first position, and there is no necessary connection between the first position and the first display area of ​​the first menu (i.e., the parent menu). In other words, the display area of ​​the submenu has nothing to do with the display area of ​​the parent menu, but the first position is considered, so that the display area of ​​the submenu is closer to the needs of actual applications, which can shorten the interaction path and interaction delay, and enhance the user experience.

[0088] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0089] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged in appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attribute in the embodiments of the present application when describing. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment containing a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment. In addition, "at least one" refers to one or more, and "multiple" refers to two or more. "And / or", describes the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B, can represent: A exists alone, A and B exist simultaneously, and B exists alone, wherein A, B can be singular or plural. The character " / " generally represents that the associated objects before and after are a kind of "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.

[0090] First, see Figure 1 , Figure 1 A schematic diagram of the system architecture provided for an embodiment of the present application.

[0091] The menu interaction method provided in the embodiment of the present application is applied to a device including a display screen. For the sake of simplicity, the target device is used in the following description to represent a device including a display screen. A variety of information can be displayed on the display screen of the target device, and the display content of the display screen can be changed by operating the display screen.

[0092] Optionally, the user can operate the display screen through gestures, including single-click, double-click, slide, etc. For the target device, different display interfaces or different gestures may trigger different functions.

[0093] Optionally, the user can also operate the content displayed on the display screen through a manipulation tool. There are many possibilities for the manipulation tool, which can be a stylus (or stylus), a mouse, a remote control, a watch, a mobile phone, or other devices that establish a communication connection with the target device and can issue instructions to the target device or operate the target device, and the specifics are not limited here. Optionally, the user's hand can also be called a manipulation tool.

[0094] It should be noted that when operating the display screen through the manipulation tool, it is not required that the manipulation tool completely touches the display screen. When the distance between the manipulation tool and the display screen is less than a preset threshold, the target device can also detect the operation of the manipulation tool. In other words, the target device can also have a hovering function, which can identify the manipulation tool hovering above the display screen.

[0095] It should be noted that the present application does not limit the number and type of display screens included in the target device. When the display screen of the target device includes a double-sided display screen, a folding screen, or a flexible display screen, part of the display screen of the target device acts as a display, and the other part of the display screen can act as a control panel. It can be understood that at this time, only the part of the display screen that acts as a display is the screen that actually displays the content, and the input performed on the screen that acts as a control panel should be considered as input performed at other locations outside the display screen, that is, it can be understood as operating the display screen through a manipulation tool.

[0096] It should be noted that the user refers to the user who operates the target device, including humans in the biological sense, and can also be a robot that operates the target device according to instructions, etc., which is not limited here. Similarly, the user's hand is not limited to a human hand, but can also be a robotic arm, an artificial hand, etc., which is not limited here.

[0097] Next, the interactive method of the menu provided by this application is described with reference to the schematic diagram. Figure 2 , Figure 2 A flowchart of a menu interaction method provided in an embodiment of the present application includes:

[0098] 201. Display a first menu in a first display area of ​​a display screen, where the first menu includes at least one menu item.

[0099] The target device may display the first menu in the first display area in response to the first operation. Specifically, when the target device detects that the first operation is a preset operation, it may determine the position of the first operation on the display screen, determine the first display area according to the position, and display the first menu in the first display area. It is understandable that the user will not perceive the process of the target device determining the first display area.

[0100] Among them, the preset operations can be customized by the user. When the first menu is a system-level menu, the user can configure the preset operations in the system's settings function. When the radial menu is an application's menu, the user can configure the preset operations in the application's settings function. The preset operations corresponding to the system-level radial menu and the application-level radial menu can be the same or different, and are not limited here. Exemplarily, the preset operation can be long pressing the display screen, hovering for a long time at a certain position on the display screen, continuously clicking the mouse at a certain position on the display screen, etc. The preset operation type can be set according to the needs of the actual application, and is not limited here. Exemplarily, the preset operation can be set to a single-finger long press for more than 1 second or 50 milliseconds, etc., which is not limited here.

[0101] It should be noted that the position of the first operation on the display screen is included in the non-control area of ​​the current display interface of the target device, that is, the first operation does not trigger the target device to execute the function of the control displayed on the current interface. In addition, in the embodiment of the present application, unlike the method of invoking the menu in the existing non-control design, the position of the first operation on the screen is not limited to a specific position. In other words, in the embodiment of the present application, the operation of invoking the radial menu does not need to be performed at a fixed position, which improves the flexibility of the technical solution.

[0102] In an embodiment of the present application, the position corresponding to the first operation that triggers display of the first menu on the display screen is not fixed. In other words, the technical solution of the present application does not require that the first operation corresponds to a fixed position on the display screen, which makes it easier to meet user needs and improves the flexibility and practicality of the technical solution of the present application.

[0103] It should also be noted that the embodiment of the present application does not limit the type of the first menu. The first menu can be a row menu, a column menu, a radial menu, etc., which is not specifically limited here. The so-called row menu means that at least one menu item in the menu is arranged in a row, and the menu items are adjacent in the horizontal direction. Similarly, at least one menu item in the column menu is arranged in a column, and the menu items are adjacent in the vertical direction. The radial menu is displayed in a ring-shaped manner, and the menu items are arranged in a ring.

[0104] In some optional implementations, the first display area may be configured to be symmetrical about an axis of symmetry, and there are multiple possibilities for the axis of symmetry.

[0105] Optionally, the axis of symmetry may be related to the shape of the area of ​​the first operation on the display screen. When the area of ​​the first operation on the display screen is a linear area, the axis of symmetry is a straight line passing through the vertices of the linear area. Alternatively, when the area of ​​the first operation on the display screen is a nonlinear area, the axis of symmetry is a straight line passing through the center point of the nonlinear area.

[0106] Exemplarily, when the first operation is that the target device detects that the stylus is hovering above the display screen, within the range where the target device can detect the hovering, the area projected by the stylus on the display screen is in the shape of a line, that is, a linear area. Usually, there is an angle between the stylus and the display screen, and the tip of the pen is at one end close to the display screen. Within the range where the target device can detect the stylus, the target device can also distinguish the vertices of the linear area projected onto the display screen as the tip and tail of the stylus according to the height of the stylus, thereby identifying the direction of the first operation.

[0107] For example, when the first operation is long pressing the display screen with a finger, the target device can detect the contact area between the finger and the display screen, which is a non-linear area. In addition, the contact area may be similar to a fingerprint, and the center point of the fingerprint is the center point of the non-linear area.

[0108] Optionally, the symmetry axis of the first display area may also include any one of the following: the long axis of the area of ​​the first operation on the display screen, a vertical line of the edge of the display screen, a diagonal line of the display screen, a symmetry center line of the display screen, and an angular center line of the display screen.

[0109] Exemplarily, assuming that the first operation is long pressing the display screen with a finger, the target device can detect the contact area between the finger and the display screen, which is similar to a fingerprint, and the target device can determine the long axis of the area.

[0110] In the embodiment of the present application, when the first display area is symmetrical about the symmetry axis, the first operation is performed in different areas on the display screen, and the straight line where the symmetry axis is located is also different, which is closer to the actual application scenario. In general, there are many possibilities for the symmetry axis of the first display area, which can be determined according to the actual application, further improving the practicality and flexibility of the technical solution of the present application.

[0111] In some optional implementations, the target device may also determine the first display area by referring to the relationship between the position of the first operation on the display screen and the edge position of the display screen. For example, when the position of the first operation on the display screen is located at the lower left corner of the display screen, in order to ensure that the first menu can be fully displayed, the position of the first operation on the display screen may be used as the edge of the first display area, and the first display area is located to the upper right of the position of the first operation on the display screen.

[0112] It should be noted that the various parameters of the first menu can be customized by the user. When the first menu is a system-level menu, the user can configure the parameters of the first menu in the system's settings function. When the first menu is an application's menu, the user can configure the parameters of the first menu in the application's settings function. The parameters of the first menu corresponding to the system-level first menu and the application-level first menu may be the same or different, which is not specifically limited here. Among them, the various parameters of the first menu include the shape of the first menu, the number of menu items included, the functions of the menu items, etc., which are not specifically limited here.

[0113] 202. Determine a first menu item, where the first menu item is any menu item of the at least one menu item.

[0114] The target device can determine the first menu item from at least one menu item of the first menu in response to the second operation. This is because the second operation points to the first menu item. The second operation points to the first menu item, and there are many forms of expression: Optionally, if the second operation is a sliding operation, then the direction of the sliding operation points to the first menu item. It should be noted that the sliding mentioned here includes not only sliding operations in contact with the display screen (such as the user's hand, stylus, etc. sliding on the screen), but also sliding operations that do not contact the display screen (such as the manipulation tool moving within the height range where hovering is detected). In addition, it can also be other types of sliding, such as the cursor of an external device such as a mouse moving on the display screen. If the second operation is a touch operation, then the long axis of the area of ​​the touch operation on the display screen points to the first menu item.

[0115] In addition, it should be noted that determining the first menu item means that the first menu item is currently selected and the function of the first menu item is to be executed. How to determine the first menu item based on the second operation will be described in detail below and will not be expanded here.

[0116] In the embodiment of the present application, the target device can determine the first menu item from at least one menu item based on the direction of the second operation. That is to say, in the present application, it is not required that the position of the second operation on the display screen reaches the position of the first menu item to hit the first menu item, thereby shortening the interaction path, that is, realizing short-distance interaction, reducing latency, and enhancing user experience.

[0117] 203. Obtain a first position, where the first position indicates a position of a manipulation tool of the display screen on the display screen.

[0118] The target device can respond to the operation of the manipulation tool, or detect the manipulation tool hovering above the display screen, or detect the manipulation tool in contact with the display screen, thereby obtaining the first position of the manipulation tool indicating the position of the display screen on the display screen. In other words, the target device can not only obtain the position of the operation on the display screen when the user operates the display screen through the manipulation tool, but also actively detect the manipulation tool, which is more sensitive.

[0119] In the embodiment of the present application, there are many possible control tools for the display screen, and the first position may be different for different control tools. The following are respectively described:

[0120] In some optional embodiments, the manipulation tool of the display screen may include a stylus or a user's hand. In this case, the first position includes the hovering position of the manipulation tool on the display screen, or the contact position of the manipulation tool and the display screen. Whether it is a hovering position or a contact position depends on the operation mode of the manipulation tool on the display screen. When the manipulation tool manipulates the display content of the display screen by hovering, it can be determined that the first position includes the hovering position of the manipulation tool on the display screen. When the manipulation tool manipulates the display content of the display screen by contacting the display screen, it can be determined that the first position includes the contact position of the manipulation tool and the display screen.

[0121] In some optional implementations, the control tool of the display screen may further include a mouse, and when the content displayed on the display screen is controlled by the mouse, a mouse cursor is displayed on the display screen. In this case, the first position includes the position of the mouse cursor on the display screen.

[0122] In some optional implementations, the control tool of the display screen may also include a robotic arm, an artificial hand, a remote control, or other tools that can operate the display screen or can be detected by the target device, which are not specifically limited here.

[0123] In some optional embodiments, when the target device detects that the manipulation tool is hovering, the first position can be determined as the hovering position of the manipulation tool on the display screen. When the target device detects that the manipulation tool is in contact with the display screen, the first position can be determined as the contact position of the manipulation tool with the display screen. The target device can also respond to a click operation from the manipulation tool to determine that the first position includes the display position of the cursor corresponding to the manipulation tool on the display screen.

[0124] In one embodiment, step 202 and step 203 are sequential in time, and the first position is acquired by the target device after the first menu item is determined. In other words, determining the first menu item is a prerequisite for the target device to acquire the first position. The target device is determined when receiving an operation performed by a manipulation tool on the display screen, or detecting a manipulation tool hovering on the display screen, and the prerequisite is that the first menu item has been determined. In one embodiment, the first position and the position of the second operation for determining the first menu item on the display screen may be different; in one embodiment, the first position and the position of the second operation for determining the first menu item on the display screen may also be the same.

[0125] For example, assuming that the user operates the display screen with both hands, the target device determines the first menu item in the first menu displayed in the lower left corner of the display screen based on the operation of the user's left hand. Then, it is detected that the index finger of the user's right hand long presses the lower right corner of the display screen, and the target device can determine that the first position is the contact position of the index finger of the right hand and the display screen. In this case, the first position is different from the position of the operation of determining the first menu item.

[0126] In this application, there are multiple possibilities for the control tools of the display screen, which enriches the implementation methods and application scenarios of the technical solution of this application. At the same time, for different control tools, there are also different possibilities for obtaining the first position, which further enhances the feasibility of the technical solution of this application.

[0127] 204. Display a submenu of the first menu item in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

[0128] After obtaining the first position, the target device may determine the second display area based on the first position, and display the submenu of the first menu item in the second display area. The second display area is an area associated with the first position, and the association may be expressed in a variety of ways: the first position may be included in the second display area, or the distance between the first position and the center of the second display area is less than the first threshold, or the second display area surrounds the first position, which is not limited here.

[0129] It should be noted that the first position is included in the second display area, including both the first position being located at the edge of the second display area and the first position being located inside the second display area, which is not specifically limited here. There are many possibilities that the distance between the first position and the center of the second display area is less than the first threshold value. The second display area can be located above, below, to the left, to the right, etc. of the first position. The first threshold value can be set according to actual application and can be related to the display area of ​​the submenu of the first menu or the area of ​​the display screen, which is not specifically limited here. The second display area surrounds the first position, which means that the second display area can be an annular area. In this case, the submenu of the first menu item is a radial menu, and the display position of each menu item in the radial menu is the same distance from the first position. Alternatively, the second display area may not be an annular area, but other regular or irregular areas surrounding the first position, which is not specifically limited here.

[0130] In the embodiments of the present application, the association between the second display area and the first position has multiple forms of expression, which further enriches the implementation methods and application scenarios of the present application.

[0131] It should also be noted that the first position is included in the non-control area of ​​the current interface displayed by the target device, that is, the first position does not trigger the existing function of the control displayed on the current interface. Figure 3 Taking the interface shown as an example, assuming that a toolbar control is also included in the upper left corner of the current interface, if the user clicks the toolbar control through the manipulation tool after determining the first menu item, the submenu of the first menu item will not be triggered, but the function of the toolbar control will be executed.

[0132] The following is a schematic diagram of the previous Figure 2 The display process of the submenu in the embodiment shown is further described. Figure 3 , Figure 3 This is a schematic diagram of an interface provided in the embodiment of the present application. It should be noted that: Figure 3 It is taken as an example that the first menu is a radial menu, and the interface currently displayed on the display screen of the target device is an interface drawn by the application.

[0133] like Figure 3 As shown in FIG. 1 , a radial menu is displayed at the lower left corner of the display screen, and the target device determines the first menu item 301 in the radial menu by recognizing the user's gesture. Figure 3 In the illustrated embodiment, the color of the first menu item 301 is different from the colors of other menu items to indicate that the first menu item 301 is hit.

[0134] In the current interface of the display screen, the user can also control the display screen through the stylus 304. The contact position between the stylus 304 and the display screen is at the tip of the stylus 304. Figure 3 In other words, the first position acquired by the target device is 303. Figure 3 In the illustrated embodiment, the first position 303 is the second display area of ​​the submenu 302 (i.e. Figure 3 As an example, the midpoint of the upper edge of the rounded box shown in FIG. 300 is used to expand the submenu 302 according to the preset shape. Assuming that the function of the first menu item 301 is "color", the submenu 302 of the first menu item is "color palette", which displays a variety of color controls. The position of the submenu 302 is not near the radial menu, but is displayed near the first position 303 sensed.

[0135] refer to Figure 3 It can be seen that in the embodiment of the present application, the submenu of the menu item is displayed near the first position and is not limited to a specific area. In other words, the user does not need to go to a specific area to operate the submenu.

[0136] It should be noted that Figure 3 This is just an example of a submenu that includes multiple colors. In actual applications, the parameters of the submenu can be customized by the user. The parameters include shape, size, number of controls included, and control functions. When the radial menu is a system-level menu, that is, when the radial menu is displayed on the desktop interface, the parameters of the submenu can be configured in the system settings function. When the radial menu is an application menu, that is, when the radial menu is displayed on the application interface, the parameters of the submenu can be configured in the application settings function.

[0137] It should also be noted that within a display cycle, that is, in the process from hitting the first menu item to displaying the submenu of the first menu item, once the second display area of ​​the submenu is determined, the submenu is displayed in the second display area and will not change with the change of the position on the display screen during subsequent operations. Figure 3 Taking the illustrated embodiment as an example, after hitting the first menu item 301, the target device obtains the first position 303, determines the second display area, and displays the submenu 302 of the first menu item in the second display area. Afterwards, the user can select a color in the submenu 302 by sliding the stylus 304. For the target device, a new operation instruction will be obtained, and the operation instruction will not lead to a change in the display area of ​​the submenu 302. When the submenu 302 disappears, the target device can hit a menu item again, and re-determine the display area of ​​the new submenu based on the position of the new operation on the display screen.

[0138] It is understandable that the submenu will not always be displayed on the display screen. In the embodiment of the present application, there are many possible ways for the submenu to disappear. It may be that after the submenu is displayed, the user clicks on the non-control area of ​​the current interface, and the submenu disappears. Figure 3 In the embodiment shown, the user clicks on the area without controls on the interface with the stylus 304. Alternatively, the submenu disappears after the function in the submenu is applied. Figure 3 In the illustrated embodiment, the user may select a color in the submenu by using the stylus 304. In addition, other scenarios may also be possible, such as the menu item hit by the radial menu is changed, or the display time of the submenu exceeds the preset time length, or the submenu is not operated within the preset time length, etc., which are not specifically limited here.

[0139] In summary, in the embodiment of the present application, the second display area for displaying the submenu of the first menu item is associated with the first position, and there is no necessary connection between the first position and the first display area of ​​the first menu (i.e., the parent menu). In other words, the display area of ​​the submenu has nothing to do with the display area of ​​the parent menu, but the first position is taken into consideration, so that the display area of ​​the submenu is closer to the needs of actual applications, which can shorten the interaction path and interaction delay, and enhance the user experience.

[0140] In the above-mentioned embodiment, the first position is the position of the manipulation tool on the display screen. However, in actual application, the first position may also be a preset position of the display screen. This situation is described below.

[0141] The preset position may include the left, right, top, bottom, center, etc. of the display screen, and may be further subdivided into upper left, lower left, upper right, lower right, upper center, lower center, etc., and the specifics are not limited here. The side of the display screen may be determined based on the center line of the display screen.

[0142] In some optional embodiments, it can be understood that, considering the limited display area of ​​the display screen, the first display area and the second display area each occupy a certain area, and the first display area can be any area without controls on the display screen as mentioned above. Then, the preset position can also be determined according to the actual application. The first position can be a position that makes the first display area and the second display area located in different areas, and the first display area and the second display area may overlap or not overlap, which is not specifically limited here.

[0143] Exemplarily, in a scheme where the first menu is displayed on the left side of the display screen, it can be assumed that the preset position is the left side, that is, the second display area is determined to be located on the right side of the display screen. In a scheme where the first menu is displayed on the right side of the display screen, it can be assumed that the preset position is the right side, that is, the second display area is determined to be located on the left side of the display screen. In a scheme where the first menu is displayed on the upper side of the display screen, it can be assumed that the preset position is the upper side, that is, the second display area is determined to be located on the lower side of the display screen. In a scheme where the first menu is displayed on the lower side of the display screen, it can be assumed that the preset position is the lower side, that is, the display screen is determined to be located on the upper side of the first position.

[0144] From the above technical solution, it can be seen that in the embodiment of the present application: the first position indicates a preset position of the display screen, and there is a certain correlation between the first position and the second display area. Then, after determining that the first menu item is hit, the target device can display the submenu in the second display area, which increases the convenience of submenu display and operation.

[0145] Previous Figure 2 and Figure 3 In the illustrated embodiment, the process of displaying, applying and disappearing the submenu of the menu item is described in detail. It can be understood that the premise of displaying the submenu of the first menu item in the first menu is that the first menu is displayed. Below, taking the first menu as a radial menu as an example, the relevant content of the first menu is described, including the process of calling up and displaying the first menu, hitting the menu item in the first menu, etc., which corresponds to step 201 and step 202 in the above embodiment.

[0146] First, taking the first menu as a radial menu as an example, the process of displaying the first menu in the first display area is described. As shown in the relevant description of step 201, the target device can respond to the first operation and display the first menu in the first display area.

[0147] When the first menu is a radial menu, the center of the radial menu includes the position of the first operation on the display screen. Specifically, optionally, when the first operation is a touch operation, the center of the radial menu includes the touch position of the touch operation on the display screen. Among them, the touch position includes the contact position between the manipulation tool and the display screen, or the center point of the area of ​​the touch operation on the display screen. It should be noted that the touch operation here includes touch operation or control operation. The so-called touch operation refers to the user directly contacting the display screen with a touch tool such as a hand or a stylus to operate the content displayed on the display screen. The control operation does not need to contact the display screen. For example, the content displayed on the display screen is operated by a manipulation tool such as a mouse, and a cursor indicating the first operation position will be displayed on the display screen. Optionally, when the first operation is a hovering operation, the center of the radial menu includes the position of the hovering operation on the display screen, including the center point or vertex of the area of ​​the hovering operation on the display screen.

[0148] In the embodiment of the present application, when the first menu is a radial menu, the center of the radial menu is the position of the first operation on the display screen, and the position of the first operation on the display screen varies with different first operations. It can be flexibly adapted to a variety of application scenarios, further enriching the implementation methods of the technical solutions of the present application.

[0149] Considering that there are multiple possible positions of the first operation on the display screen, there are also multiple possible ways for the target device to determine the first area. The possible situations are described below respectively.

[0150] 1. The first operation is obtained by the target device detecting the user's hand.

[0151] In this case, the position of the first operation on the display screen is the center point of the contact area between the finger and the display screen. When the first menu is a radial menu, the target device can use the center point as the center of the radial menu, and the direction of the long axis of the contact area between the finger and the display screen as the expansion direction of the radial menu to determine the pending display area of ​​the radial menu. And according to the relationship between the display area of ​​the radial menu and the preset radial menu, the first display area that finally displays the radial menu is determined. Specifically, if the pending display area cannot fully display the preset radial menu, the first display area is determined based on the pending display area. If the pending display area can fully display the preset radial menu, the pending display area is determined to be the first display area.

[0152] It should be noted that the various parameters of the radial menu can be customized by the user. When the radial menu is a system-level menu, the user can configure the parameters of the radial menu in the system's settings function. When the radial menu is an application's menu, the user can configure the parameters of the radial menu in the application's settings function. The parameters of the radial menu corresponding to the system-level radial menu and the application-level radial menu can be the same or different, and are not specifically limited here. Among them, the various parameters of the radial menu include the shape of the radial menu, the radius, the number of menu items included, the functions of the menu items, etc., which are not specifically limited here. Exemplarily, the shape of the radial menu can be preset to be a complete circle, a half arc, a quarter arc, etc.

[0153] The following is a diagram to illustrate the process of determining the first display area. Figure 4 , Figure 4 A schematic diagram of an interface provided for an embodiment of the present application.

[0154] exist Figure 4In the illustrated embodiment, a single finger long press for more than 30 milliseconds is taken as an example as a preset operation. When the first operation is a preset operation, the radial menu call-up process is triggered. The shape of the contact area 401 between the first operation and the display screen is similar to the shape of the fingerprint, and the finger direction can be determined based on this, that is, the direction of the long axis of the contact area 401 between the first operation and the display screen can be determined. Specifically, the fingerprint has a characteristic of one end being large and the other end being small, and the smaller end is usually the fingertip. Figure 4 As shown in the figure, the lower left area of ​​the fingerprint is larger, and the upper right area is smaller. Based on this, it is determined that the fingerprint points from the lower left to the upper right, that is, Figure 4 The direction of the straight arrow.

[0155] The long axis of the contact area 401 is used as the symmetry axis of the radial menu, and the direction of the long axis is used as the expansion direction of the radial menu to determine the display area to be determined. Among them, taking the direction of the long axis as the expansion direction of the radial menu means that the arc where the radial menu is located is expanded in the direction of the long axis. That is, when the target device determines the display area of ​​the radial menu, it expands the radial menu along the direction indicated by the arc arrow shown in the figure. In addition, the inner circle radius and the outer circle radius of the radial menu can be preset or user-defined, and are not specifically limited here.

[0156] After determining the pending display area, the target device determines whether the pending display area can fully display the preset radial menu, and performs corresponding operations based on the determination result. Figure 4 In the illustrated embodiment, the shape of the preset radial menu is a half of a circle, and the pending display area can completely display the preset radial menu. At this time, the target device determines the pending display area as the first display area, and displays the radial menu 402 in the first display area.

[0157] In some optional implementations, the pending display area may not be able to fully display the preset radial menu. In this case, the target device may adjust the pending display area and determine the adjusted pending display area as the first display area. In other words, the radial menu is displayed on the adjusted pending display area. The target device adjusts the pending display area in a manner that includes changing the axis of symmetry of the pending display area or the radius of the pending display area. The intersection of the changed axis of symmetry and the axis of symmetry of the pending display area is the center point of the contact area between the first operation and the display screen.

[0158] For example, taking the adjustment of the direction of the symmetry axis as an example, the process of adjusting the undetermined display area of ​​the target device is described in combination with the schematic diagram. Figure 5 , Figure 5 A schematic diagram of the interface provided for an embodiment of the present application.

[0159] Figure 5In the embodiment shown, the shape of the preset radial menu is a half-circle ring. Figure 5 As shown, the long axis 503 of the operation area 401 corresponding to the first operation is used as the symmetry axis of the radial menu, and the direction of the long axis is used as the expansion direction of the radial menu. The obtained pending display area 501 (that is, the position of the dotted circle) cannot completely preset the radial menu. The target device rotates the symmetry axis 503 to obtain the long axis 504, and uses the long axis 504 as the symmetry axis of the adjusted pending display area, and uses the direction of the long axis 504 as the expansion direction of the radial menu to obtain the adjusted pending display area. The adjusted pending display area can completely display the preset radial menu, and the adjusted pending display area is determined as the first display area 502. In other words, the display position of the radial menu on the electronic screen is the first display area 502.

[0160] It should be noted that the process by which the target device determines the first display area of ​​the radial menu based on the first operation is unknown to the user. The position of the radial menu displayed on the screen as seen by the user is the final display position obtained after the target device processes the display area to be determined. Figure 5 In the illustrated embodiment, that is, the user does not see an incomplete radial menu displayed in the pending display area 501 , but directly sees the radial menu displayed in the first display area 502 .

[0161] It is understandable that for the sake of simplicity, Figure 5 The menu items in the radial menu are not shown. In actual application, the radial menu includes multiple menu items, which are displayed in a circular ring of the radial menu, and the multiple menu items are symmetrical about the symmetry axis. In addition, in the process of adjusting the undetermined display area, the menu items will change accordingly, including changing the display position of the menu items, the size of the displayed icons, the distance between the icons, etc., so that the menu items are adapted to the radial menu. The specific adjustment content is not limited here.

[0162] In an embodiment of the present application, in response to a user invoking a radial menu by using a finger, the long axis of the contact area between the finger and the display screen can be used as the symmetry axis of the radial menu, and the direction behind the finger can be used as the expansion direction of the radial menu, so that the display area and display mode of the radial menu are more ergonomic, further improving the practicality of the technical solution of the present application. In addition, when the pending display area cannot fully display the preset radial menu, by adjusting the pending display area, the adjusted pending display area can fully display the preset radial menu, thereby improving the practicality of the technical solution. There are many possible ways to adjust the pending display area, which can be applicable to a variety of scenarios, further enriching the application scenarios of the technical solution of the present application.

[0163] In some optional implementations, if the pending display area cannot fully display the preset radial menu, the target device may not adjust the pending display area, but use the pending display area as the first display area for displaying the radial menu. The incomplete radial menu is displayed in the first display area, and then the menu items in the radial menu are changed through user operations, so that the menu items included in the radial menu are fully displayed. Figure 6 For a description of this approach, see Figure 6 , Figure 6 A schematic diagram of the interface provided for an embodiment of the present application.

[0164] Assume that Figure 6 In the embodiment shown, the preset radial menu is a three-quarter circular ring, including 7 menu items. Figure 6 (a) shows a half circle and only supports displaying 5 menu items at the same time. In this case, the menu items in the radial menu can be in a non-fixed position but scrollable. Figure 6 Slide the radial menu in the direction indicated by the arrow in Figure (a) to change the menu items displayed in the radial menu, such as Figure 6 As shown in Figure (b), by sliding the radial menu, the menu items included in the radial menu are fully displayed.

[0165] In some optional implementations, if the pending display area cannot fully display the preset radial menu, the target device may not adjust the pending display area, but instead pop up a pop-up window to remind the user to change the input position of the first operation.

[0166] In some optional implementations, the expansion direction of the radial menu may not be limited. That is, the center point of the contact area between the finger and the display screen is used as the center of the radial menu, and the first display area is determined according to the preset radius. When the first display area is an incomplete ring, the expansion direction of the radial menu also needs to be considered, and the target device can determine the expansion direction in a variety of ways. Optionally, the long axis direction of the contact area between the finger and the display screen can be determined as the expansion direction of the radial menu, or the radial menu can be expanded according to the default axis of symmetry. In addition to this, the expansion direction can also be determined by other methods, for example, according to the relative position of the contact area between the finger and the display screen on the electronic screen, or according to the direction of multiple touch points in the contact area between the finger and the display screen, which is not specifically limited here.

[0167] Exemplarily, in a scheme of expanding a radial menu according to a default axis of symmetry, the default axis of symmetry may be set to have a fixed angle with the edge of the electronic screen, such as perpendicular to the edge of the electronic screen, or an angle of 45°, etc., which is not specifically limited here.

[0168] Exemplarily, in a scheme for determining the expansion direction of the radial menu based on the relative position of the contact area between the finger and the display screen on the electronic screen, assuming that the contact area is located in the lower right corner of the electronic screen, based on the user's usage habits, the target device can determine that the expansion direction of the radial menu is the upper left corner of the contact area.

[0169] Exemplarily, in a scheme for determining the expansion direction of a radial menu based on the direction of multiple touch points in the contact area between a finger and a display screen, the characteristic that fingerprints gather toward the fingertips is taken into consideration, that is, the characteristic that fingerprints appear as arcs with raised positions located at the fingertips, and the direction of the fingertips is determined as the expansion direction of the radial menu.

[0170] 2. The first operation is that the target device detects input to the target device by a touch tool other than the user's hand.

[0171] In some optional implementations, the first operation may not have a direction, for example, the stylus is perpendicular to the display screen, etc. In this case, the user's operation will not be limited by the position of the finger. Therefore, the position of the first operation on the display screen can be used as the center of the radial menu, and the pending display area of ​​the radial menu can be determined according to the preset radius. If the pending display area can fully display the preset radial menu, the pending display area is determined to be the first display area. If the pending display area cannot fully display the preset radial menu, the first display area is determined based on the pending display area. Similar to the foregoing, the target device adjusts the pending display area by changing the axis of symmetry of the pending display area or the radius of the pending display area, and determining the adjusted pending display area as the first display area. Finally, the target device displays the radial menu in the first display area.

[0172] In some optional embodiments, the first operation may have a direction, for example, the stylus is at a certain angle to the display screen, the cursor displays a direction, etc. At this time, the radial menu can be expanded based on the direction of the first operation. Exemplarily, assuming that the preset operation is to hover over the same area on the display screen for more than 3 seconds, the target device detects that the first operation is that the stylus hovers over the same area on the display screen for more than 3 seconds. The area projected by the stylus on the display screen is linear, and considering the user's usage habits, the pen tip is usually close to one end of the display screen. Within the range of being able to detect the stylus, the target device can also distinguish the vertices of the linear area projected onto the display screen as the tip and tail of the stylus according to the height of the stylus, thereby identifying the direction of the first operation.

[0173] In the present application, the input position of the first operation that triggers the display of the radial menu is not fixed, as long as the first operation is a preset operation. In other words, the technical solution of the present application does not limit the input position of the operation that evokes the radial menu, which makes it easier to meet the application needs of users and improves the flexibility and practicality of the technical solution of the present application.

[0174] After the radial menu is invoked, by interacting with the radial menu, it is possible to hit a menu item in the radial menu and execute the function of the menu item in the radial menu. This process is described below.

[0175] As shown in the above step 202, the target device can determine the first menu item from at least one menu item of the first menu in response to the second operation. The second operation points to the first menu item, which can be understood as the first menu item being located in the direction of the second operation. Generally speaking, the direction of the second operation is included in the display range of the first menu item, or the direction of the second operation is included in the display range and the hot zone range of the first menu item.

[0176] The following uses the schematic diagram to illustrate the case where the first menu is a radial menu as an example, and the second operation is a touch operation and a sliding operation. Figure 7 and Figure 8 , Figure 7 and Figure 8 Each of them is an interface schematic diagram provided in the embodiment of the present application.

[0177] For example, in Figure 7 In the illustrated embodiment, the second operation is a touch operation as an example, and the user operates the display screen with a finger to call up and hit a menu item in the radial menu. Figure 7 The dotted ellipse in the lower left corner indicates the finger position for invoking the radial menu. After invoking the radial menu, the user moves the finger to select a menu item in the radial menu. When the finger moves to the position of the solid ellipse, menu item No. 2 in the radial menu is hit. The direction of the second operation is the long axis direction of the fingerprint, which is included in the display range of menu item No. 2. Figure 7 The display range of menu item No. 2 is the range of the solid circle, and the hot zone range is the range of the dotted circle.

[0178] For example, in Figure 8 In the illustrated embodiment, the second operation is a sliding operation, and the user operates the display screen with a stylus. The target device detects that the stylus slides from the starting position 801 to the end position 802, and determines that the direction of the second operation is the direction indicated by the arrow in the figure. Figure 7 Similar to the illustrated embodiment, this direction hits menu item No. 2 in the radial menu.

[0179] In some optional embodiments, such as Figure 7 and Figure 8 As shown in the figure, after hitting the menu item of the radial menu, the target device will display the window interface of the menu item. Taking menu item No. 2 as the "Share" function as an example, after hitting menu item No. 2, the target device calls up the interface corresponding to the share function and displays the following on the screen: Figure 7 or Figure 8 The share card shown. The share card displays options such as friends, groups, and applications to share to for users to choose.

[0180] In some optional implementations, the hit menu item may have a different display state from other menu items in the radial menu, such as different icon colors, sizes, transparency, or other display states that can distinguish between hits and misses, which are not specifically limited here.

[0181] In addition, it should be noted that the menu items included in the radial menu will vary depending on the current page. For example, on the main screen interface, the menu items corresponding to the radial menu can be the most frequently used multiple application icons or the most recently used multiple application icons to switch applications. After selecting the corresponding icon, it switches to the application corresponding to the icon. For example, in the drawing board application, the radial menu displays the commonly used functions of the drawing board, including color selection, shape selection, writing function, etc.

[0182] Introduced in the previous article Figure 7 and Figure 8 In the embodiment shown, after hitting a menu item of the radial menu, the target device directly displays a window interface of the menu item on the electronic screen, and the display area of ​​the window interface may be preset, but in actual application, the display area and display mode of the window interface may also be related to the operation detected by the target device. This solution is described below.

[0183] In summary, the target device can determine the second menu item in response to the third operation, the third operation points to the second menu item, and the second menu item is any menu item in at least one menu item of the first menu. Then, according to the distance between the position of the third operation on the display screen and the display position of the second menu item, the window interface of the second menu item is displayed. The process of the target device determining the second menu item in response to the third operation is similar to the process of the target device determining the first menu item in response to the second operation described above, and will not be repeated here.

[0184] In some optional embodiments, the third operation is a sliding operation. According to the distance between the position of the third operation on the display screen and the display position of the second menu item, the window interface of the second menu item is displayed, including: when the window interface of the second menu item is not displayed in full screen, and the distance between the position of the third operation end point and the display position of the second menu item is detected to be reduced, the display area of ​​the window interface of the second menu item increases. That is, in the process of the third operation moving in the direction close to the display position of the second menu item, the display area of ​​the window interface of the second menu item gradually increases. Or, in the case of detecting that the distance between the position of the third operation end point and the display position of the second menu item increases, the display area of ​​the window interface of the second menu item decreases. That is, in the process of the third operation moving in the direction away from the display position of the second menu item, the display area of ​​the window interface of the second menu item gradually decreases.

[0185] In the embodiment of the present application, there are multiple ways to define the distance between the position of the third operation end point and the display position of the second menu item. Fig. 9 , Fig. 9 A schematic diagram provided for an embodiment of the present application.

[0186] For example, in Fig. 9 Figure (a) and Fig. 9 In the embodiment shown in FIG. (b), a finger is used as a manipulation tool to call up a radial menu on a display screen. After calling up the radial menu in the area shown by the dotted ellipse, the user keeps pressing the finger and moves the finger to the area shown by the solid ellipse, and the center point of the area is the position of the third operation end point.

[0187] In some optional implementations, the distance between the position of the third operation endpoint and the display position of the second menu item may refer to the straight-line distance between the position of the third operation endpoint and the display position of the second menu item. Fig. 9 In the embodiment shown in FIG. 1 (a), the distance between the position of the third operation end point and the display position of the second menu item is L1.

[0188] In some optional implementations, the distance between the position of the third operation end point and the display position of the second menu item may also be the distance between the position of the third operation end point and the center of the radial menu, and the distance of the projection on the line connecting the center of the radial menu to the display position of the second menu item. Fig. 9 In the embodiment shown in FIG. (b), the distance between the position of the third operation end point and the display position of the second menu item is L2.

[0189] For example, the display mode of the window interface of the second menu item is described in conjunction with the schematic diagram. Fig.10 , Fig.10 A schematic diagram of the interface provided for an embodiment of the present application.

[0190] It should be noted that in Fig.10 In the illustrated embodiment, the center of the radial menu and the starting position of the third operation are point A, the end position of the third operation is point C, the display position of the second menu item is point B, and the solid line ellipse indicates the area of ​​the end point of the third operation on the display screen. Fig.10 It is taken that the projection distance is the distance between the position of the third operation end point and the display position of the second menu item, the function of the second menu item is application switching, and the operation interface of the second menu item is the interface of application one as an example.

[0191] like Fig.10 As shown, from Fig.10 Figure (a) to Fig.10 Figure (b) and then Fig.10 As shown in FIG. (c), when the target device detects that the distance between the position C of the third operation end point and the display position B of the second menu item is reduced, the window interface of the second menu item (i.e. Fig.10 The display area of ​​the application interface is increased.

[0192] In some optional implementations, the display area of ​​the window interface of the second menu item may also increase in proportion to the distance between the end point of the third operation and the display position of the second menu item. Specifically, the proportion of the distance between the end point of the third operation and the display position of the second menu item to the distance between the starting point of the third operation and the display position of the second menu item may be the same as the proportion of the display area of ​​the window interface of the second menu item to the display area of ​​the display screen.

[0193] In some optional implementations, during the process of the third operation moving toward the direction close to the display position of the second menu item, the display area of ​​the window interface of the second menu item may gradually increase. Alternatively, during the process of the third operation moving toward the direction away from the display position of the second menu item, the display area of ​​the window interface of the second menu item may gradually decrease. Fig.10 The embodiments shown are similar and will not be described again here.

[0194] In the embodiment of the present application, the first menu may further include a second menu item. When the second menu item is determined based on the third operation, the display mode of the window interface of the second menu item may also be determined based on the distance between the position of the third operation on the display screen and the display position of the second menu item. The smaller the distance between the position of the third operation on the display screen and the display position of the second menu item, the larger the display area of ​​the window interface of the second menu item, which is closer to the needs of actual applications and further improves the practicality of the technical solution of the present application.

[0195] In some optional implementations, displaying the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item may also include: when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold, displaying the window interface of the second menu item in full screen. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, displaying the window interface of the second menu item in non-full screen.

[0196] In some optional embodiments, displaying the window interface of the second menu item in full screen includes: displaying the window interface of the second menu item in split screen or in a floating window. Then, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, displaying the window interface of the second menu item in non-full screen includes: when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold and less than the third threshold, displaying the window interface of the second menu item in split screen. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the third threshold, displaying the window interface of the second menu item in a floating window.

[0197] For example, the display mode of the window interface of the second menu item is described in conjunction with the schematic diagram. Fig.11 , Fig.11 A schematic diagram of the interface provided for an embodiment of the present application.

[0198] It should be noted that in Fig.11 In the embodiment shown, the display position of the second menu item is point B, and the projection distance is taken as the distance between the position of the third operation on the display screen and the display position of the second menu item. Point D1 and point D2 are points between point A and point B, and the distance between point B and point D2 is assumed to be the second threshold, and the distance between point B and point D1 is assumed to be the third threshold. In addition, Fig.11 For example, the function of the second menu item is application switching, and the operation interface of the second menu item is the interface of application one.

[0199] like Fig.11 As shown in Figure (a), when the position of the third operation on the display screen is at point E1, the distance between point E1 and point B is greater than the third threshold, and the floating window displays the window interface of the second menu item, that is, the floating window displays the interface of application one.

[0200] like Fig.11As shown in Figure (b), when the position of the third operation on the display screen is at point E2, the distance between point E2 and point B is less than the third threshold but greater than the second threshold, and the window interface of the second menu item is displayed in split screen, that is, the interface of application 1 is displayed in split screen. It should be noted that Fig.11 FIG. (b) takes the example of the window interface of the second menu item being displayed on the split screen side where the radial menu is located. In actual applications, the window interface of the second menu item can also be displayed on a different split screen from the radial menu, which is not limited here. Fig.11 In addition to the 1:1 shown in Figure (b), other ratios may be possible, and the specific ratios are not limited here.

[0201] like Fig.11 As shown in Figure (c), when the position of the third operation on the display screen is at point E3, the distance between point E2 and point B is less than the second threshold, and the window interface of the second menu item is displayed in full screen mode, that is, the interface of application one is displayed in full screen.

[0202] In the present application, there are multiple implementation methods for displaying the window interface of the second menu item based on the distance between the position of the third operation on the display screen and the display position of the second menu item, which provides multiple possibilities for practical applications and further enriches the application scenarios of the technical solution of the present application.

[0203] In some optional implementations, the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold, including the position of the third operation on the display screen overlapping or not overlapping with the display position of the second menu item. Fig.11 In the illustrated embodiment, regardless of whether the position of the third operation on the display screen overlaps with the display position of the second menu item, the window interface of the second menu item is displayed in full screen.

[0204] In some optional embodiments, whether the position of the third operation on the display screen overlaps with the display position of the second menu item or not, the display mode of the window interface of the second menu item is different. That is to say, according to the distance between the position of the third operation on the display screen and the display position of the second menu item, the window interface of the second menu item is displayed, including: when the position of the third operation on the display screen overlaps with the display position of the second menu item, the window interface of the second menu item is displayed in full screen. Or, when the position of the third operation on the display screen does not overlap with the display position of the second menu item, the window interface of the second menu item is displayed in non-full screen. Among them, the window interface of the second menu item is displayed in non-full screen, including split screen display or floating window display of the window interface of the second menu item. Therefore, when the position of the third operation on the display screen does not overlap with the display position of the second menu item, the window interface of the second menu item is displayed in non-full screen, including: when the position of the third operation on the display screen does not overlap with the display position of the second menu item, and the distance between the position of the third operation on the display screen and the display position of the second menu item is less than the fifth threshold, the window interface of the second menu item is displayed in split screen. Alternatively, when the position of the third operation on the display screen does not overlap with the display position of the second menu item, and the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fifth threshold, the floating window displays the window interface of the second menu item.

[0205] For example, the display mode of the window interface of the second menu item is described in conjunction with the schematic diagram. Fig.12 , Fig.12 A schematic diagram of the interface provided for an embodiment of the present application.

[0206] It should be noted that in Fig.12 In the illustrated embodiment, the display position of the second menu item is point B, and the projection distance is taken as the distance between the position of the third operation on the display screen and the display position of the second menu item. Point F is a point between point A and point B, and the distance between point B and point F is taken as the fifth threshold. In addition, Fig.12 For example, the function of the second menu item is application switching, and the operation interface of the second menu item is the interface of application one.

[0207] like Fig.12 As shown in Figure (a), when the position of the third operation on the display screen is at point G1, point G1 and point B do not overlap, and the distance between the two points is greater than the fifth threshold, and the window interface of the second menu item is displayed based on the floating window display, that is, the floating window displays the application interface.

[0208] like Fig.12As shown in Figure (b), when the position of the third operation on the display screen is at point G2, point G2 and point B do not overlap, and the distance between the two points is less than the fifth threshold, the window interface of the second menu item is displayed based on the split screen mode, that is, the application interface 1 is displayed in split screen. It should be noted that Fig.12 Figure (b) takes the second menu item's window interface displayed on the split screen where the radial menu is located as an example. In actual applications, the second menu item's window interface and the radial menu can also be displayed on different split screens, which is not limited here. Fig.12 In addition to the 1:1 shown in Figure (b), other ratios may be possible, and the specific ratios are not limited here.

[0209] like Fig.12 As shown in Figure (c), the position of the third operation on the display screen overlaps with the display position of the second menu item, and the window interface of the second menu item is displayed in full screen mode, that is, the application one interface is displayed in full screen.

[0210] It should be noted that the overlap between the position of the third operation on the display screen and the display position of the second menu item means that the two have an intersection, including complete overlap and partial overlap. When determining whether the position of the third operation on the display screen overlaps with the display position of the second menu item, it is judged whether the display area of ​​the third operation on the screen (such as the solid oval shown in the figure) overlaps with the display area of ​​the second menu item (such as the white circle shown in the figure). However, when determining the distance between the two, for the convenience of calculation, it is based on the center points of the two areas.

[0211] In addition, comprehensive Fig.11 and Fig.12 As the distance between the position of the third operation on the display screen and the display position of the second menu item decreases from far to near, the display mode of the operation interface of the second menu item changes from a floating window display to a split screen display, and then to a full screen display. Optionally, in actual applications, as the distance between the position of the third operation on the display screen and the display position of the second menu item decreases from far to near, the display mode of the operation interface of the second menu item changes from a split screen display to a floating window display, and then to a full screen display. The specific implementation process is the same as Fig.11 or Fig.12 The embodiments shown are similar and will not be described again here.

[0212] In some optional implementations, after the first menu is displayed, if the manipulation tool leaves the screen, or the distance between the manipulation tool and the screen exceeds a preset height, the first menu will disappear. After the window interface of the menu item is displayed, if the manipulation tool leaves the screen, or the distance between the manipulation tool and the screen exceeds a preset height, both the first menu and the window interface of the menu item will disappear.

[0213] In the present application, when the target device displays the window interface of the menu item, the display mode of the window interface of the menu item can be determined according to the distance between the position of the operation of hitting the menu item on the display screen and the display position of the menu item. There are many possible relationships between the position of the operation of hitting the menu item on the display screen and the display position, and therefore, there are also many possible display modes of the window interface, thereby enriching the implementation mode of the technical solution of the present application, being able to flexibly adapt to different scenarios, and improving the flexibility of the technical solution of the present application.

[0214] In some optional embodiments, the function of the second menu item includes a first sub-function and a second sub-function. The window interface of the second menu item includes the window interface of the first sub-function and the window interface of the second sub-function. Then, according to the distance between the position of the third operation on the display screen and the display position of the second menu item, the window interface of the second menu item is displayed, including: when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fourth threshold, the window interface of the first sub-function is displayed. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than the fourth threshold, the window interface of the second sub-function is displayed.

[0215] The following is a diagram to illustrate this. Fig.13 , Fig.13 A schematic diagram of the interface provided for an embodiment of the present application.

[0216] It should be noted that in Fig.13 In the illustrated embodiment, the display position of the second menu item is point B, the projection distance is the distance between the position of the third operation on the display screen and the display position of the second menu item, and the distance between point B and point H is the fourth threshold value, where point H is a point between point A and point B.

[0217] Assume that the function of the second menu item is translation, the first sub-function is Chinese to English, and the second sub-function is English to Chinese. Fig.13 As shown in FIG. 1 (a), when the position of the third operation on the display screen is located at point K1, the distance between point K1 and point B is greater than the fourth threshold, and the window interface 1301 of the first sub-function is displayed. Fig.13 As shown in FIG. 14( b ), when the position of the third operation on the display screen is at point K2, the distance between point K2 and point B is less than the fourth threshold, and the window interface 1302 of the second sub-function is displayed.

[0218] It should be noted that Fig.13Taking the sub-function window interface as a floating window displayed in the upper right area of ​​the display screen as an example, in actual applications, the display area and display mode of the sub-function window interface can be preset or set by the user. When the first menu is a system-level menu, the user can configure the relevant content in the system's settings function. When the radial menu is an application's menu, the user can configure the relevant content in the application's settings function.

[0219] It should be noted that Fig.13 The explanation is only based on the example that the second menu item includes two sub-functions. In actual applications, the menu items in the first menu may also include more sub-functions. Accordingly, when switching the window interface of the sub-function by adjusting the distance between the position of the operation on the display screen and the display position of the menu item, more thresholds may be set, which are not limited here.

[0220] In some optional implementations, if a menu item includes multiple sub-functions, the window interface of all or part of the sub-functions can be switched by adjusting the distance between the position of the operation on the display screen and the display position of the menu item. When switching the window interface of some sub-functions, these sub-functions can be set by the user, or determined by the target device based on the frequency of use of the sub-functions and the last time of use, so as to be close to the user's usage habits. In addition, in the case of switching the window interface of some sub-functions, it can also be set that when the position of the operation on the display screen coincides with the display position of the menu item, the window interface of the menu item is displayed, and the sub-function controls of the menu item can be fully or partially displayed in the window interface so that the user can use the sub-functions. When the sub-function controls of the menu item are partially displayed in the window interface, it can also be used Figure 6 In a similar manner to the illustrated embodiment, the sub-function controls of the menu item are fully displayed through the display area of ​​the sliding window interface.

[0221] In the embodiment of the present application, the distance between the position of the third operation of the second menu item on the display screen and the display position of the second menu item is determined, and when the relationship with the fourth threshold is different, the window interface of different sub-functions of the second menu item can be displayed on the display screen. In other words, the sub-function switching of the second menu item can be achieved by adjusting the position of the third operation on the display screen and the distance between the display position of the second menu item, further enriching the interaction mode between the operation and the menu, and improving the flexibility of the technical solution of the present application.

[0222] Next, the related equipment provided by this application is described. Fig.14 , Fig.14 This is a schematic diagram of the structure of an electronic device provided in this application. Fig.14As shown, the electronic device 1400 includes a display unit 1401 and a processing unit 1402 .

[0223] In some optional embodiments, the display unit 1401 is used to display a first menu in a first display area of ​​the display screen, the first menu including at least one menu item. The processing unit 1402 is used to determine a first menu item, the first menu item being any menu item of the at least one menu item. The first position is obtained, the first position indicating the position of the manipulation tool of the display screen on the display screen. The display unit 1401 is also used to display a submenu of the first menu item in a second display area of ​​the display screen, the second display area being an area associated with the first position.

[0224] In some optional implementations, the manipulation tool includes a stylus or a user's hand, and the first position includes a hovering position of the manipulation tool on the display screen or a contact position of the manipulation tool and the display screen.

[0225] In some optional implementations, the manipulation tool includes a mouse, and the first position includes a position of a cursor of the mouse on the display screen.

[0226] In some optional implementations, the first position is included in the second display area, the distance between the first position and the center of the second display area is less than a first threshold, or the second display area surrounds the first position.

[0227] In some optional implementations, the display unit 1401 is further configured to display a first menu in the first display area in response to the first operation.

[0228] In some optional embodiments, the first display area is symmetrically arranged about the symmetry axis. When the area of ​​the first operation on the display screen is a linear area, the symmetry axis is a straight line passing through the vertices of the linear area. Alternatively, when the area of ​​the first operation on the display screen is a nonlinear area, the symmetry axis is a straight line passing through the center point of the nonlinear area.

[0229] In some optional embodiments, the first display area is symmetrically arranged about an axis of symmetry, and the axis of symmetry includes any one of the following: the long axis of the area of ​​the first operation on the display screen, the vertical line of the edge of the display screen, the diagonal line of the display screen, the symmetry center line of the display screen, and the angular center line of the display screen.

[0230] In some optional implementations, the first menu is a radial menu, and the center of the radial menu includes the position of the first operation on the display screen.

[0231] In some optional implementations, when the first operation is a touch operation, the center of the radial menu includes the touch position of the touch operation on the display screen. Alternatively, when the first operation is a hover operation, the center of the radial menu includes the center point or vertex of the area of ​​the hover operation on the display screen.

[0232] In some optional implementations, the processing unit 1402 is specifically configured to determine the first menu item in response to the second operation, and the second operation points to the first menu item.

[0233] In some optional implementations, the second operation points to the first menu item, including: when the second operation is a sliding operation, the direction of the sliding operation points to the first menu item. Or, when the second operation is a touch operation, the long axis of the area of ​​the touch operation on the display screen points to the first menu item.

[0234] In some optional implementations, the processing unit 1402 is further configured to determine the second menu item in response to a third operation, the third operation pointing to the second menu item, and the second menu item being any menu item of at least one menu item of the first menu. The display unit 1401 is further configured to display the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item.

[0235] In some optional embodiments, the third operation is a sliding operation. Display unit 1401 is used to increase the display area of ​​the window interface of the second menu item when the window interface of the second menu item is not displayed in full screen and the distance between the position of the end point of the third operation and the display position of the second menu item is detected to be reduced. Alternatively, display unit 1401 is used to reduce the display area of ​​the window interface of the second menu item when the distance between the position of the end point of the third operation and the display position of the second menu item is detected to be increased.

[0236] In some optional implementations, the display unit 1401 is specifically configured to display the window interface of the second menu item in full screen when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold value. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold value, display the window interface of the second menu item in non-full screen.

[0237] In some optional embodiments, the non-full screen display of the window interface of the second menu item includes: displaying the window interface of the second menu item in a split screen or a floating window. The display unit 1401 is specifically configured to display the window interface of the second menu item in a split screen when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold and less than the third threshold. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the third threshold, the floating window displays the window interface of the second menu item.

[0238] In some optional implementations, the display unit 1401 is specifically configured to display the window interface of the second menu item in full screen when the position of the third operation on the display screen overlaps with the display position of the second menu item, or to display the window interface of the second menu item in non-full screen when the position of the third operation on the display screen does not overlap with the display position of the second menu item.

[0239] In some optional embodiments, the non-full screen display of the window interface of the second menu item includes a split screen display or a floating window display of the window interface of the second menu item. Display unit 1401 is specifically configured to display the window interface of the second menu item in a split screen when the second position does not overlap with the display position of the second menu item, and the distance between the second position and the display position of the second menu item is less than a fifth threshold. Alternatively, when the second position does not overlap with the display position of the second menu item, and the distance between the second position and the display position of the second menu item is greater than the fifth threshold, the floating window displays the window interface of the second menu item.

[0240] In some optional embodiments, the function of the second menu item includes a first sub-function and a second sub-function. The display unit 1401 is specifically configured to display the window interface of the first sub-function when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fourth threshold. Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is less than the fourth threshold, the window interface of the second sub-function is displayed.

[0241] In some optional implementations, the display unit 1401 is configured to display a first menu in a first display area of ​​a display screen of the electronic device, where the first menu includes at least one menu item.

[0242] The processing unit 1402 is configured to determine a first menu item, where the first menu item is any menu item of at least one menu item of the first menu.

[0243] The processing unit 1402 is further configured to obtain a first position, where the first position indicates a preset position of the display screen.

[0244] The display unit 1401 is further configured to display a submenu of the first menu item in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

[0245] The electronic device 1400 may execute the aforementioned Figures 1 to 13 The operations performed by the target device in the illustrated embodiment will not be described in detail here.

[0246] The electronic device provided in the embodiment of the present application is described below. Fig.15 , Fig.15A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1500 includes: a processor 1501 and a memory 1502, wherein the memory 1502 stores one or more application programs or data.

[0247] Among them, the memory 1502 can be a volatile storage or a persistent storage. The program stored in the memory 1502 may include one or more modules, each of which can be used to execute a series of operations performed by the electronic device 1500. Furthermore, the processor 1501 can communicate with the memory 1502 and execute a series of instruction operations in the memory 1502 on the electronic device 1500. The processor 1501 can be a central processing unit (CPU) or a single-core processor. In addition, it can also be other types of processors, such as a dual-core processor, which is not limited here.

[0248] In some optional embodiments, the electronic device 1500 further includes a chip module, which is used to detect input operations. Taking the electronic device 1500 having a touch screen as an example, the chip module is used to detect and identify touch input. When a preset input operation is detected, the chip module transmits an instruction to the processor, which instructs to display the radial menu.

[0249] The electronic device 1500 may also include one or more communication interfaces 1503, one or more operating systems, such as Windows Server 2008, and Windows Server 2008-based operating systems. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM wait.

[0250] The electronic device 1500 can perform the aforementioned Figures 1 to 13 The operations performed by the target device in the illustrated embodiment will not be described in detail here.

[0251] It is to be understood that the electronic device referred to in the embodiments of the present application refers to a device with a display screen, including various devices with and without communication functions. The electronic device may specifically include: a handheld device, a vehicle-mounted device, a wearable device, a computing device, or other processing devices connected to a wireless modem. The terminal device may also be referred to as a terminal, and the terminal device may also be a subscriber unit, a cellular phone, a smart phone, a wireless data card, a personal digital assistant (PDA) computer, a tablet computer, a wireless modem, a handheld device (handset), a laptop computer, a machine type communication (MTC) terminal, a display, etc., which are not specifically limited here.

[0252] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0253] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0254] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0255] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0256] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

Claims

1. A menu interaction method, characterized in that: Applied to a device including a display screen, the method comprises: Displaying a first menu in a first display area of ​​the display screen, wherein the first menu includes at least one menu item; Determine a first menu item, where the first menu item is any menu item among the at least one menu item; Acquire a first position, where the first position indicates a position of a manipulation tool of the display screen on the display screen; A submenu of the first menu item is displayed in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

2. The method according to claim 1, characterized in that The manipulation tool includes a stylus or a user's hand, and the first position includes a hovering position of the manipulation tool on the display screen or a contact position of the manipulation tool and the display screen.

3. The method according to claim 1, characterized in that The manipulation tool includes a mouse, and the first position includes a position of a cursor of the mouse on the display screen.

4. The method according to any one of claims 1 to 3, characterized in that The first position is included in the second display area, a distance between the first position and a center of the second display area is less than a first threshold, or the second display area surrounds the first position.

5. The method according to any one of claims 1 to 4, characterized in that Displaying the first menu in the first display area of ​​the display screen includes: In response to a first operation, the first menu is displayed in the first display area.

6. The method according to claim 5, characterized in that The first display area is symmetrically arranged about the symmetry axis; When the area of ​​the first operation on the display screen is a linear area, the symmetry axis is a straight line passing through the vertex of the linear area; Alternatively, when the area of ​​the first operation on the display screen is a non-linear area, the symmetry axis is a straight line passing through the center point of the non-linear area.

7. The method according to claim 5, characterized in that The first display area is symmetrically arranged about a symmetry axis, and the symmetry axis includes any one of the following: The first operation includes a long axis of an area on the display screen, a vertical line of an edge of the display screen, a diagonal line of the display screen, a symmetric center line of the display screen, and an angular center line of the display screen.

8. The method according to any one of claims 5 to 7, characterized in that The first menu is a radial menu, and the center of the radial menu includes the position of the first operation on the display screen.

9. The method according to any one of claims 1 to 8, characterized in that The determining of the first menu item includes: In response to a second operation, the first menu item is determined, and the second operation points to the first menu item.

10. The method according to claim 9, characterized in that The second operation points to the first menu item, including: When the second operation is a sliding operation, the direction of the sliding operation points to the first menu item; Alternatively, when the second operation is a touch operation, the long axis of the area of ​​the touch operation on the display screen points to the first menu item.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: In response to a third operation, determining a second menu item, wherein the third operation points to the second menu item, and the second menu item is any menu item of at least one menu item of the first menu; The window interface of the second menu item is displayed according to the distance between the position of the third operation on the display screen and the display position of the second menu item.

12. The method according to claim 11, characterized in that The third operation is a sliding operation; When the window interface of the second menu item is not displayed in full screen and it is detected that the distance between the position of the third operation end point and the display position of the second menu item is reduced, the display area of ​​the window interface of the second menu item is increased; Alternatively, when it is detected that the distance between the position of the third operation end point and the display position of the second menu item increases, the display area of ​​the window interface of the second menu item decreases.

13. The method according to claim 11, characterized in that The step of displaying the window interface of the second menu item according to the distance between the position of the third operation on the display screen and the display position of the second menu item includes: When the distance between the position of the third operation on the display screen and the display position of the second menu item is less than a second threshold, displaying the window interface of the second menu item in full screen; Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, the window interface of the second menu item is displayed in non-full screen.

14. The method according to claim 13, characterized in that The non-full-screen display of the window interface of the second menu item includes: a split-screen display or a floating window display of the window interface of the second menu item; When the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold, the window interface of the second menu item is displayed in non-full screen, including: When the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the second threshold and less than the third threshold, displaying the window interface of the second menu item in split screen; Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than the third threshold, the floating window displays the window interface of the second menu item.

15. The method according to claim 11, characterized in that The function of the second menu item includes a first sub-function and a second sub-function; Displaying a window interface of the second menu item according to a distance between a position of the third operation on the display screen and a display position of the second menu item includes: When the distance between the position of the third operation on the display screen and the display position of the second menu item is greater than a fourth threshold, displaying a window interface of the first sub-function; Alternatively, when the distance between the position of the third operation on the display screen and the display position of the second menu item is smaller than the fourth threshold, the window interface of the second sub-function is displayed.

16. An electronic device, characterized in that: include: A display unit, configured to display a first menu in a first display area of ​​a display screen of the electronic device, wherein the first menu includes at least one menu item; a processing unit, configured to determine a first menu item, wherein the first menu item is any menu item of the at least one menu item; The processing unit is further used to obtain a first position, where the first position indicates a position of a manipulation tool of the display screen on the display screen; The display unit is further used to display a submenu of the first menu item in a second display area of ​​the display screen, where the second display area is an area associated with the first position.

17. An electronic device, characterized in that: include: Processor and memory; The processor stores instructions, and when the instructions are executed on the processor, the method according to any one of claims 1 to 15 is implemented.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a processor, the method according to any one of claims 1 to 15 is implemented.

Images