Game interface interaction method and device, readable storage medium and electronic equipment

By using a game interface interaction method based on a head-mounted display device, users can customize the parent-child hierarchy of the interface, which solves the problem of cumbersome interface switching in existing technologies and achieves convenient personalized interface switching and an immersive experience.

CN117839209BActive Publication Date: 2026-07-31NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
NETEASE (HANGZHOU) NETWORK CO LTD
Filing Date
2024-01-10
Publication Date
2026-07-31

AI Technical Summary

Technical Problem

Existing technologies involve cumbersome game interface switching processes, making it difficult to meet users' personalized interface switching needs.

Method used

The game's functional interface is displayed through a head-mounted display device, responding to the user's sub-interface expansion and related operations, enabling adjustments to functional modules, and allowing users to customize the parent-child hierarchy of the interface.

Benefits of technology

Reduce the number of interface switching times, improve user operation convenience, meet personalized interface switching needs, and provide an immersive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117839209B_ABST
    Figure CN117839209B_ABST
Patent Text Reader

Abstract

This disclosure provides a game interface interaction method, apparatus, storage medium, and electronic device, relating to the field of game technology. The game interface interaction method includes: in response to an operation involving the expansion of a sub-interface of a first functional module among one or more functional modules, displaying one or more functional sub-interfaces corresponding to the first functional module; and in response to an association operation between a target functional sub-interface among the one or more functional sub-interfaces and a second functional module among the one or more functional modules, adjusting the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module. This disclosure, by adjusting the functional module to which the sub-interface belongs, achieves customizable reorganization of the interface parent-child hierarchy, which can meet users' personalized interface switching needs and improve the convenience of user interface operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of game technology, and in particular to a game interface interaction method, a game interface interaction device, a computer-readable storage medium, and an electronic device. Background Technology

[0002] With the rapid development of electronic technology and the entertainment industry, games involve increasingly more content, requiring more game interfaces to display it. To view game content located in different game interfaces, players need to switch between these interfaces during gameplay.

[0003] In related technologies, when switching game interfaces, it is usually necessary to switch step by step according to the interface hierarchy preset by the developer in order to view the game content located on different game interfaces. The interface switching process is cumbersome and cannot meet the user's personalized interface switching needs.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] This disclosure provides a game interface interaction method, a game interface interaction device, a computer-readable storage medium, and an electronic device, thereby overcoming, to at least a certain extent, the problem of cumbersome interface switching processes and difficulty in meeting users' personalized interface switching needs in related technologies.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part by practice of this disclosure.

[0007] According to a first aspect of this disclosure, a game interface interaction method is provided, which displays a game function interface through a head-mounted display device. The game function interface includes one or more function modules. The method includes: in response to an operation to expand a sub-interface of a first function module among the one or more function modules, displaying one or more functional sub-interfaces corresponding to the first function module; and in response to an association operation between a target functional sub-interface among the one or more functional sub-interfaces and a second functional module among the one or more function modules, adjusting the function module to which the target functional sub-interface belongs from the first function module to the second function module.

[0008] According to a second aspect of this disclosure, a game interface interaction device is provided, which displays a game function interface via a head-mounted display device. The game function interface includes one or more function modules. The device includes: displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation to expand a sub-interface of a first functional module among the one or more functional modules; and adjusting the function module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to an association operation between a target functional sub-interface among the one or more functional sub-interfaces and a second functional module among the one or more functional modules.

[0009] According to a third aspect of this disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the above-described game interface interaction method and its possible implementations.

[0010] According to a fourth aspect of this disclosure, an electronic device is provided, comprising: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the above-described game interface interaction method and its possible implementations.

[0011] In the aforementioned game interface interaction process, in response to operations targeting the sub-interface of the first functional module among one or more functional modules, one or more functional sub-interfaces corresponding to the first functional module are displayed; in response to association operations between a target functional sub-interface among one or more functional sub-interfaces and a second functional module among one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module. On the one hand, by expanding sub-interfaces, the content of multiple different functional sub-interfaces can be viewed simultaneously, thereby reducing the number of times interfaces need to be switched and improving the convenience of user operation. On the other hand, through association operations, users can adjust the relationship between functional sub-interfaces according to their own usage habits, realizing the custom reorganization of the interface parent-child hierarchy, which can meet the user's personalized interface switching needs, allowing users to view the required interface content without switching back and forth between different levels of interfaces, further improving the convenience of user interface operation.

[0012] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0014] Figure 1 A flowchart illustrating one of the exemplary embodiments of the present disclosure of a game interface interaction method;

[0015] Figure 2A A schematic diagram showing a game function interface according to one of the exemplary embodiments of this disclosure is provided.

[0016] Figure 2B A schematic diagram illustrating one of the exemplary embodiments of this disclosure is shown.

[0017] Figure 2C This diagram illustrates the sliding of a game interface according to one of the exemplary embodiments of this disclosure;

[0018] Figure 2D A schematic diagram showing one of the functional modules of an exemplary embodiment of this disclosure is provided.

[0019] Figure 2E This diagram illustrates a first functional module highlighted in an enlarged manner, representing one of the exemplary embodiments of this disclosure.

[0020] Figure 2F A schematic diagram showing one of the functional sub-interfaces of an exemplary embodiment of this disclosure is provided.

[0021] Figure 2G This diagram illustrates one of the exemplary embodiments of the present disclosure, in which a target functional sub-interface is enlarged and highlighted.

[0022] Figure 3 A schematic diagram of an interface for adjusting affiliation relationships is shown in one of the exemplary embodiments of this disclosure;

[0023] Figure 4A This diagram illustrates a first functional sub-interface and a second functional sub-interface in a selected state according to one of the exemplary embodiments of this disclosure.

[0024] Figure 4B This diagram illustrates an enlarged view of a first functional sub-interface and a second functional sub-interface, representing one of the exemplary embodiments of this disclosure.

[0025] Figure 5 A flowchart illustrating one exemplary embodiment of the present disclosure of a game interface hierarchy customization;

[0026] Figure 6 This diagram illustrates a structural block diagram of a game interface interaction device according to one of the exemplary embodiments of this disclosure;

[0027] Figure 7 An electronic device is shown as one of the exemplary embodiments of this disclosure for implementing the above-described game interface interaction method. Detailed Implementation

[0028] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0029] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0030] In this article, "first," "second," etc., are labels for specific objects, rather than limiting the number or order of objects.

[0031] In related technologies, the interface switching is carried out step by step according to the interface hierarchy preset by the developer. The interface switching process is cumbersome and it is difficult to meet the user's personalized interface switching needs.

[0032] In view of one or more of the above-mentioned problems, exemplary embodiments of this disclosure provide a game interface interaction method, a game interface interaction device, a computer-readable storage medium, and an electronic device that can operate on a head-mounted display device.

[0033] This disclosure provides a flowchart illustrating a game interface interaction method, which can display a game function interface through a head-mounted display device. The game function interface includes one or more functional modules, such as... Figure 1 As shown, the specific steps may include S110 to S120:

[0034] Step S110: In response to the operation of expanding the sub-interface of the first functional module in one or more functional modules, display one or more functional sub-interfaces corresponding to the first functional module.

[0035] Step S120: In response to the association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

[0036] During the aforementioned game interface interaction, the operation of expanding sub-interfaces allows users to view the content of multiple different functional sub-interfaces simultaneously, thereby reducing the number of times users need to switch between interfaces and improving the convenience of user operation. Through associated operations, users can adjust the relationship between functional sub-interfaces according to their own usage habits, realizing the custom reorganization of the parent-child interface hierarchy. This can meet users' personalized interface switching needs, allowing users to view the required interface content without having to switch back and forth between different levels of interfaces, further improving the convenience of user interface operation.

[0037] It should be noted that a head-mounted display device is a wearable device that can achieve different effects such as VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality). Furthermore, head-mounted display devices can present selectable and / or operable interface elements to the user within their display space, such as UI (User Interface) elements and GUI (Graphical User Interface) elements, allowing the user to interact with these interface elements through gestures.

[0038] The game interface can be a parent game interface that allows users to access different child game interfaces, such as... Figure 2AAs shown in Figure 200, the main interface of the game lobby can be displayed as a floating window within the display space of the head-mounted display device. The game's functional interface can contain one or more functional modules, such as a personal information module, a shop module, and a warehouse module. These modules can be displayed directly within the game's functional interface, or they can be hidden and revealed through user gestures (e.g., push gestures). Hiding the functional modules within the game's functional interface can improve the interface's cleanliness to some extent.

[0039] The following is about Figure 1 Each step is explained in detail.

[0040] In step S110, in response to the operation of expanding the sub-interface of the first functional module among one or more functional modules, one or more functional sub-interfaces corresponding to the first functional module are displayed.

[0041] Among them, the functional sub-interface refers to the interface that can realize a specific game function, and is a sub-interface of the game function interface.

[0042] It should be noted that each functional module in the game's interface can correspond to one or more sub-interfaces. For example, the mall module can contain multiple sub-interfaces for selling virtual items.

[0043] The first functional module refers to the functional module selected from the functional modules included in the game's functional interface.

[0044] In an optional implementation, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation to expand the sub-interface of the first functional module among one or more functional modules, the functional modules contained in the game functional interface may be displayed by the following steps: in response to a first gesture operation on the game functional interface, the game functional interface is moved away from the head-mounted display device in the display space along a spatial coordinate axis perpendicular to the display plane where the game functional interface is located, and one or more functional modules are displayed at the original display plane of the game functional interface.

[0045] Among them, the first gesture operation for the game's functional interface can be, for example... Figure 2B The push gesture shown is illustrated. By combining the push gesture with the movement of the game's interface, an effect can be created where the interface moves with the gesture, thereby enhancing the user's immersive experience.

[0046] like Figure 2CAs shown, a schematic diagram of a game function interface being moved is provided, wherein arrow 201 can indicate the viewing direction of a user wearing a head-mounted display device 202; arrow 203 can indicate the moving direction of the game function interface 204, which is perpendicular to the spatial coordinate axis of the display plane on which the game function interface is located and away from the head-mounted display device 202.

[0047] As the game's interface evolves, for example, such as Figure 2D As shown, one or more functional modules can be displayed on the original display plane of the game's functional interface.

[0048] By moving the game's interface around, a sense of spatial depth can be created, further enhancing the user's visual experience.

[0049] For example, after displaying one or more functional modules corresponding to the game function interface, in response to a push gesture for the functional module displayed in the display space, the functional module displayed in the display space can be pushed towards the head-mounted display device along the spatial coordinate axis perpendicular to the display plane where the functional module is located, and the game function interface can be displayed at the original display plane of the functional module to achieve the retraction of the interface level.

[0050] In one alternative implementation, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation to expand the sub-interface of the first functional module among one or more functional modules, the first functional module may be determined by the following step: determining the first functional module from one or more functional modules based on the user's gaze position in one or more functional modules.

[0051] Specifically, the user's gaze position can be detected by a head-mounted display device to determine whether the user is gazing at the functional modules contained in the game interface, and the functional module that the user is gazing at can be taken as the first functional module.

[0052] Optionally, after determining the first functional module, it can be enlarged and highlighted, such as... Figure 2E As shown, a view icon can be displayed on the view module to indicate to the user the first view module object selected.

[0053] In the above steps, by combining the user's gaze position to determine the first functional module, the user's gesture operation burden can be reduced to a certain extent, and the convenience of selection operation can be improved.

[0054] In one alternative implementation, the above-mentioned response to the operation of unfolding the sub-interface of the first functional module among one or more functional modules, displaying one or more functional sub-interfaces corresponding to the first functional module, can be implemented by the following steps: in response to the first gesture operation of the first functional module, the one or more functional modules displayed in the display space are moved away from the head-mounted display device along the spatial coordinate axis perpendicular to the display plane of the one or more functional modules, and one or more functional sub-interfaces are displayed at the original display plane of the one or more functional modules.

[0055] The first gesture operation for the first functional module can be, for example... Figure 2B The push gesture shown is an example of how a push gesture, combined with the movement of the display plane containing the functional modules, creates an effect where the interface moves with the gesture, thereby enhancing the user's immersive experience.

[0056] As the display plane containing the functional modules moves, for example, such as Figure 2F As shown, the functional sub-interfaces associated with the functional module can be displayed on the original display plane of the functional module.

[0057] By shifting the display plane where the functional modules are located, a sense of spatial depth can be created, further enhancing the user's visual experience.

[0058] For example, after displaying one or more functional sub-interfaces corresponding to the first functional module, in response to a push gesture for the functional sub-interfaces displayed in the display space, the functional sub-interfaces displayed in the display space can be pushed towards the head-mounted display device along the spatial coordinate axis perpendicular to the display plane where the functional sub-interfaces are located, and the functional module corresponding to the game functional interface can be displayed at the original display plane of the functional sub-interfaces, so as to realize the back of the interface level.

[0059] In step S120, in response to the association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

[0060] The target functional sub-interface refers to the functional sub-interface selected from the functional sub-interfaces associated with the first functional module.

[0061] Specifically, the target functional sub-interface can be determined from the functional sub-interfaces associated with the first functional module based on the user's gaze position on the functional module displayed in the display space.

[0062] Optionally, after determining the target function sub-interface, the target function sub-interface can be enlarged and highlighted, such as... Figure 2GAs shown, a view icon can be displayed on the viewed sub-interface to prompt the user about the selected target sub-interface object.

[0063] By determining the target function sub-interface based on the user's gaze position, the burden of user gesture operation can be reduced to a certain extent, and the convenience of selection operation can be improved.

[0064] The second functional module refers to another functional module selected from the functional modules included in the game's functional interface. Through the association operation between the target functional sub-interface and the second functional module, the functional module to which the target functional sub-interface belongs can be adjusted from the first functional module to the second functional module. This ensures that when subsequent operations are performed on the sub-interfaces responding to the second functional module, one or more functional sub-interfaces corresponding to the second functional module can be displayed, and these functional sub-interfaces contain the target functional sub-interface.

[0065] When a functional sub-interface is in the display state, the relationship between functional sub-interfaces can be adjusted at any time without switching to a fixed functional interface to adjust the relationship between functional sub-interfaces, making the operation more convenient and flexible.

[0066] In an optional implementation, the above-mentioned adjustment of the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to the association operation between the target functional sub-interface and the second functional module in one or more functional modules can be achieved through the following steps: in response to the second gesture operation on the target functional sub-interface, a membership control area is generated, and one or more functional modules are displayed in the membership control area; in response to the association operation between the target functional sub-interface and the second functional module in the membership control area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

[0067] Optionally, the second gesture operation for the target function sub-interface can be a thumb-and-index finger grasping gesture on the target function sub-interface.

[0068] The subordinate relationship control area can be a recognition and perception area displayed on a preset side of the display plane where the functional sub-interface corresponding to the first functional module is located, which may display the existing functional modules contained in the game functional interface.

[0069] The second functional module refers to another functional module selected from the functional modules included in the game's functional interface. It can be determined by selecting from the functional modules displayed in the hierarchical control area.

[0070] By establishing a relationship between the target function sub-interface and the second function module, the relationship between the target function sub-interface and the first function module is removed, thus enabling flexible adjustment of the interface hierarchy.

[0071] In an optional implementation, when one or more functional modules are displayed in the above-mentioned subordinate relationship control area, the second functional module can be determined by the following steps: in response to a movement operation that moves the target functional sub-interface to one or more functional modules displayed in the subordinate relationship control area, the second functional module is determined from one or more functional modules.

[0072] Specifically, the functional module where the movement ends can be designated as the second functional module. By identifying the second functional module, a target adjustment object can be provided for adjusting the relationship between the target functional sub-interfaces, which is simple and easy to implement.

[0073] For example, such as Figure 3 As shown, a schematic diagram of an interface for adjusting affiliation is provided. The affiliation control area 301 can display the existing functional modules included in the game function interface. The affiliation of the target sub-function interface can be adjusted by moving the target sub-function interface to any functional module displayed in the affiliation control area 301.

[0074] Optionally, when performing a move operation, the target functional sub-interface can be controlled to move along with the move operation, so as to make the process of adjusting the affiliation visible.

[0075] In one alternative implementation, a custom functional module is displayed in the membership control area. In response to a move operation that moves the target functional sub-interface to the custom functional module, a new functional module can be created and used as a second functional module.

[0076] Customizable function modules refer to function modules that allow users to create new function modules, which can be controlled by the user through gesture operations.

[0077] Optionally, new functional modules can be named according to preset rules, such as named New Module 1, New Module 2, ... New Module n in the order of module creation, where n represents the module creation sequence number. The system can also respond to renaming operations on newly created functional modules, modifying their names to help users distinguish between different functional modules.

[0078] For example, such as Figure 3As shown, a custom function module can also be displayed in the subordinate relationship control area 301. By moving the target sub-function interface to the custom function module, a subordinate relationship can be established between the target sub-function interface and the newly created function module.

[0079] By responding to the association operation between the target functional sub-interface and the newly created functional module, the functional module to which the target functional sub-interface belongs can be adjusted from the first functional module to the newly created functional module, which can further meet the user's personalized interface hierarchy layout needs.

[0080] In one alternative implementation, in response to a second gesture operation on the target functional sub-interface, a membership restoration area is generated; in response to a movement operation that moves the target functional sub-interface to the membership restoration area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the initial configuration functional module corresponding to the target functional sub-interface.

[0081] The subordinate relationship control area can be the recognition and perception area displayed on the preset side of the display plane where the functional sub-interface corresponding to the first functional module is located.

[0082] The initial configuration function module can be the default function module configured by the developers for the function sub-interface.

[0083] like Figure 3 As shown in the membership restoration area 302, the membership relationship between the target sub-function interface and the initial configuration function module corresponding to the target sub-function interface can be established by moving the target sub-function interface to the membership restoration area 302.

[0084] Optionally, the module identifier of the initial configuration function module corresponding to the target function sub-interface can be displayed in the affiliation recovery area to prompt the user of the initial configuration function module corresponding to the target function sub-interface and help the user determine whether the function module to which the target function sub-interface belongs needs to be adjusted from the first function module to the initial configuration function module corresponding to the target function sub-interface.

[0085] By displaying the sub-interface restoration area, users no longer need to switch to a fixed function interface to restore the sub-interface relationship, further simplifying user operations.

[0086] In an alternative implementation, the following steps may also be performed: in response to a second gesture operation on the target functional sub-interface, a sub-interface deletion area is generated; in response to a movement operation that moves the target functional sub-interface to the sub-interface deletion area, the target functional sub-interface is moved to the sub-interface deletion area, and the association between the target functional sub-interface and the first functional module is terminated.

[0087] The sub-interface deletion area can be a recognition and perception area displayed on a preset side of the display plane where the functional sub-interface corresponding to the first functional module is located, which can display the deleted functional sub-interface. For example, such as Figure 3 The sub-interface deletion area 303 is shown in the figure.

[0088] By displaying the deletion area of ​​the sub-interface, it can not only assist users in performing the deletion operation of the target function sub-interface, but also prompt users that the function sub-interface has been deleted, thereby reducing the user's interface operation burden.

[0089] Optionally, it can also respond to the movement operation of the deleted sub-interface in the deletion area of ​​the interface to the display area of ​​the corresponding sub-interface of the first functional module, and establish a relationship between the corresponding deleted sub-interface and the first functional module.

[0090] Optionally, after determining the target function sub-interface, the target function sub-interface can be enlarged in response to a tapping gesture on the target function sub-interface displayed in the display space, so that the user can perform further operations on the target function sub-interface.

[0091] In an optional implementation, the following steps may also be performed: when the first functional sub-interface and the second functional sub-interface are selected, in response to a third gesture operation on the first functional sub-interface and the second functional sub-interface, the first functional sub-interface and the second functional sub-interface are enlarged and displayed in the display plane where one or more functional modules are located; wherein the first functional sub-interface and the second functional sub-interface are functional sub-interfaces among one or more functional sub-interfaces.

[0092] The first and second functional sub-interfaces can be selected from the functional sub-interfaces associated with the displayed first functional module. The third operation gesture can be, for example, a swipe down while simultaneously clicking in the air with the index and middle fingers and maintaining the drag state.

[0093] For example, such as Figure 4A As shown, when the first functional sub-interface 401 and the second functional sub-interface 402 are in the selected state, a third gesture operation can be performed on the first functional sub-interface and the second functional sub-interface to obtain the following result: Figure 4B The interface shown is magnified.

[0094] Optionally, the enlarged first and second functional sub-interfaces can respond to user interface clicks.

[0095] By simultaneously enlarging and displaying two functional sub-interfaces, users can operate on both sub-interfaces at the same time, which further reduces the complexity of user interface switching and improves the convenience of user operation.

[0096] like Figure 5 As shown, a flowchart for customizing the game interface hierarchy is provided, which may include the following steps:

[0097] Step S501: In response to the push gesture operation on the game function interface, the game function interface is pushed away from the head-mounted display device in the display space along the spatial coordinate axis perpendicular to the display plane where the game function interface is located, and the functional modules contained in the game function interface are displayed at the original display plane of the game function interface.

[0098] Step S502: Determine the first functional module from the functional modules included in the game function interface based on the user's gaze position in the functional modules displayed in the display space.

[0099] Step S503: In response to the push gesture operation for the first functional module, the functional module displayed in the display space is pushed away from the head-mounted display device along the spatial coordinate axis perpendicular to the display plane where the functional module is located, and the functional sub-interface corresponding to the first functional module is displayed at the original display plane of the functional module.

[0100] Step S504: Determine the target functional sub-interface from the functional sub-interfaces corresponding to the first functional module based on the user's gaze position in the functional sub-interfaces displayed in the display space.

[0101] Step S505: In response to the grab gesture operation on the target function sub-interface, a subordinate control area is generated, and the function modules contained in the game function interface are displayed in the subordinate control area.

[0102] Step S506: In response to the move operation of moving the target functional sub-interface to the functional module displayed in the hierarchy control area, determine the second functional module from the functional modules displayed in the hierarchy control area, and adjust the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module.

[0103] Figure 6 A game interface interaction device 600, as illustrated in an exemplary embodiment of this disclosure, displays a game function interface via a head-mounted display device. The game function interface includes one or more functional modules, such as... Figure 6 As shown, the game interface interaction device 600 may include:

[0104] The functional sub-interface display module 610 is used to display one or more functional sub-interfaces corresponding to the first functional module in response to the sub-interface expansion operation of the first functional module among one or more functional modules.

[0105] The functional sub-interface adjustment module 620 is used to adjust the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to an association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules.

[0106] In an optional implementation, based on the foregoing scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation on the sub-interface of the first functional module, the game interface interaction device 600 further includes: a functional module display module, configured to, in response to a first gesture operation on the game functional interface, move the game functional interface away from the head-mounted display device along a spatial coordinate axis perpendicular to the display plane of the game functional interface, and display one or more functional modules at the original display plane of the game functional interface. The functional sub-interface display module 610 can be configured to, in response to a first gesture operation on the first functional module, move one or more functional modules displayed in the display space away from the head-mounted display device along a spatial coordinate axis perpendicular to the display plane of the one or more functional modules, and display one or more functional sub-interfaces at the original display plane of the one or more functional modules.

[0107] In an optional implementation, based on the aforementioned scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation on the sub-interface of the first functional module among one or more functional modules, the game interface interaction device 600 further includes: a first functional module determining module, used to determine the first functional module from one or more functional modules based on the user's gaze position in one or more functional modules.

[0108] In an optional implementation, based on the aforementioned scheme, the functional sub-interface adjustment module 620 can be configured to: generate a membership control area in response to a second gesture operation on the target functional sub-interface, displaying one or more functional modules in the membership control area; and adjust the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to an association operation between the target functional sub-interface and the second functional module in the membership control area.

[0109] In an optional implementation, based on the foregoing scheme, the game interface interaction device 600 further includes a second functional module determination module. The second functional module determination module can be configured to: determine a second functional module from one or more functional modules in response to a movement operation that moves a target functional sub-interface to one or more functional modules displayed in the membership control area.

[0110] In an alternative implementation, based on the aforementioned scheme, a custom functional module is displayed in the membership control area, wherein the second functional module determination module can also be configured to: in response to moving the target functional sub-interface to the custom functional module, create a new functional module and use the new functional module as the second functional module.

[0111] In an optional implementation, based on the aforementioned scheme, the game interface interaction device 600 further includes: a membership restoration module. The membership restoration module can be configured to: generate a membership restoration area in response to a second gesture operation on a target functional sub-interface; and, in response to a movement operation that moves the target functional sub-interface to the membership restoration area, adjust the functional module to which the target functional sub-interface belongs from a first functional module to the initial configuration functional module corresponding to the target functional sub-interface.

[0112] In an optional implementation, based on the aforementioned scheme, the game interface interaction device 600 further includes a sub-interface deletion module. The sub-interface deletion module can be configured to: generate a sub-interface deletion area in response to a second gesture operation targeting a target functional sub-interface; and move the target functional sub-interface to the sub-interface deletion area in response to a movement operation that moves the target functional sub-interface to the sub-interface deletion area, and sever the association between the target functional sub-interface and the first functional module.

[0113] In an optional implementation, based on the aforementioned scheme, the game interface interaction device 600 further includes: a sub-interface magnification display module, used to magnify and display the first functional sub-interface and the second functional sub-interface in the display plane where one or more functional modules are located when the first functional sub-interface and the second functional sub-interface are in a selected state, in response to a third gesture operation on the first functional sub-interface and the second functional sub-interface; wherein, the first functional sub-interface and the second functional sub-interface are functional sub-interfaces among one or more functional sub-interfaces.

[0114] The specific details of each module in the aforementioned game interface interaction device 600 have been described in detail in the method section of the implementation. Any undisclosed details can be found in the implementation content of the method section, and therefore will not be repeated here.

[0115] Exemplary embodiments of this disclosure also provide a computer-readable storage medium storing a program product capable of implementing the game interface interaction method described above. In some possible embodiments, various aspects of this disclosure may also be implemented as a program product including program code that, when the program product is run on an electronic device, causes the electronic device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0116] Specifically, a program product stored on a computer-readable storage medium enables an electronic device to perform the following steps:

[0117] In response to an operation that expands to a sub-interface of a first functional module among one or more functional modules, one or more functional sub-interfaces corresponding to the first functional module are displayed.

[0118] In response to an association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

[0119] In an optional implementation, based on the foregoing scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to the operation of expanding the sub-interface of the first functional module among one or more functional modules, the following steps may be performed: in response to the first gesture operation on the game functional interface, the game functional interface is moved away from the head-mounted display device in the display space along the spatial coordinate axis perpendicular to the display plane where the game functional interface is located, and one or more functional modules are displayed at the original display plane of the game functional interface; wherein, in response to the operation of expanding the sub-interface of the first functional module among one or more functional modules, displaying one or more functional sub-interfaces corresponding to the first functional module can be achieved by the following steps: in response to the first gesture operation on the first functional module, one or more functional modules displayed in the display space are moved away from the head-mounted display device along the spatial coordinate axis perpendicular to the display plane where one or more functional modules are located, and one or more functional sub-interfaces are displayed at the original display plane of one or more functional modules.

[0120] In an alternative implementation, based on the foregoing scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation on the sub-interface of the first functional module among one or more functional modules, the following steps may also be performed: determining the first functional module from one or more functional modules based on the user's gaze position in one or more functional modules.

[0121] In an optional implementation, based on the foregoing scheme, in response to an association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from a first functional module to a second functional module. This can be achieved through the following steps: in response to a second gesture operation on the target functional sub-interface, a membership control area is generated, and one or more functional modules are displayed in the membership control area; in response to an association operation between the target functional sub-interface and the second functional module in the membership control area, the functional module to which the target functional sub-interface belongs is adjusted from a first functional module to a second functional module.

[0122] In an alternative implementation, based on the foregoing scheme, the following steps may also be performed: in response to a move operation that moves the target functional sub-interface to one or more functional modules displayed in the membership control area, a second functional module is determined from the one or more functional modules.

[0123] In an optional implementation, based on the aforementioned scheme, the above-mentioned subordinate relationship control area displays a custom function module, and the following steps can also be performed: in response to moving the target function sub-interface to the custom function module, a new function module is created, and the new function module is used as the second function module.

[0124] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: in response to a second gesture operation on the target functional sub-interface, a membership restoration area is generated; in response to a movement operation that moves the target functional sub-interface to the membership restoration area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the initial configuration functional module corresponding to the target functional sub-interface.

[0125] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: in response to a second gesture operation on the target functional sub-interface, a sub-interface deletion area is generated; in response to a movement operation that moves the target functional sub-interface to the sub-interface deletion area, the target functional sub-interface is moved to the sub-interface deletion area, and the association between the target functional sub-interface and the first functional module is terminated.

[0126] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: when the first functional sub-interface and the second functional sub-interface are in a selected state, in response to a third gesture operation on the first functional sub-interface and the second functional sub-interface, the first functional sub-interface and the second functional sub-interface are enlarged and displayed in the display plane where one or more functional modules are located; wherein, the first functional sub-interface and the second functional sub-interface are functional sub-interfaces among one or more functional sub-interfaces.

[0127] During the aforementioned game interface interaction, the operation of expanding sub-interfaces allows users to view the content of multiple different functional sub-interfaces simultaneously, thereby reducing the number of times users need to switch between interfaces and improving the convenience of user operation. Through associated operations, users can adjust the relationship between functional sub-interfaces according to their own usage habits, realizing the custom reorganization of the parent-child interface hierarchy. This can meet users' personalized interface switching needs, allowing users to view the required interface content without having to switch back and forth between different levels of interfaces, further improving the convenience of user interface operation.

[0128] The program product may be a portable compact disc read-only memory (CD-ROM) and include program code, and may run on an electronic device, such as a personal computer. However, the program product disclosed herein is not limited thereto. In this document, the readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0129] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0130] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0131] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF (Radio Frequency), etc., or any suitable combination thereof.

[0132] Program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing devices can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0133] Exemplary embodiments of this disclosure also provide an electronic device capable of implementing the above-described game interface interaction method. Referring below... Figure 7 To describe an electronic device 700 according to such an exemplary embodiment of the present disclosure. Figure 7 The electronic device 700 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0134] like Figure 7 As shown, the electronic device 700 can be represented as a general-purpose computing device. The components of the electronic device 700 may include, but are not limited to: at least one processing unit 710, at least one storage unit 720, a bus 730 connecting different system components (including storage unit 720 and processing unit 710), and a display unit 740.

[0135] The storage unit 720 stores program code, which can be executed by the processing unit 710, causing the processing unit 710 to perform the steps described in the "Exemplary Methods" section above according to various exemplary embodiments of this disclosure.

[0136] Specifically, the processing unit 710 may perform the following steps:

[0137] In response to an operation that expands to a sub-interface of a first functional module among one or more functional modules, one or more functional sub-interfaces corresponding to the first functional module are displayed.

[0138] In response to an association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

[0139] In an optional implementation, based on the foregoing scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to the operation of expanding the sub-interface of the first functional module among one or more functional modules, the following steps may be performed: in response to the first gesture operation on the game functional interface, the game functional interface is moved away from the head-mounted display device in the display space along the spatial coordinate axis perpendicular to the display plane where the game functional interface is located, and one or more functional modules are displayed at the original display plane of the game functional interface; wherein, in response to the operation of expanding the sub-interface of the first functional module among one or more functional modules, displaying one or more functional sub-interfaces corresponding to the first functional module can be achieved by the following steps: in response to the first gesture operation on the first functional module, one or more functional modules displayed in the display space are moved away from the head-mounted display device along the spatial coordinate axis perpendicular to the display plane where one or more functional modules are located, and one or more functional sub-interfaces are displayed at the original display plane of one or more functional modules.

[0140] In an alternative implementation, based on the foregoing scheme, before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation on the sub-interface of the first functional module among one or more functional modules, the following steps may also be performed: determining the first functional module from one or more functional modules based on the user's gaze position in one or more functional modules.

[0141] In an optional implementation, based on the foregoing scheme, in response to an association operation between a target functional sub-interface in one or more functional sub-interfaces and a second functional module in one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from a first functional module to a second functional module. This can be achieved through the following steps: in response to a second gesture operation on the target functional sub-interface, a membership control area is generated, and one or more functional modules are displayed in the membership control area; in response to an association operation between the target functional sub-interface and the second functional module in the membership control area, the functional module to which the target functional sub-interface belongs is adjusted from a first functional module to a second functional module.

[0142] In an alternative implementation, based on the foregoing scheme, the following steps may also be performed: in response to a move operation that moves the target functional sub-interface to one or more functional modules displayed in the membership control area, a second functional module is determined from the one or more functional modules.

[0143] In an optional implementation, based on the aforementioned scheme, the above-mentioned subordinate relationship control area displays a custom function module, and the following steps can also be performed: in response to moving the target function sub-interface to the custom function module, a new function module is created, and the new function module is used as the second function module.

[0144] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: in response to a second gesture operation on the target functional sub-interface, a membership restoration area is generated; in response to a movement operation that moves the target functional sub-interface to the membership restoration area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the initial configuration functional module corresponding to the target functional sub-interface.

[0145] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: in response to a second gesture operation on the target functional sub-interface, a sub-interface deletion area is generated; in response to a movement operation that moves the target functional sub-interface to the sub-interface deletion area, the target functional sub-interface is moved to the sub-interface deletion area, and the association between the target functional sub-interface and the first functional module is terminated.

[0146] In an optional implementation, based on the foregoing scheme, the following steps may also be performed: when the first functional sub-interface and the second functional sub-interface are in a selected state, in response to a third gesture operation on the first functional sub-interface and the second functional sub-interface, the first functional sub-interface and the second functional sub-interface are enlarged and displayed in the display plane where one or more functional modules are located; wherein, the first functional sub-interface and the second functional sub-interface are functional sub-interfaces among one or more functional sub-interfaces.

[0147] During the aforementioned game interface interaction, the operation of expanding sub-interfaces allows users to view the content of multiple different functional sub-interfaces simultaneously, thereby reducing the number of times users need to switch between interfaces and improving the convenience of user operation. Through associated operations, users can adjust the relationship between functional sub-interfaces according to their own usage habits, realizing the custom reorganization of the parent-child interface hierarchy. This can meet users' personalized interface switching needs, allowing users to view the required interface content without having to switch back and forth between different levels of interfaces, further improving the convenience of user interface operation.

[0148] Storage unit 720 may include a readable medium in the form of a volatile storage unit, such as random access memory (RAM) 721 and / or cache memory 722, and may further include a read-only memory (ROM) 723.

[0149] The storage unit 720 may also include a program / utility 724 having a set (at least one) of program modules 725, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0150] Bus 730 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0151] Electronic device 700 can also communicate with one or more external devices 800 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with the electronic device 700, and / or with any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 750. Furthermore, electronic device 700 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 760. Figure 7 As shown, network adapter 760 communicates with other modules of electronic device 700 via bus 730. It should be understood that, although... Figure 7 As not shown, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems.

[0152] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the method according to the exemplary embodiments of this disclosure.

[0153] Furthermore, the above figures are merely illustrative representations of the processes included in the methods according to exemplary embodiments of this disclosure, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0154] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to exemplary embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0155] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0156] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A game interface interaction method, characterized in that, Displaying a game interface via a head-mounted display device, the game interface comprising one or more functional modules, the method comprising: In response to an operation that expands the sub-interface of the first functional module among the one or more functional modules, one or more functional sub-interfaces corresponding to the first functional module are displayed. In response to an association operation between a target functional sub-interface in the one or more functional sub-interfaces and a second functional module in the one or more functional modules, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

2. The method according to claim 1, characterized in that, Before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation to expand the sub-interface of the first functional module among the one or more functional modules, the method further includes: In response to a first gesture operation on the game function interface, the game function interface is moved away from the head-mounted display device in the display space along a spatial coordinate axis perpendicular to the display plane where the game function interface is located, and the one or more function modules are displayed at the original display plane of the game function interface. The step of responding to an operation that expands the sub-interface of the first functional module among the one or more functional modules, and displaying one or more functional sub-interfaces corresponding to the first functional module, includes: In response to a first gesture operation on the first functional module, the one or more functional modules displayed in the display space are moved away from the head-mounted display device along a spatial coordinate axis perpendicular to the display plane where the one or more functional modules are located, and the one or more functional sub-interfaces are displayed at the original display plane of the one or more functional modules.

3. The method according to claim 1, characterized in that, Before displaying one or more functional sub-interfaces corresponding to the first functional module in response to an operation to expand the sub-interface of the first functional module among the one or more functional modules, the method further includes: The first functional module is determined from the one or more functional modules based on the user's gaze position within the one or more functional modules.

4. The method according to claim 1, characterized in that, The step of adjusting the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to an association operation between a target functional sub-interface and a second functional module in one or more functional modules includes: In response to a second gesture operation on the target functional sub-interface, a membership control area is generated, in which the one or more functional modules are displayed; In response to the association operation between the target functional sub-interface and the second functional module in the subordinate relationship control area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the second functional module.

5. The method according to claim 4, characterized in that, The method further includes: In response to a movement operation that moves the target functional sub-interface to one or more functional modules displayed in the membership control area, the second functional module is determined from the one or more functional modules.

6. The method according to claim 4, characterized in that, The method further includes displaying custom functional modules in the membership control area, and the method also includes: In response to moving the target function sub-interface to the custom function module, a new function module is created, and the new function module is used as the second function module.

7. The method according to claim 1, characterized in that, The method further includes: In response to a second gesture operation on the target functional sub-interface, a membership restoration area is generated; In response to the movement operation of moving the target functional sub-interface to the affiliation restoration area, the functional module to which the target functional sub-interface belongs is adjusted from the first functional module to the initial configuration functional module corresponding to the target functional sub-interface.

8. The method according to claim 1, characterized in that, The method further includes: In response to a second gesture operation on the target function sub-interface, a sub-interface deletion area is generated; In response to a movement operation that moves the target function sub-interface to the sub-interface deletion area, the target function sub-interface is moved to the sub-interface deletion area, and the association between the target function sub-interface and the first function module is terminated.

9. The method according to claim 1, characterized in that, The method further includes: When the first functional sub-interface and the second functional sub-interface are selected, in response to a third gesture operation on the first functional sub-interface and the second functional sub-interface, the first functional sub-interface and the second functional sub-interface are enlarged and displayed on the display plane where the one or more functional modules are located. Wherein, the first functional sub-interface and the second functional sub-interface are functional sub-interfaces among the one or more functional sub-interfaces.

10. A game interface interaction device, characterized in that, The device displays a game interface via a head-mounted display, the game interface comprising one or more functional modules, and the device includes: The functional sub-interface display module is used to display one or more functional sub-interfaces corresponding to the first functional module in response to the sub-interface expansion operation of the first functional module among the one or more functional modules. The functional sub-interface adjustment module is used to adjust the functional module to which the target functional sub-interface belongs from the first functional module to the second functional module in response to an association operation between a target functional sub-interface and a second functional module in one or more functional modules.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method according to any one of claims 1 to 9.

12. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the method as described in any one of claims 1 to 9.