Methods, devices, electronic devices, and computer programs for displaying information about virtual scenes

Abstract

Provided is a method, device, electronic device, computer-readable storage medium and computer program product for displaying information of a virtual scene, the method including the steps of: displaying scene auxiliary information and an operation widget of the virtual scene in an interface of the virtual scene, the operation widget being used to control an operation of a virtual object in the virtual scene; adjusting a content in a field of view of the virtual object in the virtual scene in response to a field of view adjustment operation, and adjusting a visibility of the scene auxiliary information when adjusting the content, the visibility of the scene auxiliary information after the adjustment being lower than the visibility of the operation widget; and restoring the visibility of the scene auxiliary information when the field of view adjustment operation is terminated.

Description

Technical Field

[0001] This application claims priority based on a Chinese patent application with application number 2022108345226 filed on July 14, 2022, and incorporates all the contents of the Chinese patent application by reference into the present invention.

[0002] The present invention relates to virtualization and human-computer interaction technologies, and particularly to an information display method, apparatus, electronic device, computer-readable storage medium, and computer program product for a virtual scene.

Background Art

[0003] Display technologies based on graphics processing hardware have expanded the means for environmental perception and information acquisition. In particular, the multimedia technology for virtual scenes can utilize human-computer interaction engine technology to realize various interactions between virtual objects by users or artificial intelligence according to actual application needs, and has various typical application scenarios. For example, in the scenario of a game, the actual interaction process between virtual objects can be simulated.

[0004] In related technologies, the interface of a virtual scene displays a large amount of complex information such as various function entries, widgets (also referred to as controls), prompts, etc., which affects the browsing and operation in the virtual scene by users and reduces the efficiency of human-computer interaction.

Summary of the Invention

[0005] Embodiments of the present invention provide an information display method, apparatus, electronic device, computer-readable storage medium, and computer program product for a virtual scene, which can reduce the complexity of information display and improve the utilization rate of display resources and the efficiency of human-computer interaction.

[0006] The technical means of the embodiments of the present invention are as follows.

[0007] In an embodiment of the present invention, a method for displaying information of a virtual scene, performed by an electronic device, is provided, comprising the steps of: displaying scene auxiliary information of the virtual scene; displaying an operation widget for the virtual scene, the operation widget being used to control the operation of a virtual object in the virtual scene; adjusting the content of the virtual object in the field of view in the virtual scene in response to a field of view adjustment operation; and adjusting the visibility of the scene auxiliary information when adjusting the content, the visibility of the adjusted scene auxiliary information being lower than the visibility of the operation widget; and restoring the visibility of the scene auxiliary information when the field of view adjustment operation is completed.

[0008] In an embodiment of the present invention, the present invention provides a virtual scene information display device comprising: a first display module that displays scene auxiliary information of the virtual scene and displays an operation widget for the virtual scene, the operation widget being used to control the operation of a virtual object in the virtual scene; a second display module that, in response to a field of view adjustment operation, adjusts the content of the virtual object in the field of view of the virtual scene and adjusts the visibility of the scene auxiliary information when adjusting the content, the visibility of the adjusted scene auxiliary information being lower than the visibility of the operation widget; and a third display module that restores the visibility of the scene auxiliary information when the field of view adjustment operation is completed.

[0009] In an embodiment of the present invention, an electronic device is provided that includes a memory storing computer-executable instructions, and a processor that implements a virtual scene information display method according to an embodiment of the present invention when executing the computer-executable instructions stored in the memory.

[0010] In an embodiment of the present invention, a computer-readable storage medium is provided that stores computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, realize a method for displaying information of a virtual scene according to an embodiment of the present invention.

[0011] In embodiments of the present invention, a computer program product is provided which includes a computer-executable instruction or computer program, wherein the computer-executable instruction or computer program, when executed by a processor, realizes a method for displaying information of a virtual scene according to embodiments of the present invention.

[0012] The embodiments of the present invention have the following advantageous effects.

[0013] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of virtual objects in the virtual scene are displayed. When a field of view adjustment operation is received, the content of the virtual object in the field of view of the virtual scene is adjusted. When adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. When the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when performing control operations in a virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be made to focus on the operation widget and the virtual scene itself, and the user can quickly control the operation of virtual objects based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources. [Brief explanation of the drawing]

[0014] [Figure 1A]This is a schematic diagram illustrating an application embodiment of the information display method for a virtual scene according to an embodiment of the present invention. [Figure 1B] This is a schematic diagram illustrating an application embodiment of the information display method for a virtual scene according to an embodiment of the present invention. [Figure 2] This is a schematic diagram of the configuration of an electronic device 500 that implements a virtual scene information display method according to an embodiment of the present invention. [Figure 3] This is a schematic diagram illustrating the principle of a human-computer interaction engine mounted on a virtual scene information display device according to an embodiment of the present invention. [Figure 4] This is a schematic flowchart of a method for displaying information in a virtual scene according to an embodiment of the present invention. [Figure 5] This is a schematic diagram of the trigger for the field of view adjustment operation according to an embodiment of the present invention. [Figure 6] This is a schematic diagram of the trigger for the field of view adjustment operation according to an embodiment of the present invention. [Figure 7] This is a schematic diagram of the interface of a virtual scene according to an embodiment of the present invention. [Figure 8] This is a schematic flowchart of a method for displaying information in a virtual scene according to an embodiment of the present invention. [Figure 9] This is a schematic diagram of a hierarchical display of information according to an embodiment of the present invention. [Figure 10] This is a schematic flowchart of a method for displaying information in a virtual scene according to an embodiment of the present invention. [Figure 11] This is a flowchart illustrating the hierarchical structure of information in a virtual scene according to an embodiment of the present invention. [Figure 12] This is a schematic flowchart of the slide operation according to an embodiment of the present invention. [Figure 13] This is a schematic flowchart of the opacity adjustment according to an embodiment of the present invention. [Figure 14A] This is a schematic diagram showing the display of the presentation information layer according to an embodiment of the present invention. [Figure 14B] This is a schematic diagram showing the display of an information display layer according to an embodiment of the present invention. [Figure 14C]It is a schematic diagram of the display of the basic operation layer according to an embodiment of the present invention.

Mode for Carrying Out the Invention

[0015] To make the object, technical means, and advantages of the present invention clearer, the following will further describe the embodiments of the present invention in more detail with reference to the drawings. The described embodiments do not limit the present invention, and all other embodiments that can be obtained without creative work by those skilled in the art belong to the protection scope of the present invention.

[0016] In the following description, the "some embodiments" mentioned refer to a subset of all possible embodiments, but the "some embodiments" may be the same or different subsets of all possible embodiments, and may be combined with each other as long as they do not conflict.

[0017] In the following description, the terms "first", "second", and "third" mentioned are only for distinguishing similar objects and do not represent a specific order of the objects. Note that "first", "second", and "third" may be exchanged in a specific order or the front-back order so that the embodiments of the present invention described can be implemented in an order other than those illustrated or described in this specification when permitted.

[0018] Unless otherwise specified, all technical terms and scientific terms used here have the same meaning as commonly understood by those skilled in the art. The terms used in this specification are only for explaining the embodiments of the present invention and do not limit the present invention.

[0019] Before further describing the embodiments of the present invention, the nouns and terms included in the embodiments of the present invention will be explained, and the nouns and terms included in the embodiments of the present invention are suitable for the following interpretations.

[0020] (1) Client: An application that runs on a terminal to provide various services, such as a client that supports virtual scenes (e.g., game scenes).

[0021] (2) "In response to": Used to indicate a condition or state on which an operation performed depends. If the dependent condition or state is met, one or more operations performed may be in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which multiple operations performed may be executed.

[0022] (3) Virtual Scene: A virtual scene displayed (or provided) when an application program is running on a terminal. The virtual scene may be a simulation environment of the real world, a semi-simulation and semi-fictional environment, or a purely fictional environment. The virtual scene may be a 2D virtual scene, a 2.5D virtual scene, or a 3D virtual scene.

[0023] For example, a virtual scene may include the sky, land, sea, etc. Land may include environmental elements such as deserts and cities, and the user may control virtual objects to perform actions in the virtual scene. Such actions include, but are not limited to, adjusting body posture, crawling, running, riding, jumping, driving, picking up, shooting, attacking, and throwing. The virtual scene may be displayed in a first-person perspective (for example, the user represents virtual objects in the game from their own perspective), a third-person perspective (for example, the user progresses through the game by chasing virtual objects in the game), or a bird's-eye view, and these perspectives may be switched at will.

[0024] (4) Virtual object: This may be a human or object that can interact with in the virtual scene, or it may be an actionable object in the virtual scene. The actionable object may be a virtual character, a virtual animal, a cartoon or animation character, for example, a character, animal, plant, barrel, wall, stone, etc. that is displayed in the virtual scene. The virtual object may be a virtual figure that represents the user in the virtual scene. A virtual scene may contain multiple virtual objects, each having its own shape and volume in the virtual scene and occupying a part of the space in the virtual scene.

[0025] For example, the virtual object may be a user character controlled by client operations, an artificial intelligence (AI) set up for virtual scene battles through training, or a non-player character (NPC) set up for virtual scene interaction. Here, the number of virtual objects participating in the virtual scene interaction may be set in advance, or it may be dynamically determined according to the number of clients participating in the interaction.

[0026] (5) A Massive Multiplayer Online Role-Playing Game (MMORPG) is a type of online game that belongs to the role-playing game genre, in which players play fictional characters and control the actions and activities of those characters.

[0027] (6) A first-person shooting game (FPS) is a shooting game played from the player's subjective perspective.

[0028] (7) A Head-Up Display (HUD), also known as a head-up display system, displays information related to the virtual scene (i.e., HUD information; see Figure 9 for details) on the virtual scene interface, allowing the player to always understand the most important and directly relevant content of the virtual scene.

[0029] Embodiments of the present invention provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for displaying information in a virtual scene, which can reduce the complexity of information display and improve the utilization rate of display resources and the efficiency of human-computer interaction.

[0030] To facilitate understanding of the virtual scene information display method according to an embodiment of the present invention, the following describes an exemplary implementation scenario of the virtual scene information display method according to an embodiment of the present invention. In the virtual scene information display method according to an embodiment of the present invention, the virtual scene may be output entirely by the terminal device, or it may be output through the cooperation of the terminal device and the server.

[0031] In some embodiments, the virtual scene may be an environment for game characters to interact, for example, game characters may engage in a battle within the virtual scene. The user can gain a game experience during the game by controlling the behavior of the virtual characters to enable interaction between them within the virtual scene.

[0032] Figure 1A is a schematic diagram of an application embodiment of the virtual scene information display method according to an embodiment of the present invention. In one implementation scenario, as shown in Figure 1A, it is suitable for several application modes in which the calculation of the relevant data of the virtual scene 100 is completed entirely by the computing power of the terminal 400. For example, standalone / offline mode games realize the output of the virtual scene via the terminal 400, such as a smartphone, tablet computer, and virtual reality / augmented reality device. When forming the visual perception of the virtual scene 100, the terminal 400 calculates and displays the necessary data via graphics computing hardware, loads, analyzes, and renders the display data, and outputs video frames that enable visual perception of the virtual scene using graphics output hardware. For example, a two-dimensional image or video is displayed on the display screen of a smartphone, or a video frame that enables a three-dimensional display effect is projected onto the lenses of augmented reality / virtual reality glasses. Furthermore, to enhance the perceptual effect, the device may use various hardware to realize one or more of auditory perception, tactile perception, and motion perception.

[0033] For example, terminal 400 is running a client (e.g., a standalone version of a game application). While the client is running, a virtual scene is output based on the scene data of the virtual scene. The virtual scene is an environment for game characters to interact with, and may be, for example, a plain, a city, or a valley for game characters to battle in. After outputting the virtual scene, scene auxiliary information for the virtual scene is displayed, and a virtual scene operation widget is displayed, which is used to control the behavior of virtual objects in the virtual scene. The user may trigger a field of view adjustment operation for the virtual scene. In response to the field of view adjustment operation, terminal 400 adjusts the content of the virtual objects in the field of view in the virtual scene, and when adjusting the content, adjusts the visibility of the scene auxiliary information, and the visibility of the adjusted scene auxiliary information is lower than the visibility of the operation widget. When the field of view adjustment operation is finished, the visibility of the scene auxiliary information is restored.

[0034] Figure 1B is a schematic diagram of an application embodiment of the virtual scene information display method according to an embodiment of the present invention. In another implementation scenario, as shown in Figure 1B, it is applied to a terminal 400 and a server 200. Typically, the computing power of the server 200 is used to perform the calculation of the virtual scene, and the terminal 400 is used to output the application mode of the virtual scene. Taking the formation of a visual perception of a virtual scene 100 as an example, the server 200 calculates display data related to the virtual scene and transmits it to the terminal 400 via the network 300. The terminal 400 uses graphics computing hardware to calculate, load, and analyze the display data, and uses graphics output hardware to output the virtual scene and realize visual perception, for example, by displaying a two-dimensional video frame on the display screen of a smartphone, or by projecting a video frame to realize a three-dimensional display effect onto the lenses of augmented reality / virtual reality glasses. In the case of perceiving the form of the virtual scene, the corresponding hardware outputs of the terminal may be used, for example, by using the microphone output to form auditory perception and the vibrator output to form tactile perception.

[0035] As an example, terminal 400 runs a client (e.g., a network version of a game application) to interact with other users in a virtual scene, connects to a game server (i.e., server 200) to obtain scene data for the virtual scene, and outputs the virtual scene based on the obtained scene data. After outputting the virtual scene, terminal 400 displays scene auxiliary information for the virtual scene and displays an operation widget for the virtual scene, which is used to control the behavior of virtual objects in the virtual scene. The user may trigger a field of view adjustment operation for the virtual scene. In response to the field of view adjustment operation, terminal 400 adjusts the content of the virtual objects in the field of view in the virtual scene, and when adjusting the content, adjusts the visibility of the scene auxiliary information, the visibility of the adjusted scene auxiliary information being lower than the visibility of the operation widget. When the field of view adjustment operation is finished, the visibility of the scene auxiliary information is restored.

[0036] In some embodiments, a terminal or server may implement the virtual scene information display method according to embodiments of the present invention by executing a computer program. For example, the computer program may be a native program or software module within the operating system, or a local application program (APP), i.e., a program that needs to be installed on the operating system. Alternatively, it may be an applet, i.e., a program that can be executed simply by downloading it to a browser environment. Or, it may be a game applet that can be embedded in any application. In short, the above computer program may be any form of application program, module, or plug-in.

[0037] Embodiments of the present invention may be implemented using cloud technology. Cloud technology is a hosting technology that integrates a series of resources such as hardware, software, and networks within a wide area network or local area network to enable data computation, storage, processing, and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the business model application of cloud computing, and can constitute a resource pool that can be used as needed, making it flexible and convenient. Cloud computing technology is an important supporting technology. Backend services of technical network systems require large amounts of computing and storage resources.

[0038] For example, a server (e.g., server 200) may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDNs (Content Delivery Networks), and big data and artificial intelligence platforms. A terminal (e.g., terminal 400) may be, but is not limited to, a smartphone, tablet computer, laptop computer, desktop computer, smart voice interaction device (e.g., smart speaker), smart home appliance (e.g., smart TV), smartwatch, or in-car terminal. The terminal and server may be connected directly or indirectly by wired or wireless communication, but embodiments of the present invention are not limited to these.

[0039] In some embodiments, multiple servers may constitute a blockchain, the servers may be nodes on the blockchain, and information connections may exist between each node in the blockchain, and information may be transmitted between nodes via the above-mentioned information connections. Here, data related to the information display method of a virtual scene according to an embodiment of the present invention (for example, scene data of the virtual scene) may be stored on the blockchain.

[0040] The following describes the configuration of an electronic device that implements the virtual scene information display method according to an embodiment of the present invention. Figure 2 is a schematic diagram of the configuration of an electronic device 500 that implements the virtual scene information display method according to an embodiment of the present invention. As shown in Figure 2, taking the electronic device 500 as an example of the terminal shown in Figure 1, the electronic device 500 that implements the virtual scene information display method according to an embodiment of the present invention includes at least one processor 510, memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is connected via a bus system 540. The bus system 540 is used to realize connection communication between these components. In addition to the data bus, the bus system 540 includes a power bus, a control bus, and a status signal bus. For convenience of explanation, each bus in Figure 2 will be collectively referred to as the bus system 540.

[0041] In some embodiments, the virtual scene information display device according to the embodiment of the present invention may be implemented in software. As shown in Figure 2, the virtual scene information display device 553 stored in memory 550 may be software in the form of a program and plug-ins, and includes a first display module 5531, a second display module 5532, and a third display module 5533. Since these modules are logical, they may be combined or further divided in any way according to the implemented function. The function of each module is described below.

[0042] Figure 3 is a schematic diagram illustrating the principle of a human-computer interaction engine mounted on a virtual scene information display device according to an embodiment of the present invention. As shown in Figure 3, the method for displaying virtual scene information according to an embodiment of the present invention may be implemented by each module in the virtual scene information display device shown in Figure 2 calling the relevant modules, components, or plug-in software of the game engine shown in Figure 3. The following describes, in particular, the modules, components, or plug-in software included in the game engine shown in Figure 3. As shown in Figure 3, the game engine includes the following parts.

[0043] (1) Virtual Camera: A necessary component for the game scene screen, used to display the game scene screen. The game scene corresponds to at least one virtual camera, and may have two or more virtual cameras depending on the actual needs. The virtual camera is used as the rendering window for the game, capturing and displaying the screen contents of the game world for the player. By setting the parameters of the virtual camera, the viewpoint (viewpoint) for the player to observe the game world, such as first-person view or third-person view, can be adjusted.

[0044] (2) Scene Configuration: Used for game scene management such as collision detection and visual elimination. Collision detection may be implemented via collision objects, and depending on the actual needs, collision objects may be implemented by axis-aligned bounding boxes (AABBs) or oriented bounding boxes (OBBs). Visual elimination may be implemented based on a view volume. A view volume is a three-dimensional frame generated by a virtual camera and is used to trim objects outside the camera's visible range. Objects within the view volume are projected onto the view plane, and objects outside the view volume are discarded and not processed.

[0045] (3) Terrain Management: This is a component for managing terrain in game scenes and is used to create and edit game terrain within game scenes, such as mountains, canyons, and caves.

[0046] (4) Editor: An auxiliary tool in game design, including the following:

[0047] Scene Editor: Used to edit the contents of a game scene, such as changing the terrain, customizing vegetation distribution, and lighting layout.

[0048] Model Editor: Used to create and edit in-game models (character models in game scenes).

[0049] Special Effects Editor: Used to edit special effects on the game screen.

[0050] Action Editor: Used to define and edit the actions of characters on the game screen.

[0051] (5) Special Effects Component: Used to create and edit game special effects on the game screen. Implementation may use particle special effects and texture UV animation. Particle special effects combine a large number of single particles to represent a fixed shape, and control the movement of the whole or individual particles with controllers and scripts to simulate real-world effects such as water, fire, fog, and gas. UV animation is a texture animation achieved by dynamically changing the UV coordinates of an image.

[0052] (6) Skeletal animation: This is animation achieved by moving objects using built-in bones, and may be understood as the following two concepts:

[0053] Bone: An abstract concept used to control skin, such as the bones of a human being used to control skin.

[0054] Skinning: An externally visible element controlled by bone, such as human skin, which is affected by bone.

[0055] (7) Morph animation: This is a deformation animation achieved by adjusting the vertices of the base model.

[0056] (8) UI Widgets: These are widgets used to display the game screen.

[0057] (9) Basic algorithms: These are algorithms that need to be called to implement the functions of the game engine, and include, for example, graphics algorithms necessary for scene composition, and matrix and vector transformations necessary for skeletal animation.

[0058] (10) Rendering Components: These are components necessary for displaying game screen effects. Rendering components allow a scene described in 3D vectors to be converted into a scene described in 2D pixels. This includes, for example, model rendering and scene rendering.

[0059] (11) A* search: An algorithm used to find the shortest path when performing path planning, search, and graph traversal in game design.

[0060] For example, user-game interaction can be achieved by calling the UI widget in the game engine shown in Figure 3. A 2D or 3D model is created by calling the Morph animation section of the game engine, and after the model creation is complete, the skeletal animation section applies material mapping to the model according to the different faces. This is equivalent to covering bones with skin. Finally, the render component calculates all effects such as the model, animation, lighting and shadows, and special effects in real time and displays them in the human-computer interaction interface. Specifically, the first display module 5531 renders virtual scene data by calling the rendering component in the game engine shown in Figure 3, outputs the virtual scene, displays scene auxiliary information for the virtual scene, and may also display a virtual scene manipulation widget, which is used to control the behavior of virtual objects in the virtual scene. The second display module 5532 accepts a field of view adjustment operation by calling a UI widget in the game engine shown in Figure 3, and then, in response to the field of view adjustment operation, adjusts the content of the virtual object in the field of view in the virtual scene, and when adjusting the content, it may also adjust the visibility of the scene auxiliary information, and the visibility of the scene auxiliary information after adjustment is lower than the visibility of the operation widget. The third display module 5533 detects whether the field of view adjustment operation has finished by calling a UI widget in the game engine shown in Figure 3, and if the field of view adjustment operation has finished, it may restore the visibility of the scene auxiliary information.

[0061] The following describes a method for displaying information in a virtual scene according to an embodiment of the present invention. In some embodiments, the method for displaying information in a virtual scene according to an embodiment of the present invention may be implemented by a terminal alone, by a server alone, or jointly by a terminal and a server. An example of implementation by a terminal will be described. Figure 4 is a schematic flowchart of the method for displaying information in a virtual scene according to an embodiment of the present invention. As shown in Figure 4, the method for displaying information in a virtual scene according to an embodiment of the present invention includes the following steps.

[0062] Step 101: The terminal displays scene auxiliary information for the virtual scene and displays the virtual scene operation widget.

[0063] Here, the operation widget is used to control the behavior of virtual objects in the virtual scene.

[0064] In practical applications, a terminal may run a client that supports virtual scenes (e.g., a game client). During the execution of the client, the terminal outputs a virtual scene (e.g., a shooting game scene), that is, the terminal displays the interface of the virtual scene, and the interface of the virtual scene may also display scene auxiliary information for the virtual scene, as well as operation widgets for controlling the behavior of virtual objects in the virtual scene.

[0065] In some embodiments, the terminal may display scene auxiliary information for the virtual scene and an operation widget for the virtual scene, as follows: The scene auxiliary information for the virtual scene is displayed using a first display layer of view layers, and the operation widget for the virtual scene is displayed using a second display layer separate from the first display layer. Here, the scene auxiliary information includes at least one of presentation information that presents events or states in the virtual scene, and entry information for auxiliary functions of the virtual scene.

[0066] In practical applications, the scene auxiliary information may include presentation information that indicates events or states in the virtual scene, such as presentation of virtual prop acquisition and presentation of virtual prop usage. The scene auxiliary information may further include entry information for auxiliary functions of the virtual scene, such as a chat panel, task panel, attribute information (e.g., hit points, attack value), and map preview. The operation widget is used to control the behavior of virtual objects in the virtual scene and includes, for example, a jump widget, a move widget, and a shoot widget. In this way, since scene auxiliary information and operation control can be displayed on different display layers, the visibility of the scene auxiliary information can be adjusted in subsequent processing, thereby improving processing efficiency.

[0067] In some embodiments, the terminal may display scene auxiliary information and operation widgets for the virtual scene as follows: display the scene auxiliary information for the virtual scene at a first visibility level, and display the operation widgets at a second visibility level. In actual applications, the first and second visibility levels may be the same, or the first visibility level may be lower than the second visibility level.

[0068] Step 102: In response to the field of view adjustment operation, adjust the content of the virtual object in the field of view in the virtual scene, and adjust the visibility of scene auxiliary information when adjusting the content.

[0069] In this case, the visibility of the adjusted scene aid information is lower than the visibility of the operation widget.

[0070] In some embodiments, the user may perform control operations in the virtual scene, for example, by controlling a virtual object to move, controlling a virtual object to turn, or adjusting the field of view of a virtual camera that captures the virtual scene. In embodiments of the present invention, when a field of view adjustment operation is performed (for example, by adjusting the field of view to find a target in the virtual scene, or by adjusting the field of view to move in another direction), the terminal responds to the field of view adjustment operation by adjusting the field of view from which the virtual camera captures the virtual scene (i.e., from the viewpoint of the virtual object) to adjust the content in the field of view of the virtual object. At the same time, when adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. This allows the user to quickly focus on the operation widget and the virtual scene itself, reduces the complexity of information display, allows the user to browse the virtual scene, allows the user to quickly control the movement of virtual objects based on the operation widget, and improves the efficiency of human-computer interaction.

[0071] In some embodiments, the terminal may accept field-of-view adjustment operations as follows: It accepts a slide operation performed in the virtual scene interface. The slide operation is used to adjust the content in the field of view of a virtual object by sliding the content of the virtual scene displayed in the interface. The slide operation is determined to be a field-of-view adjustment operation.

[0072] In practical applications, the field of view adjustment operation may be implemented by performing a slide operation on the virtual scene interface. This slide operation is used to adjust the content in the field of view of a virtual object by sliding the content of the virtual scene displayed on the interface. When a terminal receives a slide operation performed on the virtual scene interface, it determines that the slide operation is a field of view adjustment operation, that is, it determines that a field of view adjustment operation has been received. An example will be explained with reference to Figure 5. Figure 5 is a schematic diagram of the trigger for a field of view adjustment operation according to an embodiment of the present invention. Here, the field of view adjustment operation is performed by sliding the virtual scene interface, that is, the field of view adjustment operation is performed by performing a slide operation on the virtual scene interface. In this way, since the field of view adjustment operation can be triggered by sliding on the virtual scene interface, the operation is simple, the complexity of the human-computer interaction for triggering the field of view adjustment operation is reduced, and the efficiency of the human-computer interaction can be improved.

[0073] In some embodiments, the terminal may accept field adjustment operations as follows: It displays a turning widget for controlling the orientation of a virtual object. It accepts a turning operation on a virtual object triggered based on the turning widget and determines that the turning operation is a field adjustment operation.

[0074] In practical applications, the field of view adjustment operation may be implemented by a turning operation. Specifically, a turning widget for controlling the orientation of a virtual object may be displayed. For example, a turning widget may be displayed in the interface of a virtual scene, and the user may control the orientation of a virtual object by turning the orientation of the virtual object using the turning widget. When a turning operation on a virtual object triggered based on the virtual object is received, the turning operation is determined to be a field of view adjustment operation, that is, it is determined that a field of view adjustment operation has been received. An example will be explained with reference to Figure 6. Figure 6 is a schematic diagram of a trigger for a field of view adjustment operation according to an embodiment of the present invention. Here, a turning widget, i.e., a turning wheel, is displayed in the interface of the virtual scene. A turning operation on a virtual object may be triggered by the turning widget to implement a field of view adjustment operation. In this way, by providing a turning widget, a corresponding trigger widget can be provided to trigger a field of view adjustment operation, and the triggering of a field of view adjustment operation can be easily implemented, thereby improving the efficiency of human-computer interaction.

[0075] In some embodiments, the operation widget may be displayed with a predetermined transparency. The terminal may adjust the visibility of the scene auxiliary information as follows: The transparency of the scene auxiliary information is adjusted to a target transparency higher than the predetermined transparency in order to adjust the visibility of the scene auxiliary information.

[0076] In actual applications, the operation widget may be displayed with a predetermined transparency. The terminal may adjust the transparency of the scene auxiliary information when adjusting the visibility of the scene auxiliary information. Specifically, the transparency of the scene auxiliary information may be adjusted to a target transparency higher than the predetermined transparency. This target transparency may be completely transparent, that is, the scene auxiliary information may not be displayed at all. In order to display the scene auxiliary information separately from the operation widget, the target transparency may be higher than the predetermined transparency, but not completely transparent, so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. In this way, by adjusting the transparency of the scene auxiliary information, the visibility of the scene auxiliary information can be adjusted, the complexity of information display can be reduced, users can quickly control the behavior of virtual objects based on the operation widget, and the efficiency of human-computer interaction can be improved.

[0077] In some embodiments, the scene auxiliary information has a display state for instructing the terminal to display the scene auxiliary information and a hidden state for instructing the terminal to hide the scene auxiliary information. The terminal may display the scene auxiliary information of the virtual scene as follows: Control the terminal to keep the scene auxiliary information of the virtual scene in the display state. Accordingly, the terminal may adjust the visibility of the scene auxiliary information as follows: Control the terminal to adjust the scene auxiliary information from the display state to the hidden state.

[0078] In practical applications, the scene auxiliary information may have states that include both a visible state and a hidden state. When a terminal displays the scene auxiliary information of a virtual scene, it may control the system to ensure that the scene auxiliary information is in a visible state. When adjusting the visibility of the scene auxiliary information, the terminal may control the system to adjust the scene auxiliary information from a visible state to a hidden state. In this way, by controlling the state of the scene auxiliary information to convert it from a visible state to a hidden state, i.e., by canceling the display of the scene auxiliary information, the complexity of information display can be further reduced, allowing users to quickly control the behavior of virtual objects based on operation widgets and improving the efficiency of human-computer interaction.

[0079] In some embodiments, the scene auxiliary information includes multiple pieces of auxiliary information. The terminal may adjust the visibility of the scene auxiliary information as follows: It obtains scene data of a virtual scene and interaction data of virtual objects, calls a first neural network model based on the scene data and interaction data to predict which piece of auxiliary information to adjust, obtains the prediction result, and adjusts the visibility of the auxiliary information indicated by the prediction result.

[0080] In actual applications, the scene auxiliary information includes multiple pieces of auxiliary information. When adjusting the visibility of the scene auxiliary information, the visibility of some of the multiple pieces of auxiliary information may be adjusted. In some embodiments, the auxiliary information to be adjusted may be predicted by a neural network model; that is, a first neural network model is obtained to predict the auxiliary information to be adjusted, and this first neural network model is trained. Specifically, a first neural network model may be trained using scene data samples of a virtual scene and interaction data samples of virtual objects as training samples, and the adjusted auxiliary information as labels, thereby obtaining a trained first neural network model. Subsequently, when predicting the auxiliary information to be adjusted, scene data of a virtual scene and interaction data of virtual objects are obtained, the first neural network model is invoked based on the scene data and interaction data to predict the auxiliary information to be adjusted among the multiple pieces of auxiliary information, the prediction result is obtained, and the visibility of the auxiliary information indicated by the prediction result is adjusted. In this way, by adjusting the visibility of some of the auxiliary information among multiple pieces of auxiliary information, and by predicting which auxiliary information should be adjusted using a neural network model, the visibility of some auxiliary information can be automatically adjusted for the user based on scene data and interaction data in the user's virtual scene. This improves the utilization of hardware resources and the intelligence of the auxiliary information display, and better meets the user's needs.

[0081] In some embodiments, the scene auxiliary information includes multiple pieces of auxiliary information. The terminal may adjust the visibility of the scene auxiliary information as follows: Determine a similar history virtual scene for a virtual object. The similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold. Obtain usage data for the scene auxiliary information when adjusting the content in the similar history virtual scene. Based on the usage data, determine the target auxiliary information to be adjusted from the multiple pieces of auxiliary information and adjust the visibility of the target auxiliary information.

[0082] In actual applications, the scene auxiliary information includes multiple pieces of auxiliary information. When adjusting the visibility of the scene auxiliary information, the visibility of some of the multiple pieces of auxiliary information may be adjusted. In some embodiments, the target auxiliary information to be adjusted may be determined by taking statistics of historical data. Specifically, first, a similar historical virtual scene for the virtual scene of a virtual object is determined. The similarity between the similar historical virtual scene and the virtual scene is greater than the similarity threshold. Next, when adjusting the content in the similar historical virtual scene, usage data for the scene auxiliary information (i.e., historical usage data, which may belong to the current user or to multiple selected target users) is obtained. This usage data may include the frequency of use and viewing of each piece of auxiliary information. Next, based on the usage data, the target auxiliary information to be adjusted is determined from the multiple pieces of auxiliary information, for example, the auxiliary information whose usage frequency is lower than the frequency threshold is set as the target auxiliary information. Next, the visibility of the target auxiliary information is adjusted. In this way, it is possible to adjust the visibility of some of the auxiliary information among multiple pieces of auxiliary information, and the visibility of some of the auxiliary information can be automatically adjusted for the user based on usage data in similar historical virtual scenes, improving hardware resource utilization and the intelligence of auxiliary information display, and better meeting user needs.

[0083] In actual applications, there may be multiple operation widgets. When adjusting the visibility of scene auxiliary information, the terminal may adjust the visibility of some of the operation widgets among the multiple operation widgets. In some embodiments, there may be multiple operation widgets. The terminal may adjust the visibility of some of the operation widgets among the multiple operation widgets as follows: Obtain interaction data for virtual objects and scene data for virtual scenes. Based on the interaction data and scene data, call a second neural network model to predict which operation widget to use among the multiple operation widgets and obtain the prediction result. If the operation widget to be used indicated by the prediction result is the first operation widget, adjust the visibility of the second operation widget. The visibility of the second operation widget after adjustment is lower than the visibility of the first operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0084] In actual applications, the operation widget to be used may be predicted by a neural network model; that is, a second neural network model is obtained to predict the operation widget to be used, and this second neural network model is pre-trained. Specifically, the second neural network model is trained using scene data samples from a virtual scene and interaction data samples from virtual objects as training samples, and the corresponding operation widgets used as labels, thereby obtaining a pre-trained second neural network model. Then, when predicting the operation widget to be used, the scene data from the virtual scene and interaction data from virtual objects are obtained, and based on the scene data and interaction data, the second neural network model is invoked to predict the operation widget to be used from among multiple operation widgets, and the prediction result is obtained. If the operation widget to be used indicated by the prediction result is the first operation widget, the visibility of the second operation widget is adjusted so that its visibility is lower than that of the first operation widget. The second operation widget is an operation widget other than the first operation widget among multiple operation widgets. In this way, by adjusting the visibility of some of the multiple operation widgets, the complexity of information display is reduced, allowing users to quickly control the behavior of virtual objects based on the necessary operation widgets, thereby improving the efficiency of human-computer interaction. Furthermore, the neural network model automatically determines which operation widgets need to have their visibility adjusted for the user based on scene data and interaction data in the user's virtual scene, improving hardware resource utilization and the intelligence of information display, and further meeting user needs.

[0085] In some embodiments, there are multiple operation widgets. The terminal may adjust the visibility of some of the operation widgets among the multiple operation widgets as follows: Determine a similar history virtual scene for the virtual object. The similarity between the similar history virtual scene and the virtual scene is greater than the similarity threshold. Determine a first operation widget whose usage frequency when adjusting the content in the similar history virtual scene is lower than the frequency threshold. Adjust the visibility of the first operation widget. The visibility of the first operation widget after adjustment is lower than the visibility of the second operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0086] In practical applications, the target operation widgets to be adjusted may be determined by statistically analyzing historical data. Specifically, first, a similar history virtual scene for the virtual object is determined. The similarity between this similar history virtual scene and the virtual scene is greater than a similarity threshold. Next, a first operation widget is determined in the similar history virtual scene whose usage frequency is lower than a frequency threshold when adjusting its content. Then, the visibility of the first operation widget is adjusted so that its visibility is lower than that of the second operation widget. The second operation widget is an operation widget other than the first operation widget among multiple operation widgets. In this way, it is possible to adjust the visibility of some operation widgets among multiple operation widgets, further reducing the complexity of information display, allowing users to quickly control the behavior of virtual objects based on the necessary operation widgets, and improving the efficiency of human-computer interaction. Furthermore, based on the user's frequency of use of operation widgets in similar history virtual scenes, the operation widgets that need to have their visibility adjusted for the user can be automatically determined, improving hardware resource utilization and the intelligence of information display, and better meeting user needs.

[0087] In some embodiments, the terminal may display an information intelligent display switch for the virtual scene and, in response to an ON command for the information intelligent display switch, control the virtual scene's information display mode to the information intelligent display mode. Accordingly, when adjusting the content, the terminal may adjust the visibility of the scene auxiliary information as follows: When the virtual scene's information display mode is the information intelligent display mode, the visibility of the scene auxiliary information is adjusted when adjusting the content.

[0088] In practical applications, an information intelligent display switch for the virtual scene may be further configured. If it is necessary to control the information intelligent display mode of the virtual scene to be in information intelligent display mode, the information intelligent display switch is controlled to the ON state. Specifically, the terminal may display the information intelligent display switch for the virtual scene, and upon receiving an ON command for the information intelligent display switch, it may control the information display mode of the virtual scene to information intelligent display mode. In this case, the visibility of the scene auxiliary information is adjusted when adjusting the content. By providing an information intelligent display switch in this way, the user can turn the information intelligent display mode on or off as needed, providing the user with more choices and thus improving the user's experience of the virtual scene.

[0089] In some embodiments, the scene auxiliary information includes multiple pieces of auxiliary information. The terminal displays a selection widget for each piece of auxiliary information and, in response to a selection operation for target auxiliary information triggered based on the selection widget, determines that the target auxiliary information is the scene auxiliary information to be displayed when adjusting the content. Accordingly, the terminal may adjust the visibility of the scene auxiliary information as follows: Adjust the visibility of auxiliary information other than the target auxiliary information among the multiple pieces of auxiliary information.

[0090] In practical applications, when adjusting the content, a function to customize the auxiliary information to be displayed may be provided. That is, the terminal displays a selection widget for each piece of auxiliary information, selects the target auxiliary information based on the selection widget, and then determines that the target auxiliary information will be displayed as scene auxiliary information during content adjustment. In this way, when adjusting the visibility of scene auxiliary information, the terminal adjusts the visibility of auxiliary information other than the target auxiliary information among multiple pieces of auxiliary information, and by providing a selection widget for each piece of auxiliary information, the user can set the target auxiliary information whose visibility needs to be adjusted, giving the user more control over the information display and thus improving the user's experience of the virtual scene.

[0091] In some embodiments, the terminal may adjust the visibility of the scene auxiliary information, then display a display function item for the scene auxiliary information, and restore the visibility of the scene auxiliary information when a trigger operation is received on the display function item. An example will be explained with reference to Figure 7. Figure 7 is a schematic diagram of the interface of a virtual scene according to an embodiment of the present invention. Here, in the process of adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. That is, as shown in Figure 7(1), in the virtual scene interface, the display of the scene auxiliary information is canceled and only the operation widget is displayed, and the display function item "Display" for the scene auxiliary information is displayed. As shown in Figure 7(2), in response to a trigger operation on the display function item "Display", the visibility of the scene auxiliary information is restored, that is, the scene auxiliary information is displayed. In this way, the display function item for the scene auxiliary information allows the visibility of the scene auxiliary information to be restored as needed at any time, improving the user's control over the display of information in the virtual scene and improving the user's experience of the virtual scene.

[0092] Step 103: Once the field of view adjustment operation is complete, restore the visibility of the scene auxiliary information.

[0093] In some embodiments, scene auxiliary information includes both presented and unpresented auxiliary information. The terminal may display the scene auxiliary information of the virtual scene as follows: Display both presented and unpresented auxiliary information. Accordingly, the terminal may restore the visibility of the scene auxiliary information as follows: Restore the visibility of the unpresented auxiliary information.

[0094] In practical applications, the presentation type of auxiliary information may have a time limit. Therefore, when restoring the visibility of scene auxiliary information, the presentation of the scene auxiliary information before adjusting its visibility may be stopped, that is, only the visibility of the non-presentation type of auxiliary information may be restored, and the display of the presentation type of auxiliary information may be canceled. Here, the presentation type of auxiliary information is presentation information for presenting events or states in a virtual scene, and the non-presentation type of auxiliary information is entry information for auxiliary functions of the virtual scene. In this way, the visibility of scene auxiliary information can be restored according to the type of scene auxiliary information, so when restoring the visibility of scene auxiliary information, the restoration of the visibility of scene auxiliary information can be performed rationally and efficiently.

[0095] An example will be explained with reference to Figure 8. Figure 8 is a schematic flowchart of a virtual scene information display method according to an embodiment of the present invention. Here, as shown in Figure 8(1), the virtual scene interface displays scene auxiliary information and operation widgets for the virtual scene. As shown in Figure 8(2), a slide operation performed on the virtual scene interface is received, and in response to the slide operation, the content of the virtual object in the field of view is adjusted in the virtual scene. During the content adjustment process, the visibility of the scene auxiliary information is adjusted so that its visibility is lower than the visibility of the operation widget, that is, the display of the scene auxiliary information is canceled and only the operation widget is displayed. As shown in Figure 8(3), in response to the end of the field of view adjustment operation, the visibility of the scene auxiliary information is restored, that is, the scene auxiliary information is displayed again.

[0096] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of virtual objects in the virtual scene are displayed. When a field of view adjustment operation is received, the content of the virtual object in the field of view of the virtual scene is adjusted. When adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. When the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when performing control operations in a virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be made to focus on the operation widget and the virtual scene itself, and the user can quickly control the operation of virtual objects based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources.

[0097] The following describes an exemplary application of an embodiment of the present invention in a real-world application scenario, using as an example a virtual scene being a game scene, where a slide operation (i.e., a swipe operation performed on the device's display) triggers a field of view adjustment operation (adjusting the field of view of virtual objects to find the game's target). In a game scenario (e.g., an MMORPG + FPS type game), the game's main interface contains a large amount of HUD information, including various function entries, widgets, and prompts. On the other hand, game operations often require a high degree of precision from the player. For example, shooting in a game requires the player to quickly focus on the target. A large amount of HUD information can interfere with the player's ability to focus on the target.

[0098] In contrast, an embodiment of the present invention provides a method for displaying information in a virtual scene. In this method, the HUD information of the virtual scene (including the above-mentioned scene auxiliary information and operation widgets) is displayed on a basic operation layer (used to display operation widgets) and an information display layer (used to display scene auxiliary information), respectively. When searching for a game objective by sliding, the visibility of the scene auxiliary information is adjusted by reducing the opacity of the user interface (UI) of the information display layer, thereby reducing information interference in the HUD and allowing the player to quickly focus on the game objective in a concise HUD. Furthermore, by leaving the UI of the basic operation layer intact, the need for the player to quickly control the operation of virtual objects (e.g., shooting) can be met. After the sliding operation is completed, the display of the UI of the information display layer is restored. In this way, hierarchical processing of HUD information makes it possible to reduce interference of display-type UI information when sliding while leaving the basic operation widget intact, allowing the player to quickly concentrate on the game objective.

[0099] Next, with reference to Figure 9, the method for displaying information in a virtual scene according to an embodiment of the present invention will be described in detail. Figure 9 is a schematic diagram of the hierarchical display of information according to an embodiment of the present invention. Here, the HUD information of the virtual scene is processed hierarchically and classified into three layers: the "presentation information layer," the "information display layer," and the "basic operation layer." Here, (1) the "presentation information layer" and the "information display layer" are used to display scene auxiliary information of the virtual scene. Specifically, the "presentation information layer" displays the presentation type of scene auxiliary information (e.g., presentation of virtual item acquisition), and the "information display layer" displays the non-presentation type of scene auxiliary information (e.g., hit point information of virtual objects, task panel, chat panel, etc.). (2) The "basic operation layer" is used to display operation widgets of the virtual scene, such as the sight, movement joystick, skill button, jump button, etc.

[0100] As shown in Figure 8, (1) Before the slide operation, all HUD information is displayed on the virtual scene interface. (2) During the slide operation, the opacity of the UI of the "Presentation Information Layer" and "Information Display Layer" is reduced (in the implementation, specific opacity values ​​may be set) to adjust the visibility for displaying scene auxiliary information among the HUD information, thereby making the visibility of the scene auxiliary information lower than the visibility of the operation widget, while leaving the UI of the "Basic Operation Layer" visible to allow the player to operate and respond quickly. (3) After the slide operation is completed, the display of the UI of the "Information Display Layer" (i.e., the non-presentation type auxiliary information among the scene auxiliary information) is restored, returning to the initial state before the slide operation.

[0101] Next, with reference to Figure 10, a method for displaying information in a virtual scene according to an embodiment of the present invention will be described. Figure 10 is a schematic flowchart of the method for displaying information in a virtual scene according to an embodiment of the present invention. The method for displaying information in a virtual scene according to an embodiment of the present invention includes the following steps.

[0102] Step 201: Start processing.

[0103] Step 202: Trigger the slide operation.

[0104] Step 203: Regarding the presented information layer, in step 2031, the opacity of the UI is reduced, in step 2032, the slide operation is ended, and in step 2033, the presentation is interrupted and terminated.

[0105] Step 204: Regarding the information display layer, in step 2041, the UI opacity is reduced, in step 2042, the slide operation is terminated, and in step 2043, the UI opacity is restored.

[0106] Step 205: Regarding the basic operation layer, maintain the UI opacity as it was in Step 2051.

[0107] Step 206: Terminate the process.

[0108] In actual implementation, (1) HUD information is divided into three layers: the "presentation information layer," the "information display layer," and the "basic operation layer." Here, the "presentation information layer" refers to the pop-up prompts and is located at the top of the interface; the "basic operation layer" refers to the information necessary for player control and is located at the bottom of the interface; and the remaining UI information is in the "information display layer," which is located between the "presentation information layer" and the "basic operation layer."

[0109] (1) The flow of hierarchical structuring of HUD information is shown in Figure 11. Figure 11 is a flowchart of the hierarchical structuring of information in a virtual scene according to an embodiment of the present invention. The process includes the following steps: In step 301, components of HUD information are generated. In step 302, a component tree is constructed by linking the corresponding components to the corresponding parent nodes according to predetermined attribute values ​​of the components. In step 303, it is determined whether or not it is a component of the presentation information layer, and if so, step 304 is executed; otherwise, step 305 is executed. In step 304, it is linked as a child node of the presentation information layer. In step 305, it is determined whether or not it is a component of the information display layer, and if so, step 306 is executed, and in step 306, it is linked as a child node of the information display layer.

[0110] (2) The above slide operation rotates the virtual camera of the virtual scene to adjust the content within the field of view of the virtual object. When the slide operation is performed, no processing is done to the UI information of the "basic operation layer," and there is no need to reduce the opacity of the UI. For the UI information of the "presentation information layer" and the "information display layer," the opacity of the UI is reduced to adjust the visibility of the scene auxiliary information among the HUD information (a specific numerical value may be set).

[0111] (3) When the slide operation is finished, if the UI information belongs to the "presentation information layer", the presentation is interrupted and terminated. If the UI information belongs to the "information display layer", the opacity of the UI is restored to the opacity of the UI before the slide operation.

[0112] (2) The flow of the slide operation is shown in Figure 12. Figure 12 is a schematic flowchart of the slide operation according to an embodiment of the present invention. The process includes the following steps: Step 401 detects a user touch event on the display. Step 402 reads whether the touch coordinates occurred in the right half of the screen, and if so, executes step 403. Step 403 determines whether a slide operation is in progress, and if so, executes step 404. Step 404 reduces the opacity of the presentation information layer and the information display layer. Step 405 determines whether the slide operation has ended and the touch has been released, and if so, executes step 406. Step 406 deletes the components of the presentation information layer and restores the opacity of the components of the information display layer. That is, the opacity of the components of the information display layer is restored to the opacity before the slide operation.

[0113] In (2) and (3), the flow of opacity adjustment is shown in Figure 13. Figure 13 is a schematic flowchart of opacity adjustment according to an embodiment of the present invention. The process includes the following steps: In step 601, a user touch slide event on the display is detected. In step 602, event response function A is executed. In step 603, the component trees are scanned from the parent nodes of the presentation information layer and the information display layer, respectively, and the opacity setting operation is called to set the opacity of the corresponding component to N. In step 604, it is detected whether the slide event has been released, and if so, step 605 is executed. In step 605, event response function B is executed. In step 606, the component tree is scanned from the parent node of the presentation information layer, and a delete operation is performed on the component of the presentation information layer. In step 607, the component tree is scanned from the parent node of the information display layer, and the opacity setting operation is called to restore the opacity to M.

[0114] This will be explained with reference to Figures 14A to 14C. Here, Figure 14A is a schematic diagram of the display of the presentation information layer according to an embodiment of the present invention. Here, before the slide operation, the presentation type scene auxiliary information is displayed on the presentation information layer, during the slide operation, the presentation type scene auxiliary information is not displayed on the presentation information layer, and after the slide operation is completed, the presentation type scene auxiliary information is deleted, that is, the presentation type scene auxiliary information is not displayed on the presentation information layer.

[0115] Figure 14B is a schematic diagram of the display of the information display layer according to an embodiment of the present invention. Here, non-display type scene auxiliary information is displayed on the information display layer before the slide operation, non-display type scene auxiliary information is not displayed on the information display layer during the slide operation, and non-display type scene auxiliary information is displayed on the information display layer after the slide operation is completed.

[0116] Figure 14C is a schematic diagram of the display of the basic operation layer according to an embodiment of the present invention. Here, the operation widgets are displayed on the basic operation layer before, during, and after the slide operation.

[0117] According to the above embodiment of the present invention, interference from complex HUD information to the operation of the virtual scene can be reduced, allowing the player to be presented with concise HUD information and focus on the game's objective. Furthermore, the player can automatically interrupt the interference of pop-up information by sliding, achieving the goal of quickly clearing the screen.

[0118] Furthermore, in the embodiments of the present invention, with regard to related data such as user information, when applying the embodiments of the present invention to a specific product or technology, it is necessary to obtain the user's permission or consent, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0119] The following describes exemplary configurations in which the virtual scene information display device 553 according to embodiments of the present invention is implemented as a software module. In some embodiments, as shown in Figure 2, the software module in the virtual scene information display device 553 stored in memory 550 may include the following modules: A first display module 5531 displays scene auxiliary information of the virtual scene and displays an operation widget for the virtual scene. This operation widget is used to control the operation of virtual objects in the virtual scene. A second display module 5532 adjusts the content of the virtual object in the field of view in the virtual scene in response to a field of view adjustment operation, and adjusts the visibility of the scene auxiliary information when adjusting the content. Here, the visibility of the adjusted scene auxiliary information is lower than the visibility of the operation widget. A third display module 5533 restores the visibility of the scene auxiliary information when the field of view adjustment operation is completed.

[0120] In some embodiments, the second display module 5532 receives a slide operation performed in the virtual scene interface, which is used to adjust the content in the field of view of a virtual object by sliding the content of the virtual scene displayed in the interface, and determines the slide operation to be a field of view adjustment operation.

[0121] In some embodiments, the second display module 5532 displays a turning widget for controlling the orientation of a virtual object, accepts turning operations on the virtual object triggered based on the turning widget, and determines the turning operation as a field adjustment operation.

[0122] In some embodiments, the first display module 5531 uses a first display layer of view layers to display scene auxiliary information for the virtual scene, and uses a second display layer separate from the first display layer to display operation widgets for the virtual scene. Here, the scene auxiliary information includes at least one of presentation information that presents events or states in the virtual scene, and entry information for auxiliary functions of the virtual scene.

[0123] In some embodiments, the first display module 5531 displays the operation widget of the virtual scene with a predetermined transparency. The second display module 5532 adjusts the transparency of the scene auxiliary information to a target transparency higher than the predetermined transparency.

[0124] In some embodiments, the scene auxiliary information includes presentable auxiliary information and non-presentable auxiliary information. The first display module 5531 displays the presentable auxiliary information and the non-presentable auxiliary information. The second display module 5532 restores the visibility of the non-presentable auxiliary information.

[0125] In some embodiments, the scene auxiliary information includes multiple pieces of auxiliary information. The second display module 5532 acquires scene data of a virtual scene and interaction data of virtual objects, and based on the scene data and interaction data, calls a first neural network model to predict which of the multiple pieces of auxiliary information should be adjusted, obtains the prediction result, and adjusts the visibility of the auxiliary information indicated by the prediction result.

[0126] In some embodiments, the scene auxiliary information includes multiple pieces of auxiliary information. The second display module 5532 determines a similar history virtual scene for a virtual object, and if the similarity between the similar history virtual scene and the virtual scene is greater than the similarity threshold, it obtains usage data for the scene auxiliary information when adjusting the content in the similar history virtual scene, determines the target auxiliary information to be adjusted from the multiple pieces of auxiliary information based on the usage data, and adjusts the visibility of the target auxiliary information.

[0127] In some embodiments, there are multiple operation widgets. The second display module 5532 acquires interaction data for virtual objects and scene data for virtual scenes, and based on the interaction data and scene data, it calls a second neural network model to predict which operation widget to use from among the multiple operation widgets, obtains the prediction result, and if the operation widget to be used indicated by the prediction result is the first operation widget, it adjusts the visibility of the second operation widget, and the visibility of the adjusted second operation widget is lower than the visibility of the first operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0128] In some embodiments, there are multiple operation widgets. The second display module 5532 determines a similar history virtual scene for a virtual object, and if the similarity between the similar history virtual scene and the virtual scene is greater than the similarity threshold, it determines a first operation widget whose usage frequency when adjusting the content in the similar history virtual scene is lower than the frequency threshold, adjusts the visibility of the first operation widget, and the visibility of the adjusted first operation widget is lower than the visibility of the second operation widget. Here, the second operation widget is an operation widget other than the first operation widget among multiple operation widgets.

[0129] In some embodiments, the first display module 5531 displays an information intelligent display switch for the virtual scene and controls the information display mode of the virtual scene to the information intelligent display mode in response to an ON command for the information intelligent display switch. Accordingly, the second display module 5532 adjusts the visibility of the scene auxiliary information when adjusting the content, if the information display mode of the virtual scene is the information intelligent display mode.

[0130] In some embodiments, the second display module 5532 displays display function items for scene auxiliary information and, upon receiving a trigger operation on the display function item, restores the visibility of the scene auxiliary information.

[0131] In some embodiments, scene auxiliary information includes multiple pieces of auxiliary information. The first display module 5531 displays a selection widget for each piece of auxiliary information and, in response to a selection operation on target auxiliary information triggered based on the selection widget, determines that the target auxiliary information is the scene auxiliary information to be displayed when adjusting its content. Accordingly, the second display module 5532 adjusts the visibility of the auxiliary information other than the target auxiliary information among the multiple pieces of auxiliary information.

[0132] In some embodiments, scene auxiliary information has a display state for instructing to display the scene auxiliary information and a hidden state for instructing to hide the scene auxiliary information. The first display module 5531 controls the scene auxiliary information of the virtual scene to be in the display state. Accordingly, the second display module 5532 controls the scene auxiliary information to be adjusted from the display state to the hidden state.

[0133] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of virtual objects in the virtual scene are displayed. When a field of view adjustment operation is received, the content of the virtual object in the field of view of the virtual scene is adjusted. When adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. When the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when performing control operations in a virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be made to focus on the operation widget and the virtual scene itself, and the user can quickly control the operation of virtual objects based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources.

[0134] Embodiments of the present invention further provide a computer program or computer program product that includes a computer-executable instruction or computer program. The computer-executable instruction or computer program is stored in a computer-readable storage medium. The processor of an electronic device reads the computer-executable instruction or computer program from the computer-readable storage medium, and the processor executes the computer-executable instruction or computer program to cause the electronic device to perform the virtual scene information display method according to the embodiment of the present invention.

[0135] Embodiments of the present invention further provide a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are executed by a processor, they perform the virtual scene information display method according to embodiments of the present invention.

[0136] In some embodiments, the computer-readable storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, surface-mount memory, optical disk, or CD-ROM, or it may be various devices containing one or any combination of the above-mentioned memories.

[0137] In some embodiments, computer-executable instructions may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages) in the form of programs, software, software modules, scripts, or code, and may be implemented in any form, for example, as a standalone program, or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0138] For example, executable instructions may correspond to files in the file system, or they may be stored as part of a file that holds other programs or data. For instance, they may be stored in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program being mentioned, or in multiple collaborative files (e.g., files for storing one or more modules, subprograms, or code sections).

[0139] For example, a computer-executable instruction may be implemented and executed on a single electronic device, or on multiple electronic devices located in one place, or on multiple electronic devices distributed in multiple locations and interconnected via a communication network.

[0140] The foregoing merely describes exemplary embodiments of the present invention and does not limit it. Modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention are included within the scope of protection of the present invention.

Claims

1. A method for displaying information about a virtual scene, which is performed by an electronic device, The steps include displaying scene auxiliary information for the virtual scene and displaying an operation widget for the virtual scene, wherein the operation widget is used to control the behavior of virtual objects in the virtual scene; When a field of view adjustment operation is initiated, the following steps are taken: adjusting the content of the virtual object in the field of view of the virtual scene, and adjusting the visibility of the scene auxiliary information when adjusting the content, wherein the visibility of the scene auxiliary information after adjustment is lower than the visibility of the operation widget; The step of restoring the visibility of the scene auxiliary information after the field of view adjustment operation has been completed includes: A method for performing the field of view adjustment operation, comprising at least one of a slide operation performed in the interface of the virtual scene and a turn operation on the virtual object triggered based on a turn widget for controlling the orientation of the virtual object.

2. A step of receiving the slide operation, wherein the slide operation is used to adjust the content in the field of view of the virtual object by sliding the content of the virtual scene displayed in the interface, The method according to claim 1, further comprising the step of determining the slide operation as the field of view adjustment operation.

3. The steps include displaying the aforementioned conversion widget, The method according to claim 1, further comprising the steps of receiving a turning operation on the virtual object triggered based on the turning widget, and determining the turning operation as the field of view adjustment operation.

4. The steps of displaying scene auxiliary information for the virtual scene and displaying the operation widget for the virtual scene are: The steps include: displaying scene auxiliary information of the virtual scene using a first display layer among the view layers; and displaying operation widgets of the virtual scene using a second display layer separate from the first display layer; The method according to claim 1, wherein the scene auxiliary information includes at least one of presentation information that presents an event or state in the virtual scene, and entry information for an auxiliary function of the virtual scene.

5. The step of displaying the operation widget for the virtual scene is: The step includes displaying the operation widget of the virtual scene with a predetermined transparency, The step of adjusting the visibility of the aforementioned scene auxiliary information is: The method according to claim 1, further comprising the step of adjusting the transparency of the scene auxiliary information to a target transparency higher than the predetermined transparency.

6. The aforementioned scene support information includes presentable support information and non-presentable support information. The step of displaying scene auxiliary information for the virtual scene is: The step includes displaying the aforementioned type of auxiliary information and the aforementioned type of auxiliary information that is not displayed, The step of restoring the visibility of the aforementioned scene auxiliary information is: The method according to claim 1, comprising the step of restoring the visibility of the non-presented type of auxiliary information.

7. The aforementioned scene support information includes multiple pieces of support information, The step of adjusting the visibility of the aforementioned scene auxiliary information is: The steps include obtaining scene data of the virtual scene and interaction data of the virtual objects, The steps include calling a first neural network model based on the scene data and interaction data, predicting the auxiliary information to be adjusted among the plurality of auxiliary information, and obtaining the prediction result, The method according to claim 1, comprising the step of adjusting the visibility of auxiliary information indicated by the prediction result.

8. The aforementioned scene support information includes multiple pieces of support information, The step of adjusting the visibility of the aforementioned scene auxiliary information is: A step of determining a similar history virtual scene for the virtual object, wherein the similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold. The steps include: acquiring usage data for the scene auxiliary information when adjusting the content in the aforementioned similar history virtual scene; The method according to claim 1, comprising the steps of determining target auxiliary information to be adjusted from the plurality of auxiliary information based on the usage data, and adjusting the visibility of the target auxiliary information.

9. The number of the aforementioned operation widgets is multiple, After adjusting the visibility of the aforementioned scene auxiliary information, The steps include acquiring interaction data of the virtual object and scene data of the virtual scene, The steps include calling a second neural network model based on the interaction data and scene data, predicting which of the multiple operation widgets should be used, and obtaining the prediction result, If the operation widget to be used indicated by the prediction result is a first operation widget, the method further includes the step of adjusting the visibility of a second operation widget, wherein the adjusted visibility of the second operation widget is lower than the visibility of the first operation widget. The method according to claim 1, wherein the second operation widget is an operation widget other than the first operation widget among a plurality of operation widgets.

10. The number of the aforementioned operation widgets is multiple, After adjusting the visibility of the aforementioned scene auxiliary information, A step of determining a similar history virtual scene for the virtual object, wherein the similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold. The steps include determining a first operation widget whose usage frequency is lower than a frequency threshold when adjusting the content in the aforementioned similar history virtual scene, The process further includes the step of adjusting the visibility of the first operation widget, wherein the adjusted visibility of the first operation widget is lower than the visibility of the second operation widget. The method according to claim 1, wherein the second operation widget is an operation widget other than the first operation widget among a plurality of operation widgets.

11. The steps include: displaying the information intelligent display switch for the virtual scene; The method further includes the step of controlling the information display mode of the virtual scene to the information intelligent display mode in response to an ON command for the information intelligent display switch, When adjusting the above content, the step of adjusting the visibility of the scene auxiliary information is: The method according to claim 1, wherein, when the information display mode of the virtual scene is the information intelligent display mode, the method includes the step of adjusting the visibility of the scene auxiliary information when adjusting the content.

12. After adjusting the visibility of the aforementioned scene auxiliary information, The steps include: displaying the display function items for the aforementioned scene auxiliary information, The method according to claim 1, further comprising the step of restoring the visibility of the scene auxiliary information when a trigger operation is received for the display function item.

13. The aforementioned scene support information includes multiple pieces of support information, The steps include: displaying a selection widget for each of the aforementioned auxiliary information; The method further includes the step of determining the target information to be used as scene information to be displayed when adjusting the content, in response to a selection operation on the target information triggered based on the selection widget, The step of adjusting the visibility of the aforementioned scene auxiliary information is: The method according to claim 1, further comprising the step of adjusting the visibility of auxiliary information other than the target auxiliary information among the plurality of auxiliary information.

14. The scene auxiliary information has a display state for instructing to display the scene auxiliary information and a hidden state for instructing to hide the scene auxiliary information. The step of displaying scene auxiliary information for the virtual scene is: The step includes controlling the scene auxiliary information of the virtual scene so that it is in the display state, The step of adjusting the visibility of the aforementioned scene auxiliary information is: The method according to claim 1, comprising the step of controlling the scene auxiliary information to adjust it from the displayed state to the hidden state.

15. A virtual scene information display device, A first display module that displays scene auxiliary information of the virtual scene and displays an operation widget for the virtual scene, wherein the operation widget is used to control the operation of virtual objects in the virtual scene, and the first display module When a field of view adjustment operation is initiated, a second display module adjusts the content of the virtual object in the field of view in the virtual scene, and adjusts the visibility of the scene auxiliary information when adjusting the content, wherein the visibility of the adjusted scene auxiliary information is lower than the visibility of the operation widget, and The display module includes, when the field of view adjustment operation is completed, a third display module that restores the visibility of the scene auxiliary information, The apparatus wherein the field of view adjustment operation includes at least one of a slide operation performed in the interface of the virtual scene and a turn operation on the virtual object triggered based on a turn widget for controlling the orientation of the virtual object.

16. Memory containing executable computer instructions, An electronic device comprising: a processor that implements the virtual scene information display method described in any one of claims 1 to 14 when executing a computer-executable instruction stored in the memory.

17. A computer program comprising a computer-executable instruction, wherein the computer-executable instruction, when executed by a processor, realizes the method for displaying information of a virtual scene as described in any one of claims 1 to 14.

Images