Method, device, electronic device, and computer program for displaying virtual scene information

By adjusting scene auxiliary information visibility relative to operation widgets during field of view changes, the method simplifies virtual scene displays, improving interaction efficiency and resource utilization.

JP2024544638AActive Publication Date: 2024-12-03TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024532398
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-07-14
Filing Date
2023-05-04
Publication Date
2024-12-03
Estimated Expiration
2043-05-04

AI Technical Summary

Technical Problem

Existing virtual scene display technologies face challenges in efficiently managing complex information displays, leading to reduced human-computer interaction efficiency due to the overwhelming presence of scene auxiliary information and operation widgets.

Method used

A method and apparatus that adjust the visibility of scene auxiliary information in response to field of view adjustments, ensuring it remains lower than that of operation widgets, thereby simplifying the display and enhancing interaction efficiency.

Benefits of technology

This approach reduces information display complexity and improves the utilization rate of display resources, allowing users to focus on operation widgets and virtual scenes, thereby enhancing human-computer interaction efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024544638000001_ABST
    Figure 2024544638000001_ABST
Patent Text Reader

Abstract

Provided is a method, device, electronic device, computer-readable storage medium and computer program product for displaying information of a virtual scene, the method including the steps of: displaying scene auxiliary information and an operation widget of the virtual scene in an interface of the virtual scene, the operation widget being used to control an operation of a virtual object in the virtual scene; adjusting a content in a field of view of the virtual object in the virtual scene in response to a field of view adjustment operation, and adjusting a visibility of the scene auxiliary information when adjusting the content, the visibility of the scene auxiliary information after the adjustment being lower than the visibility of the operation widget; and restoring the visibility of the scene auxiliary information when the field of view adjustment operation is terminated.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] This application claims priority based on a Chinese patent application with application number 2022108345226, filed on July 14, 2022, the entire contents of which are incorporated herein by reference.

[0002] The present invention relates to virtualization and human-computer interaction technologies, and in particular to a method, an apparatus, an electronic device, a computer-readable storage medium and a computer program product for displaying information in a virtual scene. [Background technology]

[0003] Display technology based on graphics processing hardware expands the means for sensing the environment and obtaining information. In particular, the multimedia technology of virtual scenes can utilize human-computer interaction engine technology to realize various interactions between virtual objects by users or artificial intelligence according to actual application needs, and has various typical application scenarios. For example, in a game scenario, the actual interaction process between virtual objects can be simulated.

[0004] In the related technology, the interface of a virtual scene displays a large amount of complex information, such as various function entries, widgets (also called controls), and prompts, which affects the user's viewing and operation in the virtual scene and reduces the efficiency of human-computer interaction. Summary of the Invention

[0005] Embodiments of the present invention provide a method, apparatus, electronic device, computer-readable storage medium and computer program product for displaying information of a virtual scene, which can reduce the complexity of information display and improve the utilization of display resources and the efficiency of human-computer interaction.

[0006] The technical solutions of the embodiments of the present invention are as follows:

[0007] In an embodiment of the present invention, a method for displaying information of a virtual scene, executed by an electronic device, is provided, the method including the steps of: displaying scene auxiliary information of the virtual scene and displaying an operation widget of the virtual scene, the operation widget being used to control an operation of a virtual object in the virtual scene; adjusting content in a field of view of the virtual object in the virtual scene in response to a field of view adjustment operation, and adjusting visibility of the scene auxiliary information when adjusting the content, the visibility of the scene auxiliary information after the adjustment being lower than the visibility of the operation widget; and restoring the visibility of the scene auxiliary information when the field of view adjustment operation is terminated.

[0008] In an embodiment of the present invention, an information display device for a virtual scene is provided, the device including: a first display module that displays scene auxiliary information of the virtual scene and displays an operation widget for the virtual scene, the operation widget being used to control an action of a virtual object in the virtual scene; a second display module that adjusts content in a field of view of the virtual object in the virtual scene in response to a field of view adjustment operation and adjusts visibility of the scene auxiliary information when adjusting the content, the visibility of the scene auxiliary information after the adjustment being lower than the visibility of the operation widget; and a third display module that restores visibility of the scene auxiliary information when the field of view adjustment operation is terminated.

[0009] In an embodiment of the present invention, an electronic device is provided that includes a memory having computer-executable instructions stored therein, and a processor that, when executing the computer-executable instructions stored in the memory, realizes a method for displaying information about a virtual scene according to an embodiment of the present invention.

[0010] In an embodiment of the present invention, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions, when executed by a processor, implementing a method for displaying information about a virtual scene according to an embodiment of the present invention.

[0011] In an embodiment of the present invention, there is provided a computer program product comprising computer executable instructions or a computer program which, when executed by a processor, implements a method for displaying information in a virtual scene according to an embodiment of the present invention.

[0012] The embodiment of the present invention has the following advantageous effects.

[0013] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of a virtual object in the virtual scene are displayed, and when a field of view adjustment operation is received, the contents in the field of view of the virtual object are adjusted in the virtual scene, and when adjusting the contents, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget, and when the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when a control operation is performed in the virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of the information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be drawn to the operation widget and the virtual scene itself, and the user can quickly control the operation of the virtual object based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources. [Brief description of the drawings]

[0014] [Figure 1A]1 is a schematic diagram of an application mode of a method for displaying information of a virtual scene according to an embodiment of the present invention; [Figure 1B] 1 is a schematic diagram of an application mode of a method for displaying information of a virtual scene according to an embodiment of the present invention; [Diagram 2] 1 is a schematic diagram illustrating a configuration of an electronic device 500 that implements a method for displaying information about a virtual scene according to an embodiment of the present invention. [Diagram 3] 1 is a schematic diagram of the principle of a human-computer interaction engine installed in an information display device for a virtual scene according to an embodiment of the present invention; [Figure 4] 1 is a schematic flowchart of a method for displaying information of a virtual scene according to an embodiment of the present invention; [Diagram 5] 11 is a schematic diagram of a trigger for a field of view adjustment operation according to an embodiment of the present invention. FIG. [Figure 6] 11 is a schematic diagram of a trigger for a field of view adjustment operation according to an embodiment of the present invention. FIG. [Figure 7] FIG. 2 is a schematic diagram of a virtual scene interface according to an embodiment of the present invention. [Figure 8] 1 is a schematic flowchart of a method for displaying information of a virtual scene according to an embodiment of the present invention; [Figure 9] FIG. 2 is a schematic diagram of a hierarchical display of information according to an embodiment of the present invention. [Figure 10] 1 is a schematic flowchart of a method for displaying information of a virtual scene according to an embodiment of the present invention; [Figure 11] 1 is a flowchart of hierarchical information of a virtual scene according to an embodiment of the present invention. [Figure 12] 4 is a schematic flowchart of a slide operation according to an embodiment of the present invention. [Figure 13] 4 is a schematic flowchart of opacity adjustment according to an embodiment of the present invention. [Figure 14A] FIG. 2 is a schematic diagram of a display of a presentation information layer according to an embodiment of the present invention. [Figure 14B] 3 is a schematic diagram of a display of an information display layer according to an embodiment of the present invention; [Figure 14C]FIG. 2 is a schematic diagram of a display of a basic operation layer according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] In order to make the objectives, technical means and advantages of the present invention clearer, the following will further describe the embodiments of the present invention in detail with reference to the drawings. The described embodiments do not limit the present invention, and all other embodiments that a person skilled in the art can obtain without performing creative work belong to the scope of protection of the present invention.

[0016] In the following description, references to "some embodiments" describe a subset of all possible embodiments, but the "some embodiments" may be the same or different subsets of all possible embodiments and may be combined with each other unless inconsistent.

[0017] In the following description, references to the terms "first," "second," and "third" are merely intended to distinguish between similar objects and do not represent a particular order of the objects. It should be noted that "first," "second," and "third" may be interchanged with respect to a particular order or order, where permitted, such that the described embodiments of the invention may be practiced in orders other than those shown or described herein.

[0018] Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art. The terms used in this specification are merely for describing the embodiments of the present invention and are not intended to limit the present invention.

[0019] Before describing the embodiments of the present invention in more detail, the nouns and terms contained in the embodiments of the present invention will be explained, and the nouns and terms contained in the embodiments of the present invention are suitable for the following interpretation.

[0020] (1) Client: An application executed on a terminal to provide various services, such as a client supporting a virtual scene (e.g., a game scene).

[0021] (2) "In response to": Used to express a condition or state on which the performed operation depends. When the dependent condition or state is met, the one or more operations that are performed may be in real time or may have a configured delay. Unless otherwise specified, there is no restriction on the execution order of the multiple operations that are performed.

[0022] (3) Virtual scene: A virtual scene that is displayed (or provided) when an application program is executed on a terminal. The virtual scene may be a simulation environment for the real world, a semi-simulation and semi-fictional environment, or a purely fictional environment. The virtual scene may be any of a 2D virtual scene, a 2.5D virtual scene, and a 3D virtual scene.

[0023] For example, the virtual scene may include sky, land, sea, etc. The land may include environmental elements such as desert, city, etc., and the user may control the virtual object to perform an action in the virtual scene. The action may include, but is not limited to, at least one of adjusting a body posture, crawling, running, riding, jumping, driving, picking up, shooting, attacking, and throwing. The virtual scene may display the virtual scene from a first-person perspective (e.g., a virtual object in a game is represented from a user's own perspective), a third-person perspective (e.g., a user progresses through a game by chasing a virtual object in the game), or a bird's-eye view, and these perspectives may be arbitrarily switched.

[0024] (4) Virtual object: A virtual object may be a representation of a person or object that can be interacted with in the virtual scene, or may be a movable object in the virtual scene. The movable object may be a virtual character, a virtual animal, a cartoon or animation character, etc., such as a character, an animal, a plant, a barrel, a wall, a stone, etc., displayed in the virtual scene. The virtual object may be a virtual representation representing a user in the virtual scene. The virtual scene may include multiple virtual objects, each of which has its own shape and volume in the virtual scene and occupies a part of the space in the virtual scene.

[0025] For example, the virtual object may be a user character controlled by an operation on a client, an artificial intelligence (AI) set in a battle in a virtual scene by training, or a non-player character (NPC) set in an interaction in a virtual scene. Here, the number of virtual objects participating in the interaction in the virtual scene may be set in advance, or may be dynamically determined according to the number of clients participating in the interaction.

[0026] (5) Massive Multiplayer Online Role-Playing Game (MMORPG) is a type of online game that belongs to the role-playing game genre, in which players play fictional characters and control the actions and activities of those characters.

[0027] (6) A first-person shooting game (FPS) is a shooting game played from the player's subjective perspective.

[0028] (7) Head Up Display (HUD), also referred to as a head up display system, displays information related to the virtual scene (i.e., HUD information, see FIG. 9 for details) on the interface of the virtual scene, allowing the player to always understand the most important and most directly relevant content of the virtual scene.

[0029] Embodiments of the present invention provide a method, apparatus, electronic device, computer-readable storage medium and computer program product for displaying information of a virtual scene, which can reduce the complexity of information display and improve the utilization of display resources and the efficiency of human-computer interaction.

[0030] In order to facilitate understanding of the virtual scene information display method according to the embodiment of the present invention, the following describes an exemplary implementation scenario of the virtual scene information display method according to the embodiment of the present invention. The virtual scene in the virtual scene information display method according to the embodiment of the present invention may be completely output by the terminal device, or may be output by the terminal device and the server in cooperation with each other.

[0031] In some embodiments, the virtual scene may be an environment for game characters to interact with, for example, game characters may compete in the virtual scene, and a user may obtain a gaming experience during a game by controlling the actions of the virtual characters to interact with each other in the virtual scene.

[0032] FIG. 1A is a schematic diagram of an application aspect of a virtual scene information display method according to an embodiment of the present invention. In one implementation scenario, as shown in FIG. 1A, it is suitable for several application modes that completely rely on the computing capabilities of the terminal 400 to complete the calculation of the relevant data of the virtual scene 100. For example, a standalone version / offline mode game etc. realizes the output of the virtual scene through the terminal 400 such as a smartphone, a tablet computer and a virtual reality / augmented reality device. In forming the visual perception of the virtual scene 100, the terminal 400 calculates and displays the necessary data through the graphic computing hardware, realizes the loading, analysis and rendering of the display data, and outputs the video frame that can realize the visual perception of the virtual scene with the graphic output hardware. For example, displaying a two-dimensional image or video on the display display of the smartphone, or projecting the video frame that can realize the three-dimensional display effect on the lens of the augmented reality / virtual reality glasses. In addition, in order to enhance the perception effect, the device may use various hardware to realize one or more of auditory perception, tactile perception, and motion perception.

[0033] As an example, the terminal 400 executes a client (e.g., a standalone version of a game application). During execution of the client, the terminal 400 outputs a virtual scene based on scene data of the virtual scene. The virtual scene is an environment for game characters to interact, and may be, for example, a plain, a city, a valley, etc., for game characters to fight against each other. After outputting the virtual scene, the terminal 400 displays scene auxiliary information of the virtual scene and displays an operation widget of the virtual scene, which is used to control the operation of a virtual object in the virtual scene. The user may trigger a field of view adjustment operation for the virtual scene. In response to the field of view adjustment operation, the terminal 400 adjusts the content in the field of view of the virtual object in the virtual scene, and adjusts the visibility of the scene auxiliary information when adjusting the content, and the visibility of the scene auxiliary information after the adjustment is lower than the visibility of the operation widget. When the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored.

[0034] FIG. 1B is a schematic diagram of an application mode of the information display method of a virtual scene according to an embodiment of the present invention. In another implementation scenario, as shown in FIG. 1B, it is applied to a terminal 400 and a server 200. Usually, the computing capability of the server 200 is suitable for realizing the calculation of the virtual scene, and the terminal 400 is suitable for outputting the application mode of the virtual scene. Taking the formation of the visual perception of the virtual scene 100 as an example, the server 200 calculates the display data related to the virtual scene and transmits it to the terminal 400 via the network 300. The terminal 400 may use the graphic computing hardware to realize the calculation, loading and analysis of the display data, and use the graphic output hardware to output the virtual scene and realize the visual perception, for example, displaying a two-dimensional video frame on the display screen of a smartphone, or projecting a video frame to realize a three-dimensional display effect on the lens of an augmented reality / virtual reality glasses. For the perception of the form of the virtual scene, the corresponding hardware output of the terminal may be used, for example, using the microphone output to form an auditory perception, and using the vibrator output to form a tactile perception.

[0035] As an example, the terminal 400 executes a client (e.g., a network version of a game application) to perform game interaction with other users in a virtual scene, connects to a game server (i.e., the server 200) to obtain scene data of the virtual scene, and outputs the virtual scene based on the obtained scene data. After outputting the virtual scene, the terminal 400 displays scene auxiliary information of the virtual scene and displays an operation widget of the virtual scene, which is used to control the operation of a virtual object in the virtual scene. A user may trigger a field of view adjustment operation for the virtual scene. In response to the field of view adjustment operation, the terminal 400 adjusts the content in the field of view of the virtual object in the virtual scene, and adjusts the visibility of the scene auxiliary information when adjusting the content, and the visibility of the scene auxiliary information after the adjustment is lower than the visibility of the operation widget. When the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored.

[0036] In some embodiments, the terminal or server may execute a computer program to realize the virtual scene information display method according to the embodiment of the present invention. For example, the computer program may be a native program or software module in an operating system, or a local (Native) application program (APP: APPlication), i.e., a program that needs to be installed in the operating system. Alternatively, the computer program may be an applet, i.e., a program that can be executed simply by downloading it to a browser environment. Alternatively, the computer program may be a game applet that can be incorporated into any app. In short, the computer program may be any type of application program, module, or plug-in.

[0037] The embodiment of the present invention may be realized by cloud technology. Cloud technology is a hosting technology that integrates a series of resources such as hardware, software, and network in a wide area network or a local area network to realize data calculation, storage, processing, and sharing. Cloud technology is a collective term for network technology, information technology, integration technology, management platform technology, and application technology based on the business model application of cloud computing, which can form a resource pool and can be used as needed, which is flexible and convenient. Cloud computing technology will become an important supporting technology. The back-end service of the technology network system requires a large amount of calculation and storage resources.

[0038] As an example, the server (e.g., server 200) may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The terminal (e.g., terminal 400) may be, but is not limited to, a smartphone, a tablet computer, a laptop, a desktop computer, a smart voice interactive device (e.g., a smart speaker), a smart home appliance (e.g., a smart TV), a smart watch, an in-vehicle terminal, etc. The terminal and the server may be directly or indirectly connected by a wired or wireless communication method, but the embodiment of the present invention is not limited thereto.

[0039] In some embodiments, the multiple servers may constitute a blockchain, the servers are nodes on the blockchain, and information connections may exist between the nodes in the blockchain, and information transmission may be performed between the nodes via the information connections. Here, data related to the method for displaying information of a virtual scene according to an embodiment of the present invention (e.g., scene data of a virtual scene) may be stored in the blockchain.

[0040] The following describes the configuration of an electronic device that implements a method for displaying information about a virtual scene according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a configuration of an electronic device 500 that implements a method for displaying information about a virtual scene according to an embodiment of the present invention. As shown in FIG. 2, assuming that the electronic device 500 is the terminal shown in FIG. 1 as an example, the electronic device 500 that implements the method for displaying information about a virtual scene according to an embodiment of the present invention includes at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is connected via a bus system 540. The bus system 540 is used to realize connection and communication between these components. The bus system 540 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For convenience of explanation, each bus in FIG. 2 is collectively referred to as a bus system 540.

[0041] In some embodiments, the virtual scene information display device according to the embodiment of the present invention may be realized by software. As shown in FIG. 2, the virtual scene information display device 553 stored in the memory 550 may be software in the form of a program, a plug-in, etc., and includes a first display module 5531, a second display module 5532, and a third display module 5533. These modules are logical, and therefore may be arbitrarily combined or further divided according to the realized functions. The following describes the functions of each module.

[0042] Fig. 3 is a schematic diagram of the principle of a human-computer interaction engine installed in a virtual scene information display device according to an embodiment of the present invention. As shown in Fig. 3, the virtual scene information display method according to an embodiment of the present invention may be implemented by each module in the virtual scene information display device shown in Fig. 2 calling related modules, components, or plug-in software of the game engine shown in Fig. 3. The following exemplifies the modules, components, or plug-in software included in the game engine shown in Fig. 3. As shown in Fig. 3, the game engine includes the following parts:

[0043] (1) Virtual camera: A necessary component of the game scene screen, it is used to display the game scene screen. The game scene corresponds to at least one virtual camera, and may have two or more virtual cameras according to actual needs. The virtual camera is used as a rendering window of the game to capture and display the screen contents of the game world for the player. By setting the parameters of the virtual camera, the viewpoint (viewing angle) for the player to observe the game world, such as a first-person viewpoint or a third-person viewpoint, can be adjusted.

[0044] (2) Scene construction: Used for managing game scenes such as collision detection, visibility elimination, etc. Here, collision detection may be realized through a collision body, and the collision body may be realized by an axis-aligned bounding box (AABB) or an oriented bounding box (OBB) according to actual needs. Visibility elimination may be realized based on a view volume. A view volume is a stereoscopic frame generated by a virtual camera and is used to trim objects outside the visible range of the camera. Objects within the view volume are projected onto the view plane, and objects outside the view volume are discarded and not processed.

[0045] (3) Terrain Management: A component for managing terrain in a game scene, which is used to create and edit game terrains in a game scene, such as mountains, canyons, and caves.

[0046] (4) Editor: An auxiliary tool for game design, including the following:

[0047] Scene Editor: Used to edit the contents of game scenes, such as changing the terrain, customizing vegetation distribution, and lighting layout.

[0048] Model Editor: Used to create and edit in-game models (character models in a game scene).

[0049] Special Effects Editor: Used to edit the special effects in the game screen.

[0050] Action Editor: Used to define and edit the actions of characters on the game screen.

[0051] (5) Special Effects Component: Used to create and edit game special effects on the game screen. In implementation, particle special effects and texture UV animation may be used. Here, particle special effects combine a large number of single particles to express a fixed shape, and their overall or individual movements are controlled by a controller and script to simulate real-world effects such as water, fire, fog, and gas. UV animation is texture animation realized by dynamically changing the UV coordinates of an image.

[0052] (6) Skeletal animation: Animation achieved by moving objects using built-in bones, which may be understood as two concepts:

[0053] Bone: an abstract concept for controlling skin, such as human bones for controlling skin.

[0054] Skinning: An externally visible element controlled by bones, such as human skin being influenced by bones.

[0055] (7) Morph animation: This is a deformation animation achieved by adjusting the vertices of a basic model.

[0056] (8) UI widget: A widget for displaying the game screen.

[0057] (9) Fundamental Algorithms: These are algorithms that need to be called to realize the functions of the game engine, including, for example, graphics algorithms required to realize scene composition, and matrix transformations and vector transformations required to realize skeletal animation.

[0058] (10) Rendering component: A component required for displaying game screen effects. The rendering component can convert a scene described by 3D vectors into a scene described by 2D pixels. Examples include model rendering and scene rendering.

[0059] (11) A* Search: An algorithm for finding the shortest path used in path planning, searching and graph traversal in game design.

[0060] For example, by calling the UI widget in the game engine shown in FIG. 3, the interaction between the user and the game can be realized. By calling the Morph animation unit in the game engine, a two-dimensional or three-dimensional model is created, and after the creation of the model is completed, the skeletal animation unit imparts material mapping to the model according to different faces. This is equivalent to covering the skin on the bones. Finally, the render component calculates all effects such as the model, animation, light and shadow, and special effects in real time and displays them on the human-computer interaction interface. Specifically, the first display module 5531 renders the virtual scene data by calling the rendering component in the game engine shown in FIG. 3, and then outputs the virtual scene, displays scene auxiliary information of the virtual scene, and may display an operation widget of the virtual scene, and the operation widget is used to control the operation of the virtual object in the virtual scene. The second display module 5532 may accept a field of view adjustment operation by calling a UI widget in the game engine shown in Fig. 3, and then adjust the content in the field of view of the virtual object in the virtual scene in response to the field of view adjustment operation, and adjust the visibility of the scene auxiliary information when adjusting the content, where the visibility of the scene auxiliary information after the adjustment is lower than the visibility of the operation widget. The third display module 5533 may detect whether the field of view adjustment operation has ended by calling a UI widget in the game engine shown in Fig. 3, and restore the visibility of the scene auxiliary information when the field of view adjustment operation has ended.

[0061] The following describes a virtual scene information display method according to an embodiment of the present invention. In some embodiments, the virtual scene information display method according to the embodiment of the present invention may be implemented independently by a terminal, independently by a server, or jointly by a terminal and a server. Implementation by a terminal is taken as an example. FIG. 4 is a schematic flowchart of a virtual scene information display method according to an embodiment of the present invention. As shown in FIG. 4, the virtual scene information display method according to an embodiment of the present invention includes the following steps:

[0062] Step 101: The terminal displays scene auxiliary information of a virtual scene and displays an operation widget for the virtual scene.

[0063] Here, the manipulation widget is used to control the behavior of a virtual object in a virtual scene.

[0064] In practical applications, a terminal may execute a client (e.g., a game client) that supports a virtual scene. During the execution of the client, the terminal outputs a virtual scene (e.g., a scene of a shooting game), that is, the terminal displays an interface of the virtual scene, and may also display scene auxiliary information of the virtual scene and an operation widget for controlling the operation of a virtual object in the virtual scene in the interface of the virtual scene.

[0065] In some embodiments, the terminal may display scene auxiliary information of the virtual scene and display an operation widget of the virtual scene as follows: use a first display layer of the view layers to display the scene auxiliary information of the virtual scene, and use a second display layer separate from the first display layer to display the operation widget of the virtual scene, where the scene auxiliary information includes at least one of presentation information presenting an event or state in the virtual scene and entry information of an auxiliary function of the virtual scene.

[0066] In practical applications, the scene auxiliary information may include presentation information presenting an event or state in a virtual scene, such as presentation of acquiring a virtual prop, presentation of using a virtual prop, etc. The scene auxiliary information may further include entry information of auxiliary functions of a virtual scene, such as chat panel, task panel, attribute (e.g., hit point, attack value) information, map preview, etc. The operation widget is used to control the operation of a virtual object in a virtual scene, such as jump widget, movement widget, shooting widget, etc. In this way, the scene auxiliary information and operation control can be displayed respectively by different display layers, so that the visibility of the scene auxiliary information can be adjusted in subsequent processing, and the processing efficiency can be improved.

[0067] In some embodiments, the terminal may display the scene auxiliary information of the virtual scene and the operation widget as follows: display the scene auxiliary information of the virtual scene at a first visibility level, and display the operation widget at a second visibility level. In practical applications, the first visibility level and the second visibility level may be the same, or the first visibility level may be lower than the second visibility level.

[0068] Step 102: In response to the field of view adjustment operation, adjust the content in the field of view of the virtual object in the virtual scene, and adjust the visibility of the scene auxiliary information when adjusting the content.

[0069] Here, the visibility of the adjusted scene auxiliary information is lower than the visibility of the operation widget.

[0070] In some embodiments, the user may perform a control operation in the virtual scene, for example, control the virtual object to move, control the virtual object to turn, adjust the field of view of the virtual camera that captures the virtual scene, etc. In the embodiments of the present invention, when performing a field of view adjustment operation (for example, adjusting the field of view to search for a target in the virtual scene, or adjusting the field of view to move in another direction), the terminal adjusts the field of view of the virtual camera (i.e., from the viewpoint of the virtual object) to capture the virtual scene in response to the field of view adjustment operation, and adjusts the content in the field of view of the virtual object. At the same time, when adjusting the content, adjust the visibility of the scene auxiliary information, so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. This can quickly allow the user to pay attention to the operation widget and the virtual scene itself, and reduce the complexity of information display, so that the user can browse the virtual scene, and the user can quickly control the operation of the virtual object based on the operation widget, thereby improving the efficiency of human-computer interaction.

[0071] In some embodiments, the terminal may accept a field of view adjustment operation as follows: accept a slide operation performed in an interface of a virtual scene, the slide operation being used to adjust content in a field of view of a virtual object by sliding content of the virtual scene displayed in the interface, and determine the slide operation as a field of view adjustment operation.

[0072] In practical application, the field of view adjustment operation may be realized by performing a slide operation in the interface of the virtual scene. The slide operation is used to adjust the content in the field of view of the virtual object by sliding the content of the virtual scene displayed in the interface. When the terminal receives the slide operation performed in the interface of the virtual scene, the terminal determines the slide operation as a field of view adjustment operation, that is, determines that the field of view adjustment operation has been received. An example will be described with reference to FIG. 5. FIG. 5 is a schematic diagram of triggering a field of view adjustment operation according to an embodiment of the present invention. Here, the field of view adjustment operation is performed by sliding the interface of the virtual scene, that is, the field of view adjustment operation is performed by performing a slide operation in the interface of the virtual scene. In this way, the field of view adjustment operation can be triggered by sliding in the interface of the virtual scene, so that the operation is simple, the complexity of human-computer interaction for triggering the field of view adjustment operation can be reduced, and the efficiency of human-computer interaction can be improved.

[0073] In some embodiments, the terminal may accept a field of view adjustment operation as follows: Display a turning widget for controlling an orientation of a virtual object; Accept a turning operation on the virtual object triggered based on the turning widget, and determine the turning operation as a field of view adjustment operation.

[0074] In practical application, the view adjustment operation may be realized by a turning operation. Specifically, a turning widget for controlling the orientation of a virtual object may be displayed. For example, a turning widget may be displayed on the interface of a virtual scene, and a user may control the virtual object to turn the orientation through the turning widget. When a turning operation on a virtual object triggered based on a virtual object is received, the turning operation is determined as a view adjustment operation, that is, it is determined that a view adjustment operation is received. An example will be described with reference to FIG. 6. FIG. 6 is a schematic diagram of a trigger of a view adjustment operation according to an embodiment of the present invention. Here, a turning widget, i.e., a turning wheel, is displayed on the interface of a virtual scene. The turning widget may be used to trigger a turning operation on a virtual object to realize a view adjustment operation. In this way, by providing a turning widget, a corresponding trigger widget is provided to trigger a view adjustment operation, and the trigger of a view adjustment operation can be easily realized, so that the efficiency of human-computer interaction can be improved.

[0075] In some embodiments, the operation widget may be displayed with a predetermined transparency. The terminal may adjust the visibility of the scene auxiliary information as follows: Adjust the transparency of the scene auxiliary information to a target transparency higher than the predetermined transparency so as to adjust the visibility of the scene auxiliary information.

[0076] In practical application, the operation widget may be displayed with a predetermined transparency. When adjusting the visibility of the scene auxiliary information, the terminal may adjust the transparency of the scene auxiliary information. Specifically, the transparency of the scene auxiliary information may be adjusted to a target transparency higher than the predetermined transparency. The target transparency may be fully transparent, that is, the scene auxiliary information may not be displayed at all. In order to display the scene auxiliary information in distinction from the operation widget, the target transparency may be higher than the predetermined transparency, but not fully transparent, so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. In this way, the adjustment of the visibility of the scene auxiliary information can be realized by adjusting the transparency of the scene auxiliary information, the complexity of information display can be reduced, the user can quickly control the operation of the virtual object based on the operation widget, and the efficiency of human-computer interaction can be improved.

[0077] In some embodiments, the scene auxiliary information has a display state for instructing to display the scene auxiliary information and a non-display state for instructing to hide the scene auxiliary information. The terminal may display the scene auxiliary information of the virtual scene as follows: Control the scene auxiliary information of the virtual scene to be in the display state. In response, the terminal may adjust the visibility of the scene auxiliary information as follows: Control the scene auxiliary information to be adjusted from the display state to the non-display state.

[0078] In practical applications, a state including a display state and a non-display state may be set for the scene auxiliary information. When displaying the scene auxiliary information of the virtual scene, the terminal may control the scene auxiliary information to be in a display state. When adjusting the visibility of the scene auxiliary information, the terminal may control the scene auxiliary information to be adjusted from a display state to a non-display state. In this way, by controlling the state of the scene auxiliary information to convert from a display state to a non-display state, that is, canceling the display of the scene auxiliary information, the complexity of information display can be further reduced, and the user can quickly control the operation of the virtual object based on the operation widget, thereby improving the efficiency of human-computer interaction.

[0079] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The terminal may adjust the visibility of the scene auxiliary information as follows: obtain scene data of a virtual scene and interaction data of a virtual object, invoke a first neural network model according to the scene data and the interaction data, predict auxiliary information to be adjusted among the plurality of auxiliary information, obtain a prediction result, and adjust the visibility of the auxiliary information indicated by the prediction result.

[0080] In practical applications, the scene auxiliary information includes a plurality of auxiliary information. When adjusting the visibility of the scene auxiliary information, the visibility of some of the plurality of auxiliary information may be adjusted. In some embodiments, the auxiliary information to be adjusted may be predicted by a neural network model, that is, a first neural network model for predicting the auxiliary information to be adjusted is obtained, and the first neural network model is a trained one. Specifically, the scene data sample of the virtual scene and the interaction data sample of the virtual object may be used as a training sample, and the adjusted auxiliary information may be used as a label to train the first neural network model, and the trained first neural network model may be obtained. Then, when predicting the auxiliary information to be adjusted, the scene data of the virtual scene and the interaction data of the virtual object are obtained, and the first neural network model is called according to the scene data and the interaction data, to predict the auxiliary information to be adjusted among the plurality of auxiliary information, to obtain a prediction result, and to adjust the visibility of the auxiliary information indicated by the prediction result. In this way, by realizing the adjustment of the visibility of some of the multiple pieces of auxiliary information and predicting the auxiliary information to be adjusted by the neural network model, the visibility of some of the auxiliary information can be automatically adjusted for the user based on the scene data and interaction data in the user's virtual scene, thereby improving the utilization rate of hardware resources and the smartness of the display of the auxiliary information, and better meeting the needs of the user.

[0081] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The terminal may adjust the visibility of the scene auxiliary information as follows: determine a similar history virtual scene of the virtual scene for the virtual object; a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold; obtain usage data for the scene auxiliary information when adjusting the content in the similar history virtual scene; determine a target auxiliary information to be adjusted from the plurality of auxiliary information based on the usage data, and adjust the visibility of the target auxiliary information.

[0082] In practical applications, the scene auxiliary information includes a plurality of pieces of auxiliary information. When adjusting the visibility of the scene auxiliary information, the visibility of some of the plurality of pieces of auxiliary information may be adjusted. In some embodiments, the target auxiliary information to be adjusted may be determined by taking statistics of history data. Specifically, first, a similar history virtual scene of the virtual scene for the virtual object is determined. The similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold. Next, usage data (i.e., historical usage data, which may be that of a current user or that of a plurality of selected target users) for the scene auxiliary information is obtained when adjusting the content in the similar history virtual scene. The usage data may be the usage frequency, viewing frequency, etc. of each piece of auxiliary information. Next, based on the usage data, the target auxiliary information to be adjusted is determined from the plurality of pieces of auxiliary information, and for example, the auxiliary information whose usage frequency is lower than a frequency threshold is set as the target auxiliary information. Next, the visibility of the target auxiliary information is adjusted. In this way, it is possible to adjust the visibility of some of the multiple auxiliary information, and the visibility of some of the auxiliary information can be automatically adjusted for the user based on the user's usage data in a similar historical virtual scene, thereby improving the utilization rate of hardware resources and the smartness of the display of the auxiliary information, and better meeting the needs of the user.

[0083] In practical applications, the number of operation widgets may be multiple. When adjusting the visibility of the scene auxiliary information, the terminal may adjust the visibility of some of the operation widgets among the multiple operation widgets. In some embodiments, the number of operation widgets may be multiple. The terminal may adjust the visibility of some of the multiple operation widgets as follows: Obtain interaction data of a virtual object and scene data of a virtual scene. Based on the interaction data and the scene data, invoke a second neural network model to predict an operation widget to be used among the multiple operation widgets, and obtain a prediction result. If the operation widget to be used indicated by the prediction result is the first operation widget, adjust the visibility of the second operation widget. The visibility of the second operation widget after the adjustment is lower than the visibility of the first operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0084] In practical application, the operation widget to be used may be predicted by a neural network model, that is, a second neural network model for predicting the operation widget to be used is obtained, and the second neural network model is a trained one. Specifically, the scene data sample of the virtual scene and the interaction data sample of the virtual object are used as training samples, and the corresponding used operation widget is used as a label to train the second neural network model and obtain a trained second neural network model. Then, when predicting the operation widget to be used, the scene data of the virtual scene and the interaction data of the virtual object are obtained, and the second neural network model is invoked based on the scene data and the interaction data to predict the operation widget to be used among the multiple operation widgets, and a prediction result is obtained. If the operation widget to be used indicated by the prediction result is the first operation widget, the visibility of the second operation widget is adjusted so that the visibility of the second operation widget is lower than the visibility of the first operation widget. The second operation widget is an operation widget other than the first operation widget among the multiple operation widgets. In this way, the visibility of some operation widgets among a plurality of operation widgets can be adjusted, the complexity of information display can be reduced, and the user can quickly control the behavior of virtual objects according to the required operation widgets, thereby improving the efficiency of human-computer interaction. In addition, the neural network model can automatically determine the operation widgets that need to be adjusted in visibility for the user according to the scene data and interaction data in the user's virtual scene, thereby improving the utilization rate of hardware resources and the smartness of information display, and further meeting the needs of the user.

[0085] In some embodiments, the number of operation widgets is more than one. The terminal may adjust the visibility of some operation widgets among the multiple operation widgets as follows: determine a similar history virtual scene of the virtual scene for the virtual object; a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold; determine a first operation widget that is used less frequently than a frequency threshold when adjusting content in the similar history virtual scene; adjust the visibility of the first operation widget; and after the adjustment, the visibility of the first operation widget is lower than the visibility of the second operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0086] In practical application, the target operation widget to be adjusted may be determined by taking statistics of historical data. Specifically, firstly, a similar history virtual scene of the virtual scene for the virtual object is determined. The similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold. Then, a first operation widget is determined whose usage frequency is lower than a frequency threshold when adjusting the content in the similar history virtual scene. Then, the visibility of the first operation widget is adjusted so that the visibility of the first operation widget is lower than the visibility of the second operation widget. The second operation widget is an operation widget other than the first operation widget among the plurality of operation widgets. In this way, the visibility of some operation widgets among the plurality of operation widgets is adjusted, the complexity of information display is further reduced, and the user can quickly control the operation of the virtual object based on the required operation widget, and the efficiency of human-computer interaction can be improved. In addition, the operation widget whose visibility needs to be adjusted for the user can be automatically determined based on the usage frequency of the operation widget in the user's similar history virtual scene, and the utilization rate of hardware resources and the smartness of information display can be improved, and the needs of the user can be further met.

[0087] In some embodiments, the terminal may display an information intelligent display switch of the virtual scene, and control the information display mode of the virtual scene to the information intelligent display mode in response to an on command for the information intelligent display switch. Accordingly, the terminal may adjust the visibility of the scene auxiliary information when adjusting the content as follows: When the information display mode of the virtual scene is the information intelligent display mode, adjust the visibility of the scene auxiliary information when adjusting the content.

[0088] In practical application, an information intelligent display switch of the virtual scene may be further configured. When it is necessary to control the information intelligent display mode of the virtual scene to be the information intelligent display mode, the information intelligent display switch is controlled to an on state. Specifically, the terminal may display the information intelligent display switch of the virtual scene, and when an on command for the information intelligent display switch is received, the information display mode of the virtual scene may be controlled to the information intelligent display mode. At this time, the visibility of the scene auxiliary information is adjusted when adjusting the content. In this way, by providing the information intelligent display switch, the user can turn on or off the information intelligent display mode as needed, which can provide the user with more choices, thereby improving the user's experience of the virtual scene.

[0089] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The terminal displays a selection widget for each auxiliary information, and in response to a selection operation on the target auxiliary information triggered based on the selection widget, determines the target auxiliary information as the scene auxiliary information to be displayed when adjusting the content. In response, the terminal may adjust the visibility of the scene auxiliary information as follows: Adjust the visibility of auxiliary information other than the target auxiliary information among the plurality of auxiliary information.

[0090] In practical application, when adjusting contents, a customization setting function of auxiliary information to be displayed may be provided. That is, the terminal displays a selection widget of each auxiliary information, selects target auxiliary information based on the selection widget, and then determines the target auxiliary information as the scene auxiliary information to be displayed during the content adjustment. In this way, when adjusting the visibility of the scene auxiliary information, the terminal adjusts the visibility of auxiliary information other than the target auxiliary information among the multiple auxiliary information, and provides a selection widget for each auxiliary information, so that the user can set the target auxiliary information whose visibility needs to be adjusted, and the user can be given more control over the information display, thereby improving the user's experience of the virtual scene.

[0091] In some embodiments, the terminal may display a display function item for the scene auxiliary information after adjusting the visibility of the scene auxiliary information, and restore the visibility of the scene auxiliary information when a trigger operation on the display function item is received. An example will be described with reference to FIG. 7. FIG. 7 is a schematic diagram of a virtual scene interface according to an embodiment of the present invention. Here, in the process of adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. That is, as shown in FIG. 7(1), in the virtual scene interface, the display of the scene auxiliary information is canceled, and only the operation widget is displayed, and the display function item "display" for the scene auxiliary information is displayed. As shown in FIG. 7(2), in response to the trigger operation on the display function item "display", the visibility of the scene auxiliary information is restored, that is, the scene auxiliary information is displayed. In this way, the display function item of the scene auxiliary information can always restore the visibility of the scene auxiliary information as needed, which can improve the user's control over the information display in the virtual scene and improve the user's experience of the virtual scene.

[0092] Step 103: When the field of view adjustment operation is completed, restore the visibility of the scene auxiliary information.

[0093] In some embodiments, the scene auxiliary information includes presentation-type auxiliary information and non-presentation-type auxiliary information. The terminal may display the scene auxiliary information of the virtual scene as follows: Display the presentation-type auxiliary information and the non-presentation-type auxiliary information. In response, the terminal may restore the visibility of the scene auxiliary information as follows: Restore the visibility of the non-presentation-type auxiliary information.

[0094] In practical application, the presentation type auxiliary information may have a time-dependent nature. Therefore, when restoring the visibility of the scene auxiliary information, the presentation before adjusting the visibility of the scene auxiliary information may be stopped, that is, only the visibility of the non-presentation type auxiliary information may be restored, and the display of the presentation type auxiliary information may be canceled. Here, the presentation type auxiliary information is presentation information for presenting an event or state in the virtual scene, and the non-presentation type auxiliary information is entry information of the auxiliary function of the virtual scene. In this way, the visibility of the scene auxiliary information can be restored according to the type of the scene auxiliary information, so that when the visibility of the scene auxiliary information is restored, the visibility of the scene auxiliary information can be restored rationally and efficiently.

[0095] An example will be described with reference to FIG. 8. FIG. 8 is a schematic flowchart of a method for displaying information of a virtual scene according to an embodiment of the present invention. Here, as shown in FIG. 8(1), scene auxiliary information and operation widgets of the virtual scene are displayed in the interface of the virtual scene. As shown in FIG. 8(2), a slide operation performed on the interface of the virtual scene is accepted, and in response to the slide operation, the content in the field of view of the virtual object is adjusted in the virtual scene, and in the process of adjusting the content, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget, that is, the display of the scene auxiliary information is canceled, and only the operation widget is displayed. As shown in FIG. 8(3), in response to the end of the field of view adjustment operation, the visibility of the scene auxiliary information is restored, that is, the scene auxiliary information is displayed again.

[0096] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of a virtual object in the virtual scene are displayed, and when a field of view adjustment operation is received, the contents in the field of view of the virtual object are adjusted in the virtual scene, and when adjusting the contents, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget, and when the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when a control operation is performed in the virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of the information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be drawn to the operation widget and the virtual scene itself, and the user can quickly control the operation of the virtual object based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources.

[0097] The following describes an exemplary application of the embodiment of the present invention in one practical application scenario, taking as an example that the virtual scene is a game scene, and a sliding operation (i.e., a swipe operation performed on the display of the device) triggers a field of view adjustment operation (adjusting the field of view of the virtual object to find the game target). In a game (e.g., MMORPG+FPS type game) scenario, the main interface of the game is arranged with HUD information such as various function entries (entrances), widgets, prompts, etc., and the amount of information is very large. Meanwhile, game operations often require high operation accuracy of the player. For example, the shooting operation of the game requires the player to quickly focus on the shooting target. A large amount of HUD information interferes with the player's focus on the target.

[0098] In response to this, an embodiment of the present invention provides a method for displaying information of a virtual scene. In this method, the HUD information of the virtual scene (including the above-mentioned scene auxiliary information and operation widget) is displayed on the basic operation layer (used to display the operation widget) and the information display layer (used to display the scene auxiliary information), respectively. When searching for a game goal by sliding operation, the visibility of the scene auxiliary information is adjusted by reducing the opacity of the user interface (UI) of the information display layer, so that the information interference of the HUD can be reduced and the player can quickly focus on the game goal in the concise HUD. In addition, by leaving the UI of the basic operation layer, the need for the player to quickly control the action (e.g., shooting) of the virtual object can be met. After the sliding operation is completed, the display of the UI of the information display layer is restored. In this way, by hierarchical processing of the HUD information, the interference of the UI information of the exhibition system can be reduced when sliding while leaving the basic operation widget, so that the player can quickly focus on the game goal.

[0099] Next, with reference to FIG. 9, a method for displaying information of a virtual scene according to an embodiment of the present invention will be described in detail. FIG. 9 is a schematic diagram of a hierarchical display of information according to an embodiment of the present invention. Here, the HUD information of the virtual scene is hierarchically processed and classified into three hierarchies: a "presentation information layer", an "information display layer", and a "basic operation layer". Here, (1) the "presentation information layer" and the "information display layer" are used to display scene auxiliary information of the virtual scene. Specifically, the presentation type auxiliary information (e.g., virtual item acquisition presentation) of the scene auxiliary information is displayed in the "presentation information layer", and the non-presentation type auxiliary information (e.g., virtual object hit point information, task panel, chat panel, etc.) of the scene auxiliary information is displayed in the "information display layer". (2) The "basic operation layer" is used to display operation widgets of the virtual scene, such as a sight, a movement joystick, a skill button, a jump button, etc.

[0100] As shown in Fig. 8, (1) before a slide operation, all HUD information is displayed on the interface of the virtual scene. (2) During a slide operation, the opacity of the UI of the "presentation information layer" and "information display layer" is reduced (a specific opacity value may be set in the implementation) and the visibility for displaying the scene auxiliary information among the HUD information is adjusted, so that the visibility of the scene auxiliary information is lower than that of the operation widget, while the UI of the "basic operation layer" is left intact to allow the player to operate quickly and easily respond. (3) After the slide operation is completed, the display of the UI of the "information display layer" (i.e., non-presentation type auxiliary information among the scene auxiliary information) is restored to the initial state before the slide operation.

[0101] Next, a method for displaying information of a virtual scene according to an embodiment of the present invention will be described with reference to Fig. 10. Fig. 10 is a schematic flowchart of the method for displaying information of a virtual scene according to an embodiment of the present invention. The method for displaying information of a virtual scene according to an embodiment of the present invention includes the following steps:

[0102] Step 201: The process starts.

[0103] Step 202: A slide operation is triggered.

[0104] Step 203: For the presentation information layer, in step 2031, the opacity of the UI is reduced, in step 2032, the slide operation is ended, and in step 2033, the presentation is interrupted and ended.

[0105] Step 204: For the information display layer, in step 2041, the opacity of the UI is reduced, in step 2042, the slide operation is ended, and in step 2043, the UI opacity is restored.

[0106] Step 205: For the base operation layer, in step 2051, the opacity of the UI is maintained as is.

[0107] Step 206: The process ends.

[0108] In the actual implementation, (1) the HUD information is divided into three layers: the "presentation information layer", the "information display layer", and the "basic operation layer". Here, the "presentation information layer" refers to the prompts that pop up and is located at the top layer of the interface, the "basic operation layer" refers to the information required for the player to control the operation and is located at the bottom layer of the interface, and the remaining UI information is the "information display layer" that is located between the "presentation information layer" and the "basic operation layer".

[0109] In (1), the flow of hierarchical formation of HUD information is shown in FIG. 11. FIG. 11 is a flowchart of hierarchical formation of information of a virtual scene according to an embodiment of the present invention. The process includes the following steps: In step 301, components of HUD information are generated. In step 302, a component tree is constructed by linking corresponding components to corresponding parent nodes according to predetermined attribute values ​​of the components. In step 303, it is determined whether it is a component of a presentation information layer, and if so, step 304 is executed, and if not, step 305 is executed. In step 304, it is linked as a child node of the presentation information layer. In step 305, it is determined whether it is a component of an information display layer, and if so, step 306 is executed, and in step 306, it is linked as a child node of the information display layer.

[0110] (2) The above slide operation rotates the virtual camera of the virtual scene to adjust the contents in the field of view of the virtual object. When performing the slide operation, no processing is done on the UI information of the "basic operation layer", and there is no need to lower the opacity of the UI. For the UI information of the "presentation information layer" and the "information display layer", the opacity of the UI is lowered (a specific value may be set) to adjust the visibility of the scene auxiliary information in the HUD information.

[0111] (3) When the slide operation ends, if the UI information belongs to the "presentation information layer", the presentation is interrupted and ended, and if the UI information belongs to the "information display layer", the UI opacity is restored to the UI opacity before the slide operation.

[0112] In (2), the flow of the slide operation is shown in FIG. 12. FIG. 12 is a schematic flowchart of the slide operation according to an embodiment of the present invention. The process includes the following steps: In step 401, a touch event of the display by a user is detected. In step 402, it is read whether the touch coordinates occur in the right 1 / 2 area of ​​the screen, and if so, step 403 is executed. In step 403, it is determined whether the slide operation is in progress, and if so, step 404 is executed. In step 404, the opacity of the presentation information layer and the information display layer is reduced. In step 405, it is determined whether the slide operation is ended and the touch is released, and if so, step 406 is executed. In step 406, the components of the presentation information layer are deleted, and the opacity of the components of the information display layer is restored. That is, the opacity of the components of the information display layer is restored to the opacity before the slide operation.

[0113] In (2)-(3), the flow of opacity adjustment is shown in FIG. 13. FIG. 13 is a schematic flowchart of opacity adjustment according to an embodiment of the present invention. The process includes the following steps: In step 601, a touch slide event of the display by a user is detected. In step 602, an event response function A is executed. In step 603, the component trees are traversed from the parent nodes of the presentation information layer and the information display layer, respectively, an opacity setting operation is invoked, and the opacity of the corresponding component is set to N. In step 604, it is detected whether the slide event is released, and if so, step 605 is executed. In step 605, an event response function B is executed. In step 606, the component tree is traversed from the parent node of the presentation information layer, and a delete operation is executed for the component of the presentation information layer. In step 607, the component tree is traversed from the parent node of the information display layer, an opacity setting operation is invoked, and the opacity is restored to M.

[0114] The following description will be given with reference to Fig. 14A to Fig. 14C. Fig. 14A is a schematic diagram of a display of a presentation information layer according to an embodiment of the present invention. Here, before a slide operation, the presentation type scene auxiliary information is displayed on the presentation information layer, during the slide operation, the presentation type scene auxiliary information is not displayed on the presentation information layer, and after the slide operation is completed, the presentation type scene auxiliary information is deleted, that is, the presentation type scene auxiliary information is not displayed on the presentation information layer.

[0115] 14B is a schematic diagram of the display of an information display layer according to an embodiment of the present invention, in which non-presentation type scene auxiliary information is displayed on the information display layer before a slide operation, the non-presentation type scene auxiliary information is not displayed on the information display layer during the slide operation, and the non-presentation type scene auxiliary information is displayed on the information display layer after the slide operation ends.

[0116] 14C is a schematic diagram of a display of a basic operation layer according to an embodiment of the present invention, in which operation widgets are all displayed in the basic operation layer before, during, and after a slide operation is completed.

[0117] According to the above embodiment of the present invention, the interference of complex HUD information with the operation in the virtual scene can be reduced, and the player can be presented with concise HUD information to focus on the game goal. In addition, the player can automatically interrupt the interference of pop-up type presented information through the sliding operation, and the purpose of quickly clearing the screen can be achieved.

[0118] In addition, in the embodiments of the present invention, with regard to relevant data such as user information, when the embodiments of the present invention are applied to a specific product or technology, user permission or consent must be obtained, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0119] The following continues to describe an exemplary configuration in which the virtual scene information display device 553 according to an embodiment of the present invention is implemented as a software module. In some embodiments, as shown in FIG. 2, the software modules in the virtual scene information display device 553 stored in the memory 550 may include the following modules: The first display module 5531 displays scene auxiliary information of the virtual scene and displays an operation widget of the virtual scene. The operation widget is used to control the operation of a virtual object in the virtual scene. The second display module 5532 adjusts the content in the field of view of the virtual object in the virtual scene in response to the field of view adjustment operation, and adjusts the visibility of the scene auxiliary information when adjusting the content. Here, the visibility of the scene auxiliary information after the adjustment is lower than the visibility of the operation widget. The third display module 5533 restores the visibility of the scene auxiliary information when the field of view adjustment operation is completed.

[0120] In some embodiments, the second display module 5532 receives a slide operation performed in a virtual scene interface, the slide operation being used to adjust content in a field of view of a virtual object by sliding content of the virtual scene displayed in the interface, and determines the slide operation as a field of view adjustment operation.

[0121] In some embodiments, the second display module 5532 displays a turning widget for controlling an orientation of a virtual object, accepts a turning operation on the virtual object triggered based on the turning widget, and determines the turning operation as a field of view adjustment operation.

[0122] In some embodiments, the first display module 5531 displays scene auxiliary information of the virtual scene using a first display layer of the view layers and displays operation widgets of the virtual scene using a second display layer separate from the first display layer, where the scene auxiliary information includes at least one of presentation information presenting an event or state in the virtual scene and entry information of an auxiliary function of the virtual scene.

[0123] In some embodiments, the first display module 5531 displays the virtual scene manipulation widget at a predetermined transparency, and the second display module 5532 adjusts the transparency of the scene auxiliary information to a target transparency higher than the predetermined transparency.

[0124] In some embodiments, the scene auxiliary information includes presentation type auxiliary information and non-presentation type auxiliary information. A first display module 5531 displays the presentation type auxiliary information and the non-presentation type auxiliary information. A second display module 5532 restores visibility of the non-presentation type auxiliary information.

[0125] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The second display module 5532 acquires scene data of the virtual scene and interaction data of the virtual object, and based on the scene data and the interaction data, calls a first neural network model to predict auxiliary information to be adjusted among the plurality of auxiliary information, acquires a prediction result, and adjusts visibility of the auxiliary information shown by the prediction result.

[0126] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The second display module 5532 determines a similar history virtual scene of the virtual scene for the virtual object, where a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold, obtains usage data for the scene auxiliary information when adjusting content in the similar history virtual scene, determines target auxiliary information to be adjusted from the plurality of auxiliary information based on the usage data, and adjusts visibility of the target auxiliary information.

[0127] In some embodiments, the number of operation widgets is more than one. The second display module 5532 acquires interaction data of the virtual object and scene data of the virtual scene, and based on the interaction data and the scene data, calls a second neural network model to predict an operation widget to be used among the multiple operation widgets, acquires a prediction result, and adjusts the visibility of the second operation widget if the operation widget to be used indicated by the prediction result is the first operation widget, and the visibility of the second operation widget after the adjustment is lower than the visibility of the first operation widget. Here, the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0128] In some embodiments, the number of operation widgets is more than one. The second display module 5532 determines a similar history virtual scene of the virtual scene for the virtual object, a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold, and determines a first operation widget having a usage frequency less than a frequency threshold when adjusting content in the similar history virtual scene, adjusts a visibility of the first operation widget, and the visibility of the first operation widget after the adjustment is less than a visibility of the second operation widget, where the second operation widget is an operation widget other than the first operation widget among the multiple operation widgets.

[0129] In some embodiments, the first display module 5531 displays an information intelligent display switch of the virtual scene, and controls the information display mode of the virtual scene to the information intelligent display mode in response to an on command for the information intelligent display switch. In response, the second display module 5532 adjusts the visibility of the scene auxiliary information when adjusting the content when the information display mode of the virtual scene is the information intelligent display mode.

[0130] In some embodiments, the second display module 5532 displays a display function item for the scene auxiliary information and restores the visibility of the scene auxiliary information when a trigger operation on the display function item is received.

[0131] In some embodiments, the scene auxiliary information includes a plurality of auxiliary information. The first display module 5531 displays a selection widget for each auxiliary information, and in response to a selection operation on the target auxiliary information triggered based on the selection widget, determines the target auxiliary information as the scene auxiliary information to be displayed when adjusting the content. In response, the second display module 5532 adjusts the visibility of the auxiliary information other than the target auxiliary information among the plurality of auxiliary information.

[0132] In some embodiments, the scene auxiliary information has a display state for instructing the scene auxiliary information to be displayed and a hidden state for instructing the scene auxiliary information to be hidden. The first display module 5531 controls the scene auxiliary information of the virtual scene to be in the display state. In response, the second display module 5532 controls the scene auxiliary information to be adjusted from the display state to the hidden state.

[0133] According to the above embodiment of the present invention, scene auxiliary information of a virtual scene and an operation widget for controlling the operation of a virtual object in the virtual scene are displayed, and when a field of view adjustment operation is received, the contents in the field of view of the virtual object are adjusted in the virtual scene, and when adjusting the contents, the visibility of the scene auxiliary information is adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget, and when the field of view adjustment operation is completed, the visibility of the scene auxiliary information is restored. In this way, when a control operation is performed in the virtual scene, the visibility of the scene auxiliary information can be adjusted so that the visibility of the scene auxiliary information is lower than the visibility of the operation widget. (1) The complexity of the information display can be reduced, and the utilization rate of display resources can be improved. (2) The user can be drawn to the operation widget and the virtual scene itself, and the user can quickly control the operation of the virtual object based on the operation widget, thereby improving the efficiency of human-computer interaction and the utilization rate of hardware processing resources.

[0134] An embodiment of the present invention further provides a computer program or computer program product including computer-executable instructions or a computer program stored in a computer-readable storage medium, wherein a processor of an electronic device reads the computer-executable instructions or the computer program from the computer-readable storage medium, and the processor executes the computer-executable instructions or the computer program to cause the electronic device to perform the above-mentioned method for displaying information of a virtual scene according to an embodiment of the present invention.

[0135] An embodiment of the present invention further provides a computer-readable storage medium having stored thereon computer-executable instructions which, when executed by a processor, perform the above-described method for displaying information of a virtual scene according to an embodiment of the present invention.

[0136] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM, or may be any device including one or any combination of the above memories.

[0137] In some embodiments, the computer-executable instructions may be created in any type of programming language (including compiled or interpreted languages, or declarative or procedural languages) in the form of a program, software, software module, script or code, and may be implemented in any form, for example as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0138] As an example, the executable instructions may correspond to a file in a file system or may be stored as part of a file for holding other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program being referenced, or in multiple cooperating files (e.g., files for storing one or more modules, subprograms, or code sections).

[0139] As an example, the computer-executable instructions may be implemented and executed on a single electronic device, may be executed on multiple electronic devices located at a single location, or may be executed on multiple electronic devices distributed at multiple locations and interconnected via a communications network.

[0140] The above only describes the exemplary embodiments of the present invention, and does not limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention are included within the protection scope of the present invention.

Claims

1. 1. A method for displaying information about a virtual scene, the method comprising: displaying scene auxiliary information of the virtual scene and displaying control widgets of the virtual scene, the control widgets being used to control a motion of a virtual object in the virtual scene; adjusting a content in the field of view of the virtual object in the virtual scene in response to a field of view adjustment operation, and adjusting a visibility of the scene auxiliary information when adjusting the content, wherein the visibility of the scene auxiliary information after the adjustment is lower than a visibility of the operation widget; and restoring visibility of the scene aid information when the field of view adjustment operation is completed.

2. receiving a slide operation performed in the virtual scene interface, the slide operation being used to adjust content in a field of view of the virtual object by sliding content of the virtual scene displayed in the interface; The method of claim 1 , further comprising: determining the slide operation as the field of view adjustment operation.

3. displaying a turning widget for controlling an orientation of the virtual object; The method of claim 1 , further comprising: accepting a turning operation on the virtual object triggered based on the turning widget; and determining the turning operation as the field of view adjustment operation.

4. The step of displaying scene auxiliary information of the virtual scene and displaying an operation widget of the virtual scene includes: using a first display layer of view layers to display scene auxiliary information of the virtual scene, and using a second display layer separate from the first display layer to display manipulation widgets of the virtual scene; The method of claim 1 , wherein the scene auxiliary information includes at least one of presentation information presenting an event or state in the virtual scene and entry information of an auxiliary function of the virtual scene.

5. The step of displaying an operation widget for the virtual scene includes: displaying a manipulation widget of the virtual scene with a predetermined transparency; The step of adjusting the visibility of the scene auxiliary information includes: The method of claim 1 , further comprising adjusting a transparency of the scene auxiliary information to a target transparency that is higher than the predetermined transparency.

6. the scene auxiliary information includes presentation type auxiliary information and non-presentation type auxiliary information; The step of displaying scene auxiliary information of the virtual scene includes: displaying the presentation type auxiliary information and the non-presentation type auxiliary information; The step of restoring the visibility of the scene auxiliary information includes: The method of claim 1 , further comprising the step of: restoring visibility of the non-presentation type of auxiliary information.

7. The scene auxiliary information includes a plurality of auxiliary information, The step of adjusting the visibility of the scene auxiliary information includes: acquiring scene data of the virtual scene and interaction data of the virtual object; Invoking a first neural network model based on the scene data and the interaction data to predict auxiliary information to be adjusted among the plurality of auxiliary information, and obtaining a prediction result; and adjusting visibility of auxiliary information indicated by the prediction result.

8. The scene auxiliary information includes a plurality of auxiliary information, The step of adjusting the visibility of the scene auxiliary information includes: determining a similar history virtual scene of the virtual scene for the virtual object, wherein a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold; obtaining usage data for the scene auxiliary information in adjusting the content in the similarity history virtual scene; determining a target auxiliary information to be adjusted from the plurality of auxiliary information based on the usage data, and adjusting visibility of the target auxiliary information.

9. the number of the operation widgets is more than one; After adjusting the visibility of the scene auxiliary information, acquiring interaction data of the virtual object and scene data of the virtual scene; Invoking a second neural network model based on the interaction data and the scene data to predict an operation widget to be used among the plurality of operation widgets, and obtaining a prediction result; and if the operation widget to be used is a first operation widget, adjusting the visibility of a second operation widget, the visibility of the second operation widget after the adjustment is lower than the visibility of the first operation widget; The method of claim 1 , wherein the second operation widget is an operation widget other than the first operation widget of the plurality of operation widgets.

10. the number of the operation widgets is more than one; After adjusting the visibility of the scene auxiliary information, determining a similar history virtual scene of the virtual scene for the virtual object, wherein a similarity between the similar history virtual scene and the virtual scene is greater than a similarity threshold; determining a first control widget that is used less frequently than a frequency threshold when adjusting the content in the similar historical virtual scene; adjusting the visibility of the first operation widget, the visibility of the first operation widget being lower than the visibility of the second operation widget; The method of claim 1 , wherein the second operation widget is an operation widget other than the first operation widget of the plurality of operation widgets.

11. displaying the virtual scene information intelligent display switch; and controlling an information display mode of the virtual scene to an information intelligent display mode in response to an ON command for the information intelligent display switch; The step of adjusting the visibility of the scene auxiliary information when adjusting the content includes: The method of claim 1 , further comprising: adjusting visibility of the scene auxiliary information when adjusting the content, if an information display mode of the virtual scene is the information intelligent display mode.

12. After adjusting the visibility of the scene auxiliary information, displaying a display function item for the scene auxiliary information; The method according to claim 1 , further comprising: restoring visibility of the scene auxiliary information when a trigger operation on the display function item is received.

13. The scene auxiliary information includes a plurality of auxiliary information, displaying a selection widget for each of the auxiliary information; In response to a selection operation on the target auxiliary information triggered based on the selection widget, determining the target auxiliary information as scene auxiliary information to be displayed when adjusting the content, The step of adjusting the visibility of the scene auxiliary information includes: The method of claim 1 , further comprising adjusting visibility of auxiliary information of the plurality of auxiliary information other than the target auxiliary information.

14. the scene support information has a display state for instructing to display the scene support information and a non-display state for instructing to not display the scene support information, The step of displaying scene auxiliary information of the virtual scene includes: controlling scene auxiliary information of the virtual scene to be in the displayed state; The step of adjusting the visibility of the scene auxiliary information includes: The method of claim 1 , further comprising controlling the scene auxiliary information to be adjusted from the displayed state to the non-displayed state.

15. 1. An information display device for a virtual scene, comprising: a first display module for displaying scene auxiliary information of the virtual scene and displaying an operation widget of the virtual scene, the operation widget being used to control a motion of a virtual object in the virtual scene; a second display module that adjusts a content in the field of view of the virtual object in the virtual scene in response to a field of view adjustment operation, and adjusts a visibility of the scene auxiliary information when adjusting the content, wherein the visibility of the scene auxiliary information after the adjustment is lower than a visibility of the operation widget; and a third display module that restores visibility of the scene auxiliary information when the field of view adjustment operation is terminated.

16. A memory having computer executable instructions stored thereon; and a processor which, when executing computer-executable instructions stored in the memory, implements the method for displaying information about a virtual scene according to any one of claims 1 to 14.

17. A computer program comprising computer executable instructions which, when executed by a processor, implements a method for displaying information about a virtual scene according to any of the preceding claims.

Citation Information

Patent Citations

  • Virtual map display method and device, electronic equipment and readable storage medium

    CN113101635A

  • Virtual object display method and device, storage medium and electronic equipment

    CN113827962A

  • Method, apparatus, and recording medium for performance game

    JP2011245307A

  • Computer programs and computer devices

    JP5775468B2

  • Processing device, program, and method

    JP6881871B1