Information processing method, device, equipment, and computer program in a virtual environment
By dynamically adjusting HUD controls in virtual environments based on character states, the method enhances interaction and user understanding, addressing the limitations of static HUD displays in existing technologies.
Patent Information
- Application Number
- JP2024532540
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-06-23
- Filing Date
- 2023-04-28
- Publication Date
- 2024-12-03
AI Technical Summary
Existing virtual environment interfaces in games display HUD controls statically and uniformly, lacking dynamic adjustment based on character states, which hinders effective human-computer interaction and user understanding of character conditions.
The method involves displaying HUD controls with adjustable perspective angles based on the character's state, simulating real-world effects such as wind resistance, to enhance interaction and user understanding.
This approach improves human-computer interaction efficiency and user experience by providing a more immersive and informative display of character states through dynamic HUD adjustments.
Smart Images

Figure 2024544648000001_ABST
Abstract
Description
[Technical field]
[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to a Chinese patent application filed with the China Patent Office on June 23, 2022, bearing application number 202210719002.0 and entitled "Method, device, equipment and program product for displaying information in a virtual environment," the entire contents of which are incorporated herein by reference.
[0002] TECHNICAL FIELD Embodiments of the present application relate to the field of graphical user interfaces, and in particular to a method, apparatus, device and program product for processing information in a virtual environment. [Background technology]
[0003] A user can control a game character in a game program to compete in a match. The game program provides a virtual environment, and the game character is a virtual character that exists in the virtual environment.
[0004] The terminal displays a virtual environment screen and a head-up display (HUD) control. The virtual environment screen is a screen obtained by observing the virtual world from the viewpoint of a current virtual character, and the HUD control is a screen that displays relevant information in a game and is usually displayed on top of the virtual environment screen. In the related technology, when the virtual character moves in the virtual environment, the user can obtain state information of the virtual character through the virtual environment screen and the HUD control.
[0005] However, in the related art, HUD controls are stationary and float above the virtual environment screen, and the method of displaying information is relatively uniform. Summary of the Invention [Means for solving the problem]
[0006] The present application provides an information processing method, device, equipment and program product in a virtual environment, which adjusts different perspective angles according to different character states to display HUD controls.
[0007] According to one aspect of the present application, there is provided an information processing method in a virtual environment, the method being executed by a terminal, the method comprising: displaying a virtual environment view and a head-up display (HUD) control, the virtual environment view displaying a virtual environment and the HUD control displaying user interface (UI) information necessary to control a virtual character; controlling the virtual character to act in the virtual environment; and displaying the HUD control with different perspective angles based on a character state of the virtual character, the perspective angles being angles between the HUD control and an imaging plane of the virtual environment screen.
[0008] According to one aspect of the present application, there is provided an information processing apparatus in a virtual environment, the apparatus comprising: a display module; and a control module; the display module is configured to display a virtual environment screen and a head-up display (HUD) control, the virtual environment screen displaying a virtual environment and the HUD control displaying user interface (UI) information required to control a virtual character; the control module is configured to control the virtual character to act in the virtual environment; The display module is further configured to display the HUD control with different perspective angles based on a character state of the virtual character, the perspective angle being an angle between the HUD control and an imaging plane of the virtual environment screen.
[0009] According to another aspect of the present application, there is provided a computer device comprising a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to realize the information processing method in a virtual environment described in the above aspect.
[0010] According to another aspect of the present application, a computer storage medium is provided, the computer-readable storage medium having at least one computer program stored therein, the at least one computer program being loaded and executed by a processor to realize the information processing method in a virtual environment described in the above aspect.
[0011] According to another aspect of the present application, there is provided a computer program product, the computer program product including a computer program, the computer program being stored in a computer-readable storage medium, the computer program being read and executed by a processor of a computing device, causing the computing device to perform the information processing method in a virtual environment described in the above aspect.
[0012] The technical solution provided in this application has at least the following beneficial effects:
[0013] According to the information processing method in a virtual environment provided by the present application, a virtual environment screen and a head-up display (HUD) control are displayed, and the HUD control with different perspective angles is displayed based on the character state when the virtual character is active in the virtual environment. The present application provides a new information display method that associates the information display method of the HUD control with the character state of the virtual character and displays the HUD control with different perspective angles, thereby assisting a user in determining the character state of the virtual character according to the perspective angle. By displaying the HUD control, the HUD display effect in the real world is simulated, and the change in the perspective angle imitates the deformation of the lens caused by the influence of wind resistance when the HUD is projected onto the lens in the real world. For example, when a motorcycle accelerates while moving in the real world, the windshield of the motorcycle is the HUD projection lens, and deformation occurs due to the influence of air resistance. The perspective angle simulates the change in the viewing angle of the HUD projection lens caused by the influence of wind resistance in the real world on the terminal, providing a more detailed simulation effect on the real world and improving the efficiency of human-computer interaction. [Brief description of the drawings]
[0014] [Figure 1] 1 is a schematic diagram of a method for processing information in a virtual environment according to an exemplary embodiment of the present application; [Diagram 2] FIG. 1 is a block diagram showing a configuration of a computer system according to an exemplary embodiment of the present application. [Diagram 3] 1 is a flowchart of a method for processing information in a virtual environment according to an exemplary embodiment of the present application. [Figure 4] FIG. 2 is a schematic diagram illustrating a conversion process from a three-dimensional space to a two-dimensional image according to an exemplary embodiment of the present application. [Diagram 5] 1 is a flowchart of a method for processing information in a virtual environment according to an exemplary embodiment of the present application. [Figure 6] FIG. 2 is a schematic diagram showing a HUD control display at different perspective angles according to an exemplary embodiment of the present application; [Figure 7] FIG. 2 is a schematic diagram of an information processing interface in a virtual environment according to an exemplary embodiment of the present application. [Figure 8] FIG. 2 is a schematic diagram showing a HUD control display at different perspective angles according to an exemplary embodiment of the present application; [Figure 9] FIG. 2 is a schematic diagram of an information processing interface in a virtual environment according to an exemplary embodiment of the present application. [Figure 10] FIG. 2 is a schematic diagram showing a HUD control display at different perspective angles according to an exemplary embodiment of the present application; [Figure 11] FIG. 13 is a schematic diagram of HUD controls for different regions according to an exemplary embodiment of the present application. [Figure 12] FIG. 2 is a schematic diagram of a right side HUD area according to an exemplary embodiment of the present application. [Figure 13] FIG. 2 is a schematic diagram of an upper HUD area according to an exemplary embodiment of the present application. [Figure 14] FIG. 2 is a schematic diagram of a lower HUD area according to an exemplary embodiment of the present application. [Figure 15] FIG. 2 is a schematic diagram of a left HUD area according to an exemplary embodiment of the present application. [Figure 16] FIG. 2 is a block diagram showing a configuration of an information processing terminal in a virtual environment according to an exemplary embodiment of the present application. [Figure 17] FIG. 2 is a block diagram of an information processing device in a virtual environment according to an exemplary embodiment of the present application. [Figure 18] FIG. 2 is a schematic diagram illustrating a configuration of computer devices in a virtual environment according to an exemplary embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] First, the terms used in the embodiments of the present application will be explained.
[0016] Virtual environment: A virtual environment that is displayed (or provided) when an application is executed on a terminal. The virtual environment may be a simulation of the real world, a semi-simulated, semi-fictional 3D world, or a completely fictional 3D world. The virtual environment may be one of a 2D virtual environment, a 2.5D virtual environment, or a 3D virtual environment.
[0017] Virtual character: an actionable object in a virtual environment. The actionable object may be at least one of a virtual animal, an animated character. Optionally, when the virtual environment is a three-dimensional virtual environment, the virtual characters may be three-dimensional virtual models, each of which has its own shape and volume in the three-dimensional virtual environment and occupies a part of the space of the three-dimensional virtual environment. Optionally, the virtual characters are three-dimensional characters constructed based on three-dimensional human skeleton technology, and the virtual characters achieve different appearances by wearing different skins. In some implementations, the virtual characters may also be implemented by adopting a 2.5-dimensional or two-dimensional model, and the embodiments of the present application are not limited thereto.
[0018] Heads-up Display (HUD) control: A screen that displays relevant information in a game, usually displayed on top of the virtual environment screen. HUD controls are the most effective way for the game world to interact with the player, and any element that can visually convey information to the player can be called a HUD. Common HUD controls include operation controls, toolbars, maps, ammunition tanks, blood tanks, sights, etc. Heads-up display controls are also called heads-up display controls.
[0019] The embodiments of the present application provide a technical solution for an information processing method in a virtual environment, which can be executed by a terminal or a client on the terminal. As shown in Fig. 1(a), a virtual environment screen 101 and a head-up display (HUD) control 102 are displayed on the terminal.
[0020] Here, the virtual environment screen 101 displays a screen obtained by observing the virtual environment, and the HUD control 102 displays user interface (UI) information required to control the virtual character 103, and the HUD control 102 is usually displayed on the upper layer of the virtual environment screen 101. The terminal displays the HUD control 102 with different perspective angles based on the character state of the virtual character 103 in the virtual environment.
[0021] The perspective angle is the angle between the HUD control 102 and the imaging plane of the virtual environment screen 101.
[0022] Optionally, the HUD controls 102 include state information and operation controls for the virtual character 103, but are not limited thereto, and embodiments of the present application are not specifically limited thereto.
[0023] Exemplarily, when the virtual character 103 is in the virtual environment in a first state, the terminal displays the HUD control 102 at a first perspective angle, and when the virtual character 103 is in the virtual environment in a second state, the terminal displays the HUD control 102 at a second perspective angle. As shown in FIG. 1(b), in response to the character state of the virtual character 103 changing from the first state to the second state, the terminal changes the perspective angle of the HUD control 102 from the first perspective angle to the second perspective angle, where the first perspective angle corresponds to the first state and the second perspective angle corresponds to the second state.
[0024] Optionally, the first state is a walking state, and the second state is a running state. In response to the character state of the virtual character 103 changing from the walking state to the running state, the terminal changes the perspective angle of the HUD control 102 from the first perspective angle to the second perspective angle, the second perspective angle being greater than the first perspective angle. For example, when the virtual character 103 is in the walking state, the first perspective angle corresponding to the HUD control 102 is 5°, when the virtual character 103 is in the running state, the second perspective angle corresponding to the HUD control 102 is 30°, and when the virtual character 103 switches from the walking state to the running state, the perspective angle of the HUD control 102 switches from 5° to 30°.
[0025] Illustratively, the terminal changes the perspective angle of the HUD control 102 in response to a change in an attribute parameter of the character state of the virtual character 103 .
[0026] Optionally, the terminal increases the perspective angle of the HUD control 102 in response to an increase in the velocity or acceleration of the virtual character 103 in the virtual environment. The terminal decreases the perspective angle of the HUD control 102 in response to a decrease in the velocity or acceleration of the virtual character 103 in the virtual environment. For example, if the virtual character 103 is parachuting or flying, the terminal increases the perspective angle of the HUD control 102 in response to an increase in the velocity or acceleration of the virtual character 103 in the virtual environment.
[0027] Illustratively, the terminal displays the HUD control 102 with a dynamically changing perspective angle in response to the character state of the virtual character 103 being in a third state; The dynamically changing perspective angle falls within a third perspective angle range corresponding to a third state.
[0028] Optionally, the third state is an attacked state, and the terminal displays the HUD control 102 at a perspective angle that periodically swings and changes in response to the character state of the virtual character 103 in the virtual environment being attacked.
[0029] For example, when the virtual character 103 is under attack in the virtual environment, the terminal dynamically displays the HUD control 102 within a third perspective angle range, and when the virtual character 103 is under attack, for example, the third perspective angle range is 0 to 30°, and the HUD control 102 is displayed while dynamically changing between 0 to 30°.
[0030] In one possible implementation, the HUD control 102 includes a manipulation control, and the terminal displays the HUD control 102 with different perspective angles in response to triggering of the manipulation control.
[0031] Illustratively, the operational control includes a first type of operational control, and in response to a trigger operation of the first type of operational control, the terminal changes the perspective angle of the HUD control 102 to a corresponding perspective angle after triggering the first type of operational control.
[0032] Illustratively, the operational control includes a second type of operational control, and the terminal displays the HUD control 102 with a dynamically changing perspective angle in response to a trigger operation of the second type of operational control, the dynamically changing perspective angle being within a perspective angle range corresponding to the second type of operational control.
[0033] As described above, the method provided in this embodiment displays a virtual environment screen and a head-up display (HUD) control, controls a virtual character to act in the virtual environment, and displays the HUD control with different perspective angles based on the character state of the virtual character. The present application provides a new information display method, associates the information display method of the HUD control with the character state of the virtual character, and displays the HUD control with different perspective angles, thereby helping the user determine the character state of the virtual character according to the perspective angle, improving the efficiency of human-computer interaction and improving the user experience.
[0034] 2 is a block diagram showing a configuration of a computer system according to an exemplary embodiment of the present application. The computer system 100 includes a first terminal 110, a server 120, and a second terminal .
[0035] A client 111 supporting a virtual environment is installed and executed in the first terminal 110, and the client 111 may be a multiplayer online battle program. When the first terminal executes the client 111, a user interface of the client 111 is displayed on the screen of the first terminal 110. The client 111 may be any one of a battle royal shooting game, a virtual reality (VR) application, an augmented reality (AR) program, a three-dimensional map program, a virtual reality game, an augmented reality game, a first-person shooting game (FPS), a third-person shooting game (TPS), a multiplayer online battle arena game (MOBA), and a simulation game (SLG). In this embodiment, the client 111 is an MOBA game as an example. The first terminal 110 is a terminal used by the first user 112, and the first user 112 uses the first terminal 110 to control the actions of a first virtual character located in a virtual environment, and the first virtual character can be called a virtual character of the first user 112. The first user 112 can perform operations such as assembly, disassembly, and uninstallation on virtual items owned by the first virtual character, but the present application is not limited thereto. Exemplarily, the first virtual character is a first virtual character such as a pseudo character or an animated character.
[0036] A client 131 supporting a virtual environment is installed and executed on the second terminal 130, and the client 131 may be a multiplayer online battle program. When the second terminal 130 executes the client 131, a user interface of the client 131 is displayed on the screen of the second terminal 130. The client may be any one of a battle royal shooting game, a VR application, an AR program, a 3D map program, a virtual reality game, an augmented reality game, an FPS, a TPS, a MOBA, and a SLG, and in this embodiment, the client is an MOBA game as an example. The second terminal 130 is a terminal used by a second user 113, and the second user 113 uses the second terminal 130 to control a second virtual character located in a virtual environment to be active, and the second virtual character may be called a virtual character of the second user 113. Exemplarily, the second virtual character may be a second virtual character such as a simulated character or an animated character. Optionally, the first virtual character and the second virtual character are in the same virtual environment. Optionally, the first virtual character and the second virtual character belong to the same faction, team, organization, have a companion relationship, have temporary communication rights, etc. Optionally, the first virtual character and the second virtual character belong to different factions, teams, organizations, or are enemies.
[0037] Optionally, the client installed on the first terminal 110 and the second terminal 130 is the same, or the client installed on the two terminals is the same type of client on different operating system platforms (Android or IOS). The first terminal 110 can generally refer to one of the multiple terminals, and the second terminal 130 can generally refer to another terminal of the multiple terminals, and in this embodiment, only the first terminal 110 and the second terminal 130 are described as examples. The device types of the first terminal 110 and the second terminal 130 are the same or different, and the device types include at least one of a smartphone, a tablet, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a desktop computer. Although only two terminals are shown in FIG. 2, in different embodiments, there are multiple other terminals 140 that can access the server 120. Optionally, there are also one or more terminals 140 which are developer-enabled terminals having a client development and editing platform that supports a virtual environment installed, and the developer edits and updates the client on the terminal 140 and sends the updated client installation package to the server 120 via a wired or wireless network, and the first terminal 110 and the second terminal 130 can download the client installation package from the server 120 to realize the client update.
[0038] The first terminal 110, the second terminal 130, and the other terminals 140 are connected to the server 120 via a wireless network or a wired network. The server 120 includes at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The server 120 provides back-end services to clients supporting a three-dimensional virtual environment. Optionally, the server 120 is responsible for primary computing tasks, and the terminals are responsible for secondary computing tasks, or the server 120 is responsible for secondary computing tasks, and the terminals are responsible for main computing tasks, or a distributed computing architecture is adopted between the server 120 and the terminals to perform collaborative computing.
[0039] In one illustrative example, the server 120 includes a processor 122, a user account database 123, a match service module 124, and a user-facing input / output interface (I / O interface) 125. Here, the processor 122 loads instructions stored in the server 120 and processes data in the user account database 123 and the match service module 124, the user account database 123 stores data of the user account used by the first terminal 110, the second terminal 130, and the other terminals 140, such as the avatar of the user account, the nickname of the user account, the combat power index of the user account, the service area where the user account is located, etc., the match service module 124 provides a plurality of match rooms, such as 1V1 match, 3V3 match, 5V5 match, etc., for users to match up, and the user-facing I / O interface 125 establishes communication for exchanging data with the first terminal 110 and / or the second terminal 130 via a wireless network or a wired network.
[0040] 3 is a flowchart of an information processing method in a virtual environment according to an exemplary embodiment of the present application. The method can be executed by a terminal or a client on a terminal in the system shown in FIG. 2. The method includes the following steps:
[0041] In step 302, a virtual environment screen and head-up display (HUD) controls are displayed.
[0042] The virtual environment screen displays a screen obtained by observing the virtual environment, and the HUD controls display user interface (UI) information required to control the virtual character. Optionally, the HUD controls include, but are not limited to, navigation controls, toolbars, maps, ammunition tanks, blood tanks, sights, etc., and embodiments of the present application are not limited thereto.
[0043] Optionally, the HUD control is displayed floating on top of the virtual environment screen, or the HUD control is displayed floating on top of the virtual environment screen with a default perspective angle, where the default perspective angle is determined according to a current character state of the virtual character, or the HUD control is displayed floating on top of the virtual environment screen with a dynamic perspective angle, but this is not limited thereto, and the embodiment of the present application is not specifically limited thereto.
[0044] Optionally, the virtual environment screen is a screen obtained by observing the virtual environment, and an imaging plane of the virtual environment screen is formed by obtaining model information of a three-dimensional virtual model of the virtual environment and rendering the three-dimensional virtual model as a screenshot.
[0045] The perspective angle is the angle between the HUD controls and the imaging plane of the virtual environment screen.
[0046] Optionally, the perspective angle refers to an angle between a single HUD control and an imaging plane of the virtual environment screen, or the perspective angle refers to an angle between a plane on which all HUD controls are located and an imaging plane of the virtual environment screen, or the perspective angle refers to an angle between a plane on which HUD controls included in a certain area are located and an imaging plane of the virtual environment screen, but is not limited thereto. The virtual environment is an environment in which a virtual character is placed in the virtual world during execution of an application in the terminal. Optionally, in an embodiment of the present application, the virtual character is observed in the virtual world by a camera model.
[0047] Optionally, the camera model performs auto-tracking with respect to the virtual character in the virtual world. That is, when the position of the virtual character in the virtual world changes, the camera model simultaneously changes to track the position of the virtual character in the virtual world, and the camera model is always within a predetermined distance range of the virtual character in the virtual world. Optionally, during auto-tracking, the relative positions of the camera model and the virtual character do not change. In one example, the imaging plane is a plane perpendicular to the shooting direction of the camera model, for example, when the camera model shoots from a bird's-eye view with a third-person perspective, the imaging plane is a horizontal plane in the virtual environment, and when the camera model shoots head-up with a first-person perspective, the imaging plane is parallel to the vertical direction. The horizontal plane is a plane perpendicular to the simulated gravity direction in the virtual environment, and the vertical direction is parallel to the simulated gravity direction in the virtual environment. Exemplarily, the camera model is also called a virtual camera, the shooting direction pointed by the camera model is perpendicular to the imaging plane, and the imaging plane is usually rectangular, also called an imaging rectangle. The virtual photoreceptor on the imaging plane corresponds one-to-one to the pixels on the screen of the terminal, and the virtual photoreceptor records the light intensity and color when observing a virtual character through the camera model. For example, the camera model is a model used to observe a virtual world in computer graphics. For an introduction to the camera model, please refer to the book "Game Engine Architecture (2nd Edition)" (translated by Ye Jinsong) by Jason Gregory (USA) published in February 2019, in which you can refer to, but are not limited to, Chapter 10, Section 10.1 "Basics of Triangle Rasterization Using Depth Buffer", especially Section 10.1.4 "Virtual Camera". In addition, please refer to the book "Unity 5.X from Introduction to Mastery" (edited by Unity Software (Shanghai) Co. Ltd.) published by China Railway Publishing House in January 2016, in which you can refer to, but are not limited to, the contents related to the camera in the basic 3D game scene in Chapter 6.
[0048] The camera model is a three-dimensional model located around a virtual character in a virtual world. When a first-person viewpoint is adopted, the camera model is located near the head of the virtual character or is located at the head of the virtual character. When a third-person viewpoint is adopted, the camera model is located behind the virtual character and may be bound to the virtual character or may be located at any position that is a predetermined distance away from the virtual character, and the camera model allows the virtual character located in the virtual world to be observed from different viewing angles. Optionally, when the third-person viewpoint is a first-person over-the-shoulder viewpoint, the camera model is located behind the virtual character (e.g., the head and shoulders of the virtual character). Optionally, in addition to the first-person viewpoint and the third-person viewpoint, the viewpoint also includes other viewpoints such as an overhead viewpoint, and when an overhead viewpoint is adopted, the camera model may be located in the air above the head of the virtual character, and the overhead viewpoint is a viewpoint for observing the virtual world from an overhead viewing angle from the air. Optionally, the camera model is not actually displayed in the virtual world. That is, the camera model is not displayed in the virtual world displayed in the user interface.
[0049] A case where the camera model is located at an arbitrary position that is a predetermined distance away from the virtual character will be described as an example. Optionally, one virtual character corresponds to one camera model, and the camera model can rotate around the virtual character as a rotation center, for example, the camera model is rotated around an arbitrary point of the virtual character as a rotation center, and the camera model not only rotates in terms of visual angle but also has a displacement deviation during rotation, and the distance between the camera model and the rotation center does not change during rotation. That is, the camera model rotates on a spherical surface with the rotation center as the center of the sphere, and the arbitrary point of the virtual character may be the head, torso, or any point around the virtual character, and the embodiment of the present application is not limited thereto. Optionally, when the camera model observes the virtual character, the center of the viewpoint of the camera model points in the direction in which the point on the spherical surface where the camera model is located points to the center of the sphere. Optionally, the camera model can also observe the virtual character at a predetermined visual angle in different directions of the virtual character.
[0050] In step 304, the virtual character is controlled to act in the virtual environment.
[0051] The virtual character is a virtual character controlled by an account logged into the terminal. The object controls the virtual character to perform an activity in the virtual environment by using the operation control, and the object can control the virtual character to perform an activity by pressing one or more buttons of the operation control. The activity includes at least one of adjusting a body posture, walking, running, jumping, riding, driving, aiming, picking up, using a throwing tool, etc., but the embodiment of the present application is not limited thereto.
[0052] Optionally, the object can be controlled to make the virtual character release a skill or use an item by pressing one or more buttons of the operation control. The object can also control the virtual character by a signal generated by long pressing, clicking, double clicking and / or sliding on the touch screen. Optionally, the manner of controlling the activity of the virtual character includes: the object controls the activity of the virtual character through at least one of a virtual remote lever, a virtual switch and a virtual button on the terminal interface; the object controls the activity of the virtual character through an external device (such as a steering wheel, VR glasses, VR helmet, etc.) connected to the terminal; the object controls the activity of the virtual character by voice; and the object controls the activity of the virtual character by tactile manipulation. The present application is not specifically limited to the manner of controlling the activity of the virtual character. Exemplarily, the HUD control is used to display user interface (UI) information required to control the virtual character, and the HUD control may be used to control the activity of the virtual character and may be used to display at least one information of the virtual environment, the virtual object in the virtual environment, and the virtual character in the virtual environment. The present embodiment is not limited thereto.
[0053] In step 306, a HUD control is displayed with different perspective angles based on the character state of the virtual character.
[0054] The perspective angle is the angle between the HUD controls and the imaging plane of the virtual environment screen.
[0055] A character state refers to a state of a virtual character in a virtual environment, such as, but not limited to, a walking state, a running state, or a state being attacked, and the embodiments of the present application do not specifically limit this. Optionally, a character state refers to a state associated with a virtual character, or a character state refers to a state that appears when a virtual character interacts with other virtual characters or virtual items in a virtual environment, or a character state refers to, but is not limited to, a motion state, a health state, or a level state of the virtual character itself.
[0056] The terminal displays HUD controls having different perspective angles on the terminal based on changes in the character state of the virtual character. Specifically, when the character state of the virtual character is a first state, a HUD control having a first perspective angle is displayed, and when the character state of the virtual character is a second state, a HUD control having a second perspective angle is displayed, where the first state and the second state are different character states. When the character state of the virtual character is the first state, the multiple HUD controls can have the same or different perspective angles.
[0057] In addition, the present application displays HUD controls with different perspective angles based on the character state of the virtual character, and allows the user to obtain at least one of the virtual character's movement speed and acceleration information by observing the HUD controls, thereby providing an accurate simulation of the real world. When the HUD controls are displayed through a transparent plate made of a material such as plastic, the display effect of the transparent plate being affected by air resistance during movement is simulated, providing a better simulation effect of the real world.
[0058] As described above, the method of the present embodiment displays a virtual environment screen and a head-up display (HUD) control, and displays the HUD control with different perspective angles based on the character state when the virtual character is active in the virtual environment. The present application provides a new information display method, associates the information display method of the HUD control with the character state of the virtual character, and displays the HUD control with different perspective angles to help the user determine the character state of the virtual character according to the perspective angle, and simulates the HUD display effect in the real world by displaying the HUD control, and the change in the perspective angle imitates the deformation of the lens caused by the influence of wind resistance when the HUD is projected onto the lens in the real world. For example, when a motorcycle accelerates while moving in the real world, the windshield of the motorcycle is the HUD projection lens, and deformation occurs due to the influence of air resistance. The perspective angle simulates the change in the viewing angle of the HUD projection lens caused by the influence of wind resistance in the real world on the terminal, providing a more detailed simulation effect on the real world and improving the efficiency of human-computer interaction.
[0059] In one implementation, the virtual environment is an environment in which a virtual character is placed in a virtual world during execution of an application in a terminal, the virtual environment being a three-dimensional space, the world space coordinate system being used to describe the coordinates of three-dimensional models in the virtual environment within the same scene, the three-dimensional models being objects in the virtual environment.
[0060] For example, the world space coordinate system is obtained by transforming a three-dimensional model in a model space coordinate system via a model transformation matrix, and the model space coordinate system is used to indicate the position information of the three-dimensional model, and the coordinate information of each three-dimensional model in the model space coordinate system is unified into the world space coordinate system in the three-dimensional space via the model transformation matrix.
[0061] Exemplarily, a three-dimensional model in a world space coordinate system is transformed into a camera space coordinate system via a view matrix, and the camera space coordinate system is used to describe the coordinates of the three-dimensional model observed through the camera model. For example, with the position of the camera model as the coordinate origin, the three-dimensional model in the camera space coordinate system is transformed into a crop space coordinate system via a projection matrix, and the crop space coordinate system is used to describe the projection of the three-dimensional model in the viewing cone of the camera model. A general perspective projection matrix (a type of projection matrix) is used to project the three-dimensional model into a model that conforms to the human eye observation rule of "near large far small". Exemplarily, the above model transformation matrix, view matrix, and projection matrix are usually collectively referred to as a model view projection (MVP) matrix.
[0062] FIG. 4 is a schematic diagram showing a conversion process from a three-dimensional space to a two-dimensional image according to an exemplary embodiment of the present application. Referring to FIG. 4, a process of mapping one feature point P in a three-dimensional space 201 to a feature point p' in an imaging plane 204 (called an image coordinate system or a pixel coordinate system) is shown. The coordinates of the feature point p in the three-dimensional space 201 are in a three-dimensional format, and the coordinates of the feature point p' in the imaging plane 204 are in a two-dimensional format. The three-dimensional space 201 is a three-dimensional space corresponding to a virtual environment. The camera plane 202 is determined by the posture of the camera model, the camera plane 202 is a plane perpendicular to the shooting direction of the camera model, and the imaging plane 204 and the camera plane 202 are parallel to each other. The imaging plane 104 is a plane when the camera model images the virtual environment located within the field of view when observing the virtual environment.
[0063] Furthermore, the perspective angle is used to indicate the angle between the plane 203 on which the HUD control is located and the imaging plane 204, the perspective angle being the angle between the two planes, the angle being the angle of the projection located on the reference plane 205. The plane 203 on which the HUD control is located is the plane of the HUD control displayed on the terminal in the three-dimensional space corresponding to the virtual environment. The imaging plane 204 and the reference plane 205 are in a perpendicular relationship, and the plane 203 on which the HUD control is located and the reference plane 205 are in a perpendicular relationship. The projection of the imaging plane 204 onto the reference plane 205 is a straight line, and the projection of the plane 203 on which the HUD control is located onto the reference plane 205 is also a straight line, the perspective angle being the angle between the two straight lines, the perspective angle being greater than or equal to 0 degrees and less than or equal to 90 degrees. Furthermore, the HUD control displayed on the terminal is obtained by observing the plane 203 on which the HUD control is located via a camera model, and the observation direction of the camera is perpendicular to the imaging plane 204. In the figure, in order to easily show the plane 203 on which the HUD control is located, some edges of the plane are shown with dashed lines, and a rectangular HUD control is displayed on the plane 203 on which the HUD control is located, also shown with dashed lines, and the diagonal of the HUD control is also drawn to avoid confusion with other parts of the figure. In this figure, the reference plane 205 is a horizontal plane in the three-dimensional space 201. It can be understood that as the position of the camera model changes, the reference plane 205 changes to another plane accordingly. In the figure, it is only shown that the reference plane 205 is a horizontal plane in the three-dimensional space 201 at the current camera position, and it can be understood that the reference plane 205 can be another plane parallel to the horizontal plane in the three-dimensional space 201 at the current camera position.
[0064] 5 is a flowchart of an information processing method in a virtual environment according to an exemplary embodiment of the present application. The method can be executed by a terminal or a client on a terminal in the system shown in FIG. 2. The method includes the following steps:
[0065] In step 402, a virtual environment screen and head-up display (HUD) controls are displayed.
[0066] The HUD controls display user interface (UI) information required to control the virtual character. Optionally, the HUD controls include, but are not limited to, operation controls, toolbars, maps, ammunition tanks, blood tanks, sights, etc., and the embodiments of the present application are not limited thereto. Optionally, the virtual environment displayed on the virtual environment screen includes at least one element of a mountain, a plain, a river, a lake, an ocean, a desert, a swamp, quicksand, a sky, a plant, a building, a vehicle, and a person.
[0067] In step 404, the virtual character is controlled to act in the virtual environment.
[0068] The object is to control a virtual character through the operation control to perform an activity in the virtual environment, and the object can control the virtual character to perform an activity by pressing one or more buttons of the operation control, the activity including at least one of walking, running, lying down, jumping, and half squat, but the embodiment of the present application is not limited thereto.
[0069] At step 406, in response to the character state of the virtual character changing from the first state to the second state, the perspective angle of the HUD control is changed from the first perspective angle to a second perspective angle.
[0070] The perspective angle is the angle between the HUD controls and the imaging plane of the virtual environment screen.
[0071] The character state refers to a state of a virtual character in a virtual environment, for example, a walking state, a running state, and a state of being attacked, but is not limited thereto, and the embodiment of the present application does not specifically limit this. In one example, the character state of a virtual character is related to the control of the activity of the virtual character in the virtual environment, for example, controlling the virtual character to run, and the character state of the virtual character changes to a running state. In another example, the character state of a virtual character is related to the control of the activity of the virtual character in the virtual environment, for example, when the virtual character receives a virtual attack, the character state is a state of being attacked, and the state of being attacked is a result of the virtual character receiving the virtual attack and is unrelated to controlling the virtual character to be active. Exemplarily, in response to the change of the character state of the virtual character from a first state to a second state, the terminal changes the perspective angle of the HUD control from a first perspective angle to a second perspective angle, where the first perspective angle corresponds to the first state and the second perspective angle corresponds to the second state.
[0072] Optionally, the first state refers to a state associated with a virtual character, or the first state refers to a state that appears when the virtual character interacts with other virtual characters, virtual items in a virtual environment, or the first state refers to, but is not limited to, a motion state, health state, or level state of the virtual character itself.
[0073] Optionally, the second state refers to a state associated with the virtual character, or the second state refers to a state that appears when the virtual character interacts with other virtual characters, virtual items in the virtual environment, or the second state refers to, but is not limited to, a motion state, health state, or level state of the virtual character itself.
[0074] Optionally, a first perspective angle corresponding to a first state refers to the perspective angle of the HUD control being the first perspective angle when the virtual character is in the first state, and a second perspective angle corresponding to a second state refers to the perspective angle of the HUD control being the second perspective angle when the virtual character is in the second state.
[0075] Optionally, the first state and the second state include at least one of a stationary state, a walking state, a running state, a flying state, a crash state, a parachuting state, a crawling state, a crawling state, a jumping state, and an injured state, but are not limited thereto, and the embodiment of the present application is not specifically limited thereto. Note that, step 402, step 404, and step 406 in this embodiment can be individually implemented by configuring a new embodiment, and the embodiment is not limited thereto.
[0076] Optionally, in an implementation form, the first state in step 406 is a walking state, and the second state is a running state, and step 406 can be implemented as follows. That is, in response to the character state of the virtual character changing from the walking state to the running state, the terminal changes the perspective angle of the HUD control from a first perspective angle to a second perspective angle, and the second perspective angle is greater than the first perspective angle. For example, when the virtual character is in the walking state, the first perspective angle corresponding to the HUD control is 5°, and when the virtual character is in the running state, the second perspective angle corresponding to the HUD control is 30°, and when the virtual character switches from the walking state to the running state, the perspective angle of the HUD control switches from 5° to 30°. For example, FIG. 6 is a schematic diagram showing a HUD control at different perspective angles, and at least one of an operation control, an ammunition tank, a blood volume tank, and virtual character information is shown on the HUD control in the figure. As shown in (a) of FIG. 6, when the virtual character is in a stationary state in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 0°, and as shown in (b) of FIG. 6, when the virtual character is in a walking state in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 5°. When the virtual character switches from a stationary state to a walking state, the perspective angle of the HUD control switches from 0° to 5°. For example, FIG. 7 is a schematic diagram of an information processing interface in a virtual environment, in which a virtual environment screen 601 and a HUD control 602 are displayed on the interface, and as shown in (a) of FIG. 7, when the virtual character 603 is in a stationary state in the virtual environment, the virtual environment screen 601 and a HUD control 602 with a perspective angle of 0° are displayed on the interface, and as shown in (b) of FIG. 7, when the virtual character 603 switches from a stationary state to a walking state, the virtual environment screen 601 and a HUD control 602 with a perspective angle of 5° are displayed on the interface.
[0077] In step 408, the perspective angle of the HUD control is changed in response to a change in the attribute parameters of the virtual character's character state.
[0078] Optionally, the change in the attribute parameter of the character state refers to the attribute parameter of the virtual character in a motion state, such as speed and acceleration, or the change in the attribute parameter of the character state refers to the attribute parameter of the virtual character, such as, but not limited to, ammunition value, life value, blood value and damage value. Note that, step 402, step 404 and step 408 in this embodiment can be implemented separately by configuring a new embodiment, and this embodiment is not limited thereto.
[0079] Optionally, in one implementation, step 408 may be implemented as follows: the terminal increases the perspective angle of the HUD control in response to an increase in the speed or acceleration of the virtual character in the virtual environment.
[0080] Optionally, in one implementation, step 408 may be implemented as follows: the terminal decreases the perspective angle of the HUD control in response to a decrease in the velocity or acceleration of the virtual character in the virtual environment. For example, when the virtual character is parachuting or flying, the terminal increases the perspective angle of the HUD control in response to an increase in the velocity or acceleration of the virtual character in the virtual environment.
[0081] For example, FIG. 8 is a schematic diagram of a HUD control displayed at different perspective angles. At least one of an operation control, an ammunition tank, a blood tank, and virtual character information is shown in the HUD control in the figure. As shown in FIG. 8(a), when the virtual character is in the virtual environment in a walking state and the walking speed is a first speed, the perspective angle of the HUD control displayed on the terminal is 10°, and as shown in FIG. 8(b), when the virtual character is in the virtual environment in a walking state and the walking speed is a second speed, the perspective angle of the HUD control displayed on the terminal is 35°, where the second speed is greater than the first speed. When the virtual character is walking and the speed is switched from the first speed to the second speed, the perspective angle of the HUD control switches from 10° to 35°. For example, FIG. 9 is a schematic diagram of an information processing interface in a virtual environment. The interface displays a virtual environment screen 801 and a HUD control 802. As shown in (a) of Figure 9, when a virtual character 803 is walking in the virtual environment and the walking speed is 1 m / s, the interface displays the virtual environment screen 801 and a HUD control 802 with a perspective angle of 10°. As shown in (b) of Figure 9, when the walking speed of the virtual character 803 switches from 1 m / s to 3 m / s, the interface displays the virtual environment screen 801 and a HUD control 802 with a perspective angle of 35°.
[0082] At step 410, in response to the character state of the virtual character being in a third state, a HUD control is displayed with a dynamically changing perspective angle.
[0083] The dynamically changing perspective angle falls within a third perspective angle range corresponding to a third state.
[0084] It should be noted that steps 402, 404, and 410 in this embodiment can be implemented individually by configuring a new embodiment, and this embodiment is not limited to this.
[0085] Optionally, the third state refers to a state associated with the virtual character, or the third state refers to a state that appears when the virtual character interacts with other virtual characters, virtual items in the virtual environment, or the third state refers to, but is not limited to, a motion state, health state, or level state of the virtual character itself.
[0086] Optionally, the third state includes at least one of an attacked state, an attacking state, a state when in a dangerous area, a state when driving a virtual tool, and a state when an enemy virtual character is approaching, but is not limited thereto, and the embodiment of the present application does not specifically limit this. Optionally, in an implementation form, step 410 may be executed as follows. That is, in response to the character state of the virtual character in the virtual environment being in an attacked state, the terminal displays the HUD control at a perspective angle that periodically swings and changes. For example, when the virtual character is under attack in the virtual environment, the terminal dynamically displays the HUD control within a third perspective angle range, and for example, when the virtual character is in a state under attack, if the third perspective angle range is 0 to 30°, the HUD control is dynamically changed and displayed between 0 to 30°.
[0087] For example, FIG. 10 is a schematic diagram showing a HUD control displayed at different perspective angles. At least one of an operation control, an ammunition tank, a blood tank, and virtual character information is shown in the HUD control in the figure. When the virtual character is in a state of being attacked, the HUD control is displayed at a perspective angle that periodically swings and changes between 0 and 30 degrees. For example, at 0.1 s, the HUD control is displayed at 5 degrees, at 0.2 s, the HUD control is displayed at 10 degrees, and at 0.3 s, the HUD control is displayed at 15 degrees, but is not limited thereto, and the embodiment of the present application does not specifically limit this. In one possible implementation form, the HUD control includes at least two HUD controls located in at least two regions, and the perspective angles corresponding to the HUD controls located in different regions are different.
[0088] For example, Figure 11 is a schematic diagram of a HUD control in different regions. The HUD control 1001 in the figure is divided into four regions, which are a left HUD region 1002, an upper HUD region 1003, a lower HUD region 1004, and a right HUD region 1005, and the terminal displays the HUD control in different regions with different perspective angles based on the character state of the virtual character. For example, when the virtual character is in a walking state and walking from left to right, the perspective angle corresponding to the left HUD region 1002 is 5°, the perspective angle corresponding to the upper HUD region 1003 is 0°, the perspective angle corresponding to the lower HUD region 1004 is 0°, and the perspective angle corresponding to the right HUD region 1005 is 15°.
[0089] For example, when the virtual character 103 is in an attacking state, the third perspective angle range corresponding to the third state is 0 to 30°, and the state information and operation control of the virtual character in the left HUD area 1002 dynamically changes between 0 to 30°, and similarly, the HUD control in the upper HUD area 1003 dynamically changes between 0 to 30°, the HUD control in the lower HUD area 1004 dynamically changes between 0 to 30°, and the HUD control in the right HUD area 1005 dynamically changes between 0 to 30°. It can be understood that the HUD control can be divided into at least two areas, and the embodiment of the present application takes four areas as an example, but is not limited thereto, and the third perspective angle range corresponding to each area can be the same or different, and the embodiment of the present application does not specifically limit this. The HUD control in each area can change synchronously or asynchronously when dynamically changing within the third perspective angle range, and the embodiment of the present application does not specifically limit this. For example, when the HUD control is divided into four regions, a left HUD region, an upper HUD region, a lower HUD region, and a right HUD region, and the virtual character is in a state of rotating counterclockwise, the perspective angle corresponding to the left HUD region 1002 is opposite to the perspective angle corresponding to the right HUD region 1005. For example, the perspective angle corresponding to the left HUD region 1002 is -15°, the perspective angle corresponding to the upper HUD region 1003 is 0°, the perspective angle corresponding to the lower HUD region 1004 is 0°, and the perspective angle corresponding to the right HUD region 1005 is +15°, but is not limited thereto, and the embodiment of the present application does not specifically limit this.
[0090] Illustratively, the HUD control includes at least two HUD controls located in at least two regions, and rotated within the regions about a sideline of an imaging plane frame proximate to the virtual environment screen to obtain the HUD controls displayed at different perspective angles.
[0091] In one implementation, the shape characteristics of the HUD control change based on the perspective angle. A corresponding perspective angle can be obtained by changing the shape of the HUD control displayed on the terminal. For example, based on the principle of perspective, a rectangular control is stretched into a trapezoid, and a circular control is stretched into an ellipse, and the perspective angle is determined based on the degree of the shape change of the HUD control depending on whether a perspective angle exists, for example, the perspective angle is determined by the change in aspect ratio. By changing the shape characteristics such as the aspect ratio of the HUD control, a perspective display effect of the HUD control can be provided to the user, and the user can be assisted in determining the character state of the virtual character depending on whether a shape change occurs in the HUD control, thereby improving the efficiency of human-computer interaction.
[0092] In another implementation, the arrangement characteristics of the HUD controls change based on the perspective angle. The corresponding perspective angle can be obtained by the connecting lines between the multiple HUD controls displayed on the terminal. For example, the center points of the two HUD controls are connected, and the perspective angle is determined based on the change of the connected angle according to whether a perspective angle exists. By changing the position characteristics of the HUD controls, a perspective display effect of multiple HUD controls is provided to the user, and the user can be assisted in determining the character state of the virtual character according to whether a shape change occurs in the HUD controls. In one example, the aspect ratio of the HUD controls in the above embodiment does not change, and the shape of one HUD control is not stretched. For example, a circular control is not stretched into a multi-circular or other irregular shape according to the perspective angle, so as to fully consider the user's operation habits on the control and avoid the problem that the user cannot accurately identify the HUD control due to the change in shape. Optionally, the area of the HUD control decreases as the perspective angle increases, which is close to the effect of the principle of perspective on the display of the HUD control, providing the user with an immersive display experience.
[0093] In another implementation, the visual characteristics of the HUD control change based on the perspective angle. In one example, the visual characteristics include display parameters of the HUD control, which change based on the perspective angle, e.g., have a positive or negative correlation with the perspective angle, and the display parameters include, but are not limited to, at least one of the following parameters: transparency, brightness, saturation, contrast, sharpness, and color temperature. In another example, the visual characteristics include auxiliary display marks around the HUD control, which may be used to enhance the visual prominence of the HUD control, e.g., highlighted lines, shapes, etc. They may also be used to enhance the display effect of the HUD control. For example, lines emanating from the HUD control simulate the effect of movement or rotation of the HUD control. Parameters such as the length and brightness of the auxiliary display marks change based on the perspective angle.
[0094] Optionally, there is at least one overlapping pixel point between the HUD controls displayed at different perspective angles, i.e., the at least one overlapping pixel point is on each of the HUD controls displayed at different perspective angles, the overlapping pixel points ensure that the display positions of the HUD controls at different perspective angles are not significantly shifted, fully considering the user's operation habits for the controls, and avoiding the problem of inconvenient operation or erroneous operation due to the shifting of the HUD controls at different perspective angles.
[0095] It is understood that the above various implementations may be implemented separately or in combination with each other to form different embodiments, and the present application is not limited thereto. Exemplarily, the HUD control is divided into four regions, namely, the left HUD region, the upper HUD region, the lower HUD region, and the right HUD region. Taking the right HUD region as an example, FIG. 12 is a schematic diagram of the right HUD region, and as shown in FIG. 12(a), when the virtual character is in a stationary state in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 0°, and as shown in FIG. 12(b), when the virtual character switches from a stationary state to a walking state, the perspective angle of the HUD control displayed on the terminal switches from 0° to 10°, that is, rotates 10° clockwise with the right sideline as the rotation axis. As shown in (c) of FIG. 12, when the virtual character switches from a walking state to a running state, the perspective angle of the HUD control displayed on the terminal switches from 10° to 30°, i.e., rotates again clockwise by 20° around the right sideline as the axis of rotation, and when the virtual character is in a state of being attacked, the third perspective angle range is 0 to 30°, and the HUD control 102 dynamically changes the display between 0 to 30°, i.e., rotates dynamically between 0 to 30° around the right sideline as the axis of rotation.
[0096] FIG. 13 is a schematic diagram of the upper HUD area. As shown in FIG. 13(a), when the virtual character is stationary in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 0°. As shown in FIG. 13(b), when the virtual character switches from the stationary state to the walking state, the perspective angle of the HUD control displayed on the terminal switches from 0° to 10°, i.e., rotates 10° inward with the upper sideline as the rotation axis. As shown in FIG. 13(c), when the virtual character switches from the walking state to the running state, the perspective angle of the HUD control displayed on the terminal switches from 10° to 30°, i.e., rotates 20° inward again with the upper sideline as the rotation axis. When the virtual character is in a state to be attacked, the third perspective angle range is 0 to 30°, and the HUD control 102 dynamically changes the display between 0 to 30°, i.e., dynamically rotates between 0 to 30° with the upper sideline as the rotation axis.
[0097] FIG. 14 is a schematic diagram of the lower HUD area. As shown in FIG. 14(a), when the virtual character is stationary in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 0°. As shown in FIG. 14(b), when the virtual character switches from the stationary state to the walking state, the perspective angle of the HUD control displayed on the terminal switches from 0° to 10°, i.e., rotates 10° inward around the lower sideline as the rotation axis. As shown in FIG. 14(c), when the virtual character switches from the walking state to the running state, the perspective angle of the HUD control displayed on the terminal switches from 10° to 30°, i.e., rotates 20° inward again around the lower sideline as the rotation axis. When the virtual character is in a state to be attacked, the third perspective angle range is 0 to 30°, and the HUD control 102 dynamically changes the display between 0 to 30°, i.e., dynamically rotates between 0 to 30° around the lower sideline as the rotation axis.
[0098] FIG. 15 is a schematic diagram of the left HUD area. As shown in FIG. 15(a), when the virtual character is stationary in the virtual environment, the perspective angle of the HUD control displayed on the terminal is 0°. As shown in FIG. 15(b), when the virtual character switches from the stationary state to the walking state, the perspective angle of the HUD control displayed on the terminal switches from 0° to 10°, i.e., rotates 10° counterclockwise around the left sideline as the axis of rotation. As shown in FIG. 15(c), when the virtual character switches from the walking state to the running state, the perspective angle of the HUD control displayed on the terminal switches from 10° to 30°, i.e., rotates 20° counterclockwise again around the left sideline as the axis of rotation. When the virtual character is in a state to be attacked, the third perspective angle range is 0 to 30°, and the HUD control 102 dynamically changes the display between 0 to 30°, i.e., dynamically rotates between 0 to 30° around the left sideline as the axis of rotation. In one possible implementation form, the HUD control includes an operation control, and the terminal displays the HUD control with a different perspective angle in response to a trigger operation of the operation control. Exemplarily, the operation control is used to adjust the perspective angle of the HUD control. Optionally, the trigger operation includes, but is not limited to, any one of a click operation, a continuous touch operation, and a slide operation, and the embodiment of the present application is not specifically limited thereto.
[0099] Optionally, the operational control includes a first type of operational control, and in response to a trigger operation of the first type of operational control, the terminal changes the perspective angle of the HUD control to a corresponding perspective angle after triggering the first type of operational control.
[0100] For example, in response to the trigger operation of the walking control or the running control, the terminal changes the perspective angle of the HUD control to the corresponding perspective angle after the walking control or the running control is triggered. For example, after the object triggers the walking control, the perspective angle of the HUD control displayed on the terminal is 10°.
[0101] Optionally, the operation control includes a second type of operation control, and the terminal displays the HUD control with a dynamically changing perspective angle in response to a trigger operation of the second type of operation control, and the dynamically changing perspective angle belongs to a perspective angle range corresponding to the second type of operation control. For example, in response to a trigger operation of an attack control or a defense control, the terminal changes the perspective angle of the HUD control to a corresponding perspective angle after triggering a walk control or a run control. For example, after an object triggers an attack control, the terminal dynamically changes the HUD control between 0° and 30°.
[0102] As described above, the method provided in this embodiment displays a virtual environment screen and a head-up display (HUD) control, controls a virtual character to act in the virtual environment, and displays HUD controls with different perspective angles corresponding to various character states based on various character states of the virtual character. The present application provides a new information display method, associates the information display method of the HUD control with the character state of the virtual character, and displays the HUD control with different perspective angles, thereby helping the user determine the character state of the virtual character according to the perspective angle, improving the efficiency of human-computer interaction and improving the user experience.
[0103] 16 is a block diagram showing the configuration of an information processing terminal in a virtual environment according to an exemplary embodiment of the present application. The terminal includes an input unit 1501, a processor 1502, a display unit 1503, a power supply 1504, and a memory 1505.
[0104] The input unit 1501 may be an operation control, and the object inputs information to the input unit 1501 by pressing one or more buttons of the operation control, or the object inputs information to the input unit 1501 via a virtual remote lever on the terminal interface, and the object inputs information to the input unit 1501 via an external device (such as a steering wheel, VR glasses, or VR helmet) connected to the terminal, and the object controls the virtual character to act by voice, and the object inputs information to the input unit 1501 by tactile manipulation. The processor 1502 may include one or more processing cores, for example, a 4-core processor, an 8-core processor, and the like. In some embodiments, the processor may further include an artificial intelligence (AI) processor, which is used to process computation operations related to machine learning. The processor 1502 processes the information received by the input unit 1501 to match the state of the virtual character with the trigger mechanism.
[0105] The display unit 1503 displays the virtual environment screen and head-up display (HUD) controls.
[0106] The power supply 1504 supplies power to each component in the information processing terminal in the virtual environment.
[0107] The memory 1505 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1505 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices, etc. In some embodiments, the non-transitory computer-readable storage media in the memory 1505 stores at least one instruction that is executed by the processor 1502 to realize the information processing method in the virtual environment provided in the embodiments of the present application.
[0108] 17 is a block diagram of an information processing device in a virtual environment according to an exemplary embodiment of the present application. The device may be implemented as a whole or part of a computer device by software, hardware, or a combination of both, and includes a display module 1601 and a control module 1602. The display module 1601 is configured to display a virtual environment screen and a head-up display (HUD) control, the virtual environment screen displaying a virtual environment and the HUD control displaying user interface (UI) information required to control a virtual character; a control module 1602 configured to control the virtual character to act in the virtual environment; The display module 1601 is further configured to display the HUD control with different perspective angles based on a character state of the virtual character, the perspective angle being an angle between the HUD control and an imaging plane of the virtual environment screen.
[0109] In one possible implementation, the display module 1601 is further configured to change a perspective angle of the HUD control from a first perspective angle to a second perspective angle in response to a character state of the virtual character changing from a first state to a second state, the first perspective angle corresponding to the first state and the second perspective angle corresponding to the second state.
[0110] The first state is a walking state, and the second state is a running state.
[0111] In one possible implementation, the display module 1601 is further configured to change the perspective angle of the HUD control from the first perspective angle to the second perspective angle in response to the character state of the virtual character changing from the walking state to the running state, the second perspective angle being greater than the first perspective angle.
[0112] In one possible implementation, the display module 1601 is further configured to change the perspective angle of the HUD control in response to a change in an attribute parameter of a character state of the virtual character.
[0113] In one possible implementation, the display module 1601 is further configured to increase the perspective angle of the HUD control in response to an increase in the velocity or acceleration of the virtual character in the virtual environment.
[0114] In one possible implementation, the display module 1601 is further configured to decrease the perspective angle of the HUD control in response to a decrease in the velocity or acceleration of the virtual character in the virtual environment.
[0115] In one possible implementation, the display module 1601 is further configured to display the HUD control with a dynamically changing perspective angle in response to the character state of the virtual character being in a third state; The dynamically changing perspective angle falls within a third perspective angle range corresponding to the third state.
[0116] The third state is an attacked state. In one possible implementation, the display module 1601 is further configured to display the HUD control with a periodically swinging and changing perspective angle in response to the character state of the virtual character in the virtual environment being attacked. The HUD control includes at least two HUD controls located in at least two regions, and the perspective angles corresponding to the HUD controls located in different regions are different. The HUD control includes an operation control.
[0117] In one possible implementation, the display module 1601 is further configured to display the HUD control with different perspective angles in response to a trigger operation of the operational control, the operational control including a first type of operational control.
[0118] In one possible implementation, the display module 1601 is further configured to, in response to triggering the first type of operational control, change the perspective angle of the HUD control to a corresponding perspective angle after triggering the first type of operational control, the operational control including a second type of operational control.
[0119] In one possible implementation, the display module 1601 is further configured to display the HUD control with a dynamically changing perspective angle in response to a trigger operation of the second type of operation control; The dynamically changing perspective angle falls within a perspective angle range corresponding to the second type of operation control.
[0120] 18 is a schematic diagram illustrating a configuration of a computing device 1700 in a virtual environment according to an exemplary embodiment of the present application. The computing device 1700 may be a smartphone, a tablet computer, a Moving Picture Experts Group Audio Layer III (MP3) player, or a Moving Picture Experts Group Audio Layer IV (MP4) player. The computing device 1700 may also be referred to by other names such as user equipment, mobile terminal, etc.
[0121] Typically, the computing device 1700 includes a processor 1701 and a memory 1702 .
[0122] The processor 1701 may include one or more processing cores, for example, a 4-core processor, an 8-core processor, etc. The processor 1701 may be implemented in at least one hardware form of a digital signal processor (DSP), a field programmable gate array (FPGA), and a programmable logic array (PLA). The processor 1701 may also include a main processor and a coprocessor. The main processor is a processor used to process data in an active state, also called a central processing unit (CPU). The coprocessor is a low-power processor that processes data in a standby state. In some embodiments, the processor 1701 may be integrated with a graphics processing unit (GPU), which renders and draws content that needs to be displayed on a display screen. In some embodiments, the processor 1701 may further include an artificial intelligence (AI) processor, which processes computational operations related to machine learning. The memory 1702 may include one or more computer-readable storage media, which may be non-transitory. The memory 1702 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices, etc. In some embodiments, the non-transitory computer-readable storage media in the memory 1702 stores at least one instruction that is executed by the processor 1701 to implement the information processing method provided in the embodiments of the present application.
[0123] In some embodiments, the computing device 1700 may optionally further include a peripheral interface 1703 and at least one peripheral. Specifically, the peripheral includes at least one of an RF circuit 1704, a touch screen 1705, a camera assembly 1706, an audio circuit 1707, and a power supply 1708. The peripheral interface 1703 may be used to connect at least one peripheral associated with input / output (I / O) to the processor 1701 and the memory 1702. In some embodiments, the processor 1701, the memory 1702, and the peripheral interface 1703 may be integrated on the same chip or circuit board, and in some other embodiments, any one or two of the processor 1701, the memory 1702, and the peripheral interface 1703 may be implemented on separate chips or circuit boards, and this embodiment is not limited thereto. The RF circuit 1704 is used to transmit and receive radio frequency (RF) signals, also referred to as electromagnetic signals. The RF circuitry 1704 communicates with a communication network or other communication devices via electromagnetic signals. The RF circuitry 1704 may further include Near Field Communication (NFC) related circuits. The touch screen 1705 displays a user interface (UI). The UI may include graphics, text, icons, videos, and any combination thereof. The camera assembly 1706 collects images or videos. Optionally, the camera assembly 1706 includes a front camera and a rear camera. The audio circuitry 1707 provides an audio interface between the user and the computer device 1700. The audio circuitry 1707 may include a microphone and a speaker. The microphone collects sound waves from the user and the environment, converts the sound waves into electrical signals, and inputs the sound waves to the processor 1701 for processing, or to the RF circuitry 1704 for voice communication. The power supply 1708 provides power to each component in the computer device 1700. The power source 1708 can be AC, DC, a disposable battery, or a rechargeable battery.
[0124] In some embodiments, the computing device 1700 further includes one or more sensors 1709. The one or more sensors 1709 include, but are not limited to, an acceleration sensor 1710, a gyro sensor 1711, a pressure sensor 1712, an optical sensor 1713, and a proximity sensor 1714. The acceleration sensor 1710 can detect the magnitude of acceleration on three coordinate axes of a coordinate system established by the computing device 1700. The gyro sensor 1711 can detect the body orientation and rotation angle of the computing device 1700. The pressure sensor 1712 can be provided on a side frame of the computing device 1700 and / or on a lower layer of the touch screen 1705. The pressure sensor 1712 detects a grip signal of a user on the computing device 1700 and / or realizes control of an operable control on a UI interface based on a user's pressure operation on the touch screen 1705. The optical sensor 1713 collects the intensity of ambient light. The proximity sensor 1714, also called a distance sensor, is typically provided on the front of the computer device 1700. The proximity sensor 1714 collects the distance between the user and the front of the computer device 1700.
[0125] Those skilled in the art will appreciate that the structure shown in FIG. 18 does not constitute a limitation on computing device 1700, which may include more or fewer components than shown, combine certain components, or employ different component arrangements.
[0126] An embodiment of the present application further provides a computer device comprising a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to realize the information processing method in a virtual environment provided in each of the above embodiments.
[0127] An embodiment of the present application further provides a computer storage medium, the computer-readable storage medium storing at least one computer program, the at least one computer program being loaded and executed by a processor to realize the information processing method in the virtual environment provided in each of the above embodiments.
[0128] An embodiment of the present application further provides a computer program product, the computer program product including a computer program, the computer program being stored in a computer-readable storage medium, and the computer program being read from the computer-readable storage medium and executed by a processor of a computing device, thereby realizing, in the computing device, the information processing method in a virtual environment provided in each of the above embodiments. [Explanation of symbols]
[0129] 100 Computer Systems 101 Virtual Environment Screen 102 Head-Up Display (HUD) Control 102 HUD Control 103 Virtual Characters 104 Imaging Planes 110 Terminal 1 111 Client 112 First User 113 Second User 120 Servers 122 processors 123 User Account Database 124 Battle Service Module 125 Output Interface (I / O Interface: Input / Output Interface) 130 Terminal 2 131 clients 140 terminals 201 3D space 202 Camera Plane 203 plane 204 Imaging Plane 205 Reference plane 601 Virtual Environment Screen 602 HUD Control 603 Virtual Character 801 Virtual Environment Screen 802 HUD Control 803 Virtual Characters 1001 HUD Control 1002 Left HUD area 1003 Upper HUD area 1004 Lower HUD area 1005 Right HUD area 1501 Input Unit 1502 Processor 1503 Display unit 1504 Power supply 1505 Memory 1601 Display module 1602 Control Module 1700 Computer Equipment 1701 Processor 1702 Memory 1703 Peripheral Device Interface 1703 Peripheral Device Interface 1704 RF circuit 1705 Touch Screen 1706 Camera Assembly 1707 Audio Circuit 1708 Power supply 1709 Sensor 1710 Acceleration Sensor 1711 Gyro sensor 1712 Pressure Sensor 1713 Optical Sensor 1714 Proximity Sensor
Claims
1. An information processing method in a virtual environment executed by a terminal, comprising: displaying a virtual environment view and a head-up display (HUD) control, the virtual environment view displaying a virtual environment and the HUD control displaying user interface (UI) information required to control a virtual character; controlling the virtual character to act in the virtual environment; and displaying the HUD control with different perspective angles based on a character state of the virtual character, the perspective angle being an angle between the HUD control and an imaging plane of a screen of the virtual environment.
2. displaying the HUD control with different perspective angles based on a character state of the virtual character, changing a perspective angle of the HUD control from a first perspective angle to a second perspective angle in response to a character state of the virtual character changing from a first state to a second state, the first perspective angle corresponding to the first state and the second perspective angle corresponding to the second state. The method of processing information in a virtual environment according to claim 1.
3. The first state is a walking state, and the second state is a running state, changing a perspective angle of the HUD control from a first perspective angle to a second perspective angle in response to a change in a character state of the virtual character from a first state to a second state, changing a perspective angle of the HUD control from the first perspective angle to the second perspective angle in response to a change in the character state of the virtual character from the walking state to the running state, the second perspective angle being greater than the first perspective angle; The method for processing information in a virtual environment according to claim 2.
4. displaying the HUD control with different perspective angles based on a character state of the virtual character, changing a perspective angle of the HUD control in response to a change in an attribute parameter of a character state of the virtual character; The method of processing information in a virtual environment according to claim 1.
5. The step of changing a perspective angle of the HUD control in response to a change in an attribute parameter of a character state of the virtual character includes: increasing a perspective angle of the HUD control in response to an increase in a velocity or acceleration of the virtual character in the virtual environment. The method for processing information in a virtual environment according to claim 4.
6. The step of changing the perspective angle of the HUD control in response to a change in an attribute parameter of a character state of the virtual character includes: reducing a perspective angle of the HUD control in response to a decrease in a velocity or acceleration of the virtual character in the virtual environment. The method for processing information in a virtual environment according to claim 4.
7. displaying the HUD control with different perspective angles based on a character state of the virtual character, displaying the HUD control with a dynamically changing perspective angle in response to the character state of the virtual character being in a third state; The dynamically changing perspective angle is within a third perspective angle range corresponding to the third state. The method of processing information in a virtual environment according to claim 1.
8. the third state being an attacked state, displaying the HUD control at a dynamically changing perspective angle in response to the character state of the virtual character being in a third state, displaying the HUD control at a perspective angle that periodically swings and changes in response to a character state of the virtual character in the virtual environment being in the attacked state; The method for processing information in a virtual environment according to claim 7.
9. The HUD controls include at least two HUD controls located in at least two regions, and perspective angles corresponding to the HUD controls located in different regions are different. The information processing method in a virtual environment according to any one of claims 1 to 8.
10. The HUD control includes an operation control, and the method for processing information in a virtual environment includes: and displaying the HUD control with a different perspective angle in response to a trigger operation of the operation control. The information processing method in a virtual environment according to any one of claims 1 to 8.
11. the operational control includes a first type of operational control; The step of displaying the HUD control with different perspective angles in response to a trigger operation of the operation control includes: in response to a trigger operation of the first type of operational control, changing a perspective angle of the HUD control to a corresponding perspective angle after triggering the first type of operational control; The method for processing information in a virtual environment according to claim 10.
12. the operational control includes a second type of operational control; The step of displaying the HUD control with different perspective angles in response to a trigger operation of the operation control includes: displaying the HUD control at a dynamically changing perspective angle in response to a trigger operation of the second type of operational control; the dynamically changing perspective angle is within a perspective angle range corresponding to the second type of operation control; The method for processing information in a virtual environment according to claim 10.
13. An information processing device in a virtual environment, comprising: a display module; and a control module, the display module is configured to display a virtual environment screen and a head-up display (HUD) control, the virtual environment screen displaying a virtual environment and the HUD control displaying user interface (UI) information required to control a virtual character; the control module is configured to control the virtual character to act in the virtual environment; The display module is further configured to display the HUD control with different perspective angles based on a character state of the virtual character, the perspective angle being an angle between the HUD control and an imaging plane of the virtual environment screen.
14. A computer device comprising a processor and a memory, the memory storing at least one computer program, and the processor loading and executing the at least one computer program to realize the information processing method in a virtual environment according to any one of claims 1 to 12.
15. A computer-readable storage medium storing at least one computer program for implementing the information processing method in a virtual environment according to any one of claims 1 to 12 when the computer program is loaded and executed by a processor.
16. A computer program product including a computer program stored in a computer device, the computer program being read and executed by a processor of a computer device to cause the computer device to execute an information processing method in a virtual environment according to any one of claims 1 to 12.
Citation Information
Patent Citations
Virtual environment picture display method and device, equipment and medium
CN111603770A
Display control method and device in game and electronic equipment
CN111803941A
Presentation information transmission method, presentation information display method, presentation information transmission device, presentation information display device, terminal, and computer program for multiplayer online battle program
JP2022521620A
Analysis of video game videos for information extraction, content labeling, smart video editing / creation and highlights generation
US20170228600A1
Environment Interactive System Providing Augmented Reality for In-Vehicle Infotainment and Entertainment
US20220062752A1
