Interface display method and device, terminal, storage medium, and computer program product

KR103000580B1Active Publication Date: 2026-08-05TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
KR1020247013369
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-01-21
Filing Date
2022-10-31
Publication Date
2026-08-05
Estimated Expiration
2042-10-31

Smart Images

  • Figure 112024044013776-PCT00002_ABST
    Figure 112024044013776-PCT00002_ABST
Patent Text Reader

Abstract

Interface display method and apparatus, terminal, storage medium, and computer program product. The present application relates to an interface display method and apparatus, terminal, storage medium, and computer program product in the technical field of computers and the Internet. The method comprises the step (201) of displaying a flight image in a user interface (UI) during the flight of a virtual object—the flight image is an image for observing a virtual environment from the flight perspective of the virtual object—; the step (202) of displaying a search image in response to a search operation during the display of the flight image—the search image is an image for exploring a virtual environment from the search perspective of the virtual object, and the virtual environment displayed in the search image is a local area of ​​the virtual environment displayed in the flight image—; and the step (203) of adjusting to display the search image in response to an adjustment operation regarding the search perspective.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] Related applications

[0002] This application claims priority to Chinese patent application No. 202210074263.1, titled "interface display method and apparatus, terminal, storage medium, and computer program product," filed on January 21, 2022.

[0003] Technology field

[0004] The embodiments of the present application relate to the technical field of computers and the Internet, and in particular, to interface display methods and devices, terminals, storage media, and computer program products. Background Technology

[0005] Currently, in game applications, players can determine the location of a virtual character controlled by an enemy player by exploring the virtual ground of a virtual environment through a virtual aircraft.

[0006] Taking a shooting game application as an example, the player performs flight control of a virtual aircraft based on a flight perspective corresponding to the virtual aircraft (e.g., a head-up perspective), and uses the flight perspective to explore the virtual ground of the virtual environment while controlling the flight of the virtual aircraft, thereby exploring a virtual character controlled by an enemy player.

[0007] However, from a flight perspective, the visibility of the ground is poor, ground search is difficult, and search efficiency is low. means of solving the problem

[0008] Embodiments of the present application provide an interface display method and device, a terminal, a storage medium, and a computer program product, which can ensure a flight field of view required for flight control and a search field of view required for search operations during flight, thereby reducing search difficulties and improving search efficiency. The technical solutions are as follows:

[0009] According to an embodiment of the present application, an interface display method executed by a terminal device is provided, and the method

[0010] A step of displaying flight images in a user interface (UI) during the flight of a virtual object—the flight images are images for observing the virtual environment from the perspective of the virtual object's flight—;

[0011] During the display of flight images, a step of displaying a navigation image in response to a navigation action—the navigation image is an image for navigating a virtual environment from the perspective of navigating a virtual object, and the virtual environment displayed in the navigation image is a local area of ​​the virtual environment displayed in the flight images—; and

[0012] It includes a step of adjusting the display of the navigation image in response to an adjustment action for the navigation perspective.

[0013] According to an embodiment of the present application, an interface display device is provided, and the device

[0014] An image display module configured to display flight images in a UI during the flight of a virtual object, wherein the flight images are images for observing a virtual environment from the perspective of the flight of a virtual object;

[0015] A display module, wherein the image display module is further configured to display a navigation image in response to a navigation operation during the display of a flight image, the navigation image is an image for navigating a virtual environment from the perspective of navigating a virtual object, and the virtual environment displayed in the navigation image is a local area of ​​the virtual environment displayed in the flight image; and

[0016] It includes an image adjustment module configured to adjust the display of a navigation image in response to an adjustment action regarding the navigation perspective.

[0017] According to an embodiment of the present application, a terminal device comprising a processor and a memory for storing computer programs is provided, and the computer programs are loaded and executed by the processor to implement an interface display method.

[0018] According to an embodiment of the present application, a computer-readable storage medium for storing computer programs is provided, and the computer programs are loaded and executed by a processor to implement an interface display method.

[0019] According to an embodiment of the present application, a computer program product comprising computer programs stored in a computer-readable storage medium is provided. A processor of a terminal reads and executes computer programs from the computer-readable storage medium, thereby causing the terminal to execute the interface display method.

[0020] During the flight of a virtual object, it is supported that a search image be displayed while a flight image is displayed, thereby ensuring the flight field of view required for flight control and the search field of view required for search operations during flight; this avoids the problem of significant search difficulty caused by poor identification of the reference plane field of view under the flight perspective of the relevant technology, thereby reducing search difficulty and improving search efficiency.

[0021] In addition, by adopting the technical solutions provided by the embodiments of the present application, it is possible to overcome the conflict between the flight view (e.g., head-up view) and the search view (e.g., top-down view), and to realize flight control and search operations by realizing both the flight view and the search view without frequently switching between them, thereby further improving search efficiency. Brief explanation of the drawing

[0022] FIG. 1 is a diagram of an implementation environment of a solution provided by one embodiment of the present application. FIG. 2 is a flowchart of an interface display method provided by one embodiment of the present application. FIG. 3 is a drawing of a flight image provided by one embodiment of the present application. FIG. 4 is a diagram of the flight view and the navigation view provided by one embodiment of the present application. FIG. 5 is a drawing of a search image provided by one embodiment of the present application. FIG. 6 is a flowchart of an interface display method provided by another embodiment of the present application. FIG. 7 is a drawing of a target object in a locked state provided by one embodiment of the present application. FIG. 8 is a drawing of a search area in a second display state provided by one embodiment of the present application. FIG. 9 is a flowchart of an interface display method provided by another embodiment of the present application. FIG. 10 is a block diagram of an interface display device provided by one embodiment of the present application. FIG. 11 is a block diagram of an interface display device provided by another embodiment of the present application. FIG. 12 is a block diagram of a terminal provided by one embodiment of the present application. Specific details for implementing the invention

[0023] Referring to FIG. 1, a diagram of an implementation environment of a solution provided by one embodiment of the present application is shown. The implementation environment may include a terminal (10) and a server (20).

[0024] The terminal (10) may be an electronic device such as a mobile phone, tablet, game console, multimedia playback device, and personal computer (PC). A client of a target application, such as a game application and a simulated learning application, may be installed on the terminal (10). For example, the terminal (10) may also be referred to as a terminal device (10).

[0025] The server (20) is configured to provide background services to clients of an application (such as a game application) within the terminal (10). For example, the server (20) may be a background server for said application (such as a game application). The server (20) may be a server, a server cluster composed of multiple servers, or a cloud computing service center.

[0026] The terminal (10) and the server (20) can communicate with each other through the network (30). The network (30) may be a wired network or a wireless network.

[0027] For example, taking a client applying a game application as an example, during the flight of a virtual object (such as a virtual aircraft, virtual character, and virtual navigation device), the UI displays a flight image from the flight perspective; and the player can display a navigation image while displaying the flight image by triggering a navigation control in the UI to navigate a virtual character controlled by an enemy player through the navigation image without affecting the flight view.

[0028] Referring to FIG. 2, a flowchart of an interface display method provided by one embodiment of the present application is illustrated. The subject of each step of the method may be a terminal (10) in an implementation environment of the solution illustrated in FIG. 1. The method may include the following steps (steps 201 to 203):

[0029] Step 201: Display a flight image on the UI during the flight of the virtual object, and the flight image is an image for observing the virtual environment from the perspective of the flight of the virtual object.

[0030] In the embodiments of the present application, the virtual object may refer to a virtual character controlled by a user account in an application. Taking a shooting game application as an example, the virtual object refers to a game character controlled by a user account in a game application, and the game character has the ability to fly. The virtual object may also refer to a virtual aircraft piloted by a virtual character in an application, such as a virtual aircraft, a virtual helicopter, and a virtual hot air balloon. The virtual object may also refer to a virtual exploration device controlled by a virtual character in an application, such as a virtual unmanned aerial vehicle. The type of virtual object is not limited in the embodiments of the present application.

[0031] UI refers to the display interface of an application, such as the display interface of the target application. For example, in a shooting game application, the UI may be the display interface of the game match for presenting the virtual environment of the game match to the user. In a simulated learning application, the UI may be the display interface of the learning scene for presenting the simulated environment within the learning scene to the user. In some embodiments, the UI includes a display layer and a control layer. The display level of the control layer is higher than the display level of the display layer. The display layer is configured to display image information (such as flight images and navigation images); and the control layer is configured to display controls of the UI (such as the navigation controls and flight remote sensing controls below).

[0032] In some embodiments, the flight view refers to a perspective for assisting flight control during the flight of a virtual object; the player can acquire a corresponding flight field of view through the flight view and then control the flight direction, speed, etc. of the virtual object based on the virtual environment in the flight field of view. For example, the flight view may refer to a head-up view, that is, a generalized view having the virtual object as a centerline. For example, during the flight of a virtual object, the flight view may be adjusted by adjusting the flight angle of the virtual object to view the virtual sky, virtual ground, etc.

[0033] A virtual environment is an environment that is displayed (or provided) when a client of an application (e.g., a game application) is executed on a terminal, and a virtual environment refers to an environment in which a virtual object is created to perform an activity (e.g., a game competition), and, for example, a virtual environment may be a virtual house, a virtual island, a virtual sky, and a virtual land. A virtual environment may be a real-world simulation environment, or a semi-simulation semi-fictional environment, or a purely fictional environment, and this is not limited by the embodiments of the present application.

[0034] For example, referring to FIG. 3, during the flight of a virtual aircraft (301), a flight image (302) is displayed on the UI (300), and the flight image (302) is an image of the virtual environment viewed from the flight perspective of the virtual aircraft (301).

[0035] Step 202: During the display of the flight image, a navigation image is displayed in response to a navigation action, and the navigation image is an image for navigating the virtual environment from the perspective of navigating a virtual object, and the virtual environment displayed in the navigation image is a local area of ​​the virtual environment displayed in the flight image.

[0036] The search perspective refers to a perspective used to explore the virtual environment during the flight of a virtual object. Through the search perspective, the player acquires a corresponding search field of view and can then search for a target object based on the local virtual environment within the search field of view. For example, the angle of the search perspective may be the same as the angle of the flight perspective. For example, the search perspective may be a generalized perspective with the virtual object as the centerline. The search perspective may also refer to any perspective other than the flight perspective, such as a top-down perspective relative to a reference plane (such as virtual ground and virtual sea level) in the virtual environment. The angle of the search perspective is not limited in the embodiments of this application. In some embodiments, the target object may refer to a virtual character, virtual vehicle, virtual object, etc., and is not limited in the embodiments of this application. The search image is displayed on the same screen as the flight image. In some embodiments, the search image may be a partially magnified image taken from the flight image; the search image may also be an image taken from the virtual environment by a corresponding virtual camera; and the virtual camera corresponding to the search image may refer to a virtual camera having a higher magnification than the virtual camera corresponding to the flight image.

[0037] For example, referring to FIG. 4, the virtual aircraft (401) corresponds to a head-up view (i.e., flight view (402)) with the virtual aircraft (401) as the centerline. The virtual aircraft (401) also corresponds to a search view (403) from the virtual aircraft (401) (such as a top-down view) having an angle different from the aircraft view (402). Target objects (404) and target objects (405) are included in the search field of view corresponding to the search view (403).

[0038] In some embodiments, a navigation action is used to trigger the display of a navigation image; the navigation action may be an action such as a click, a press, and a slide. A navigation action may refer to an action performed by a player on a UI control within the UI.

[0039] In one example, the display process of a navigation image may be as follows: acquiring a flight line of sight corresponding to a flight viewpoint; determining an initial navigation line of sight based on the flight line of sight in response to a triggering action for a navigation control displayed in the UI; and displaying a navigation image based on the initial navigation line of sight.

[0040] The flight line of sight refers to a centerline corresponding to a flight perspective, such as the centerline of a virtual aircraft (401) corresponding to the flight perspective (402). The search line of sight refers to a centerline corresponding to a search perspective, such as the centerline corresponding to the search perspective (403). In some embodiments, the flight line of sight may be determined as an initial search line of sight, or the initial search line of sight may be set at an angle set apart from the flight line of sight, which is not limited by the embodiments of the present application.

[0041] A navigation control is used to trigger the display of a navigation image. The navigation control may refer to a remote sensing control, a button combination control, etc. For example, referring to FIG. 5, a navigation control (303) is displayed in the UI (300), and the navigation control (303) corresponds to a movable area (304). In the initial state, the navigation control (303) is positioned at the center of the movable area (304). A navigation image (305) is triggered to be displayed in response to a drag action (i.e., a triggering action) by the player on the navigation control (303) in the movable area (304), which causes the navigation control (303) to move away from the center of the movable area (304).

[0042] In some embodiments, the display of the content and position of the navigation image (305) is adjusted in response to the player's drag action on the navigation control (303) not being released; the navigation image (305) is canceled from display in response to the player's release action on the navigation control (303), and the navigation line of sight is initialized to the flight line of sight.

[0043] In some embodiments, the navigation image corresponds to a display area, and the display area refers to a local area in a virtual environment; and the display elements corresponding to the local area (i.e., display content) are the display elements of the navigation image.

[0044] In one example, a method for acquiring a display area corresponding to a search image may be as follows: acquiring a first collision point between an initial search line and a reference plane of a virtual environment; determining an area corresponding to the first collision point in the virtual environment as a display area corresponding to the search image; and displaying the search image based on elements within the display area.

[0045] The reference plane refers to the flight reference plane of a virtual object during flight, which may be a virtual ground, a virtual sea surface, etc. in a virtual environment. In the embodiments of the present application, the collision point refers to the intersection of a detection ray and a collision box. For example, the first collision point refers to the intersection of a detection ray corresponding to the initial search line of sight and a collision box corresponding to the reference plane. The detection ray corresponding to the initial search line of sight may overlap with the initial search line of sight.

[0046] In some embodiments, the area centered at the first collision point may be determined as a display area corresponding to the search image, a regular area such as a circle and a square, and an irregular area such as a broken mirror. The display content of the search image is determined based on elements corresponding to the display area; and the search image is displayed based on the display content of the search image.

[0047] For example, referring to FIGS. 4 and 5, in the initial state, the search line corresponding to the search viewpoint (403) overlaps with the flight line corresponding to the flight viewpoint (402), that is, the first collision point between the search line and the reference plane is the intersection point between the flight line and the reference plane. A circular area centered at the first collision point is determined as a display area corresponding to the search image (305); and the display content corresponding to the display area is enlarged to obtain the display content corresponding to the search image (305).

[0048] Step 203: Adjust the display of the navigation image in response to the adjustment action for the navigation view.

[0049] In some embodiments, the following steps are performed: acquiring an adjusted search line corresponding to the search point in response to an adjustment action for the search point; acquiring a second collision point between the adjusted search line and a reference plane of the virtual environment; determining an area corresponding to the second collision point in the virtual environment as an adjusted display area corresponding to the search image; and adjusting the display of the search image based on elements within the adjusted display area.

[0050] The second collision point refers to the intersection of a detection ray corresponding to the adjusted search line and a collision box corresponding to a reference plane. An area centered at the second collision point is determined as the adjusted display area; display content corresponding to the adjusted display area is enlarged to obtain the adjusted display content corresponding to the search image; and the search image is adjusted to be displayed based on the adjusted display content. For example, referring to FIG. 4, the initial search line corresponding to the search viewpoint (403) is set as the centerline corresponding to the flight viewpoint (402), and then the centerline corresponding to the search viewpoint (403) is the adjusted search line, and the display area corresponding to the search viewpoint (403) is the adjusted display area.

[0051] In some embodiments, referring to FIG. 5, a drag operation is performed on the navigation control (303) without being released, so that the display area corresponding to the navigation image can be adjusted.

[0052] In one example, the process for acquiring an adjusted search line of sight may be as follows: acquiring a direction variable and a magnitude variable corresponding to the adjustment action in response to an adjustment action for the search viewpoint; determining a direction variable of the search line of sight based on the direction variable corresponding to the adjustment action based on the flight line of sight; determining a magnitude variable of the search line of sight based on the magnitude variable corresponding to the adjustment action based on the flight line of sight; and acquiring an adjusted search line of sight based on the direction variable of the search line of sight and the magnitude variable of the search line of sight.

[0053] A direction variable is used to map the changing direction representing the search line, and a size variable is used to map the changing size representing the search line. For example, referring to FIG. 5, a vertical downward direction through the center point of the movable area is taken as the reference direction, and the reference direction is the same as the direction of the flight line of the virtual aircraft (301). Based on the coordinates of the search control (303) and the reference direction, the direction variable and the size variable are determined. For example, if the direction variable indicates that the search line is moving to the right of the flight line, the size variable is combined to determine the size of the movement of the search line in that direction (i.e., the size variable) and the search line adjusted thereby is determined.

[0054] In some embodiments, a second collision point follows on the screen to move to display a search image. For example, the second collision point is determined as the position center point of the search image; and during a change of the second collision point, the display position of the search image changes according to the change of the second collision point. The search image may be displayed fixedly at a set position on the screen. For example, the search image is displayed fixedly at the upper right corner of the screen, and the display position of the search image is not limited in the embodiments of the present application.

[0055] In one possible example, a flight remote sensing control corresponding to a virtual object is displayed in the UI, and the movable area corresponding to the flight remote sensing control includes a flight control area and a navigation control area. In the initial state, the flight remote sensing control is located at the center of the movable area.

[0056] When the flight remote sensing control is located in the flight control area, the flight remote sensing control is used to control the flight view of the virtual object. When the flight remote sensing control is located in the navigation control area, the flight remote sensing control is used to control the navigation view of the virtual object. The movable area refers to the area to which the flight remote sensing control can move.

[0057] In some embodiments, a navigation image is displayed in response to the flight remote sensing control being moved from the center of the movable area to the navigation control area. For example, the flight control area is a circular area centered at the center of the movable area; and the navigation control area is an area centered at the center of the movable area excluding the flight control area. A navigation image is displayed in response to the player moving the flight remote sensing control from the flight control area to the navigation control area.

[0058] In some embodiments, the navigation image is adjusted to be displayed in response to adjustment actions of the flight remote sensing control in the navigation control area. For example, referring to the embodiments above, after the display of the navigation image, the display of the navigation image is adjusted in response to the player controlling the movement of the flight remote sensing control in the navigation control area.

[0059] In some embodiments, the navigation image is canceled from display in response to the flight remote sensing control moving from the navigation control area to the flight control area or being released. For example, referring to the embodiments above, after the display of the navigation image, the display of the navigation image is canceled in response to the player moving the flight remote sensing control from the navigation control area to the flight control area or being released.

[0060] In summary, the technical solutions provided by the embodiments of the present application support displaying a search image while displaying a flight image during the flight of a virtual object, thereby ensuring that the flight field of view required for flight control and the search field of view required for search operations can be guaranteed during flight; and can avoid the problem of significant search difficulty caused by poor identification of the reference plane field of view under the flight perspective in the relevant technology, thereby reducing search difficulty and improving search efficiency.

[0061] In addition, by adopting the technical solutions provided by the embodiments of the present application, it is possible to overcome the conflict between the flight view (e.g., head-up view) and the search view (e.g., top-down view), and to realize flight control and search operations by realizing both the flight view and the search view without frequently switching between them, thereby further improving search efficiency.

[0062] In addition, by moving along the second collision point on the screen and displaying the search image, the display area corresponding to the search image can be accurately characterized, thereby further reducing the difficulty of search and improving search efficiency. At the same time, searching in a planned and strategic manner is advantageous to players, thereby improving the user experience. Furthermore, by adjusting the search line at two angles of direction and size variables, the accuracy of adjusting the search line is improved, and the accuracy of searching the flight image is further enhanced.

[0063] Referring to FIG. 6, a flowchart of an interface display method provided by another embodiment of the present application is illustrated. The subject of each step of the method may be a terminal (10) in an implementation environment of the solution illustrated in FIG. 1. The method may include the following steps (steps 601 to 605):

[0064] Step 601: Display a flight image in the UI during the flight of the virtual object, and the flight image is an image for observing the virtual environment from the perspective of the flight of the virtual object.

[0065] Step 602: During the display of the flight image, a navigation image is displayed in response to a navigation action, the navigation image is an image for navigating a virtual environment from the perspective of navigating a virtual object, and the virtual environment displayed in the navigation image is a local area of ​​the virtual environment displayed in the flight image.

[0066] Steps 601 and 602 are identical to the embodiments above. For matters not described in the embodiments of the present application, the embodiments above may be referenced and will not be repeated.

[0067] Step 603: Control a search area corresponding to the search image to follow a target object in response to an adjustment action for the search view, and the range of the search area is less than or equal to the range of the display area of ​​the search image.

[0068] The target object may refer to a virtual character, virtual vehicle, virtual object, etc. The type of target object is not limited in the embodiments of the present application. In the embodiments of the present application, a search area is used to capture the target object. The center position of the search area may overlap with the center position of the display area of ​​the search image. The search area may be a shaped area such as a circle or a square.

[0069] For example, referring to FIG. 5, the search image (305) corresponds to the search area (306). There is a target object in the search image (305), and the player can control the search area (306) to follow the target object within the search image by controlling the search control (303).

[0070] Step 604: When the duration of the target object in the search area is greater than or equal to the first time threshold, annotation information regarding the target object is generated, and the annotation information is used to annotate and display the target object.

[0071] The first time threshold can be adaptively set and adjusted according to actual usage requirements, such as 1.5 seconds and 2 seconds. If the center position corresponding to the target object is located within the search area, the target object can be determined to be within the search area. Annotation information for the target object is generated when the duration exceeds the first time threshold by the player adjusting the search areas so that the target object persists between the search areas.

[0072] In some embodiments, the annotation information includes a first sub-annotation information, a second sub-annotation information, and a third sub-annotation information, wherein the first sub-annotation information is used to indicate type information regarding a target object, the second sub-annotation information is used to indicate camp information regarding a target object, and the third sub-annotation information is used to indicate location information regarding a target object.

[0073] The first sub-annotation information is generated based on type information regarding the target object; the second sub-annotation information is generated based on camp information regarding the target object; and the third sub-annotation information is generated based on location information regarding the target object. For example, the first sub-annotation information is displayed in an icon format. For instance, a triangle icon represents a virtual character; a square represents a virtual vehicle; and a circle represents a virtual object. The second sub-annotation information is displayed in color. For instance, red represents a virtual object controlled by a hostile player; and blue represents a virtual object within the same camp as the virtual object. The third sub-annotation information is displayed in the form of location coordinates.

[0074] For example, referring to FIG. 4, when target objects (404) and (405) are locked by a search area, a double triangle indicates that target object (404) is a virtual vehicle and a single triangle indicates that target object (405) is a virtual character. If both the double triangle and the single triangle are marked in red, target objects (404) and (405) belong to a hostile camp. The double triangle and the single triangle may indicate the location of target object (404) and the location of target object (405), respectively.

[0075] In some embodiments, the search area may lock a virtual vehicle and a virtual character simultaneously, lock only a virtual character, or lock only a virtual vehicle, and this is not limited to the embodiments of the present application. For example, referring to FIG. 7, the search area corresponding to a virtual aircraft (401) locks only a target object (404) (such as a virtual tank).

[0076] In one example, a search area corresponding to a search image includes a first display modality and a second display modality, the first display modality is used to indicate that a target object is in an unlocked state, and the second display modality is used to indicate that a target object is in a locked state.

[0077] When the duration of the target object in the search area is greater than or equal to the first time threshold, the target object is switched from an unlocked state to a locked state, and the search area is switched from a first display modality to a second display modality. The second display modality is displayed differently from the first display modality. For example, the search area within the second display modality is emphasized compared to the first display modality. Alternatively, the shape of the search area in the first display modality is different from the shape of the search area in the second display modality. Alternatively, the color of the search area in the first display modality is different from the color of the search area in the second display modality, and this is not limited to the embodiments of the present application. For example, referring to FIGS. 5 and FIGS. 8, the search area (306) in the first display modality has a double circle combination shape; the search area (306) in the second display modality has a single circle shape; The size of the search area (306) in the first display modality is larger than the size of the search area (306) in the second display modality. Therefore, displaying the first display modality differently from the second display modality and emphasizing the second display modality provides intuitive feedback to the player as to whether the target object is locked, thereby improving the efficiency of information acquisition.

[0078] Step 605: Display annotation information regarding the target object.

[0079] In some embodiments, annotation information is displayed above, to the left, to the right, etc. of a target object, for example, above the target object, and first sub-annotation information displaying type information regarding the target object, second sub-annotation information displaying camp information regarding the target object, and third sub-annotation information displaying location information regarding the target object are displayed. The annotation information is visible to players within the same camp as the virtual object. In some embodiments, the annotation information may be displayed in the form of icons, text, etc.

[0080] In one example, after displaying comment information regarding the target object, the following contents may also be included:

[0081] 1. If the display duration of annotation information regarding a target object is greater than or equal to the second time threshold, the display of annotation information regarding a target object is cancelled.

[0082] The second time threshold can be adaptively set and adjusted according to actual usage requirements, such as 30 seconds and 35 seconds.

[0083] 2. If the distance between the target object and the virtual object is greater than or equal to the first distance threshold, the display of annotation information regarding the target object is cancelled.

[0084] The first distance threshold can be adaptively set and adjusted according to actual usage requirements, such as 35 meters and 40 meters.

[0085] 3. The display of annotation information regarding the target object is cancelled when it is detected that the virtual life value of the target object is below the first life threshold.

[0086] The first life threshold can be adaptively set and adjusted according to actual usage requirements such as 0 and 5.

[0087] In one example, the annotation process for a target object may also be as follows: detecting a search image; generating annotation information regarding the target object if the search image is detected to contain the target object—the annotation information is used to annotate and display the target object—; and displaying the annotation information regarding the target object.

[0088] In some embodiments, after displaying the search image, the client automatically detects a target object in the search image and automatically generates and displays annotation information for the target object.

[0089] In another example, the annotation process for a target object may also be as follows: in response to a closing action on a navigation image, if a target object is detected to be included in the navigation image, annotation information regarding the target object is automatically generated and displayed.

[0090] In summary, the technical solutions provided by the embodiments of the present application support displaying a search image while displaying a flight image during the flight of a virtual object, thereby ensuring that the flight field of view required for flight control and the search field of view required for search operations can be guaranteed during flight; and can avoid the problem of significant search difficulty caused by poor identification of the reference plane field of view under the flight perspective in the relevant technology, thereby reducing search difficulty and improving search efficiency.

[0091] In addition, by adopting the technical solutions provided by the embodiments of the present application, it is possible to overcome the conflict between the flight view (e.g., head-up view) and the search view (e.g., top-down view), and to realize flight control and search operations by realizing both the flight view and the search view without frequently switching between them, thereby further improving search efficiency.

[0092] Furthermore, by tracking and annotating target objects within the search area's search imagery, rapid and accurate reporting of target objects is achieved, thereby improving the efficiency of information annotation. Simultaneously, based on the reported information, players can acquire the location, camp, type, and other details regarding target objects much more intuitively, thereby improving the efficiency of information acquisition. Additionally, the reported information facilitates more intuitive communication between players and teammates, reducing the impact of different reference systems and different lines of sight on communication, thereby improving communication efficiency and further enhancing the user experience.

[0093] In one exemplary embodiment, referring to FIG. 9, the interface display method provided by the embodiments of the present application, exemplified by a virtual aircraft in a shooting game application, may further be as follows:

[0094] A step of displaying flight images in the UI during the flight of the virtual aircraft—the flight images are images for observing the virtual environment from the flight perspective of the virtual aircraft. The flight line of sight corresponding to the flight perspective coincides with the centerline of the virtual aircraft, i.e., the head-up perspective.

[0095] During the display of the flight image, a navigation image is displayed in the UI in response to the player sliding the wheel control; the navigation image is an image for navigating the virtual environment from the navigation perspective of the virtual aircraft, and the virtual environment displayed in the navigation image is a local area of ​​the virtual environment displayed in the flight image. The wheel control is used to control the navigation perspective of the virtual aircraft, such as remote sensing controls and button combination controls. The navigation perspective refers to the perspective used to navigate the virtual environment during the flight of the virtual object. In some embodiments, the field of view of the navigation perspective is smaller than the field of view of the flight perspective. The initial navigation line of sight corresponding to the navigation perspective overlaps with the flight line of sight. The field of sight area corresponding to the navigation perspective is the display area corresponding to the navigation image.

[0096] The coordinates of the wheel control are acquired; when the wheel control coordinates change, the movement direction of the search image is adjusted according to the direction variable corresponding to the wheel control, and the movement size of the search image is adjusted according to the size variable corresponding to the wheel control. For example, based on the flight line of sight, the adjusted position of the search image on the screen is calculated based on the direction and size variables corresponding to the wheel control, and the search image is displayed at the adjusted position. Otherwise, the wheel control coordinates are continuously acquired to detect whether the wheel control coordinates have changed.

[0097] If it is detected that the player has released the wheel controls, the navigation image display is canceled. Otherwise, the wheel control coordinates continue to be acquired to detect whether the wheel control coordinates have changed.

[0098] In some embodiments, a navigation light column corresponding to the navigation image is displayed while the navigation image is displayed in the UI. The navigation light column refers to a visual rendering effect of the navigation area corresponding to the navigation image to assist the player in performing visual navigation toward a target object. For example, if the navigation area is set as a circular area, the navigation light column may refer to a cone composed of rays from the starting point of the navigation line directed toward each point within the circular area. The centerline of the navigation light column overlaps with the navigation line, the direction of the navigation light column is the same as the direction of the navigation line, and the navigation light column moves according to the movement of the navigation line. The range of the navigation area may be less than or equal to the range of the display area of ​​the navigation image.

[0099] During the display of the search image, the search light column continuously illuminates. When the search light column illuminates the target object, a timer starts. Otherwise, it continues to detect whether the search light column illuminates the target object. In some embodiments, the timer is turned off when the target object moves away from the search light column.

[0100] A timing duration is acquired; if the timing duration is greater than or equal to a first threshold time, camp information and type information regarding the target object are acquired and the timer is turned off. Otherwise, if the search light column is still illuminating the target object, whether the timing duration is greater than or equal to the first threshold time is continuously detected. If the target object moves out of the illumination of the search light column, whether the search light column is illuminating the target object is continuously detected.

[0101] After acquiring camp information, first sub-annotation information and second sub-annotation information regarding the target object are generated according to the camp information and type information. For example, if the camp information indicates that the target object is a hostile camp, the second sub-annotation information is set to red; otherwise, the second sub-annotation information is set to blue. If the type information indicates that the target object is a virtual vehicle, the first sub-annotation information is set as a triangle; otherwise, the first sub-annotation information is set as a double triangle.

[0102] For example, if the target object is a hostile camp, or if the target object is a virtual vehicle, a red double triangle icon (i.e., hostile vehicle icon) is displayed over the target object. If the target object is a virtual character, a red single triangle icon (i.e., hostile character icon) is displayed over the target object. If the target object is not a hostile camp, or if the target object is an unmanned neutral virtual vehicle, a blue unmanned neutral double triangle icon (i.e., unmanned neutral vehicle icon) is displayed. If the target object is not an unmanned neutral virtual vehicle, it is continuously detected whether the search light column is illuminating the target object.

[0103] After the target object is locked and annotation information regarding the target object (such as the aforementioned hostile vehicle icon and hostile character icon) is displayed, a timer starts. The timing duration of the timer is acquired; if the timing duration is greater than or equal to the second threshold time, the display of the annotation information is canceled, otherwise, the annotation information continues to be displayed. The second threshold time is greater than the first threshold time.

[0104] In summary, the technical solutions provided by the embodiments of the present application support displaying a search image while displaying a flight image during the flight of a virtual object, thereby ensuring that the flight field of view required for flight control and the search field of view required for search operations can be guaranteed during flight; and can avoid the problem of significant search difficulty caused by poor identification of the reference plane field of view under the flight perspective in the relevant technology, thereby reducing search difficulty and improving search efficiency.

[0105] In addition, by adopting the technical solutions provided by the embodiments of the present application, it is possible to overcome the conflict between the flight view (e.g., head-up view) and the search view (e.g., top-down view), and to realize flight control and search operations by realizing both the flight view and the search view without frequently switching between them, thereby further improving search efficiency.

[0106] The following are apparatus embodiments of the present application that may be used to carry out the method embodiments of the present application. For details not disclosed in the apparatus embodiments of the present application, refer to the method embodiments of the present application.

[0107] Referring to FIG. 10, a block diagram of an interface display device provided by one embodiment of the present application is illustrated. The device has functions for implementing method embodiments; the functions may be implemented by hardware or by hardware executing corresponding software. The device may be a terminal as described above or may be provided to a terminal. As illustrated in FIG. 10, the device (1000) includes an image display module (1001) and an image adjustment module (1002).

[0108] The image display module (1001) is configured to display a flight image in the UI during the flight of a virtual object, and the flight image is an image for observing the virtual environment from the perspective of the flight of the virtual object.

[0109] The image display module (1001) is further configured to display a search image in response to a search operation during the display of the flight image, and the search image is an image for searching a virtual environment from the perspective of searching a virtual object, and the virtual environment displayed in the search image is a local area of ​​the virtual environment displayed in the flight image.

[0110] The image adjustment module (1002) is configured to adjust the display of the navigation image in response to an adjustment action for the navigation view.

[0111] In one exemplary embodiment, the image display module (1001) is

[0112] Acquire a flight line of sight corresponding to the flight perspective;

[0113] In response to a triggering action for a navigation control displayed in the UI, determine an initial navigation line of sight based on the flight line of sight;

[0114] It is configured to display a search image based on the initial search line.

[0115] In one exemplary embodiment, the image display module (1001) is

[0116] Acquire a first collision point between the initial search line of sight and the reference plane of the virtual environment;

[0117] Determining an area corresponding to a first collision point in a virtual environment as a display area corresponding to a search image;

[0118] It is further configured to display a navigation image based on elements within the display area.

[0119] In one exemplary embodiment, the image display module (1001) is further configured to cancel the display of the search image in response to a release operation for the search control.

[0120] In one exemplary embodiment, the image adjustment module (1002) is

[0121] Acquire an adjusted search line corresponding to the search perspective in response to an adjustment action regarding the search perspective;

[0122] Acquire a second collision point between the adjusted search line of sight and the reference plane of the virtual environment;

[0123] Determining an area corresponding to a second collision point in a virtual environment as an adjusted display area corresponding to a search image;

[0124] It is configured to adjust the display of the navigation image based on elements within the adjusted display area.

[0125] In one exemplary embodiment, the image adjustment module (1002) is

[0126] In response to an adjustment action regarding the search perspective, acquire direction and magnitude variables corresponding to the adjustment action;

[0127] Based on the flight line of sight, determine the direction variable of the search line of sight based on the direction variable corresponding to the adjustment action;

[0128] Based on the flight line of sight, determine the size variable of the search line of sight based on the size variable corresponding to the adjustment action;

[0129] It is further configured to acquire an adjusted search line based on the direction variable and the size variable of the search line.

[0130] In one exemplary embodiment, the image adjustment module (1002) is

[0131] Follow the second collision point on the screen and move to display the navigation image;

[0132] Alternatively, it is further configured to display the navigation image fixedly at a set position on the screen.

[0133] In one exemplary embodiment, a flight remote sensing control corresponding to a virtual object is displayed in the UI, and a movable area corresponding to the flight remote sensing control includes a flight control area and a navigation control area. In the initial state, the flight remote sensing control is located at the center of the movable area.

[0134] The image display module (1001) is further configured to display a navigation image in response to the flight remote sensing control moving from the center of the movable area to the navigation control area.

[0135] The image adjustment module (1002) is further configured to adjust the display of the navigation image in response to the adjustment operation of the flight remote sensing control in the navigation control area.

[0136] In one exemplary embodiment, the image adjustment module (1002) is further configured to cancel the display of the navigation image in response to the flight remote sensing control moving from the navigation control area to the flight control area or being released.

[0137] In one exemplary embodiment, as illustrated in FIG. 11, the device (1000) further includes an object tracking module (1003), an information generation module (1004), and an information display module (1005).

[0138] The object tracking module (1003) is configured to control a search area corresponding to the search image to track a target object in response to an adjustment action for the search perspective. The range of the search area is less than or equal to the range of the display area of ​​the search image.

[0139] The information generation module (1004) is configured to generate annotation information regarding a target object when the duration of the target object in the search area is greater than or equal to a first time threshold, and the annotation information is used to annotate and display the target object.

[0140] The information display module (1005) is configured to display annotation information regarding the target object.

[0141] In one exemplary embodiment, the object tracking module (1003) is further configured to detect a search image.

[0142] The information generation module (1004) is further configured to generate annotation information regarding a target object when a search image is detected to contain a target object, and the annotation information is used to annotate and display the target object.

[0143] The information display module (1005) is additionally configured to display annotation information regarding the target object.

[0144] In one exemplary embodiment, the annotation information includes a first sub-annotation information, a second sub-annotation information, and a third sub-annotation information, wherein the first sub-annotation information is used to display type information regarding a target object, the second sub-annotation information is used to display camp information regarding a target object, and the third sub-annotation information is used to display location information regarding a target object.

[0145] In one exemplary embodiment, the information display module (1005) is

[0146] If the display duration of annotation information regarding a target object is greater than or equal to the second time threshold, cancel the display of annotation information regarding a target object;

[0147] Or, if the distance between the target object and the virtual object is greater than or equal to the first distance threshold, cancel the display of annotation information regarding the target object;

[0148] Alternatively, it is additionally configured to cancel the display of annotation information regarding the target object when it is detected that the virtual life value of the target object is below the first life threshold.

[0149] In one exemplary embodiment, a search area corresponding to a search image includes a first display modality and a second display modality.

[0150] The image adjustment module (1002) is further configured to switch the target object from an unlocked state to a locked state and switch the search area from a first display modality to a second display modality when the duration of the target object in the search area is greater than or equal to a first time threshold.

[0151] In summary, the technical solutions provided by the embodiments of the present application support displaying a search image while displaying a flight image during the flight of a virtual object, thereby ensuring that the flight field of view required for flight control and the search field of view required for search operations can be guaranteed during flight; and can avoid the problem of significant search difficulty caused by poor identification of the reference plane field of view under the flight perspective in the relevant technology, thereby reducing search difficulty and improving search efficiency.

[0152] In addition, by adopting the technical solutions provided by the embodiments of the present application, it is possible to overcome the conflict between the flight view (e.g., head-up view) and the search view (e.g., top-down view), and to realize flight control and search operations by realizing both the flight view and the search view without frequently switching between them, thereby further improving search efficiency.

[0153] It should be noted that when the device provided in the above embodiments implements the functions, the division of the function modules is used merely as an example for illustrative purposes. In actual applications, functions may be assigned to different function modules and completed by them according to requirements. That is, the internal structure of the device may be divided into different function modules to complete all or part of the aforementioned functions. Furthermore, the device and method embodiments provided in the above embodiments belong to the same concept. For details of specific implementation processes, refer to the method embodiments. Details are not described again in this specification.

[0154] Referring to FIG. 12, a structural block diagram of a terminal (1200) provided by one embodiment of the present application is shown. The terminal is configured to implement the interface display method provided in the embodiments. The terminal may be a terminal (10) in the implementation environment shown in FIG. 1.

[0155] Specifically, the terminal (1200) generally includes a processor (1201) and a memory (1202).

[0156] In some embodiments, the processor (1201) may include one or more processing cores, such as a 4-core processor and an 8-core processor. The processor (1201) may be implemented in hardware in at least one form of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor (1201) includes a main processor and a coprocessor, the main processor is a processor for processing data in an awake state, also referred to as a central processing unit (CPU), and the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor (1201) may be integrated with a graphics processing unit (GPU), and the GPU is configured to render and draw content required for a display screen. In some embodiments, the processor (1201) may further include an artificial intelligence (AI) processor. The AI ​​processor is configured to process computing operations related to machine learning.

[0157] In some embodiments, the memory (1202) may include one or more computer-readable storage media; the computer-readable storage media may be non-transient. The memory (1202) may further include high-speed random access memory and non-volatile memory, for example, one or more disk storage devices and flash storage devices. In some embodiments, the non-transient computer-readable storage media in the memory (1202) is used to store at least one instruction, at least one program piece, code set, or instruction set configured to be executed by one or more processors to implement an interface display method.

[0158] In some embodiments, the terminal (1200) may also optionally include a peripheral device interface (1203) and at least one peripheral device. The processor (1201), memory (1202), and peripheral device interface (1203) may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface (1203) via a bus, a signal line, or a circuit board. In particular, the peripheral device includes at least one of a radio frequency circuit (1204), a display screen (1205), an audio circuit (1206), and a power supply (1207).

[0159] A person skilled in the art can understand that the structure illustrated in FIG. 12 does not constitute a limitation on the terminal (1200) and may include more or fewer assemblies than those illustrated in the drawing, combine some assemblies, or use different assembly arrangements.

[0160] In one exemplary embodiment, a computer-readable storage medium is further provided for storing at least one instruction, at least one program, a set of codes, or a set of instructions that implement the interface display method when executed by a processor.

[0161] In some embodiments, the computer-readable storage medium may include read-only memory (ROM), random-access memory (RAM), solid-state drives (SSD), optical disks, etc. The random-access memory may include resistive random-access memory (ReRAM) and dynamic random-access memory (DRAM).

[0162] In one exemplary embodiment, computer program products or computer programs comprising computer instructions stored in a computer-readable storage medium are further provided. A processor of a terminal reads computer instructions from a computer-readable storage medium, and the processor executes computer instructions to cause the terminal to execute the interface display method.

[0163] As used herein, "plural" means two or more. "And / or," describing an associated relationship between associated objects, indicates that there may be three relationships; for example, A and / or B may indicate three cases: A alone, A and B together, and B alone. The character " / " generally indicates an "or" relationship between associated objects. Additionally, the step numbers described herein merely illustrate possible execution orders between the steps. In some other embodiments, the steps may not be performed in the order of the numbers. For example, two steps with different numbers may be performed simultaneously, or two steps with different numbers may be performed in an order opposite to that shown in the drawings. This is not limited to the embodiments of the present application.

[0164] The foregoing is merely an exemplary embodiment of the present application and is not intended to limit the application. Any modification, equivalent substitution, or improvement made within the spirit and principles of the present application will fall within the scope of protection of the present application.

Claims

Claim 1 A method for displaying an interface executed by a terminal device, comprising: a step (201) of displaying a flight image in a user interface (UI) during the flight of a virtual object, wherein the flight image is an image for observing a virtual environment from the perspective of the flight of the virtual object; a step (202) of displaying a search image in response to a search operation during the display of the flight image, wherein the search image is an image for exploring the virtual environment from the perspective of the search of the virtual object, and the virtual environment displayed in the search image is a local area of ​​the virtual environment displayed in the flight image; and a step (203) of adjusting the display of the search image in response to an adjustment operation for the perspective of the search, wherein the search area corresponding to the search image includes a first display modality and a second display modality, and the method further comprises the step of switching the target object from an unlocked state to a locked state and switching the search area from the first display modality to the second display modality when the duration of the target object in the search area is greater than or equal to a first time threshold. Claim 2 A method according to claim 1, wherein the step of displaying a search image in response to a search operation comprises: a step of acquiring a flight line of sight corresponding to the flight viewpoint; a step of determining an initial search line of sight based on the flight line of sight in response to a triggering operation for a search control displayed in the UI; and a step of displaying the search image based on the initial search line of sight. Claim 3 A method according to paragraph 2, wherein the step of displaying the search image based on the initial search line comprises: acquiring a first collision point between the initial search line and a reference plane of the virtual environment; determining an area corresponding to the first collision point in the virtual environment as a display area corresponding to the search image; and displaying the search image based on elements within the display area. Claim 4 A method according to paragraph 2, further comprising the step of canceling the display of the search image in response to a release operation for the search control. Claim 5 In paragraph 2, the step of adjusting the display of the search image in response to an adjustment operation for the search perspective comprises: a step of acquiring an adjusted search line corresponding to the search perspective in response to an adjustment operation for the search perspective; a step of acquiring a second collision point between the adjusted search line and a reference plane of the virtual environment; a step of determining an area corresponding to the second collision point in the virtual environment as an adjusted display area corresponding to the search image; and a step of adjusting the display of the search image based on elements within the adjusted display area. Claim 6 In claim 5, the step of acquiring an adjusted search line corresponding to the search point in response to an adjustment action for the search point comprises: acquiring a direction variable and a size variable corresponding to the adjustment action in response to the adjustment action for the search point; determining a direction variable of the search line based on the direction variable corresponding to the adjustment action based on the flight line; determining a size variable of the search line based on the size variable corresponding to the adjustment action based on the flight line; and acquiring the adjusted search line based on the direction variable of the search line and the size variable of the search line. Claim 7 In claim 5, the step of adjusting the display of the search image comprises: a step of moving to display the search image following the second collision point on the screen; or a step of fixedly displaying the search image at a set position on the screen. Claim 8 A method according to claim 1, wherein a flight remote sensing control corresponding to the virtual object is displayed in the UI, and a movable area corresponding to the flight remote sensing control includes a flight control area and a search control area; wherein the flight remote sensing control is positioned at the center of the movable area in an initial state; the step of displaying a search image in response to a search operation includes the step of displaying the search image in response to the flight remote sensing control moving from the center of the movable area to the search control area; and the step of adjusting the display of the search image in response to an adjustment operation regarding the search view includes the step of adjusting the display of the search image in response to the adjustment operation of the flight remote sensing control in the search control area. Claim 9 A method according to claim 8, further comprising the step of canceling the display of the search image in response to the flight remote sensing control moving from the search control area to the flight control area or being released. Claim 10 A method according to claim 1, further comprising the steps of: controlling the search area corresponding to the search image to follow the target object in response to an adjustment operation for the search perspective, wherein the range of the search area is less than or equal to the range of the display area of ​​the search image; generating annotation information regarding the target object when the duration of the target object in the search area is greater than or equal to the first time threshold, wherein the annotation information is used to annotate and display the target object; and displaying the annotation information regarding the target object. Claim 11 A method according to claim 1, further comprising: a step of detecting the search image; a step of generating annotation information regarding the target object when the search image is detected to include the target object—the annotation information is used to annotate and display the target object—; and a step of displaying the annotation information regarding the target object. Claim 12 A method according to claim 10 or 11, wherein the annotation information comprises a first sub-annotation information, a second sub-annotation information, and a third sub-annotation information, wherein the first sub-annotation information is used to display type information regarding the target object, the second sub-annotation information is used to display camp information regarding the target object, and the third sub-annotation information is used to display location information regarding the target object. Claim 13 A method according to claim 10 or 11, further comprising, after the step of displaying annotation information regarding the target object, a step of canceling the display of the annotation information regarding the target object when the duration of the display of the annotation information regarding the target object is greater than or equal to a second time threshold; or a step of canceling the display of the annotation information regarding the target object when the distance between the target object and the virtual object is greater than or equal to a first distance threshold; or a step of canceling the display of the annotation information regarding the target object when the virtual life value of the target object is detected to be less than or equal to a first life threshold. Claim 14 As an interface display device, an image display module (1001) configured to display a flight image in a user interface (UI) during the flight of a virtual object, wherein the flight image is an image for observing a virtual environment from the perspective of the flight of the virtual object; the image display module is further configured to display a search image in response to a search operation during the display of the flight image, wherein the search image is an image for searching the virtual environment from the perspective of the search of the virtual object, and the virtual environment displayed in the search image is a local area of ​​the virtual environment displayed in the flight image; The device includes an image adjustment module (1002) configured to adjust the display of the search image in response to an adjustment operation for the search perspective, wherein the search area corresponding to the search image includes a first display modality and a second display modality, and the device is further configured to switch the target object from an unlocked state to a locked state and switch the search area from the first display modality to the second display modality when the duration of the target object in the search area is greater than or equal to a first time threshold. Claim 15 A terminal device comprising a processor and a memory for storing computer programs, wherein the computer programs are loaded and executed by the processor to implement an interface display method according to claim 1. Claim 16 A computer-readable storage medium for storing computer programs, wherein the computer programs are loaded and executed by a processor to implement an interface display method according to claim 1. Claim 17 delete Claim 18 delete

Citation Information

Patent Citations

  • Flight simulation training image display system

    KR101396291B1