Interface display method, interface display device, terminal equipment, and computer program
By implementing a method to simultaneously display flight and search screens in game applications, the visibility and efficiency of locating enemy characters are improved, addressing the low visibility and high difficulty from a flight perspective, and enhancing user experience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- TENCENT TECHNOLOGY (SHENZHEN) CO LTD
- Filing Date
- 2022-10-31
- Publication Date
- 2026-06-18
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In game applications, particularly shooting games, the visibility from a flight perspective is low, leading to high difficulty and low efficiency in exploring the virtual environment to locate enemy-controlled characters.
Simultaneously display a flight screen and a search screen during flight, allowing for both flight control and search operations by adjusting the search screen based on user interactions, ensuring both flight and search fields of view are maintained without frequent view switching.
This approach reduces the difficulty of search operations and improves search efficiency by maintaining necessary fields of view, enabling simultaneous flight and search capabilities, and enhances user experience through accurate and intuitive target object annotation.
Smart Images

Figure 0007875952000001 
Figure 0007875952000002 
Figure 0007875952000003
Abstract
Description
【Technical Field】 【0001】 This application claims the priority of the Chinese patent application with the application number 202210074263.1 and the invention title "Interface Display Method, Device, Terminal, Storage Medium, and Computer Program Product", which was filed on January 21, 2022, and the entire content of the Chinese patent application is incorporated herein by reference. The invention of this application relates to the fields of computer and Internet technologies, and particularly to an interface display method, Interface display device, terminal equipment, and and computer program Mu related thereto. 【Background Art】 【0002】 Currently, in a game application, a player can explore the virtual ground of a virtual environment by a virtual flying vehicle to determine the position of a virtual character controlled by an enemy player. 【0003】 Taking a shooting game application as an example, a player can control the flight of a virtual flying vehicle based on a flight perspective (e.g., a frontal perspective) corresponding to the virtual flying vehicle, and during the flight control of the virtual flying vehicle, use the flight perspective to explore the virtual ground of the virtual environment and search for a virtual character controlled by an enemy player. 【0004】 However, the visibility of the ground view from the flight perspective is low, the difficulty of ground exploration is high, and the exploration efficiency is low. 【Summary of the Invention】 【0005】 The invention of this application is an interface display method, Interface display device, terminal equipment, and and computer program MuThe present invention provides the ability to secure a search field of view necessary for search operations while maintaining the flight field of view necessary for flight control during flight, thereby reducing the difficulty of search and improving search efficiency. The present invention is as follows: 【0006】 According to one embodiment of the present invention, an interface display method performed by a terminal device, A step of displaying a flight screen in the user interface while a virtual object is in flight, wherein the flight screen is a screen that observes the virtual environment from the flight viewpoint of the virtual object; The step of displaying a search screen in response to a search operation while the above-mentioned flight screen is being displayed, wherein the search screen is a screen for searching the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen, An interface display method is provided which includes the step of adjusting and displaying the search screen in response to an adjustment operation on the search viewpoint. 【0007】 According to one embodiment of the present invention, an interface display device is provided, A screen display module for displaying a flight screen on a user interface while a virtual object is in flight, wherein the flight screen is a screen for observing the virtual environment from the flight viewpoint of the virtual object, and the screen display module is further used to display a search screen in response to a search operation while the flight screen is being displayed, wherein the search screen is a screen for exploring the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen, and An interface display device is provided, which includes a screen adjustment module used to adjust and display the search screen in response to an adjustment operation on the search viewpoint. 【0008】 According to one embodiment of the present invention, a terminal device is provided which includes a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is loaded and executed by the processor, the interface display method is executed. 【0009】 According to one embodiment of the present invention, a computer-readable storage medium is provided which stores a computer program, and which, when the computer program is loaded and executed by a processor, executes the interface display method described above. 【0010】 According to one embodiment of the present invention, a computer program product is provided which includes a computer program stored in a computer-readable storage medium. When the processor of a terminal reads the computer program from the computer-readable storage medium and the processor executes the computer program, the terminal executes the interface display method described above. 【0011】 By supporting the simultaneous display of the flight screen and the search screen while a virtual object is in flight, it is possible to secure the flight field of view necessary for flight control while simultaneously securing the search field of view necessary for search operations. This avoids the problem of high search difficulty caused by the low visibility of the reference plane field of view from the flight viewpoint in conventional technology, thereby reducing the difficulty of search and improving search efficiency. 【0012】 Furthermore, by adopting the technical solution provided by the embodiment of this application, it is possible to overcome the collision between the flight view (e.g., a ground view) and the search view (e.g., an overhead view) without frequently switching between the flight view and the search view in order to realize flight control and search operations, thereby achieving simultaneous possession of both the flight view and the search view and further improving search efficiency. [Brief explanation of the drawing] 【0013】 [Figure 1]It is a schematic diagram of the implementation environment of the solution provided by an embodiment of the present application. [Figure 2] It is a flowchart of the interface display method provided by an embodiment of the present application. [Figure 3] It is a schematic diagram of the flight screen provided by an embodiment of the present application. [Figure 4] It is a schematic diagram of the flight viewpoint and exploration viewpoint provided by an embodiment of the present application. [Figure 5] It is a schematic diagram of the exploration screen provided by an embodiment of the present application. [Figure 6] It is a flowchart of the interface display method provided by another embodiment of the present application. [Figure 7] It is a schematic diagram of the target object in the locked state provided by an embodiment of the present application. [Figure 8] It is a schematic diagram of the exploration area in the second display state provided by an embodiment of the present application. [Figure 9] It is a flowchart of the interface display method provided by another embodiment of the present application. [Figure 10] It is a block diagram of the interface display device provided by an embodiment of the present application. [Figure 11] It is a block diagram of the interface display device provided by another embodiment of the present application. [Figure 12] It is a block diagram of the terminal provided by an embodiment of the present application. 【Embodiments for Implementing the Invention】 【0014】 FIG. 1 shows a schematic diagram of the implementation environment of the solution provided by an embodiment of the present application. The implementation environment may include a terminal 10 and a server 20. 【0015】 The terminal 10 may be an electronic device such as a smartphone, a tablet computer, a game console, a multimedia playback device, or a PC (Personal Computer). A client of a target application, for example, a client of a game application or a simulation learning application, can be installed on the terminal 10. Exemplarily, the terminal 10 may also be referred to as the terminal device 10. 【0016】 The server 20 is used to provide a background service for a client of an application (such as a game application) in the terminal 10. For example, the server 20 may be a background server of the above application (game application). The server 20 may be a single server, or a server cluster composed of multiple servers, or a single cloud computing service center. 【0017】 The terminal 10 and the server 20 can communicate with each other via the network 30. The network 30 may be a wired network or a wireless network. 【0018】 Exemplarily, taking the client applicable to a game application as an example, during the flight of a virtual object (such as a virtual flying vehicle, a virtual character, a virtual exploration device, etc.), the user interface displays a flight screen from a flight perspective. By triggering the exploration control in the user interface, the player can display a search screen while displaying the flight screen, without affecting the flight field of view, and can search for the virtual character controlled by the enemy player through the search screen. 【0019】 Figure 2 shows a flowchart of an interface display method provided by one embodiment of the present invention, wherein the entity executing each step of the method may be terminal 10 in the implementation environment shown in Figure 1, and the method may include several steps (steps 201 to 203) as follows. 【0020】 In step 201, while the virtual object is flying, the user interface displays a flight screen, which is a screen that allows the user to observe the virtual environment from the virtual object's flight viewpoint. 【0021】 In the embodiments of the present invention, the virtual object may refer to a virtual character controlled by a user account within an application. Taking a shooting game application as an example, the virtual object refers to a game character controlled by a user account within the game application, and the game character has the ability to fly. The virtual object may also refer to a virtual flying vehicle driven by a virtual character within an application, such as a virtual airplane, virtual helicopter, or virtual hot air balloon. The virtual object may also refer to a virtual exploration device controlled by a virtual character within an application, such as a virtual drone, and the embodiments of the present invention are not limited to the type of virtual object. 【0022】 A user interface refers to the display screen of an application, such as the display screen of the target application described above. For example, in a shooting game application, the user interface may be the game's display interface for presenting the virtual environment of the game to the user. In a simulation learning application, the user interface may be the learning scene's display interface for presenting the simulation environment within the learning scene to the user. In some embodiments, the user interface includes a display layer and a control layer. Of these, the display layer of the control layer is higher than the display layer of the display layer. The display layer is used to display screen information (e.g., flight screen, exploration screen, etc.), and the control layer is used to display UI (User Interface) controls (hereinafter referred to as exploration controls, flight remote controls, etc.). 【0023】 In some embodiments, the flight viewpoint refers to a viewpoint used to assist in flight control of a virtual object. The player can obtain a corresponding flight field of view through the flight viewpoint and further control the flight direction, speed, etc., of the virtual object based on the virtual environment within the flight field of view. Exemplarily, the flight viewpoint may refer to a plan view, i.e., a broad viewpoint with the virtual object as the centerline. For example, the flight viewpoint can be adjusted by adjusting the flight angle of the virtual object in order to observe the virtual sky, virtual ground, etc., while the virtual object is flying. 【0024】 Among these, the virtual environment is the environment displayed (or provided) when a client of an application (e.g., a game application) is executed on a terminal, and refers to the environment created for virtual objects to perform activities (e.g., a game competition), and may be, for example, a virtual house, a virtual island, a virtual sky, a virtual land, etc. The virtual environment may be a simulation environment of the real world, a semi-simulated and semi-fictional environment, or a purely fictional environment, and the embodiments of the present application are not limited to these. 【0025】 For example, referring to Figure 3, while the virtual flight vehicle 301 is in flight, the user interface 300 displays a flight screen 302, which is a screen that allows the user to observe the virtual environment from the flight perspective of the virtual flight vehicle 301. 【0026】 In step 202, while the flight screen is displayed, in response to a search operation, a search screen is displayed which allows the virtual environment to be explored from the search viewpoint of the virtual object. The virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen. 【0027】 The exploration viewpoint refers to a viewpoint used to explore the virtual environment while a virtual object is flying. By exploring the viewpoint, the player can obtain a corresponding exploration field of view and further explore target objects based on the local virtual environment within the exploration field of view. Exemplaryly, the angle of the exploration viewpoint may be the same as the angle of the flight viewpoint. For example, the exploration viewpoint may be a broad viewpoint with the virtual object as the centerline. The exploration viewpoint may refer to any viewpoint other than the flight viewpoint, such as an overhead view with respect to a reference plane in the virtual environment (e.g., virtual ground, virtual sea surface, etc.), and the embodiments of this application are not limited to the angle of the exploration viewpoint. In some embodiments, the target object may be a virtual character, virtual vehicle, virtual item, etc., and the embodiments of this application are not limited to these. The exploration screen is displayed on the same screen as the flight screen. In some embodiments, the exploration screen may be a magnified portion of the flight screen, and the exploration screen may be a screen captured from the virtual environment by a corresponding virtual camera, and the virtual camera corresponding to the exploration screen may be a virtual camera with a higher magnification than the virtual camera corresponding to the flight screen. 【0028】 For example, referring to Figure 4, the virtual flight vehicle 401 corresponds to a plan view (i.e., flight view 402) with the virtual flight vehicle 401 as the centerline. The virtual flight vehicle 401 further corresponds to a search view 403 (e.g., an overhead view) that starts from the virtual flight vehicle 401 and has a different angle from the flight view 402. The search field of view corresponding to the search view 403 includes target objects 404 and 405. 【0029】 In some embodiments, a search operation is used to trigger the display of a search screen, and such search operation may be an operation such as clicking, pressing, or sliding. Such search operation may refer to the player's operation on a UI control within the user interface. 【0030】 In one example, the process of displaying the search screen may include the steps of: acquiring a flight line corresponding to the flight viewpoint; determining an initial search line based on the flight line in response to a trigger operation on the search control displayed on the user interface; and displaying the search screen based on the initial search line. 【0031】 The flight line of sight refers to the centerline corresponding to the flight viewpoint, for example, the centerline of the virtual flying vehicle 401 corresponding to the flight viewpoint 402. The search line of sight refers to the centerline corresponding to the search viewpoint, for example, the centerline corresponding to the search viewpoint 403. In some embodiments, the flight line of sight may be determined as the initial search line of sight, or the initial search line of sight may be set to an angle where the difference between it and the flight line of sight is set, and the embodiments of the present application are not limited to these. 【0032】 The exploration control is used to trigger the display of the exploration screen. This exploration control can refer to a remote control, a button combination control, etc. For example, referring to Figure 5, the user interface 300 displays a exploration control 303 corresponding to the movable area 304. In the initial state, the exploration control 303 is located at the center of the movable area 304. In response to the player's drag operation (i.e., trigger operation) on the exploration control 303 within the movable area 304, the display of the exploration screen 305 is triggered so that the exploration control 303 moves away from the center of the movable area 304. 【0033】 In some embodiments, the content and position of the exploration screen 305 are adjusted and displayed in response to the player's non-drop / drag operation on the exploration control 303, and the display of the exploration screen 305 is canceled and the exploration line of sight is initialized to the flight line of sight in response to the player's drop operation on the exploration control 303. 【0034】 In some embodiments, the exploration screen corresponds to a display area, which refers to a local area in the virtual environment, and the display elements (i.e., display content) corresponding to this local area are the display elements of the exploration screen. 【0035】 In one example, the method for obtaining the display area corresponding to the search screen may include obtaining a first collision point between the initial search line of sight and the reference plane of the virtual environment, determining the area in the virtual environment corresponding to the first collision point as the display area corresponding to the search screen, and displaying the search screen based on the elements in the display area. 【0036】 The reference plane refers to the flight reference plane of a virtual object in flight, and may be a virtual ground, a virtual sea surface, etc., in the virtual environment. In the embodiments of this application, the collision point means the intersection point of the detection ray and the collision box. For example, the first collision point means the intersection point of the detection ray corresponding to the initial search line and the collision box corresponding to the reference plane. The detection ray corresponding to the initial search line can overlap with the initial search line. 【0037】 In some embodiments, the region centered on the first collision point can be determined as a display region corresponding to the search screen, such as a regular region like a circle or a square, or an irregular region similar to a damaged mirror surface. The display content of the search screen is determined based on the elements corresponding to the display region, and the search screen is displayed based on the display content of the search screen. 【0038】 For example, referring to Figures 4 and 5, in the initial state, the search line of sight corresponding to the search viewpoint 403 overlaps with the flight line of sight corresponding to the flight viewpoint 402, that is, the first collision point between the search line of sight and the reference plane is the intersection point between the flight line of sight and the reference plane. A circular area centered on the first collision point is determined as the display area corresponding to the search screen 305, and the display content corresponding to the display area is enlarged to obtain the display content corresponding to the search screen 305. 【0039】 In step 203, the search screen is adjusted and displayed in response to an adjustment operation on the search viewpoint. 【0040】 In some embodiments, in response to an adjustment operation on the search viewpoint, an adjusted search line of sight corresponding to the search viewpoint is obtained, a second collision point between the adjusted search line of sight and the reference plane of the virtual environment is obtained, the region in the virtual environment corresponding to the second collision point is determined as the adjusted display region corresponding to the search screen, and the display of the search screen is adjusted based on the elements of the adjusted display region. 【0041】 The second collision point refers to the intersection of the detection ray corresponding to the adjusted search line of sight and the collision box corresponding to the reference plane. The region centered on the second collision point is determined as the adjusted display area, the display content corresponding to the adjusted display area is enlarged to obtain the adjusted display content corresponding to the search screen, and the search screen is adjusted and displayed based on the adjusted display content. For example, referring to Figure 4, if the initial search line of sight corresponding to the search viewpoint 403 is the center line corresponding to the flight viewpoint 402, then the center line corresponding to the search viewpoint 403 is the adjusted search line of sight, and the display area corresponding to the search viewpoint 403 is the adjusted display area. 【0042】 In some embodiments, referring to Figure 5, a non-drop-drag operation can be performed on the search control 303 to adjust the display area corresponding to the search screen. 【0043】 In one example, the process of acquiring the adjusted search line of sight may include the steps of: acquiring a direction variable and amplitude variable corresponding to an adjustment operation in response to an adjustment operation on the search viewpoint; determining the direction variable of the search line of sight based on the direction variable corresponding to the adjustment operation, with the flight line of sight as the reference; determining the amplitude variable of the search line of sight based on the amplitude variable corresponding to the adjustment operation, with the flight line of sight as the reference; and acquiring the adjusted search line of sight based on the direction variable and amplitude variable of the search line of sight. 【0044】 The direction variable is used to map and indicate the direction of change in the search line of sight, and the amplitude variable is used to map and indicate the amplitude of the search line of sight fluctuation. For example, referring to Figure 5, the vertical downward direction passing through the center point of the movable area is defined as the reference direction, and this reference direction is the same as the direction of the flight line of sight of the virtual flight vehicle 301. The direction variable and amplitude variable are determined based on the coordinates of the search control 303 and the reference direction. For example, if the direction variable instructs the search line of sight to move to the right of the flight line of sight, then together with the amplitude variable, the amplitude of the search line of sight movement in that direction (i.e., the amplitude variable) is determined, and the adjusted search line of sight is determined. 【0045】 In some embodiments, the search screen can be moved and displayed on the screen to follow a second collision point. For example, the second collision point can be determined as the center point of the search screen, and the display position of the search screen changes in accordance with the change in the second collision point. The search screen can also be fixed and displayed at a set position on the screen. For example, the search screen can be fixed and displayed in the upper right corner of the screen. The embodiments of this application are not limited to the display position of the search screen. 【0046】 In one executable example, the user interface displays a flight remote control corresponding to a virtual object, and the movable area corresponding to this flight remote control includes a flight control area and a search control area, of which, in the initial state, the flight joystick control is located at the center of the movable area. 【0047】 When a flight remote control is located in the flight control area, it is used to control the flight viewpoint of the virtual object. When a flight remote control is located in the search control area, it is used to control the search viewpoint of the virtual object. The movable area refers to the movable area corresponding to the flight remote control. 【0048】 In some embodiments, the exploration screen is displayed in response to the flight remote control being moved from the center of the movable area to the exploration control area. For example, the flight control area is a circular area with the center of the movable area as its center, and the exploration control area is the area with the center of the movable area as its center, excluding the flight control area. The exploration screen is displayed in response to the player moving the flight remote control from the flight control area to the exploration control area. 【0049】 In some embodiments, the search screen is adjusted and displayed in response to adjustment operations of the flight remote control within the search control area. For example, referring to the above embodiment, after the display of the search screen, the search screen is adjusted and displayed in response to the player controlling the movement of the flight remote control within the search control area. 【0050】 In some embodiments, the display of the search screen is canceled in response to the flight remote control being moved from the search control area to the flight control area or being released. For example, referring to the above embodiment, after the display of the search screen, the display of the search screen is canceled in response to the player moving the flight remote control from the search control area to the flight control area or releasing it. 【0051】 In summary, the technology provided by the embodiment of the present invention supports the simultaneous display of a flight screen and a search screen while a virtual object is in flight. This ensures the flight field of view necessary for flight control while securing the search field of view necessary for search operations. This avoids the problem in the prior art of high search difficulty due to the low visibility of the reference plane field of view from the flight viewpoint, thereby reducing the difficulty of search and improving search efficiency. 【0052】 Furthermore, by adopting the technical solution provided by the embodiment of this application, it is possible to overcome the collision between the flight view (e.g., a ground view) and the search view (e.g., an overhead view) without frequently switching between the flight view and the search view in order to realize flight control and search operations, thereby achieving simultaneous possession of both the flight view and the search view and further improving search efficiency. 【0053】 Furthermore, by moving the exploration screen to follow the second collision point on the screen, the display area corresponding to the exploration screen can be accurately characterized, further reducing the difficulty of exploration and improving exploration efficiency. At the same time, this helps players conduct planned and strategic exploration, improving the user experience. In addition, by adjusting the exploration line of sight using two angles, the directional variable and the amplitude variable, the accuracy of adjusting the exploration line of sight is improved, further enhancing the exploration accuracy of the flight screen. 【0054】 Refer to Figure 6, which shows a flowchart of an interface display method provided by another embodiment of the present invention, wherein the entity performing each step of the method may be terminal 10 in the implementation environment shown in Figure 1, and the method may include the following steps (steps 601 to 605). 【0055】 In step 601, while the virtual object is flying, the user interface displays a flight screen, which is a screen that allows the user to observe the virtual environment from the virtual object's flight viewpoint. 【0056】 In step 602, while the flight screen is displayed, in response to a search operation, a search screen is displayed which is a screen for exploring the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen. 【0057】 Steps 601 and 602 are the same as those described in the above-mentioned embodiments, and for any aspects not described in the embodiments of this application, refer to the above embodiments, and their description is omitted here. 【0058】 In step 603, in response to an adjustment operation on the search viewpoint, the search area corresponding to the search screen is controlled to follow the target object, and the range of the search area is less than or equal to the range of the display area of the search screen. 【0059】 The target object can refer to a virtual character, virtual vehicle, virtual item, etc., and the embodiments of this application are not limited to the type of target object. In the embodiments of this application, the search area is used to capture the target object. The center position of the search area may coincide with the center position of the display area of the search screen. The search area may be a region having a shape such as a circle or a rectangle. 【0060】 For example, referring to Figure 5, the exploration screen 305 corresponds to the exploration area 306. If a target object exists on the exploration screen 305, the player can control the exploration control 303 to make the exploration area 306 follow the target object on the exploration screen. 【0061】 In step 604, if the time the target object has been in the search area is equal to or greater than the first time threshold, annotation information (comment information) for the target object is generated, and this annotation information is used to display the target object with annotations. 【0062】 Of these, the first time threshold can be adaptively set and adjusted according to actual usage needs, such as 1.5 seconds or 2 seconds. If the center position corresponding to the target object is within the search area, the target object can be determined to be within the search area. The player adjusts the search area so that the target object remains within the search area, and generates annotation information for the target object when the duration exceeds the first time threshold. 【0063】 In some embodiments, the annotation information may include a first sub-annotation, a second sub-annotation, and a third sub-annotation, of which the first sub-annotation is used to indicate the type of the target object, the second sub-annotation is used to indicate the faction of the target object, and the third sub-annotation is used to indicate the location of the target object. 【0064】 Based on the target object's type information, a first sub-annotation is generated; based on the target object's faction information, a second sub-annotation is generated; and based on the target object's location information, a third sub-annotation is generated. For example, the first sub-annotation is displayed in icon style. For instance, a triangular icon represents a virtual character, a square represents a virtual vehicle, and a circle represents a virtual item. The second sub-annotation is displayed in color. For example, red represents a virtual object controlled by an enemy player, and blue represents a virtual object belonging to the same faction as the virtual object. The third sub-annotation is displayed in the form of location coordinates. 【0065】 For example, referring to Figure 4, if target object 404 and target object 405 are locked in the search area, a double triangle indicates that target object 404 is a virtual vehicle, and a single triangle indicates that target object 405 is a virtual character. Assuming that both the double and single triangles are red annotations, both target object 404 and target object 405 belong to the enemy faction. The double and single triangles can indicate the location of target object 404 and target 405, respectively. 【0066】 In some embodiments, the search area may lock both virtual vehicles and virtual characters simultaneously, lock only virtual characters, or lock only virtual vehicles, and the embodiments of the present invention are not limited to these. For example, referring to Figure 7, the search area corresponding to the virtual flying vehicle 401 locks only the target object 404 (e.g., a virtual tank). 【0067】 In one example, the search area corresponding to the search screen includes a first display mode to indicate that the target object is unlocked and a second display mode to indicate that the target object is locked. 【0068】 If the time the target object is located within the search area is greater than or equal to a first time threshold, the target object is switched from an unlocked state to a locked state, and the search area is switched from a first display mode to a second display mode. The second display mode is displayed distinctly from the first display mode. For example, the search area in the second display mode is highlighted relative to the first display mode. Alternatively, the shape of the search area in the first display mode is different from the shape of the search area in the second display mode. Alternatively, the color of the search area in the first display mode is different from the color of the search area in the second display mode, and the embodiments of this application are not limited to these. For example, referring to Figures 5 and 8, the search area 306 in the first display mode has a double-circle combination shape, the search area 306 in the second display mode has a single-circle shape, and the dimensions of the search area 306 in the first display mode are greater than the dimensions of the search area 306 in the second display mode. In this way, by distinguishing between the first and second display modes and highlighting the second display mode, the player is given intuitive feedback on whether or not the target object is locked, thereby improving the efficiency of information acquisition. 【0069】 In step 605, the annotation information of the target object is displayed. 【0070】 In some embodiments, annotation information is displayed above, to the left of, or to the right of the target object. For example, above the target object, a first sub-annotation is displayed to indicate the type of the target object, a second sub-annotation is displayed to indicate the faction of the target object, and a third sub-annotation is displayed to indicate the location of the target object. Players belonging to the same faction as the virtual object can view this annotation information. In some embodiments, this annotation information can be displayed in the form of icons, text, or other similar forms. 【0071】 In one example, after displaying the annotation information of the target object, the following may be further included: 【0072】 1. If the display time of the annotation information for the target object exceeds the second time threshold, the display of the annotation information for the target object will be canceled. 【0073】 Of these, the second time threshold can be adaptively set and adjusted according to actual usage needs, such as 30 seconds or 35 seconds. 【0074】 2. If the distance between the target object and the virtual object is greater than or equal to the first distance threshold, the display of the target object's annotation information is canceled. 【0075】 The first distance threshold can be adaptively set and adjusted according to actual usage needs, such as 35 meters or 40 meters. 【0076】 3. When it is detected that the virtual life value of the target object is below the first life threshold, the display of the annotation information for the target object is canceled. 【0077】 The first life threshold can be adaptively set and adjusted according to actual usage needs, such as 0 or 5. 【0078】 In one example, the process of annotating a target object may further include the steps of detecting a search screen, generating annotation information for the target object for annotating and displaying the target object if the search screen is found to contain the target object, and displaying the annotation information for the target object. 【0079】 In some embodiments, after the search screen is displayed, the client automatically detects the target object within the search screen and automatically generates and displays annotation information for the target object. 【0080】 In another example, the target object annotation process may further include the step of automatically generating and displaying annotation information for the target object when it detects that the target object is included in the exploration screen in response to an off operation on the exploration screen. 【0081】 In summary, the present invention supports the simultaneous display of a flight screen and a search screen while a virtual object is in flight. This ensures the flight field of view necessary for flight control while simultaneously securing the search field of view necessary for search operations. This avoids the problem in the prior art of high search difficulty due to the poor visibility of the reference plane field of view from the flight viewpoint, thereby reducing the difficulty of search and improving search efficiency. 【0082】 Furthermore, according to the present invention, in order to realize flight control and search operations, it is possible to overcome the collision between the flight view (e.g., a ground view) and the search view (e.g., an overhead view) without frequently switching between the flight view and the search view, thereby achieving simultaneous possession of both the flight view and the search view, and further improving search efficiency. 【0083】 Furthermore, by having the search area track and annotate target objects within the search screen, rapid and accurate location reporting of target objects is achieved, improving the efficiency of information annotation. At the same time, players can more intuitively acquire information such as the location, faction, and type of target objects based on this location report information, improving the efficiency of information acquisition. In addition, location report information is advantageous for more intuitive communication between players and partners, reducing the influence of different reference systems and different perspectives on communication, improving communication efficiency, and further enhancing the user experience. 【0084】 In one exemplary embodiment, referring to Figure 9, and taking a virtual flying vehicle in a shooting game application as an example, the interface display method provided by the embodiment of the present invention may further include the following steps. 【0085】 During flight of the virtual flying vehicle, a flight screen is displayed on the user interface. This flight screen allows the user to observe the virtual environment from the virtual flying vehicle's viewpoint. The flight line of sight corresponding to the flight viewpoint coincides with the centerline of the virtual flying vehicle, i.e., it is a planar view. 【0086】 While the flight screen is displayed, the user interface displays an exploration screen in response to the player sliding the wheel control. This exploration screen is a screen for exploring the virtual environment from the exploration viewpoint of the virtual flight vehicle, and the virtual environment displayed on the exploration screen is a local area of the virtual environment displayed on the flight screen. The wheel control is used to control the exploration viewpoint of the virtual flight vehicle, such as remote control or button combination control. The exploration viewpoint refers to the viewpoint for exploring the virtual environment while the virtual object is flying. In some embodiments, the field of view of the exploration viewpoint is smaller than the field of view of the flight viewpoint. The initial exploration viewpoint corresponding to the exploration viewpoint overlaps with the flight viewpoint. The field of view area corresponding to the exploration viewpoint is the display area corresponding to the exploration screen. 【0087】 The system obtains the coordinates of the wheel control, and when the wheel control coordinates change, it adjusts the movement direction of the search screen based on the direction variable corresponding to the wheel control, and adjusts the movement amplitude of the search screen based on the amplitude variable corresponding to the wheel control. For example, using the flight line of sight as a reference, it calculates the adjusted position of the search screen on the screen based on the direction variable and amplitude variable corresponding to the wheel control, and displays the search screen at that adjusted position. Otherwise, it continues to obtain the wheel control coordinates and detects whether or not the wheel control coordinates have changed. 【0088】 If the system detects that the player has released the wheel controls, it cancels the display of the exploration screen. Otherwise, it continues to acquire the wheel control coordinates and detects whether or not the wheel control coordinates have changed. 【0089】 In some embodiments, the user interface displays a search screen and simultaneously displays a search beam corresponding to the search screen. This search beam represents the visualization rendering effect of the search area corresponding to the search screen, assisting the player in visually searching for target objects. For example, if the search area is set to a circular area, the search beam can represent a cone composed of the starting point of the search line and rays directed to each point within the circular area. The center line of the search beam coincides with the search line, the direction of the search beam is the same as the direction of the search line, and the search beam moves in accordance with the movement of the search line. The range of the search area may be less than or equal to the range of the display area of the search screen. 【0090】 While the search screen is displayed, the search beam continues to illuminate. When the search beam illuminates a target object, the timer starts. Otherwise, it continues to detect whether the search beam is illuminating the target object. In some embodiments, the timer is closed when the target object moves out of the search beam's range. 【0091】 The timer's current time is retrieved. If the current time is equal to or greater than the first threshold time, the target object's faction and type information is retrieved, and the timer is closed. Otherwise, if the search beam is still shining on the target object, the system continues to detect whether the current time is equal to or greater than the first threshold time. If the target object moves out of the search beam's range, the system continues to detect whether the search beam was shining on the target object. 【0092】 After obtaining faction information, the system generates first and second sub-annotation information for the target object based on the faction information and type information. For example, if the faction information indicates that the target object belongs to an enemy faction, the second sub-annotation information is set to red; otherwise, it is set to blue. If the type information indicates that the target object is a virtual vehicle, the first sub-annotation information is set to a triangle; otherwise, it is set to a double triangle. 【0093】 For example, if the target object belongs to the enemy faction, and the target object is a virtual vehicle, a red double triangle icon (i.e., the enemy vehicle icon) will be displayed above the target object. If the target object is a virtual character, a red single triangle icon (i.e., the enemy character icon) will be displayed above the target object. If the target object does not belong to the enemy faction, and the target object is an unmanned neutral virtual vehicle, a blue unmanned neutral double triangle icon (i.e., the unmanned neutral vehicle icon) will be displayed. If the target object is not an unmanned neutral virtual vehicle, the system will continue to detect whether the search beam has been shone on the target object. 【0094】 The program locks onto the target object, displays its annotation information (e.g., the enemy vehicle icon, enemy character icon mentioned above), and then starts a timer. It retrieves the timer's duration, and if the duration is greater than or equal to a second threshold time, it cancels the display of the annotation information; otherwise, it continues to display the annotation information. The second threshold time is greater than the first threshold time. 【0095】 In summary, the present invention supports the simultaneous display of a flight screen and a search screen while a virtual object is in flight. This ensures the flight field of view necessary for flight control while simultaneously securing the search field of view necessary for search operations. This avoids the problem in the prior art of high search difficulty due to the poor visibility of the reference plane field of view from the flight viewpoint, thereby reducing the difficulty of search and improving search efficiency. 【0096】 Furthermore, according to the present invention, in order to realize flight control and search operations, it is possible to overcome the collision between the flight view (e.g., a ground view) and the search view (e.g., an overhead view) without frequently switching between the flight view and the search view, thereby achieving simultaneous possession of both the flight view and the search view, and further improving search efficiency. 【0097】 The following are embodiments of the apparatus of the present application for carrying out embodiments of the method of the present application. For details not disclosed in the embodiments of the apparatus of the present application, refer to the embodiments of the method of the present application. 【0098】 Figure 10 shows a block diagram of an interface display device provided by one embodiment of the present invention. The device has the function of performing an example of the above method, which may be performed in hardware or by running corresponding software in hardware. The device may be a terminal as described above or may be installed in a terminal. As shown in Figure 10, the device 1000 includes a screen display module 1001 and a screen adjustment module 1002. 【0099】 The screen display module 1001 is used to display a flight screen on the user interface while the virtual object is in flight, and the flight screen is a screen that allows the user to observe the virtual environment from the virtual object's flight viewpoint. 【0100】 The above-mentioned screen display module 1001 is further used to display a search screen in response to a search operation while the above-mentioned flight screen is being displayed. The search screen is a screen for exploring the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen. 【0101】 The screen adjustment module 1002 is used to adjust and display the search screen in response to adjustment operations on the search viewpoint. 【0102】 In one exemplary embodiment, the screen display module 1001 is: The flight view corresponding to the above flight view is obtained, In response to a trigger operation on the search control displayed in the user interface described above, the initial search line is determined based on the flight line described above. This is used to display the search screen based on the initial search gaze described above. 【0103】 In one exemplary embodiment, the screen display module 1001 is: The first collision point between the initial search line and the reference plane of the virtual environment is obtained. The region corresponding to the first collision point in the virtual environment described above is determined as the display region corresponding to the search screen described above. The elements within the above display area are further used to display the above search screen. 【0104】 In one exemplary embodiment, the screen display module 1001 is further used to cancel the display of the search screen in response to a release operation on the search control. 【0105】 In one exemplary embodiment, the screen adjustment module 1002 is: In response to the adjustment operation on the above search viewpoint, the adjusted search line of sight corresponding to the above search viewpoint is obtained. The second collision point between the adjusted search line and the reference plane of the virtual environment is obtained. The region corresponding to the second collision point in the virtual environment described above is determined as the adjusted display region corresponding to the search screen described above. This is used to adjust and display the search screen based on the elements within the display area after the above adjustments. 【0106】 In one exemplary embodiment, the screen adjustment module 1002 is: In response to the adjustment operation with respect to the above search viewpoint, the direction variable and amplitude variable corresponding to the above adjustment operation are obtained. Based on the above flight line of sight, and the direction variables of the search line of sight corresponding to the above adjustment operation, the direction variables of the search line of sight are determined. Based on the above-mentioned flight line of sight, and the amplitude variables of the search line of sight corresponding to the above-mentioned adjustment operation, the amplitude variables of the search line of sight are determined. Based on the direction variable and amplitude variable of the search line described above, the adjusted search line is further used to obtain the adjusted search line. 【0107】 In one exemplary embodiment, the screen adjustment module 1002 is: On the screen, the search screen is moved and displayed in accordance with the second collision point. Alternatively, it may be used to fix the above-mentioned search screen in a designated position on the screen. 【0108】 In one exemplary embodiment, the user interface displays a flight remote control corresponding to the virtual object, and the movable area corresponding to the flight remote control includes a flight control area and a search control area, of which, in the initial state, the flight remote control is located at the center of the movable area. The screen display module 1001 is further used to display the search screen in response to the flight remote control being moved from the center of the movable area to the search control area. 【0109】 The screen adjustment module 1002 is further used to adjust the display of the search screen in response to adjustment operations of the flight remote control in the search control area. 【0110】 In one exemplary embodiment, the screen adjustment module 1002 is further used to cancel the display of the search screen in response to the flight remote control being moved from the search control area to the flight control area or being released. 【0111】 In one exemplary embodiment, as shown in Figure 11, the apparatus 1000 further includes an object tracking module 1003, an information generation module 1004, and an information display module 1005. 【0112】 The object tracking module 1003 is used to control the search area corresponding to the search screen to follow the target object in response to adjustment operations on the search viewpoint, wherein the range of the search area is less than or equal to the range of the display area of the search screen. 【0113】 The information generation module 1004 is used to generate annotation information for the target object when the time of the target object in the search area is equal to or greater than a first time threshold, and the annotation information is used to display the target object with annotations. 【0114】 The information display module 1005 is used to display annotation information for the target object mentioned above. 【0115】 In one exemplary embodiment, the object tracking module 1003 is further used to detect the search screen. 【0116】 The information generation module 1004 is further used to generate annotation information for the target object if it detects that the target object is included in the search screen, and the annotation information is used to display the target object with annotations. 【0117】 The above-mentioned information display module 1005 is used to display annotation information for the target object. 【0118】 In one exemplary embodiment, the annotation information includes a first sub-annotation information for indicating the type information of the target object, a second sub-annotation information for indicating the faction information of the target object, and a third sub-annotation information for indicating the location information of the target object. 【0119】 In one exemplary embodiment, the information display module 1005 is: If the display time of the annotation information for the target object exceeds the second time threshold, the display of the annotation information for the target object will be canceled. Alternatively, if the distance between the target object and the virtual object is greater than or equal to the first distance threshold, the display of the annotation information of the target object is canceled. Alternatively, if it is detected that the virtual life value of the target object is below a first life threshold, this is further used to cancel the display of the annotation information of the target object. 【0120】 In one exemplary embodiment, the search area corresponding to the search screen includes a first display mode and a second display mode. The screen adjustment module 1002 described above is further used to switch the target object from an unlocked state to a locked state and to switch the search area from the first display mode to the second display mode when the time of the target object in the search area is equal to or greater than the first time threshold. 【0121】 In summary, the technology provided by the embodiment of the present application supports the simultaneous display of a flight screen and a search screen while a virtual object is in flight. This ensures the flight field of view necessary for flight control while securing the search field of view necessary for search operations. This avoids the problem in the prior art of high search difficulty due to the low visibility of the reference plane field of view from the flight viewpoint, thereby reducing the difficulty of search and improving search efficiency. 【0122】 Furthermore, by adopting the technical solution provided by the embodiment of this application, it is possible to overcome the collision between the flight view (e.g., a ground view) and the search view (e.g., an overhead view) without frequently switching between the flight view and the search view in order to realize flight control and search operations, thereby achieving simultaneous possession of both the flight view and the search view and further improving search efficiency. 【0123】 The apparatus provided in the above embodiment is illustrated only by the division of each functional module in order to realize its functions. In actual applications, the above functions can be realized by assigning them to different functional modules as needed, that is, by dividing the internal structure of the device into different functional modules, thereby realizing all or part of the functions described above. The apparatus and method embodiments provided in the above embodiment belong to the same concept, and their specific implementation process is omitted here, as it should be referred to in detail in the method embodiments. 【0124】 Figure 12 shows a block diagram of the configuration of terminal 1200 provided according to one embodiment of the present invention. This terminal is used to perform the interface display method provided in the above embodiment. This terminal may be terminal 10 in the implementation environment shown in Figure 1. Specifically, it is as follows. 【0125】 Typically, terminal 1200 includes a processor 1201 and memory 1202. 【0126】 In some embodiments, the processor 1201 may include one or more processing cores, such as a 4-core processor or an 8-core processor. The processor 1201 may be implemented in at least one hardware form from among DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1201 may include a main processor and a coprocessor, the main processor being a processor that processes data in the wake-up state and also called a CPU (Central Processing Unit), and the coprocessor being a low-power processor that processes data in the standby state. In some embodiments, the processor 1201 may integrate a GPU (Graphics Processing Unit) responsible for rendering and drawing content that needs to be displayed on a display screen. In some embodiments, the processor 1201 may further include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning. 【0127】 In some embodiments, memory 1202 may include one or more computer-readable storage media that may be non-temporary. Memory 1202 may further include high-speed random-access memory and one or more non-volatile memory such as disk storage devices or flash memory storage devices. In some embodiments, the non-temporary computer-readable storage media in memory 1202 are used to store at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set are arranged to be executed by one or more processors to perform the interface display method. 【0128】 In some embodiments, the terminal 1200 may further optionally include a peripheral interface 1203 and at least one peripheral device. The processor 1201, memory 1202, and peripheral interface 1203 may be connected by a jack or signal line. Each peripheral device may be connected to the peripheral interface 1203 via a jack, signal line, or circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 1204, a display screen 1205, an audio circuit 1206, and a power supply 1207. 【0129】 Those skilled in the art will see that the structure shown in Figure 12 does not constitute a limitation of terminal 1200, and may include more or fewer components than those shown, or combine several components, or employ a different arrangement of components. 【0130】 In one exemplary embodiment, a computer-readable storage medium is further provided, the storage medium storing at least one instruction, at least one program, a code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set, when executed by a processor, performs the interface display method. 【0131】 In some embodiments, the computer-readable storage medium may include ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives), or optical discs. Of these, the random-access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory). 【0132】 In one exemplary embodiment, a computer program product or computer program is further provided, which includes computer instructions stored in a computer-readable storage medium. The terminal's processor reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the terminal performs the interface display method. 【0133】 It should be understood that "multiple" as used in this specification refers to two or more. "And / or" describes the relationship between related objects and indicates that there may be three types of relationships. For example, A and / or B may represent three cases: A existing alone, A and B existing simultaneously, or B existing alone. The symbol " / " generally indicates that the preceding and succeeding related objects are in an "or" relationship. Furthermore, the step numbers described herein are merely illustrative to show one possible order in which the steps are performed. In some other embodiments, the steps may not be performed in the order of the numbers. For example, two steps of different numbers may be performed simultaneously, or two steps of different numbers may be performed in the reverse order shown, and the embodiments of this application are not limited to these. 【0134】 The above description is merely an exemplary embodiment of the present application and does not limit it; any modifications, equivalents, improvements, etc., made within the spirit and principles of the present application should all be included within the scope of protection of the present application.
Claims
[Claim 1] An interface display method performed by a terminal device, wherein the method is A step of displaying a flight screen in the user interface while a virtual object is in flight, wherein the flight screen is a screen that observes the virtual environment from the flight viewpoint of the virtual object; The step of displaying a search screen in response to a search operation while the flight screen is being displayed, wherein the search screen is a screen for searching the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen. The steps include adjusting and displaying the search screen in response to an adjustment operation on the search viewpoint. Includes, The step of displaying a search screen in response to the aforementioned search operation is: The steps include: acquiring a flight line of sight corresponding to the aforementioned flight viewpoint, The steps include: determining an initial search line based on the flight line in response to a trigger operation on the search control displayed in the user interface; A method comprising the step of displaying the search screen based on the initial search gaze. [Claim 2] The step of displaying the search screen based on the initial search gaze is as follows: The steps include obtaining a first collision point between the initial search line and the reference plane of the virtual environment, The steps include determining the region corresponding to the first collision point in the virtual environment as the display region corresponding to the search screen, The method according to claim 1, comprising the step of displaying the search screen based on the elements in the display area. [Claim 3] The method according to claim 1, further comprising the step of canceling the display of the search screen in response to a release operation on the search control. [Claim 4] The step of adjusting and displaying the search screen in response to an adjustment operation on the search viewpoint is: The steps include: acquiring an adjusted search line of sight corresponding to the search viewpoint in response to an adjustment operation on the search viewpoint; The steps include obtaining a second collision point between the adjusted search line and the reference plane of the virtual environment, The steps include determining the region corresponding to the second collision point in the virtual environment as the adjusted display region corresponding to the search screen, The method according to claim 1, comprising the step of adjusting and displaying the search screen based on the elements in the adjusted display area. [Claim 5] The step of acquiring an adjusted search line of sight corresponding to the search viewpoint in response to an adjustment operation for the search viewpoint is: The steps include: acquiring a direction variable and an amplitude variable corresponding to the adjustment operation in response to the adjustment operation with respect to the search viewpoint; A step of determining the direction variable of the search line based on the direction variable corresponding to the adjustment operation, with respect to the flight line of sight, The steps include determining the amplitude variable of the search line based on the amplitude variable corresponding to the adjustment operation, using the aforementioned flight line as a reference, The method according to claim 4, comprising the step of obtaining the adjusted search line based on the direction variable of the search line and the amplitude variable of the search line. [Claim 6] The step of adjusting and displaying the aforementioned search screen is: The steps of moving and displaying the search screen in accordance with the second collision point on the screen, Or, The method according to claim 4, further comprising the step of fixing the search screen at a set position on the screen. [Claim 7] The user interface displays a flight remote control corresponding to the virtual object, and the movable area corresponding to the flight remote control includes a flight control area and a search control area. In the initial state, the flight remote control is located at the center of the movable area. The step of displaying a search screen in response to the aforementioned search operation is: The step includes displaying the search screen in response to the flight remote control being moved from the center of the movable area to the search control area, The step of adjusting and displaying the search screen in response to an adjustment operation on the search viewpoint is: The method according to claim 1, further comprising the step of adjusting the display of the search screen in response to an adjustment operation of the flight remote control in the search control area. [Claim 8] The method according to claim 7, further comprising the step of canceling the display of the search screen in response to the flight remote control being moved from the search control area to the flight control area or being released. [Claim 9] A step of controlling the search area corresponding to the search screen to follow the target object in response to an adjustment operation on the search viewpoint, wherein the range of the search area is less than or equal to the range of the display area of the search screen. If the time the target object is located within the search area is equal to or greater than a first time threshold, the step of generating annotation information for the target object, wherein the annotation information is used to display the target object in annotation form. The method according to claim 1, further comprising the step of displaying annotation information of the target object. [Claim 10] The steps include detecting the aforementioned search screen, If the search screen detects that a target object is included, the step of generating annotation information for the target object, wherein the annotation information is used to display the target object in an annotation, The method according to claim 1, further comprising the step of displaying annotation information of the target object. [Claim 11] The annotation information includes a first sub-annotation information, a second sub-annotation information, and a third sub-annotation information. The method according to claim 9 or 10, wherein the first sub-annotation information is used to indicate the type information of the target object, the second sub-annotation information is used to indicate the faction information of the target object, and the third sub-annotation information is used to indicate the location information of the target object. [Claim 12] After displaying the annotation information of the target object, If the display time of the annotation information of the target object exceeds a second time threshold, the display of the annotation information of the target object is canceled. Or, If the distance between the target object and the virtual object is greater than or equal to a first distance threshold, the display of the annotation information of the target object is canceled. Or, The method according to claim 9 or 10, further comprising the step of detecting that the virtual life value of the target object is below a first life threshold, and canceling the display of annotation information for the target object. [Claim 13] The search area corresponding to the search screen includes a first display mode and a second display mode, and the method is The method according to claim 9, further comprising the steps of: if the time the target object has been located within the search area is equal to or greater than the first time threshold, switching the target object from an unlocked state to a locked state, and switching the search area from a first display mode to a second display mode. [Claim 14] An interface display device, A screen display module for displaying a flight screen on a user interface while a virtual object is in flight, wherein the flight screen is a screen for observing the virtual environment from the flight viewpoint of the virtual object, and the screen display module is further used to display a search screen in response to a search operation while the flight screen is being displayed, wherein the search screen is a screen for exploring the virtual environment from the search viewpoint of the virtual object, and the virtual environment displayed on the search screen is a local region of the virtual environment displayed on the flight screen, and Includes a screen adjustment module used to adjust and display the search screen in response to adjustment operations on the search viewpoint, Displaying the search screen in response to the aforementioned search operation is: The flight line corresponding to the aforementioned flight viewpoint is obtained, In response to a trigger operation on the search control displayed in the user interface, the initial search line is determined based on the flight line. An interface display device that includes displaying the search screen based on the initial search gaze. [Claim 15] A terminal device comprising a processor and memory, wherein a computer program is stored in the memory, and when the computer program is loaded and executed by the processor, the terminal device performs the interface display method described in any one of claims 1 to 10. [Claim 16] A computer program that causes a computer to execute the interface display method described in any one of claims 1 to 10.