Virtual object control method and apparatus, device, and computer-readable storage medium

Abstract

A virtual object control method and apparatus, a device, and a computer-readable storage medium, relating to the technical field of computers. The method comprises: acquiring a reference image (100); in response to the reference image comprising information of a virtual environment, displaying a transmission control (200); and in response to a trigger operation of the transmission control, transmitting a currently controlled first virtual object to a reference position in the virtual environment, the reference position comprising the position of a second virtual object in the virtual environment or the position of the reference image obtained by photographing in the virtual environment (300). According to the method, the apparatus, the device, and the medium, by means of triggering of the transmission control, the first virtual object is directly transmitted to the reference position, thereby saving the time of the first virtual object looking for the reference position in the virtual environment, and improving the interactivity and the game experience of a game.

Description

Virtual object control method, device, equipment and computer-readable storage medium

[0001] This application claims priority to Chinese patent application No. 202311867765.0, filed on December 29, 2023, entitled “Method, device, apparatus and computer-readable storage medium for game control,” the entire contents of which are incorporated herein by reference. Technical Field

[0002] The embodiments of the present application relate to the field of computer technology, and in particular to a method, apparatus, device, and computer-readable storage medium for controlling a virtual object. Background Art

[0003] With the continuous advancement of computer technology, the number of players of MMO (Massively Multiplayer Online Role-Playing Game) and open-world games is increasing. These games feature beautiful and expansive virtual environments, allowing players to freely explore them by controlling virtual objects.

[0004] During the process of virtual objects exploring the virtual environment, many players will record the virtual environment, for example, taking photos of the virtual environment.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a method, apparatus, device, and computer-readable storage medium for controlling a virtual object. The technical solution is as follows:

[0007] On the one hand, an embodiment of the present application provides a method for controlling a virtual object, the method comprising: acquiring a reference image; displaying a transmission control in response to the reference image containing information about a virtual environment; and transmitting a currently controlled first virtual object to a reference position in the virtual environment in response to a triggering operation of the transmission control, the reference position comprising a position of a second virtual object in the virtual environment or a position where the reference image is captured in the virtual environment.

[0008] On the other hand, an embodiment of the present application provides a control device for a virtual object, the device comprising: an acquisition module for acquiring a reference image; a display module for displaying a transmission control in response to the reference image containing information about a virtual environment; a transmission module for transmitting a currently controlled first virtual object to a reference position in the virtual environment in response to a triggering operation of the transmission control, the reference position comprising a position of a second virtual object in the virtual environment or a position where the reference image is captured in the virtual environment.

[0009] On the other hand, an embodiment of the present application provides a computer device, which includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor so that the computer device implements any of the above-mentioned virtual object control methods.

[0010] On the other hand, a non-volatile computer-readable storage medium is also provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to enable a computer to implement any of the above-mentioned virtual object control methods.

[0011] On the other hand, a computer program or computer program product is also provided, wherein the computer program or computer program product stores at least one computer instruction, and the at least one computer instruction is loaded and executed by a processor to enable the computer to implement any of the above-mentioned virtual object control methods.

[0012] The technical solution provided in the embodiments of the present application enables, when a reference image includes information about the virtual environment, direct transmission of a first virtual object to a reference location by triggering a transmission control. This reduces the time it takes for the first virtual object to search for the reference location within the virtual environment and improves the efficiency of moving the first virtual object to the reference location. After the first virtual object moves to the reference location, the player controlling the first virtual object can observe the scene presented in the reference image, thereby improving the player's efficiency in observing the scene presented in the reference image and enhancing the interactivity and gaming experience.

[0013] In addition, based on the fact that the first virtual object is directly transmitted to the reference position, since the first virtual object does not need to search for the reference position in the virtual environment, there is no need to render each picture of the process of the first virtual object searching for the reference position in the virtual environment, which is conducive to reducing rendering resources and improving the running smoothness of the computer device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] FIG1 is a schematic diagram of an implementation environment of a virtual object control method provided by an embodiment of the present application;

[0015] FIG2 is a flow chart of a method for controlling a virtual object provided in an embodiment of the present application;

[0016] FIG3 is a schematic diagram of an interface for capturing and obtaining a reference image provided by an embodiment of the present application;

[0017] FIG4 is a schematic diagram of an interface for sharing a reference image provided by an embodiment of the present application;

[0018] FIG5 is a schematic diagram of an interface for uploading a reference image provided in an embodiment of the present application;

[0019] FIG6 is a schematic diagram of an interface for detecting a reference image provided by an embodiment of the present application;

[0020] FIG7 is a schematic diagram of an interface for displaying prompt information provided in an embodiment of the present application;

[0021] FIG8 is a flow chart of a method for determining a reference position provided by an embodiment of the present application;

[0022] FIG9 is a flow chart of a method for matching the color features of a reference image with the color distribution of a virtual environment on a reference plane, provided by an embodiment of the present application;

[0023] FIG10 is a flow chart of another method for determining a reference position provided by an embodiment of the present application;

[0024] FIG11 is a flow chart of another method for determining a reference position provided in an embodiment of the present application;

[0025] FIG12 is a schematic diagram of an interface displaying a transmission control according to an embodiment of the present application;

[0026] FIG13 is a schematic diagram of an interface displaying a first virtual object and a portal provided by an embodiment of the present application;

[0027] FIG14 is a schematic diagram of a third game interface provided in an embodiment of the present application;

[0028] FIG15 is a schematic diagram of an interface for displaying a reference image provided by an embodiment of the present application;

[0029] FIG16 is a schematic diagram of the structure of a control device for a virtual object provided in an embodiment of the present application;

[0030] FIG17 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

[0031] FIG18 is a schematic diagram of the structure of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0033] It should be noted that the terms "first," "second," and the like in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0034] Before introducing the technical solution of the present application, the abbreviations and key terms involved in the embodiments of the present application are defined first.

[0035] Virtual environment: refers to the environment provided (or displayed) when an application is running on a terminal device. This virtual environment is the environment created for virtual objects to carry out activities. A virtual environment can be a two-dimensional virtual environment, a 2.5-dimensional virtual environment, or a three-dimensional virtual environment. A virtual environment can be a simulation of the real world, a semi-simulation of the real world, or a purely fictional environment. For example, the virtual environment involved in the embodiments of this application is a three-dimensional virtual environment.

[0036] Virtual objects refer to movable objects within a virtual environment. These movable objects can be virtual characters, virtual animals, or animated characters. Players can manipulate virtual objects through external components or by tapping the touchscreen display. Each virtual object has its own unique shape and volume within the virtual environment and occupies a portion of the virtual space. For example, in a three-dimensional virtual environment, virtual objects are three-dimensional models created using animation skeletal technology.

[0037] Third-person perspective: refers to the position of the virtual camera in the game at a certain distance behind the virtual object controlled by the player. The player can see the virtual object controlled by the player and all elements in the surrounding environment in the virtual environment.

[0038] First-person perspective: refers to the player's subjective perspective. In the first-person perspective, the game is played from the player's subjective perspective.

[0039] FIG1 is a schematic diagram of an implementation environment of a virtual object control method provided in an embodiment of the present application. As shown in FIG1 , the implementation environment includes: a terminal device 101 and a server 102 .

[0040] The terminal device 101 has a client installed and running that can provide a virtual environment. For example, the terminal device 101 is used to execute the virtual object control method provided in the embodiment of the present application. The terminal device 101 displays a virtual object and a virtual environment containing the virtual object.

[0041] For example, the client can be a game client, and the game client providing a virtual environment in the terminal device 101 can be an open world game, a third-person shooter (TPS) game, a first-person shooter (FPS) game, a multiplayer online battle arena (MOBA) game, a multiplayer shooting survival game, an MMO, or an action role playing game (ARPG). For example, the client can also be a virtual reality (VR) client, an augmented reality (AR) client, a three-dimensional map program, a map simulation program, a social client, an interactive entertainment client, etc.

[0042] Server 102 is used to provide background services for a client installed on terminal device 101 that can provide a virtual environment. In one possible implementation, server 102 performs primary computing tasks, while terminal device 101 performs secondary computing tasks. Alternatively, server 102 performs secondary computing tasks, while terminal device 101 performs primary computing tasks. Alternatively, terminal device 101 and server 102 can collaborate on computing using a distributed computing architecture.

[0043] Optionally, the terminal device 101 may be any electronic device that can interact with a user through one or more methods such as a keyboard, a touchpad, a remote control, voice interaction, or a handwriting device. For example, the terminal device 101 may be a smartphone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a PC (Personal Computer), a mobile phone, a PDA (Personal Digital Assistant), a wearable device, a PPC (Pocket PC), a smart car computer, a smart TV, etc.

[0044] Terminal device 101 may generally refer to one of multiple terminal devices. This embodiment uses terminal device 101 as an example. Those skilled in the art will appreciate that the number of terminal devices 101 may be greater or lesser. For example, there may be only one terminal device 101, or there may be dozens, hundreds, or even more terminal devices 101. This embodiment of the application does not limit the number or type of terminal devices 101.

[0045] The server 102 is a single server, or a server cluster consisting of multiple servers, or any one of a cloud computing platform and a virtualization center, which is not limited in the embodiments of the present application. The server 102 is directly or indirectly connected to the terminal device 101 via a wired or wireless communication method. The server 102 has a data receiving function, a data processing function, and a data sending function. Of course, the server 102 may also have other functions, which are not limited in the embodiments of the present application.

[0046] Those skilled in the art should understand that the above-mentioned terminal device 101 and server 102 are merely examples, and other existing or future terminal devices or servers, if applicable to the present application, should also be included in the scope of protection of the present application and are incorporated herein by reference.

[0047] The present application provides a method for controlling a virtual object. This method can be applied to the implementation environment shown in FIG. 1 . Taking the flowchart of a method for controlling a virtual object provided in the present application shown in FIG. 2 as an example, this method can be executed by a computer device. For example, this method can be executed by the terminal device 101 in FIG. 1 , or can be executed interactively by the terminal device 101 and the server 102. Taking the method executed by the terminal device 101 as an example, as shown in FIG. 2 , the method includes the following steps 100 to 300.

[0048] In step 100, a reference image is acquired.

[0049] A reference image refers to an image that, while including information about the virtual environment, can indicate the location of a second virtual object in the virtual environment, or an image of the location at which the reference image was captured in the virtual environment. For example, the second virtual object can be the first virtual object itself, or a virtual object other than the first virtual object. For example, the first virtual object and the second virtual object have an association relationship, which can include, but is not limited to, a friendship, a collaborative relationship within the same camp, or an adversarial relationship between different camps.

[0050] In an exemplary embodiment of the present application, the terminal device executing the method may be a first terminal, where the first terminal is a terminal used by the first player to control the first virtual object.

[0051] In an exemplary embodiment, the reference image can be obtained by obtaining a reference image uploaded by a first player. The first player can select a reference image from a local image library and upload it to the first terminal. For example, the reference image uploaded by the first player may be an image taken by the first player or by another player, although this embodiment of the present application is not limited thereto. This method allows for efficient reference image acquisition without requiring interaction with other terminals.

[0052] Exemplarily, an upload control may be displayed in the client of the first terminal. In response to a triggering operation of the upload control, an image in the local image library of the first terminal may be displayed. The first player may select an image to be uploaded in the image library, use the selected image in the image library as a reference image, and upload the reference image to the client.

[0053] In an exemplary embodiment, the reference image can also be obtained by receiving a reference image sent by the control terminal of the second virtual object. This method of obtaining a reference image can occur when the second virtual object is a virtual object other than the first virtual object. Based on this method of obtaining a reference image, other players can proactively share their captured images with the first player, enhancing inter-player interactivity, thereby improving the player interaction experience and the human-computer interaction rate.

[0054] The embodiment of the present application is described by taking the second virtual object as a virtual object other than the first virtual object as an example. The second virtual object is controlled by the second player through the second terminal, that is, the control terminal of the second virtual object is the second terminal. In other words, the terminal that interacts with the first terminal is the second terminal, and the second terminal controls the second virtual object. The first virtual object and the second virtual object may have other associations. Exemplarily, the second virtual object has an association with the first virtual object, so that the first virtual object and the second virtual object can interact during the game. For example, the second virtual object and the first virtual object may be friends. For another example, the second virtual object and the first virtual object may not be friends, but the second virtual object and the first virtual object may be in the same camp, or the second virtual object and the first virtual object may be in different camps. It should be noted that the association between the second virtual object and the first virtual object in this application is an exemplary description and is not limited to this.

[0055] Whether it is the first terminal or the second terminal, a client capable of providing a virtual environment can be installed and run in the terminal device. The client can be a client for any game, or it can be other types of clients (such as virtual reality clients, augmented reality clients, three-dimensional map programs, map simulation programs, social clients, interactive entertainment clients, etc.), and the embodiments of the present application do not limit this. For example, the client in the embodiments of the present application is a game application. In response to the application receiving the start instruction, the terminal device displays the game preloading interface of the application, wherein the game preloading interface may include a virtual object selection interface, a player teaming interface, a map selection interface, and a current game loading interface, etc.

[0056] By way of example, a virtual environment is an environment provided by an application on a terminal device. Within the virtual environment, multiple virtual objects can be displayed, where different virtual objects can be controlled by different players. In addition to displaying virtual objects, the virtual environment can also display virtual elements. These virtual elements may include mountains, plains, rivers, lakes, oceans, deserts, swamps, quicksand, skies, plants, buildings, and the like. This application describes the virtual environment as an example and does not limit it.

[0057] In an exemplary embodiment of the present application, while a player controls a virtual object to explore a virtual environment, the player can take photos and record the virtual environment. This is explained by taking an example in which a second player controls a second virtual object to explore a virtual environment. FIG3 is a schematic diagram of an interface for capturing a reference image provided by an embodiment of the present application. As shown in FIG3 , the second player can control the second virtual object 110 to move in the virtual environment through a virtual joystick 130. When the second player wants to record a picture of the virtual environment, the second player can take photos and record the virtual environment through an image generation control 120 to obtain a reference image. The shooting operation can be completed based on a virtual camera in the application, and the relative position of the virtual camera and the second virtual object 110 remains unchanged.

[0058] Exemplarily, the second terminal is a terminal of a second player, and the second player can control the second virtual object through the second terminal. For example, the second player controls the second virtual object using a virtual camera to obtain a reference image. The virtual camera can be a virtual camera with a first-person perspective of the second virtual object, which takes a picture of the virtual environment from the first-person perspective of the second virtual object to obtain a reference image. In this case, the reference image obtained does not include the second virtual object. Alternatively, the virtual camera can be a virtual camera with a third-person perspective of the second virtual object, which takes a picture of the virtual environment from the third-person perspective of the second virtual object to obtain a reference image. In this case, the reference image obtained includes the second virtual object.

[0059] In the method provided in an embodiment of the present application, in the process of obtaining a reference image, the second terminal obtains the position information of the initial image in response to receiving the generation operation of the initial image, where the position information includes the position at which the initial image is obtained in the virtual environment, and the position information is associated with the initial image to obtain a reference image.

[0060] In an exemplary embodiment of the present application, the application of the second terminal receives a trigger operation of an image generation control, that is, an operation of generating an initial image, and can obtain the position information corresponding to the initial image. The operation of generating the initial image may include an image shooting operation. When the second player controls the second virtual object to shoot an image using a first-person perspective camera, the position information may include the position information of the second virtual object in the virtual environment, and may also include the orientation information of the second virtual object in the virtual environment; when the second player controls the second virtual object to shoot an image using a third-person perspective camera, the position information may include the position information of the second virtual object in the virtual environment. After obtaining the position information, the position information is associated with the initial image. For example, a hidden watermark is formed in the initial image based on the position information to obtain a reference image.

[0061] By associating the information with the initial image, the position information contained in the reference image can be quickly determined in the subsequent process, and the reference position of the transmission can be determined using the position information. To a certain extent, the efficiency of virtual object transmission during the game can be improved, the amount of data processing can be reduced, and the resources consumed in processing data can be saved.

[0062] After acquiring the reference image, the second player can share it with other players in the game. Figure 4 is a schematic diagram of an interface for sharing reference images, provided in an embodiment of the present application. As shown in Figure 4, the second player can send the reference image to other players using the sharing controls in the game sharing interface. For example, if the second player sends the reference image to the first player, the first player's first terminal can receive the reference image sent by the second player's second terminal.

[0063] The first player can also obtain a reference image in advance and store the reference image locally, and upload the reference image to a client that supports the virtual environment when it is necessary to control a virtual object according to the reference image. Figure 5 is a schematic diagram of an interface for uploading a reference image provided by an embodiment of the present application. As shown in Figure 5, the first player can enter the chat interface 501 of the client, and an upload control 502 is displayed in the chat interface 501. After the first player triggers the upload control 502, an image selection interface 503 can be displayed. The image selection interface 503 displays a confirmation control 504 and images in the image library. The first player can select the image he wants to upload in the image library and trigger the confirmation control 504. In response to the triggering operation of the confirmation control 504, the image selected by the first player is used as a reference image and uploaded to the client.

[0064] It should be noted that the above description only takes the example of the reference image being obtained by the second player photographing the virtual environment. The embodiments of the present application are not limited to this. In some embodiments, the reference image can also be obtained by the second player photographing an environment other than the virtual environment; in other embodiments, the reference image can also be obtained by the first player photographing the virtual environment or other environments.

[0065] In step 200 , in response to the reference image containing information of the virtual environment, a transfer control is displayed.

[0066] In an exemplary embodiment of the present application, after acquiring a reference image, the reference image is detected, and in response to detecting that the reference image does not include information about the virtual environment, that is, the reference image is an image unrelated to the virtual environment, the acquired reference image is displayed. Optionally, in response to detecting that the reference image contains information about the virtual environment, a transmission control is displayed in a first game interface, wherein the first game interface is a game interface in which a first virtual object participates, and the first virtual object can be a virtual object controlled by a first player based on a first terminal. In the embodiment of the present application, the interface displaying the transmission control is referred to as the first game interface, but is not limited thereto, that is, the interface displaying the transmission control can also have other names.

[0067] Figure 6 is a schematic diagram of an interface for detecting a reference image provided by an embodiment of the present application. As shown in Figure 6, after obtaining the reference image, the reference image is identified, and the image identification is displayed below the reference image. It should be noted that, in the case where the reference image is an image uploaded by the first player, player A in Figure 6 refers to the first player, the virtual object controlled by player A is the first virtual object, and player A's chat message can be regarded as a message automatically sent by the system assistant. In the case where the reference image is an image sent by the second player's terminal, player A in Figure 6 refers to the second player, the virtual object controlled by player A is the second virtual object, and player A's chat message is the chat message sent by the second player to the first player.

[0068] It should be noted that the number of reference images can be one or more. The reference image can be an image containing information about the virtual environment or an image not containing information about the virtual environment. This application only illustrates the process of obtaining the reference image for illustrative purposes and does not limit the method and number of reference images. Only one reference image is used as an example for illustration, and other reference images are not described in detail.

[0069] The embodiment of the present application does not limit the method for identifying whether the reference image contains information about the virtual environment, and can be implemented based on any image recognition method. Regardless of the image recognition method used, after identifying that the reference image contains information about the virtual environment, a teleportation control can be displayed in the first game interface, which is the interface of the game in which the currently controlled first virtual object participates. The teleportation control is used to trigger the teleportation of the first virtual object to the virtual environment contained in the reference image. The embodiment of the present application does not limit the display method of the teleportation control, and the teleportation control can be displayed at any location in the first game interface so that the player can trigger the teleportation operation.

[0070] In an exemplary embodiment of the present application, in the case where the reference image is obtained by receiving a reference image sent by a control terminal of a second virtual object, the method further includes: in response to receiving the reference image, displaying a prompt message, the prompt message being used to indicate receipt of the reference image, the prompt message including at least one of an identity identifier corresponding to the second virtual object or information about the reference image. Exemplarily, the prompt message is displayed in the first game interface. By displaying the prompt message, the first player can be intuitively informed that the reference image has been received, allowing the first player to quickly view the reference image, thereby improving interaction efficiency, thereby enhancing the interaction experience, and increasing the human-computer interaction rate.

[0071] Exemplarily, after displaying the prompt information, the method further includes: in response to a triggering operation of the prompt information, displaying a chat message sent by the second player on the chat interface, the chat message including a reference image, so that the first player can intuitively view the reference image through the chat message.

[0072] For example, during the game, the first terminal may display a first game interface, which may be the current game interface. Upon receiving a reference image sent by the second terminal, a prompt message may be displayed on the first game interface to remind the player that the reference image has been received. Optionally, the prompt message may be displayed in a pop-up window, including the identity identifier and reference image information corresponding to the second virtual object. For example, the prompt message may indicate that a reference image has been sent to player A. It should be noted that the display method and content of the prompt message in this application are exemplary and are not limited thereto.

[0073] The identity identifier corresponding to the second virtual object can be any information that can identify the identity of the second virtual object. For example, the identity identifier corresponding to the second virtual object can be the identity identifier of the player controlling the second virtual object (the second player). For example, the identity identifier of the second player can be the nickname of the second player or the ID (Identity Document) of the second player. The information of the reference image is information used to identify the reference image. For example, the information of the reference image can be the name of the reference image or a thumbnail of the reference image.

[0074] For example, taking the first player as player B, the interface displaying prompt information may be as shown in Figure 7. The interface displaying prompt information shown in Figure 7 is the interface in which player B controls the virtual object B in the virtual environment. In the lower area of ​​the interface, a prompt message "Friend A sent a picture" is displayed, where "Friend A" is the identity identifier corresponding to the second virtual object.

[0075] In step 300, in response to the triggering operation of the transmission control, the currently controlled first virtual object is transmitted to a reference position in the virtual environment, where the reference position includes the position of the second virtual object in the virtual environment or the position of a reference image captured in the virtual environment.

[0076] In one embodiment of the present application, before transmitting the first virtual object to the reference position in the virtual environment in response to the triggering operation of the transmission control, a process of determining the reference position may be further included. The reference position determination process may include but is not limited to the following two methods.

[0077] Method 1: Detect a reference image, and in response to detecting that the reference image contains position information, determine a reference position based on the position information. The position information is used to represent the position of the second virtual object in the virtual environment or the position of the reference image captured in the virtual environment. Exemplarily, the position information can be expressed as a hidden watermark in the reference image. When the reference image is detected to contain a hidden watermark, the position information in the hidden watermark is obtained, and the reference position is determined based on the position information. This method can directly determine the reference position based on the position information contained in the reference image, which is beneficial for improving the efficiency of determining the reference position, and thereby improving the efficiency of transmitting the first virtual object to the reference position.

[0078] In another embodiment of the present application, in response to detecting that the reference image does not include position information, a reference position is determined based on the reference image and the virtual environment, for example, see the following method 2.

[0079] In a second approach, taking the flowchart of a method for determining a reference image provided by an embodiment of the present application as shown in FIG8 as an example, the process of determining a reference position may include steps 210 to 240 .

[0080] In step 210 , basic information of the virtual environment is determined based on the spatial coordinate system of the virtual environment, where the basic information includes at least one of marker distribution, shape distribution, or color distribution.

[0081] In an exemplary embodiment of the present application, a spatial coordinate system is established based on the virtual environment. The spatial coordinate system may include a first direction, a second direction, and a third direction that are perpendicular to each other. Basic information of the virtual environment in the spatial coordinate system is obtained, where the basic information may include at least one of a distribution of markers, a shape distribution, or a color distribution in the virtual environment.

[0082] The marker distribution is used to indicate the location of markers in the virtual environment. Markers in a virtual environment refer to objects to be marked in the virtual environment. The embodiments of the present application do not limit the types of markers in the virtual environment. For example, markers in a virtual environment can refer to all independent objects in the virtual environment. For another example, markers in a virtual environment can also refer to certain types of objects in the virtual environment. For example, markers in the virtual environment can be marked during the construction of a spatial coordinate system. With reference to Figure 3, markers in the virtual environment can include pavilions, the sun, mountains, trees, etc. The markers in the virtual environment are identified using a deep learning model to obtain labels for the markers. During the process of establishing a spatial coordinate system for the virtual environment, the distribution of the markers can be obtained based on the labels of the markers. Taking the pavilion as an example, the pavilion label in the virtual environment can be retrieved, and the distribution of the pavilions can be determined based on the position of the pavilion label in the spatial coordinate system.

[0083] Shape distribution is used to indicate the shape information of each location in a virtual environment. For example, if a virtual environment contains virtual elements, the shapes of these virtual elements can be determined based on the shape distribution. Virtual elements are elements in the virtual environment with well-defined shapes. Color distribution is used to indicate the color information of each location in the virtual environment. After establishing a spatial coordinate system, the shape information and / or color information of each location in the virtual environment can be determined in conjunction with the spatial coordinate system, thereby obtaining a shape distribution and / or color distribution.

[0084] For example, taking the first direction, the second direction, and the third direction in the spatial coordinate system as corresponding to the X-axis, the Z-axis, and the Y-axis, respectively, the distribution of markers in the virtual environment, and the shape distribution and color distribution of virtual elements in the virtual environment are obtained based on the spatial coordinate system.

[0085] In step 220 , feature information of the reference image is acquired, where the feature information includes at least one of a marker feature, a shape feature, or a color feature.

[0086] Exemplarily, feature information of a reference image is obtained using a deep learning model, where the feature information includes at least one of a marker feature, a shape feature, or a color feature. The marker feature is used to characterize the marker in the reference image; the shape feature is used to characterize the shape in the reference image; and the color feature is used to characterize the color in the reference image.

[0087] In step 230 , a reference region is determined based on the feature information and the basic information.

[0088] The reference region is the region in the virtual environment corresponding to the reference image. After obtaining the feature information of the reference image and the basic information of the virtual environment, the reference region is determined by comparing the feature information and the basic information. The reference region refers to the region in the virtual environment corresponding to the reference image. The region in the virtual environment corresponding to the reference image is the imaging region in the virtual environment corresponding to the scene in the virtual environment presented in the reference image. In other words, by mapping the scene in the virtual environment presented in the reference image into the reference region, an image with content consistent with the reference image can be obtained.

[0089] After obtaining the feature information of the reference image, if the basic information includes a marker distribution and the feature information of the reference image includes marker features, the process of determining the reference area based on the feature information of the reference image and the basic information corresponding to the virtual environment may include: determining the position area of ​​the marker in the virtual environment based on the marker features and the marker distribution; and determining the reference area based on the position area. The marker is a marker represented by the marker features of the reference image. The position area of ​​the marker in the virtual environment is highly correlated with the reference area. Determining the reference area based on the position area of ​​the marker in the virtual environment is conducive to improving the reliability of the reference area determination, thereby improving the accuracy of the subsequently determined reference position, improving the control effect of the virtual object, and thus improving the interactive experience and the human-computer interaction rate.

[0090] Exemplarily, the process of determining the position area of ​​the marker in the virtual environment based on the marker characteristics and marker distribution can be: determining the target marker area in the virtual environment based on the marker characteristics and marker distribution, where the target marker area is the position area of ​​the marker in the virtual environment.

[0091] For example, feature information of the reference image may be detected to determine whether the feature information of the reference image includes a marker feature. If the feature information includes a marker feature, the reference image includes a marker; if the feature information does not include a marker feature, the reference image does not include a marker.

[0092] In response to detecting that the feature information contains a marker feature, that is, the reference image contains a marker, a target marker area of ​​the marker in the virtual environment is determined based on the marker feature and the marker distribution, and the target marker area is the position area of ​​the marker in the virtual environment.

[0093] In an exemplary embodiment of the present application, the process of determining a location area of ​​a marker in a virtual environment based on marker characteristics and marker distribution may include: obtaining the type of the marker; determining a marker area based on the marker type and marker distribution, where the marker area is the distribution area corresponding to the marker type; determining relevant environmental characteristics of the marker; and filtering the marker area based on the relevant environmental characteristics to obtain a location area. By initially filtering the marker area based on the marker type and then filtering the location area based on the relevant environmental characteristics of the marker, there is no need to compare the positions of all markers based on the marker distribution, which helps improve the efficiency of determining the location area, and thus improves the efficiency of determining the reference area and reference position.

[0094] For example, a deep learning model is used to determine the type of a marker, where the marker type can be a label. For example, if the label is a pavilion, a first screening is performed on the virtual environment based on the distribution of pavilions to obtain an initial marked area, where the initial marked area is the area where pavilions are located in the virtual environment. Then, relevant environmental features of the marker can be further obtained. For example, in Figure 3, the pavilion is located at the foot of a mountain and surrounded by trees. A second screening is performed on the pavilion distribution area using relevant environmental features to obtain a location area that meets the relevant environmental features of the marker.

[0095] After the location area is determined, a reference area may be determined based on the location area.

[0096] In an exemplary embodiment, determining a reference region based on the location region includes mapping the location region to obtain the reference region. Mapping the location region can be determined by analyzing a planar image of a marker in a reference image and comparing the shape of the marker in the virtual environment. This is sufficient as long as, after mapping the location region, the mapped image of the marker in the virtual environment is consistent or substantially consistent with the planar image of the marker in the reference image.

[0097] In an exemplary embodiment, the method of determining the reference area based on the location area includes: further determining the reference area within the location area based on feature information of the reference image and basic information corresponding to the virtual environment.

[0098] In an exemplary embodiment of the present application, in response to a reference image containing a marker, the reference image is matched with the location region of the virtual environment in the location region, and the reference region is determined using the matching result. In response to the reference image not containing the marker, the reference image is matched with the virtual environment, and the reference region is determined using the matching result. It should be noted that the process of matching the reference image with the virtual environment in the location region or directly matching the reference image with the virtual environment is similar, and this application uses matching the reference image with the virtual environment as an example for explanation.

[0099] In an exemplary embodiment of the present application, the process of determining a reference area based on the feature information of a reference image and basic information corresponding to a virtual environment may include: determining a reference plane based on a spatial coordinate system, mapping the basic information of the virtual environment onto the reference plane to obtain distribution information of the virtual environment on the reference plane; matching the distribution information of the virtual environment on the reference plane with the feature information corresponding to the reference image, and determining a reference area within the reference plane based on the matching result. By determining the reference plane, the reference area can be directly determined by matching information on a two-dimensional plane, eliminating the need to convert a three-dimensional area into a two-dimensional area. This helps reduce the computational complexity of determining the reference area, improves the efficiency of determining the reference area, and thereby improves the efficiency of determining the reference position.

[0100] For example, the first direction of the spatial coordinate system is used as the central axis, and reference planes are set at certain angular intervals. Similarly, the second and third directions of the spatial coordinate system are used as the central axes, and the remaining reference planes are set at certain angular intervals.

[0101] In an exemplary embodiment of the present application, after determining multiple reference planes, the shape distribution and color distribution in the basic information of the virtual environment are mapped onto the reference planes to obtain distribution information of the virtual environment on the reference planes. In other words, the distribution information of the virtual environment on the reference planes may include shape distribution information and color distribution information. The shape distribution information refers to the shape distribution of the virtual environment on the reference planes, and the color distribution information refers to the color distribution of the virtual environment on the reference planes.

[0102] In an exemplary embodiment of the present application, the shape features and color features of the reference image are matched with the shape distribution and color distribution of the virtual environment in the reference plane respectively to obtain matching results of the shape features and shape distribution and matching results of the color features and color distribution, and the reference area is determined within the reference plane using the matching results.

[0103] In an exemplary embodiment of the present application, shape features of a reference image are matched with the shape distribution of the virtual environment on a reference plane to obtain a matching result of the shape features and shape distribution, and a reference region is determined within the reference plane using the matching result. In an exemplary embodiment of the present application, color features of a reference image are matched with the color distribution of the virtual environment on a reference plane to obtain a matching result of the color features and color distribution, and a reference region is determined within the reference plane using the matching result.

[0104] FIG9 is a flow chart of a method for matching the color features of a reference image with the color distribution of a virtual environment on a reference plane provided by an embodiment of the present application. As shown in FIG9 , matching the color features of a reference image with the color distribution of a reference plane may include steps 231 to 234.

[0105] In step 231 , noise reduction processing is performed on the reference image based on the color feature to obtain standard pixel information contained in the reference image. The standard pixel information includes standard pixel values ​​and the number of standard pixel values.

[0106] Exemplarily, a reference image is composed of multiple pixels. The color features of the reference image may include the color value of each pixel, wherein the color value of each pixel may include an R (red) value, a G (green) value, and a B (blue) value. Noise reduction processing is performed on the reference image using the color value of each pixel. The noise reduction processing may include dilating and eroding the reference image to remove noise in the reference image. The color values ​​of the pixels in the dilated and eroded reference image are then converted into standard pixel information. The standard pixel information may include standard pixel values. The standard pixel values ​​may correspond to an RGB color value range. Based on the RGB color value range, the color values ​​corresponding to the pixels are converted into standard pixel values. The reference image is then divided based on the standard pixel values ​​to obtain the number of standard pixel values ​​contained in the reference image. For example, the different color values ​​corresponding to dark green, light green, grass green, etc. are converted into the standard pixel values ​​corresponding to green to obtain green blocks in the reference image. Similarly, blocks of other colors contained in the reference image can be obtained. Furthermore, the number of color blocks contained in the reference image, i.e., the number of standard pixel values, can be obtained. It should be noted that the standard pixel value and the RGB color value range corresponding to the standard pixel value can be set based on actual conditions, and this application does not limit this.

[0107] In step 232 , the color distribution of the virtual environment on the reference plane is processed to obtain a standard pixel value distribution on the reference plane.

[0108] For example, the color distribution of the virtual environment on the reference plane may include the color values ​​corresponding to the pixels. Based on the color distribution of the virtual environment on the reference plane, denoising is performed on the reference plane to obtain a standard pixel value distribution for the reference plane. It should be noted that the process of denoising the reference plane is similar to the process of denoising the reference image, and will not be further elaborated here.

[0109] By performing dilation and erosion processing on the reference image and the reference plane, the interference information in the reference image and the reference plane can be reduced, which is conducive to converting the color values ​​of the pixels in the reference image and the reference plane into standard pixel information; converting the color values ​​of the pixels in the reference image into standard pixel values ​​and obtaining the number of standard pixel values ​​in the reference image can reduce the amount of data processing in the process of matching the color features of the reference image with the color distribution of the reference plane, thereby improving the matching efficiency.

[0110] In step 233, based on the standard pixel information and the standard pixel value distribution, a first matching is performed between the reference image and the reference plane, and based on the result of the first matching, an initial area is determined in the reference plane, and the initial area has the same standard pixel values ​​and the same number of standard pixel values ​​as those contained in the reference image.

[0111] Exemplarily, the reference plane is a projection plane of the virtual environment, and therefore, the size of the reference plane is much larger than the size of the reference image. A matching unit area and a matching interval are set within the reference plane, wherein the size of the matching unit area is the same as the size of the reference image. The matching unit area is moved in a certain order within the reference plane based on the matching interval. During the movement, the standard pixel values ​​and the number of standard pixel values ​​contained in the matching unit area are first matched with the standard pixel values ​​and the number of standard pixel values ​​contained in the reference image. If the standard pixel values ​​and the number of standard pixel values ​​contained in the matching unit area are the same as those in the reference image, the matching unit area is used as an initial area until the matching of the entire reference plane is completed to obtain the initial area. Exemplarily, the number of initial areas is one or more.

[0112] In step 234 , based on the color distribution and color features of the initial region, a second matching is performed between the initial region and the reference image, and a reference region is determined in the initial region based on the result of the second matching.

[0113] In the process of determining the reference area based on color information, the standard pixel value and the initial area with the same number of standard pixel values ​​are first screened out through the first matching, and then the reference area is screened out through the second matching. Determining the reference area through two-step screening is beneficial to reducing the amount of calculation in the process of determining the reference area, improving the efficiency of determining the reference area, and thus improving the efficiency of determining the reference position.

[0114] Illustratively, after obtaining the initial region, the color distribution of the initial region can be extracted from the color distribution of the reference plane in the virtual environment, and then a second match can be performed based on the color distribution of the initial region and the color features of the reference image to obtain the reference region.

[0115] Exemplarily, the process of obtaining a reference area by performing a second match based on the color distribution of the initial area and the color features of the reference image may include: performing grid division on the initial area and the reference image based on grid division parameters to obtain grid cells of the initial area and grid cells of the reference image; determining first pixel values ​​corresponding to the grid cells of the initial area based on the color distribution of the initial area, and determining second pixel values ​​corresponding to the grid cells of the reference image based on the color features; and determining the initial area as the reference area in response to the number of grid cells in the initial area that meet a reference condition being greater than or equal to a first threshold. The similarity between the first pixel values ​​corresponding to the grid cells that meet the reference condition and the second pixel values ​​corresponding to the corresponding grid cells in the reference image is greater than or equal to a similarity threshold. Dividing both the initial area and the reference image into grid cells and determining whether the initial area is a reference area by comparing the pixel values ​​of the grid cells can reduce the computational complexity of determining whether the initial area is a reference area, improve the efficiency of determining the reference area, and thereby improve the efficiency of determining the reference position.

[0116] The similarity threshold can be set based on experience or flexibly adjusted according to the application scenario, and is not limited in this embodiment of the present application. For example, the similarity threshold can be 100%, and the first pixel value corresponding to the grid cell that meets the reference condition is the same as the second pixel value corresponding to the corresponding grid cell in the reference image.

[0117] In an exemplary embodiment of the present application, the grid division parameter may be the size of the grid. The initial region and the reference image are divided based on the grid division parameter to obtain grid cells of the initial region and grid cells of the reference image. The size of the grid may be set based on actual conditions. For example, the grid cell may be a single pixel or may include multiple pixels.

[0118] Exemplarily, the size of the initial region is the same as the size of the reference image. After meshing the initial region and the reference image using the same meshing parameters, the size of the mesh cells in the initial region is the same as the number of mesh cells in the reference image, and the number of mesh cells in the initial region is the same as the number of mesh cells in the reference image. In other words, the mesh cells in the initial region correspond one-to-one with the mesh cells in the reference image. The correspondence between mesh cell A in the initial region and mesh cell a in the reference image means that the position of mesh cell A in the initial region is the same as the position of mesh cell a in the reference image.

[0119] After obtaining the grid cells corresponding to the initial region and the reference image, the first pixel value corresponding to the grid cell of the initial region and the second pixel value corresponding to the grid cell of the reference image can also be determined. For example, when the grid cell contains a single pixel, the first pixel value corresponding to the grid cell of the initial region can be determined by the color distribution of the initial region, and the second pixel value corresponding to the grid cell of the reference image can be determined by the color characteristics of the reference image. When the grid cell contains multiple pixels, the pixel value of each pixel in the grid cell of the initial region can be determined by the color distribution of the initial region, and the average of the pixel values ​​can be used as the first pixel value of the grid cell of the initial region. Similarly, the second pixel value of the grid cell of the reference image can be obtained.

[0120] Exemplarily, the first pixel values ​​and second pixel values ​​of the grid cells corresponding to the initial region and the reference image are compared. If the similarity between the first pixel value of a grid cell in the initial region and the second pixel value of the corresponding grid cell in the reference image is greater than or equal to a similarity threshold, the grid cell is identified as a grid cell in the initial region that meets the reference condition. If the number of grid cells in the initial region that meet the reference condition is greater than or equal to a first threshold, the initial region is determined to be the reference region. The first threshold can be set based on actual circumstances, for example, the first threshold can be set to 90% of the total number of grid cells in the reference image.

[0121] The number of the initial regions is one or more. If there are multiple initial regions, step 234 is performed for each initial region.

[0122] In an exemplary embodiment of the present application, a reference image and a reference plane contain virtual elements. When the feature information includes shape features and the distribution information of the virtual environment on the reference plane includes the shape distribution of the virtual environment on the reference plane, the distribution information of the virtual environment on the reference plane is matched with the feature information of the reference image. The process of determining a reference area within the reference plane based on the matching results may include: determining a first outline of the virtual element based on the shape features of the reference image, and determining a second outline of the virtual element based on the shape distribution of the virtual environment on the reference plane; and in response to the overlap ratio between the first outline and the second outline being greater than or equal to a second threshold, determining the area within the reference plane corresponding to the second outline as the reference area. Determining the reference area by comparing the overlap ratio of the virtual element outlines simplifies the logic for determining the reference area, reduces the computational complexity of determining the reference area, improves the efficiency of determining the reference area, and thereby improves the efficiency of determining the reference position.

[0123] For example, the reference image includes virtual elements. Referring to FIG3 , the virtual elements may be a pavilion, the sun, a mountain, or trees. The contours of the virtual elements can be obtained using a contour detection algorithm or contour detection function. Taking the mountain as an example, a first contour of the mountain in the reference image is obtained based on feature information (e.g., shape features) of the reference image. A second contour of the mountain within the reference plane is obtained based on distribution information (e.g., shape distribution) of the virtual environment on the reference plane. The first and second contours are then compared segment by segment. If the overlap between the first and second contours is greater than or equal to a second threshold, the area containing the mountain and the area surrounding the mountain are determined as the reference area.

[0124] For example, in the process of contour comparison, the overall shape of the contour can be compared first to determine the candidate area with a similar overall shape of the virtual element. In the candidate area, the detailed features in the contour of the virtual element, such as the sharpness of the contour, the curvature of the contour, etc., are used to compare the detailed contour features of the virtual element to obtain the area where the detailed features of the first contour and the second contour of the virtual element match. Then, the overlap rate of the first contour and the second contour is calculated in the area where the detailed features match, and the reference area is determined using the overlap rate of the first contour and the second contour.

[0125] In an exemplary embodiment of the present application, the feature information includes color features and shape features, the distribution information of the virtual environment on the reference plane includes the color distribution and shape distribution of the virtual environment on the reference plane, and the distribution information of the virtual environment on the reference plane is matched with the feature information. The process of determining a reference area in the reference plane based on the matching result includes: when the reference area is determined by matching the color distribution of the virtual environment on the reference plane with the color features, and when the reference area is also determined by matching the shape distribution of the virtual environment on the reference plane with the shape features, the union area or the intersection area of ​​the two reference areas is used as the reference area finally determined in the reference plane. When the reference area is determined only by matching the color distribution of the virtual environment on the reference plane with the color features, or when the reference area is determined only by matching the shape distribution of the virtual environment on the reference plane with the shape features, the reference area determined is directly used as the reference area finally determined in the reference plane.

[0126] It should be noted that the process of determining the reference area by considering color information and / or shape information described above is described using the entire virtual environment as an example, and the embodiments of the present application are not limited thereto. In exemplary embodiments, the reference area can also be determined based on the location area of ​​the marker in the virtual environment, using similar principles by considering color information and / or shape information, thereby reducing the computational complexity of the reference area determination process and improving the efficiency of determining the reference area and reference position.

[0127] It should be noted that the above-described process of determining the reference area within the reference plane is described using only one reference plane as an example, but the embodiments of the present application are not limited to this. The number of reference planes may also be multiple. In the case of multiple reference planes, each reference plane is processed according to the method of determining the reference area within the reference plane described above until all reference planes are processed. The reference area obtained after all reference planes are processed is used as the final reference area. The number of reference areas finally determined may be one or more, and the embodiments of the present application are not limited to this.

[0128] In step 240 , a reference position is determined based on the spatial coordinate system and the reference area.

[0129] First, by comparing the basic information of the virtual environment with the feature information of the reference image, the reference area corresponding to the reference image in the virtual environment is determined. Then, the reference position is determined based on the reference area. The process of determining the reference position is highly standardized, which helps to improve the reliability of the determined reference position.

[0130] In an exemplary embodiment of the present application, after determining the reference area, the reference position can also be determined using the spatial coordinate system and the reference area. Figure 10 is a flow chart of a method for determining a reference position provided in an embodiment of the present application. As shown in Figure 10, the process of determining the reference position can include steps 241 to 243.

[0131] In step 241 , an adjustment angle of the spatial coordinate system is determined based on the position of the reference area in the spatial coordinate system.

[0132] For example, the spatial coordinate system is continued to be composed of mutually perpendicular X-axis, Y-axis, and Z-axis, and the position of the reference area in the spatial coordinate system is determined. If the reference area is parallel to or coincides with the plane formed by any two coordinate axes, the adjustment angle is 0°; if the reference area is not parallel to the plane formed by any two coordinate axes, the adjustment angle of the spatial coordinate system can be determined by using the angle between the plane formed by the coordinate axes and the plane where the reference area is located.

[0133] In step 242 , the spatial coordinate system is adjusted based on the adjustment angle to obtain a reference coordinate system, wherein a reference plane where the reference area is located is parallel to or coincides with a plane formed by the first reference direction and the second reference direction in the reference coordinate system.

[0134] For example, after determining the adjustment angle, the spatial coordinate system can be rotated based on the adjustment angle, and the rotated coordinate system can be a reference coordinate system. In the reference coordinate system, the reference plane where the reference area is located is parallel to or coincides with the plane composed of the first reference direction and the second reference direction in the reference coordinate system, and the first reference direction and the second reference direction are perpendicular to each other. In this application, the first reference direction and the second reference direction are taken as the X' axis and the Z' axis as an example, and the reference plane where the reference area is located is parallel to or coincides with the plane composed of the X' axis and the Z' axis.

[0135] In step 243, the coordinates of the reference area in the first reference direction and the second reference direction of the reference coordinate system are determined. Based on the adjustment angle and the coordinates of the reference area in the first reference direction and the second reference direction, the coordinates of the reference position in the first direction and the second direction in the spatial coordinate system are determined. The first direction is obtained based on the first reference direction and the adjustment angle, and the second direction is obtained based on the second reference direction and the adjustment angle.

[0136] Exemplarily, the process of determining the coordinates of the reference position in the first and second directions in the spatial coordinate system based on the adjustment angle and the coordinates of the reference area in the first and second reference directions includes: determining the coordinates of the shooting position in the first and second directions in the spatial coordinate system based on the adjustment angle and the coordinates of the reference area in the first and second reference directions; and determining the coordinates of the reference position in the first and second directions in the spatial coordinate system based on the coordinates of the shooting position in the first and second directions in the spatial coordinate system. The shooting position refers to the position of the virtual camera that captured the reference image in the virtual environment at the time the reference image was captured. Since the relative positional relationship between the virtual camera and the reference virtual object is fixed, the coordinates of the reference position in the first and second directions in the spatial coordinate system can be determined based on the coordinates of the shooting position in the first and second directions in the spatial coordinate system and the relative positional relationship between the virtual camera and the reference virtual object.

[0137] Exemplarily, the first direction is determined by rotating a first reference direction by an adjustment angle to obtain the first direction. The second direction is determined by rotating a second reference direction by an adjustment angle to obtain the second direction.

[0138] For example, taking the reference area as a rectangle, after determining the reference area, the coordinates of the vertices and center point of the reference area on the X' axis and Z' axis in the reference coordinate system can be determined. Then, by adjusting the angle, the coordinates of the vertices and center point of the reference area on the X' axis and Z' axis can be converted into the coordinates of the X axis and Z axis in the spatial coordinate system, and the coordinates of the reference position on the X axis and Z axis in the spatial coordinate system can be determined.

[0139] In an exemplary embodiment of the present application, if the reference image contains a reference virtual object, the position where the reference virtual object needs to be transmitted to the reference area can be determined based on the relative position of the reference virtual object in the reference image, and the X-axis and Z-axis coordinates of this position can be determined.

[0140] In an exemplary embodiment of the present application, if the reference image does not contain a reference virtual object, the reference virtual object needs to be transmitted to the position where the reference virtual object obtains the reference image. The position where the reference virtual object obtains the reference image can be the X-axis and Z-axis coordinates corresponding to the center point of the reference area.

[0141] Determining the reference position by comprehensively considering the coordinates of the reference position in the first direction and the second direction in the spatial coordinate system is conducive to ensuring the positioning accuracy of the reference position in the first direction and the second direction, and to a large extent ensuring the reliability of the reference position, thereby ensuring the control reliability of the virtual object.

[0142] In an exemplary embodiment of the present application, after determining the coordinates of the reference position in the first and second directions in the spatial coordinate system, the coordinates of the reference position in a third direction in the spatial coordinate system can be determined using the reference image and virtual elements within the reference region. The third direction is perpendicular to the plane formed by the first and second directions, and the third direction is determined based on a third reference direction and an adjustment angle. Exemplarily, determining the third direction includes rotating the third reference direction by the adjustment angle to obtain the third direction.

[0143] FIG11 is a flow chart of another method for determining a reference position provided by an embodiment of the present application. As shown in FIG11 , the process of determining a reference position may further include steps 244 to 247 .

[0144] In step 244 , a reference virtual element is determined among the virtual elements of the reference image, and a first ratio between the reference virtual element and the reference image is obtained.

[0145] For example, the reference image may include multiple virtual elements, and a reference virtual element is determined from among the multiple virtual elements. The reference virtual element may be one or more. For example, the reference virtual element is determined based on the volume and outline of the virtual element. Optionally, a virtual element with a moderate volume and a relatively regular shape is selected from among the virtual elements as the reference virtual element. The moderate volume and relatively regular shape of the virtual element facilitate calculation of the first ratio between the reference virtual element and the reference image.

[0146] After determining the reference virtual element, the first ratio of the reference virtual element to the reference image can be obtained. Exemplarily, the area of ​​the reference virtual element and the area of ​​the reference image are determined, and the first ratio of the reference virtual element to the reference image is calculated using the area of ​​the reference virtual element and the area of ​​the reference image. For example, the ratio of the area of ​​the reference virtual element to the area of ​​the reference image is used as the first ratio of the reference virtual element to the reference image. This application takes one reference virtual element as an example. For example, the reference virtual element is a mountain, and the area of ​​the mountain is determined in the reference image, wherein the area of ​​the mountain can be calculated based on the outline of the mountain in the reference image. For example, the reference image is divided into area units arranged in an array, and the number of area units occupied by the outline of the mountain is determined, and the first ratio of the outline of the mountain to the entire reference image is further confirmed. It should be noted that the calculation of the first ratio between the reference virtual element and the reference image in this application is an exemplary description, and there may be other calculation methods, which this application does not limit.

[0147] In step 245 , a second ratio of the reference virtual element to the reference area is determined in the reference area.

[0148] For example, after determining the first ratio, a second ratio of the same reference virtual object within the reference region can be determined. For example, within the reference region, the ratio of the area of ​​the same reference virtual element to the area of ​​the reference region can be determined to obtain the second ratio of the reference virtual element to the reference region. It should be noted that the process for calculating the second ratio is similar to the process for calculating the first ratio and is not further elaborated here.

[0149] In step 246 , in response to the first ratio and the second ratio being different, the reference plane where the reference area is located is moved along the third reference direction of the reference coordinate system until the first ratio and the second ratio are the same.

[0150] Exemplarily, in response to a difference between a first proportion of the reference virtual element in the reference image and a second proportion of the reference virtual element in the reference region, the reference plane in which the reference region resides is moved along a third reference direction, i.e., the Y'-axis, until the first proportion and the second proportion become equal. For example, if the reference virtual element is a mountain, and the mountain occupies 40% of the reference image, when the mountain has the same Y'-axis coordinate as the reference region, the mountain's proportion in the reference region is 0%. As the reference plane in which the reference region resides moves along the Y'-axis, the mountain's proportion in the reference region increases until the mountain's proportion in the reference region becomes 40%.

[0151] In step 247, the moving distance of the reference plane where the reference area is located along the third reference direction of the reference coordinate system is obtained, and based on the moving distance, the adjustment angle and the position of the reference virtual element in the spatial coordinate system, the coordinates of the reference position in the third direction in the spatial coordinate system are determined. The third direction is perpendicular to the plane formed by the first direction and the second direction, and the third direction is obtained based on the third reference direction and the adjustment angle.

[0152] Exemplarily, the process of determining the coordinates of the reference position in the third direction in the spatial coordinate system based on the movement distance, the adjustment angle, and the position of the reference virtual element in the spatial coordinate system includes: determining the coordinates of the shooting position in the third direction in the spatial coordinate system based on the movement distance, the adjustment angle, and the position of the reference virtual element in the spatial coordinate system; and determining the coordinates of the reference position in the third direction in the spatial coordinate system based on the coordinates of the shooting position in the third direction in the spatial coordinate system. The shooting position refers to the position of the virtual camera that captured the reference image in the virtual environment at the time the reference image was captured. Since the relative positional relationship between the virtual camera and the reference virtual object is fixed, the coordinates of the reference position in the third direction in the spatial coordinate system can be determined based on the coordinates of the shooting position in the third direction in the spatial coordinate system and the relative positional relationship between the virtual camera and the reference virtual object.

[0153] Exemplarily, the movement distance of the reference plane where the reference area is located along the third reference direction of the reference coordinate system is obtained, and the movement distance is converted into the movement distance in the spatial coordinate system based on the movement distance and the adjustment angle. The Y-axis coordinate of the reference virtual element in the spatial coordinate system can be determined using the outline of the reference virtual element in the spatial coordinate system. The Y-axis coordinate of the shooting position is determined based on the movement distance of the reference plane where the reference area is located in the spatial coordinate system and the Y-axis coordinate of the reference virtual element in the spatial coordinate system. The Y-axis coordinate of the reference position is then determined based on the Y-axis coordinate of the shooting position. The Y-axis coordinate of the reference position is then determined based on the Y-axis coordinate of the shooting position. The Y-axis is the third direction of the spatial coordinate system, and the third direction is perpendicular to the plane formed by the first direction and the second direction.

[0154] Comprehensively considering the coordinates of the reference position in the first and second directions of the spatial coordinate system, as well as the coordinates of the reference position in the third direction of the spatial coordinate system, to determine the reference position helps improve the reliability of the reference position. Furthermore, by comparing the proportions of the reference virtual elements to determine the coordinates of the reference position in the third direction of the spatial coordinate system, the reliability of the coordinates of the reference position in the third direction of the spatial coordinate system is high, which helps further improve the reliability of the reference position, thereby improving the reliability of the control of the virtual object, and enhancing the player's interactive experience and the human-computer interaction rate.

[0155] In an exemplary embodiment of the present application, after obtaining the coordinates of the reference location, the reference area and the coordinates of the reference location can also be used to determine the orientation angle. Exemplarily, the process of determining the orientation angle includes: determining a reference point within the reference area; determining a first vector of the reference point and a second vector of the reference location based on a spatial coordinate system; and determining the orientation angle of the reference location using the first vector and the second vector. The orientation angle includes, but is not limited to, the orientation angle of the second virtual object at the reference location in the virtual environment or the orientation angle of a reference image captured in the virtual environment. The orientation angle is used to constrain the orientation of the first virtual object after being teleported to the reference location. That is, after the first virtual object is teleported to the reference location, the orientation of the first virtual object at the reference location is the same as the orientation angle of the second virtual object at the reference location in the virtual environment or the orientation angle of the reference image captured in the virtual environment. This ensures that after the first virtual object is teleported, the first player can directly view the scene presented by the reference image without having to adjust the orientation of the first virtual object, thereby improving the first player's interactive experience and, in turn, the human-computer interaction rate.

[0156] Exemplarily, the reference point can be the center point of the reference area, and the coordinates of the center point of the reference area in the spatial coordinate system are used to determine the coordinates of the center point of the reference area. After determining the coordinates of the center point and the coordinates of the reference position, the first vector corresponding to the center point and the second vector of the reference position can also be determined, and then the orientation angle of the reference position is determined by performing a dot product calculation on the first vector and the second vector. Exemplarily, the first vector refers to a vector pointing from the origin of the spatial coordinate system to the coordinates of the center point, and the second vector refers to a vector pointing from the origin of the spatial coordinate system to the coordinates of the reference position.

[0157] Exemplarily, when the reference virtual object is in the reference image, the orientation angle is the orientation angle of the virtual camera that takes the reference image; when the reference virtual object is not in the reference image, the orientation angle is the orientation angle of the reference virtual object, that is, the orientation angle of the first virtual object to be transmitted.

[0158] In an exemplary embodiment of the present application, Figure 12 is a schematic diagram of an interface displaying a teleport control provided in an embodiment of the present application. As shown in Figure 12, a reference image sent by player A is recognized, and after it is determined that the reference image contains information about the virtual environment, a teleport control "Teleport to this location" is displayed around the reference image, where the location is the reference location.

[0159] Exemplarily, after the first terminal receives the reference image sent by the terminal of player A and displays the transmission control, the first player clicks the transmission control, and the first terminal obtains the triggering operation of the transmission control.

[0160] In an exemplary embodiment, the method further includes: in response to a triggering operation of a teleportation control, displaying a first virtual object and a teleportation portal, the teleportation portal being located around the first virtual object and configured to teleport the first virtual object to a reference location. Displaying the teleportation portal after the teleportation control is triggered can provide the first player with a visual effect of the first virtual object being transported to the reference location via the teleportation portal, thereby enhancing the first player's interactive experience and thereby improving the human-computer interaction rate.

[0161] For example, the surroundings of the first virtual object may refer to the first virtual object's feet, or may refer to other locations, which are not limited in this embodiment of the present application. Taking the first virtual object's surroundings as the first virtual object's feet as an example, an interface displaying the first virtual object and a portal may be shown in FIG13 . In FIG13 , a portal 1302 is displayed at the feet of the first virtual object 1301.

[0162] In response to receiving a triggering operation of the teleportation control, a portal may be generated on the corresponding game interface, and the first virtual object may be teleported to the reference location via the portal. For example, after the first virtual object is teleported to the reference location, the portal may continue to be displayed or may be canceled, which is not limited in this embodiment of the present application.

[0163] Exemplarily, in response to a triggering operation of a teleport control, the process of teleporting a first virtual object to a reference position in a virtual environment may include: in response to a triggering operation of the teleport control, displaying a second game interface, the second game interface including the first virtual object and a teleportation portal, the teleportation portal being located around the first virtual object, and the teleportation portal being used to teleport the first virtual object to the reference position.

[0164] For example, after the first virtual object is transferred to the reference position, the first virtual object at the reference position is displayed, which ensures that the first player controlling the first virtual object can view the content presented in the reference image, thereby improving the interactive experience and human-computer interaction rate.

[0165] Exemplarily, the method further includes: displaying a third game interface, wherein the third game interface includes the reference position. The third game interface is an interface displayed when the first terminal transfers the first virtual object to the reference position.

[0166] Figure 14 is a schematic diagram of a third game interface provided by an embodiment of the present application. As shown in Figure 14 , after player B clicks the teleport control, a portal 140 is generated around the first virtual object B controlled by player B. Portal 140 is used to teleport first virtual object B to a reference location. The virtual environment displayed in the third game interface is identical to the virtual environment displayed in the reference image.

[0167] In an exemplary embodiment, the reference image may not include information about the virtual environment. In this case, only the reference image is displayed without the transfer control. For example, an interface displaying the reference image may be as shown in FIG15 . In the interface shown in FIG15 , only the reference image is displayed without the transfer control.

[0168] Since MMO, open world and other games often have better environmental display effects, many players will take pictures of the better scenery in the game scenes to record them, or invite friends to take photos here. However, many times players see a photo without a specific location and cannot know its specific location in the game. It is very difficult to browse to that location. If a friend is currently at the corresponding location, they can be teleported to that location through a team invitation, but if the friend is no longer at that location, the player cannot go there.

[0169] The method provided in the embodiment of the present application can quickly identify the reference image based on image recognition technology after obtaining the reference image. In the case where the reference image contains information about the virtual environment, a transmission control is displayed, and after the transmission control is triggered, the first virtual object is directly transmitted to the reference position, which can save the time of the first virtual object in searching for the reference position in the virtual environment and improve the interactivity and gaming experience of the game.

[0170] In addition, after quickly determining the reference position, the virtual object is quickly transported to the designated location through the portal. For example, by calibrating the corresponding positions of the reference image and the landscape elements in the game, the shooting coordinate points are calculated, and a fast transmission method is provided so that players can quickly reach the shooting position corresponding to the target location, thereby further improving the animation effects during the game and enriching the gaming experience.

[0171] The present application also provides a virtual object control device. FIG16 is a schematic diagram of the structure of a virtual object control device provided in an embodiment of the present application. As shown in FIG16 , the device includes:

[0172] An acquisition module 410 is configured to acquire a reference image;

[0173] a display module 420 for displaying a transfer control in response to the reference image including information about the virtual environment;

[0174] The transmission module 430 is used to transmit the currently controlled first virtual object to a reference position in the virtual environment in response to the trigger operation of the transmission control. The reference position includes the position of the second virtual object in the virtual environment or the position of the reference image captured in the virtual environment.

[0175] In a possible implementation, the second virtual object is associated with the first virtual object, and the acquisition module 410 is configured to receive a reference image sent by a control terminal of the second virtual object.

[0176] In one possible implementation, the display module 420 is further used to display a prompt message in response to receiving a reference image, where the prompt message is used to prompt that the reference image has been received, and the content of the prompt message includes at least one of the identity identifier corresponding to the second virtual object or the information of the reference image.

[0177] In one possible implementation, the display module 420 is further configured to display the first virtual object and a portal in response to a triggering operation of the transfer control, where the portal is located around the first virtual object and is configured to transfer the first virtual object to a reference position.

[0178] In a possible implementation, the display module 420 is further used to display the first virtual object located at the reference position.

[0179] In one possible implementation, the transmission module 430 is further used to determine basic information of the virtual environment based on the spatial coordinate system of the virtual environment, the basic information including at least one of marker distribution, shape distribution, or color distribution; obtain feature information of the reference image, the feature information including at least one of marker features, shape features, or color features; determine a reference area based on the feature information and the basic information; and determine a reference position based on the spatial coordinate system and the reference area.

[0180] In one possible implementation, the basic information includes marker distribution, and the feature information includes marker features. The transmission module 430 is used to determine the location area of ​​the marker in the virtual environment based on the marker features and the marker distribution; and determine the reference area based on the location area.

[0181] In one possible implementation, the transmission module 430 is used to obtain the type of the marker, determine the marker area based on the type of the marker and the marker distribution, and the marker area is the distribution area corresponding to the type of the marker; determine the relevant environmental characteristics of the marker, and filter the marker area based on the relevant environmental characteristics to obtain the location area.

[0182] In one possible implementation, the transmission module 430 is used to determine a reference plane based on a spatial coordinate system, map the basic information of the virtual environment on the reference plane, and obtain the distribution information of the virtual environment on the reference plane; match the distribution information of the virtual environment on the reference plane with the feature information, and determine a reference area within the reference plane based on the matching result.

[0183] In one possible implementation, the feature information includes a color feature, and the distribution information of the virtual environment on the reference plane includes the color distribution of the virtual environment on the reference plane. The transmission module 430 is used to perform noise reduction processing on the reference image based on the color feature to obtain standard pixel information contained in the reference image, where the standard pixel information includes a standard pixel value and the number of standard pixel values; process the color distribution of the virtual environment on the reference plane to obtain the standard pixel value distribution of the reference plane; based on the standard pixel information and the standard pixel value distribution, perform a first matching between the reference image and the reference plane, and determine an initial area in the reference plane based on the result of the first matching, where the standard pixel value and the number of standard pixel values ​​contained in the initial area are the same as those in the reference image; based on the color distribution and color feature of the initial area, perform a second matching between the initial area and the reference image, and determine a reference area in the initial area based on the result of the second matching.

[0184] In one possible implementation, the transmission module 430 is used to perform grid division on the initial area and the reference image based on the grid division parameters to obtain grid cells of the initial area and grid cells of the reference image; determine the first pixel values ​​corresponding to the grid cells of the initial area based on the color distribution of the initial area, and determine the second pixel values ​​corresponding to the grid cells of the reference image based on the color features; in response to the number of grid cells in the initial area that meet the reference condition being greater than or equal to a first threshold, determine the initial area as the reference area, and the similarity between the first pixel values ​​corresponding to the grid cells that meet the reference condition and the second pixel values ​​corresponding to the corresponding grid cells in the reference image is greater than or equal to the similarity threshold.

[0185] In one possible implementation, the reference image and the reference plane contain virtual elements, the feature information includes shape features, the distribution information of the virtual environment in the reference plane includes the shape distribution of the virtual environment in the reference plane, and the transmission module 430 is used to determine a first outline of the virtual element based on the shape features, and determine a second outline of the virtual element based on the shape distribution of the virtual environment in the reference plane; in response to the overlap rate between the first outline and the second outline being greater than or equal to a second threshold, the area corresponding to the second outline in the reference plane is determined as a reference area.

[0186] In one possible implementation, the transmission module 430 is used to determine the adjustment angle of the spatial coordinate system based on the position of the reference area in the spatial coordinate system; adjust the spatial coordinate system based on the adjustment angle to obtain the reference coordinate system, and the reference plane where the reference area is located is parallel to or coincides with the plane composed of the first reference direction and the second reference direction in the reference coordinate system; determine the coordinates of the reference area in the first reference direction and the second reference direction of the reference coordinate system, and determine the coordinates of the reference position in the first direction and the second direction in the spatial coordinate system based on the adjustment angle and the coordinates of the reference area in the first reference direction and the second reference direction, the first direction is obtained based on the first reference direction and the adjustment angle, and the second direction is obtained based on the second reference direction and the adjustment angle.

[0187] In one possible implementation, the reference image and the reference plane include virtual elements, and the transmission module 430 is further used to determine the reference virtual element in the virtual elements of the reference image, and obtain a first ratio between the reference virtual element and the reference image; determine a second ratio between the reference virtual element and the reference area in the reference area; in response to the difference between the first ratio and the second ratio, move the reference plane where the reference area is located along the third reference direction of the reference coordinate system until the first ratio and the second ratio are the same; obtain the movement distance of the reference plane where the reference area is located along the third reference direction of the reference coordinate system, and determine the coordinates of the reference position in the third direction in the spatial coordinate system based on the movement distance, the adjustment angle and the position of the reference virtual element in the spatial coordinate system, where the third direction is perpendicular to the plane formed by the first direction and the second direction, and the third direction is obtained based on the third reference direction and the adjustment angle.

[0188] In one possible implementation, the transmission module 430 is further used to determine a reference point in the reference area; determine a first vector of the reference point and a second vector of the reference position based on the spatial coordinate system; and determine an orientation angle of the reference position using the first vector and the second vector.

[0189] In one possible implementation, the transmission module 430 is further used to determine the reference position based on the position information in response to detecting that the reference image contains position information, where the position information is used to represent the position of the second virtual object in the virtual environment or the position of the reference image captured in the virtual environment.

[0190] The device provided in an embodiment of the present application, after acquiring a reference image, displays a transfer control, and when the transfer control is triggered, directly transfers the first virtual object to the reference location, saving the time required for the second virtual object to search for the reference location in the virtual environment and improving the efficiency of moving the first virtual object to the reference location. After the first virtual object moves to the reference location, the player controlling the first virtual object can observe the scene presented in the reference image, thereby improving the player's efficiency in observing the scene presented in the reference image and enhancing the interactivity and gaming experience.

[0191] In addition, based on the fact that the first virtual object is directly transmitted to the reference position, since the first virtual object does not need to search for the reference position in the virtual environment, there is no need to render each picture of the process of the first virtual object searching for the reference position in the virtual environment, which is conducive to reducing rendering resources and improving the running smoothness of the computer device.

[0192] It should be understood that the above-mentioned device is merely an example of the division of the above-mentioned functional modules when implementing its functions. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0193] FIG17 shows a block diagram of a terminal device 1100 provided in accordance with an exemplary embodiment of the present application. The terminal device 1100 may be any electronic device capable of human-computer interaction with a user through one or more methods, such as a keyboard, touchpad, remote control, voice interaction, or handwriting device. Examples include a PC (Personal Computer), mobile phone, smartphone, PDA (Personal Digital Assistant), wearable device, Pocket PC (PPC), tablet computer, smart car computer, smart TV, smart speaker, smart watch, and the like.

[0194] Typically, the terminal device 1100 includes a processor 1101 and a memory 1102 .

[0195] The processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1101 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1101 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1101 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0196] The memory 1102 may include one or more computer-readable storage media, which may be non-transitory. The memory 1102 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1102 is used to store at least one instruction, which is executed by the processor 1101 to implement the virtual object control method provided in the method embodiment of the present application.

[0197] In some embodiments, the terminal device 1100 may optionally further include: a display screen 1105 .

[0198] The display screen 1105 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1105 is a touch screen display, the display screen 1105 also has the ability to collect touch signals on the surface or above the surface of the display screen 1105. The touch signal can be input as a control signal to the processor 1101 for processing. At this time, the display screen 1105 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, there can be one display screen 1105, which is set on the front panel of the terminal device 1100; in other embodiments, there can be at least two display screens 1105, which are respectively set on different surfaces of the terminal device 1100 or in a folding design; in other embodiments, the display screen 1105 can be a flexible display screen, which is set on the curved surface or folding surface of the terminal device 1100. Even more, the display screen 1105 can be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1105 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0199] Those skilled in the art will understand that the structure shown in FIG17 does not constitute a limitation on the terminal device 1100 , and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0200] FIG18 is a schematic diagram of the structure of the server provided in an embodiment of the present application. The server 1200 may vary significantly due to different configurations or performances, and may include one or more processors 1201 and one or more memories 1202. The one or more memories 1202 store at least one program code, which is loaded and executed by the one or more processors 1201 to implement the virtual object control methods provided in the above-mentioned various method embodiments. Of course, the server 1200 may also have components such as a wired or wireless network interface, a keyboard, and an input / output interface for input and output. The server 1200 may also include other components for implementing device functions, which will not be described in detail here.

[0201] In an exemplary embodiment, a non-volatile computer-readable storage medium is further provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to enable a computer to implement any of the above-mentioned virtual object control methods.

[0202] Optionally, the above-mentioned non-volatile computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0203] In an exemplary embodiment, a computer program or a computer program product is further provided. The computer program or the computer program product stores at least one computer instruction, which is loaded and executed by a processor to enable a computer to implement any of the above-mentioned virtual object control methods.

[0204] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the reference images and reference locations involved in this application were obtained with full authorization.

[0205] It should be understood that the term "plurality" used herein refers to two or more. "And / or" describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates an "or" relationship between the associated objects.

[0206] The above description is merely an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A control method for virtual objects, wherein, The method is executed by a computer device, and the method includes: Obtain a reference image; In response to the reference image including information about a virtual environment, display a teleport control; In response to a trigger operation of the teleport control, teleport a first virtual object currently controlled to a reference position in the virtual environment, where the reference position includes the position of a second virtual object in the virtual environment or the position where the reference image is captured in the virtual environment.

2. The method according to claim 1, wherein, The second virtual object has an associated relationship with the first virtual object; the obtaining of the reference image includes: Receive the reference image sent by the control terminal of the second virtual object.

3. The method according to claim 2, wherein, The method further includes: In response to receiving the reference image, display a prompt message for prompting the reception of the reference image, and the content of the prompt message includes at least one of the identity identifier corresponding to the second virtual object or the information of the reference image.

4. The method according to any one of claims 1-3, wherein, The method further includes: In response to a trigger operation of the teleport control, display the first virtual object and a portal, where the portal is located around the first virtual object and is used to teleport the first virtual object to the reference position.

5. According to the method of any one of claims 1-4, wherein The method further includes: Display the first virtual object located at the reference position.

6. The method according to any one of claims 1-5, wherein, The method further includes: Determine basic information of the virtual environment based on the spatial coordinate system of the virtual environment, where the basic information includes at least one of marker distribution, shape distribution, or color distribution; Obtain feature information of the reference image, where the feature information includes at least one of marker features, shape features, or color features; Determine a reference area based on the feature information and the basic information; Determine the reference position based on the spatial coordinate system and the reference area.

7. The method according to claim 6, wherein, The basic information includes the marker distribution, and the feature information includes the marker features. Determining the reference area based on the feature information and the basic information includes: Based on the marker features and the marker distribution, determine the position area of the marker in the virtual environment; Based on the position area, determine the reference area.

8. The method according to claim 7, wherein The determining of the position area of the marker in the virtual environment based on the marker features and the marker distribution includes: Obtain the type of the marker, and based on the type of the marker and the marker distribution, determine a marker area, where the marker area is the distribution area corresponding to the type of the marker; Determine the relevant environmental features of the marker, and filter the marker area based on the relevant environmental features to obtain the position area.

9. The method according to any one of claims 6 - 8, wherein, Determining the reference area based on the feature information and the basic information includes: Determine a reference plane based on the spatial coordinate system, map the basic information onto the reference plane, and obtain the distribution information of the virtual environment on the reference plane; Match the distribution information of the virtual environment on the reference plane with the feature information, and determine the reference area in the reference plane based on the matching result.

10. The method according to claim 9, wherein, The feature information includes the color feature, the distribution information of the virtual environment on the reference plane includes the color distribution of the virtual environment on the reference plane, and the matching of the distribution information of the virtual environment on the reference plane with the feature information and determining the reference area in the reference plane based on the matching result includes: Based on the color feature, perform noise reduction processing on the reference image to obtain the standard pixel information included in the reference image, where the standard pixel information includes the standard pixel value and the quantity of the standard pixel value; Process the color distribution of the virtual environment on the reference plane to obtain the standard pixel value distribution of the reference plane; Based on the standard pixel information and the standard pixel value distribution, perform a first match between the reference image and the reference plane, and determine an initial area in the reference plane based on the result of the first match, where the initial area is the same as the standard pixel value and the quantity of the standard pixel value included in the reference image; Based on the color distribution of the initial area and the color feature, perform a second match between the initial area and the reference image, and determine the reference area in the initial area based on the result of the second match.

11. The method according to claim 10, wherein, The performing a second match between the initial area and the reference image based on the color distribution of the initial area and the color feature and determining the reference area in the initial area based on the result of the second match includes: Perform grid division on the initial area and the reference image based on the grid division parameter to obtain the grid cells of the initial area and the grid cells of the reference image; Determine the first pixel value corresponding to the grid cell of the initial area based on the color distribution of the initial area, and determine the second pixel value corresponding to the grid cell of the reference image based on the color feature; In response to the quantity of grid cells in the initial area that meet the reference condition being greater than or equal to a first threshold, determine the initial area as the reference area, where the similarity between the first pixel value corresponding to the grid cell that meets the reference condition and the second pixel value corresponding to the corresponding grid cell in the reference image is greater than or equal to a similarity threshold.

12. The method according to any one of claims 9-11, wherein, The reference image and the reference plane include virtual elements, the feature information includes a shape feature, the distribution information of the virtual environment on the reference plane includes the shape distribution of the virtual environment on the reference plane, and the matching of the distribution information of the virtual environment on the reference plane with the feature information and determining the reference area in the reference plane based on the matching result includes: Determine the first contour of the virtual element based on the shape feature, and determine the second contour of the virtual element based on the shape distribution of the virtual environment on the reference plane; In response to the coincidence rate between the first contour and the second contour being greater than or equal to a second threshold, determine the area corresponding to the second contour in the reference plane as the reference area.

13. The method according to any one of claims 6-12, wherein, The determining the reference position based on the spatial coordinate system and the reference area includes: Determine an adjustment angle of the spatial coordinate system based on the position of the reference region in the spatial coordinate system; Adjust the spatial coordinate system based on the adjustment angle to obtain a reference coordinate system, where the reference plane where the reference region is located is parallel or coincident with the plane formed by a first reference direction and a second reference direction in the reference coordinate system; Determine the coordinates of the reference region in the first reference direction and the second reference direction of the reference coordinate system, and based on the adjustment angle and the coordinates of the reference region in the first reference direction and the second reference direction, determine the coordinates of the reference position in the first direction and the second direction of the spatial coordinate system, where the first direction is obtained based on the First reference direction and the adjustment angle, and the second direction is obtained based on the second reference direction and the adjustment angle.

14. The method according to claim 13, wherein, The method further includes: Determine a reference virtual element among the virtual elements of the reference image, and obtain a first ratio of the reference virtual element to the reference image; Determine a second ratio of the reference virtual element to the reference region in the reference region; In response to the first ratio and the second ratio being different, move the reference plane where the reference region is located along a third reference direction of the reference coordinate system until the first ratio and the second ratio are the same; Obtain the moving distance of the reference plane where the reference region is located along the third reference direction of the reference coordinate system, and based on the moving distance, the adjustment angle, and the position of the reference virtual element in the spatial coordinate system, determine the coordinates of the reference position in the third direction of the spatial coordinate system, where the third direction is perpendicular to the plane formed by the first direction and the second direction, and the third direction is obtained based on the third reference direction and the adjustment angle.

15. The method according to any one of claims 6-14, wherein, The method further includes: Determine a reference point within the reference region; Determine a first vector of the reference point and a second vector of the reference position based on the spatial coordinate system; Use the first vector and the second vector to determine the orientation angle of the reference position.

16. The method according to any one of claims 1-15, wherein, The method further includes: In response to detecting that the reference image includes position information, determine the reference position based on the position information, where the position information is used to characterize the position of the second virtual object in the virtual environment or the position where the reference image is captured in the virtual environment.

17. A control device for a virtual object, wherein, The apparatus includes: An acquisition module, configured to acquire a reference image; A display module, configured to display a transfer control in response to the reference image including information about the virtual environment; A transfer module, configured to transfer a first virtual object currently controlled to a reference position in the virtual environment in response to a trigger operation of the transfer control, where the reference position includes the position of a second virtual object in the virtual environment or the position where the reference image is captured in the virtual environment.

18. A computer device, wherein, The computer device includes a processor and a memory. At least one program code is stored in the memory and is loaded and executed by the processor so that the computer device implements the control method of the virtual object as described in any one of claims 1 to 16.

19. A non-volatile computer-readable storage medium, wherein, At least one program code is stored in the non-volatile computer-readable storage medium and is loaded and executed by a processor so that a computer implements the control method of the virtual object as described in any one of claims 1 to 16.

20. A computer program product, wherein, At least one computer instruction is stored in the computer program product and is loaded and executed by a processor so that a computer implements the control method of the virtual object as described in any one of claims 1 to 16.

Images