Game processing method and related device

Abstract

The embodiment of the invention discloses a game processing method and a related device, at least relates to a cloud technology and the like, realizes immersive experience of a virtual game, and improves game interaction experience. The method comprises the steps that a first game interface is displayed, the first game interface comprises a first virtual character of a first object, a second virtual character of a second object and a target interaction condition, the first virtual character is controlled by the first object through a target account, and the fondness degree of the first object to the second object is larger than a preset threshold value; in response to a triggering operation for the target interaction condition, when the target interaction condition is met, indication information is sent to the XR shooting equipment, and the indication information is used for indicating the XR shooting equipment to shoot game actions of the first object to obtain action information; the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server are received, a first interaction picture is generated and displayed, and the action characteristics of the first virtual character are determined by the server based on the action information.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technologies, and particularly to a method for game processing and related devices. Background Art

[0002] Extended reality (XR) technology refers to the combination of the real and the virtual through a computer to create a virtual environment for human-computer interaction. It is also a collective term for various technologies such as Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR). By integrating the visual interaction technologies of the three, it brings an "immersive feeling" of seamless conversion between the virtual world and the real world to the experiencer. With the continuous development of social productivity and science and technology, the demand for XR technology in all walks of life is increasing day by day. With the rapid development of the game industry, various types of game software emerge in an endless stream, and the game content has become increasingly rich. Using XR technology can provide game players with a diversified virtual world.

[0003] In traditional dance games implemented using XR technology, game players usually need to use interactive devices such as touchscreens or keyboards and mice to inform the server of information such as the dance movements of the game players, so as to control the dance movements of the virtual characters corresponding to the game players. However, the method of using a touchscreen or a keyboard and mouse to control virtual characters easily causes game players to be unable to be fully immersed during the game process, and even less able to achieve close social interaction with other virtual characters, resulting in a poor game experience. Summary of the Invention

[0004] The embodiments of the present application provide a method for game processing and related devices, which are used to achieve an immersive virtual game experience, increase game interaction methods, and enhance the game interaction experience.

[0005] In a first aspect, an embodiment of the present application provides a method for game processing. This method can be applied to an extended reality (XR) display terminal corresponding to a target account. In this method, the XR display terminal displays a first game interface. The first game interface mentioned herein includes a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. The first virtual character is controlled by the first object through the target account. The degree of affection of the first object for the second object is greater than a preset threshold. The target interaction condition is used to indicate the triggering condition when the first virtual character and the second virtual character perform a game interaction operation. In response to a triggering operation for the target interaction condition, the XR display terminal sends an indication message to the XR shooting device when the target interaction condition is met. The indication message is used to instruct the XR shooting device to take a photo of the game action of the first object to obtain the action information of the first object. The XR display terminal receives the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server. The action characteristics of the first virtual character are determined by the server based on the action information of the first object, and the action characteristics of the second virtual character are determined by the server based on the action of the second virtual character. The XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, and displays the first interaction screen.

[0006] In a second aspect, an embodiment of the present application provides another method for game processing. This method can be applied to a server. In this method, the server receives the action information of the first object sent by the XR shooting device. The action information of the first object is obtained by the XR shooting device taking a photo of the game action of the first object. The first virtual character is controlled by the first object through the target account. The server determines the action characteristics of the first virtual character based on the action information of the first object. The server sends the action characteristics of the first virtual character and the action characteristics of the second virtual character to the XR display terminal corresponding to the target account, so that the XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character. The second virtual character corresponds to the second object, and the degree of affection of the first object for the second object is greater than a preset threshold.

[0007] In a third aspect, an embodiment of the present application provides another method for game processing. This method can be applied to an XR shooting device. In this method, the XR shooting device receives the indication message for the first object sent by the XR display terminal. In response to the indication message, the XR shooting device takes a photo of the game action of the first object to obtain the action information of the first object. The XR shooting device sends the action information of the first object to the server. The action information of the first object is used by the server to determine the action characteristics of the first virtual character, and the first virtual character corresponds to the first object.

[0008] Fourth aspect, an embodiment of the present application provides an XR display terminal. The XR display terminal includes a processing unit, a sending unit, and a receiving unit. Among them, the processing unit is used to display a first game interface, the first game interface includes a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. The first virtual character is controlled by the first object through a target account. The degree of preference of the first object for the second object is greater than a preset threshold. The target interaction condition is used to indicate the triggering condition when the first virtual character and the second virtual character perform a game interaction operation. The sending unit is used to, in response to a triggering operation for the target interaction condition, when the target interaction condition is satisfied, send an indication message to the XR shooting device, and the indication message is used to instruct the XR shooting device to take a photo of the game action of the first object to obtain the action information of the first object. The receiving unit is used to receive the action feature of the first virtual character and the action feature of the second virtual character sent by the server. The action feature of the first virtual character is determined by the server based on the action information of the first object, and the action feature of the second virtual character is determined by the server based on the action of the second virtual character. The processing unit is used to generate a first interaction screen based on the action feature of the first virtual character and the action feature of the second virtual character, and display the first interaction screen.

[0009] In some optional examples, the processing unit is used to: determine the displacement feature and rotation feature of the first virtual character based on the action feature of the first virtual character; determine the displacement feature and rotation feature of the second virtual character based on the action feature of the second virtual character; control the first virtual character and the second virtual character to perform a game interaction operation based on the displacement feature and rotation feature of the first virtual character, and the displacement feature and rotation feature of the second virtual character, so as to generate a first interaction screen.

[0010] In some other optional implementation manners, the first game interface includes a mixed reality game lobby interface. The receiving unit is used to, after displaying the first game interface, obtain target information, and the target information includes one or more of the audio information, expression information, gesture information, and body information of the first object. The sending unit is used to send the target information to the server, and the target information is used for the server to calculate a feedback parameter corresponding to the target information, and the feedback parameter is used to indicate the situation when the second virtual character makes a feedback to the target information. The receiving unit is used to receive the feedback parameter sent by the server and determine the information corresponding to the feedback parameter. The processing unit is used to generate a second interaction screen based on the target information and the information corresponding to the feedback parameter, and display the second interaction screen.

[0011] In some other optional implementation manners, the processing unit is used to, before responding to the triggering operation for the target interaction condition, respond to the triggering operation for the second virtual character to control the second virtual character to move to a first area, and the distance between the first area and the area where the first virtual character is located satisfies a preset condition.

[0012] In some other alternative embodiments, a processing unit is configured to display a second game interface before displaying a first game interface, where the second game interface includes a first character list. A receiving unit is configured to obtain a first selection instruction for a first virtual character in the first character list. The processing unit is configured to, in response to the first selection instruction, display the first virtual character in the first game interface.

[0013] In some other alternative embodiments, the second game interface further includes a second character list; the obtaining unit is further configured to obtain a second selection instruction for a second virtual character in the second character list. The processing unit is configured to, in response to the second selection instruction, also display the second virtual character in the first game interface.

[0014] In some other alternative embodiments, the second game interface further includes an interaction condition list; the obtaining unit is further configured to obtain a third selection instruction for a target interaction condition in the interaction condition list. The processing unit is configured to, in response to the third selection instruction, also display the target interaction condition in the first game interface.

[0015] In a fifth aspect, an embodiment of the present application provides a server. The server includes a receiving unit, a processing unit, and a sending unit. Among them, the receiving unit is configured to receive action information of a first object sent by an extended reality (XR) shooting device, where the action information of the first object is obtained by the XR shooting device taking a photo of a game action of the first object, and the first virtual character is controlled by the first object through a target account. The processing unit is configured to determine an action feature of the first virtual character based on the action information of the first object. The sending unit is configured to send the action feature of the first virtual character and the action feature of a second virtual character to an XR display terminal corresponding to the target account, so that the XR display terminal generates a first interaction screen based on the action feature of the first virtual character and the action feature of the second virtual character, where the second virtual character corresponds to a second object, and the degree of preference of the first object for the second object is greater than a preset threshold.

[0016] In some alternative embodiments, the receiving unit is further configured to receive target information sent by the XR display terminal, where the target information includes one or more of audio information, expression information, gesture information, and body information of the first object. The processing unit is configured to determine a feedback parameter corresponding to the target information based on the target information, where the feedback parameter is used to indicate the situation when the second virtual character makes a feedback to the target information. The sending unit is configured to send the feedback parameter to the XR display terminal, where the feedback parameter is used for the XR display terminal to determine the information corresponding to the feedback parameter, so that the XR display terminal generates a second interaction screen based on the target information and the information corresponding to the feedback parameter.

[0017] Sixth aspect, an XR shooting device is provided in an embodiment of the present application. The XR shooting device includes a receiving unit, a processing unit, and a transmitting unit. Among them, the receiving unit is configured to receive indication information about a first object sent by an XR display terminal. The processing unit is configured to take a photo of the gaming action of the first object in response to the indication information to obtain action information of the first object. The transmitting unit is configured to send the action information of the first object to a server, and the action information of the first object is used by the server to determine the action characteristics of a first virtual character, and the first virtual character corresponds to the first object.

[0018] In some optional implementation manners, the processing unit is configured to take a photo of the gaming action of the first object in response to the indication information by using a preset outward-inward positioning algorithm to obtain action information of the first object.

[0019] Seventh aspect, a game processing system is provided in an embodiment of the present application. The game processing system includes an XR display terminal, an XR shooting device, and a server. Among them, the XR display terminal is configured to execute the game processing method corresponding to the implementation manner of the first aspect above; the server is configured to execute the game processing method corresponding to the implementation manner of the second aspect above; the XR shooting device is configured to execute the game processing method corresponding to the implementation manner of the third aspect above.

[0020] An eighth aspect of the embodiment of the present application provides a game processing device, including: a memory, an input / output (I / O) interface, and a memory. The memory is used to store program instructions. The processor is configured to execute the program instructions in the memory to execute the game processing method corresponding to the implementation manner of the first aspect above; or execute the game processing method corresponding to the implementation manner of the second aspect above; or execute the game processing method corresponding to the implementation manner of the third aspect above.

[0021] A ninth aspect of the embodiment of the present application provides a computer-readable storage medium, in which instructions are stored, and when it runs on a computer, it causes the computer to execute the game processing method corresponding to the implementation manner of the first aspect above; or execute the game processing method corresponding to the implementation manner of the second aspect above; or execute the game processing method corresponding to the implementation manner of the third aspect above.

[0022] A tenth aspect of the embodiment of the present application provides a computer program product containing instructions, and when it runs on a computer or a processor, it causes the computer or the processor to execute the game processing method corresponding to the implementation manner of the first aspect above; or execute the game processing method corresponding to the implementation manner of the second aspect above; or execute the game processing method corresponding to the implementation manner of the third aspect above.

[0023] As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

[0024] In the embodiment of the present application, the XR display terminal displays a first game interface, which includes a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. Among them, the target interaction condition is used to indicate the trigger condition when the first virtual character and the second virtual character perform a game interaction operation. In addition, the first virtual character is controlled by the first object through a target account, and the degree of preference of the first object for the second object is greater than a preset threshold. The XR display terminal responds to a trigger operation for the target interaction condition, and then, when the target interaction condition is met, sends an indication message to the XR shooting device. Through this indication message, the XR shooting device can be instructed to take a photo of the game action of the first object to obtain the action information of the first object. The XR display terminal then receives the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server, where the action characteristics of the first virtual character are determined by the server based on the action information of the first object. In this way, the XR display terminal then generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, and displays the first interaction screen.

[0025] That is to say, in the embodiment of the present application, the action information of the first object is obtained by an independent XR shooting device taking a real-time photo of the game action of the first object, and then the action information captured in real time is used to control the action of the first virtual character, rather than relying on triggering or methods such as keyboards and mice as in traditional dance solutions to inform, which can enable the first object to fully achieve an immersive experience in the game. In addition, in the embodiment of the present application, since the degree of preference of the first object for the second object is greater than a preset threshold, and the action characteristics of the first virtual character and the action characteristics of the second virtual character are used to generate and display the first interaction screen, the first object can complete the same-stage interaction with the second object whose degree of preference is greater than the preset threshold through the first virtual character at close range, increasing the interaction methods during the game process and enhancing the game interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for describing the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0027] Figure 1 Shows a schematic diagram of a scene in a related dance game;

[0028] Figure 2Shows the schematic diagram of the system architecture provided by the embodiments of the present application;

[0029] Figure 3 Shows a flowchart of a method for game processing provided by the embodiments of the present application;

[0030] Figure 4 Shows the schematic diagram of displaying the second game interface provided by the embodiments of the present application;

[0031] Figure 5 Shows the schematic diagram of displaying the first game interface provided by the embodiments of the present application;

[0032] Figure 6 Shows the schematic diagram of action capture provided by the embodiments of the present application;

[0033] Figure 7 Shows another flowchart of a method for game processing provided by the embodiments of the present application;

[0034] Figure 8 Shows the schematic diagram of displaying expression information provided by the embodiments of the present application;

[0035] Figure 9 Shows the schematic diagram of displaying the second interaction screen provided by the embodiments of the present application;

[0036] Figure 10 Shows the optional schematic diagram of the functional modules of the XR display terminal provided by the embodiments of the present application;

[0037] Figure 11 Shows the optional schematic diagram of the functional modules of the server provided by the embodiments of the present application;

[0038] Figure 12 Shows the optional schematic diagram of the functional modules of the XR shooting device provided by the embodiments of the present application;

[0039] Figure 13 Shows the schematic diagram of the structure of the V game processing system provided by the embodiments of the present application;

[0040] Figure 14 Shows the optional schematic diagram of the hardware structure of the game processing device provided by the embodiments of the present application. Detailed implementation

[0041] The embodiments of the present application provide a method for game processing and related devices, which are used to achieve an immersive virtual game experience, increase game interaction methods, and enhance the game interaction experience.

[0042] It is understandable that in the specific embodiments of the present application, data related to user information and the like are involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions.

[0043] Next, the technical solutions in the embodiments of the present application will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0044] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above accompanying drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device comprising a series of steps or units does not necessarily need to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0045] With the continuous development of social productivity and science and technology, the demand for VR technology in all walks of life is also increasing day by day. VR technology has also been continuously developed and gradually become a new field of science and technology. For example, VR technology is widely applied to virtual game scenarios, medical scenarios, educational scenarios, social scenarios, tourism scenarios, etc., and is not limited specifically in the embodiments of the present application.

[0046] For dance games in virtual game scenarios, VR technology is also gradually applied to complete the dance operations of game players in the virtual world. Exemplarily, Figure 1 shows a schematic diagram of a scene in a related dance game. As Figure 1 shown, game player A controls the virtual character "Xiaowu" corresponding to the game player A in the virtual world to complete corresponding dance actions by clicking on the action control on the display screen or triggering the click of the action control through the keyboard and mouse, such as the "up", "down", "left", and "right" controls, etc.

[0047] However, from Figure 1As can be seen from the traditional dance method shown, the operation method of this dance is still a two-dimensional (2D) plane. Game players can neither be fully immersed during the game nor achieve close social interaction with other virtual characters, resulting in a poor gaming experience.

[0048] Therefore, to solve the above-mentioned technical problems, an embodiment of this application provides a method for game processing. This game processing method can be applied to Figure 2 the system architecture shown. As Figure 2 shown, this system architecture at least includes an XR display terminal, an XR shooting device, and a server. Among them, the mentioned XR display terminal, XR shooting device, and server can be directly or indirectly connected through wired communication, wireless communication, etc. This application does not make specific limitations.

[0049] In this application, a virtual game application (application, APP) is deployed in the XR display terminal. The first object can log in to the virtual game application in the XR display terminal through the target account. After logging in and starting the virtual game application, the XR shooting device captures the game actions of the first object to obtain action information about the first object, and then sends the action information to the server. After receiving the action information of the first object, the server performs calculations on the action information to determine the action characteristics of the first virtual character corresponding to the first object, and feeds them back to the XR display terminal. It should be noted that the above-mentioned virtual game can include, but is not limited to, dance games, etc., and no specific limitations are made here.

[0050] The above-mentioned first object can be understood as the game player wearing the XR display terminal. The first virtual character can be understood as the virtual image used by the first object in the virtual world. In addition, in this scenario, there is also a second virtual character corresponding to the second object. The second virtual character can be understood as the virtual image used by the second object in the virtual world. The degree of preference of the first object for the second object is greater than the preset threshold. For example, if the idol that the first object likes the most is Xiaoming, Xiaoming can be understood as the second object mentioned in this application at this time.

[0051] In addition, the server also needs to send the action characteristics of the second virtual character to the XR display terminal. In this way, the XR display terminal generates and displays a corresponding first interaction screen based on the action characteristics of the first virtual character and the second virtual character. Or rather, from the first interaction screen, the action interaction situation between the first virtual character and the second virtual character can be clearly shown, so as to understand the game interaction situation between the first object and the second object.

[0052] Optionally, the XR display terminal can also obtain target information and send it to the server. For example, the target information can include one or more of the audio information, expression information, and gesture information of the first object. After receiving the target information, the server determines the feedback parameters corresponding to the target information. The described feedback parameters can reflect the situation when the second virtual character makes a feedback to the target information. The server then sends the feedback parameters to the XR display terminal, enabling the XR display terminal to determine the information corresponding to the feedback parameters. In this way, the XR display terminal then generates and displays the second interaction screen based on the target information and the information corresponding to the feedback parameters. Or rather, from the second interaction screen, one or more of the expression interaction situation and audio interaction situation between the first virtual character and the second virtual character can be clearly shown.

[0053] It should be noted that the above-mentioned XR display terminal can include, but is not limited to, a VR headset device with MR perspective function, or other AR glasses (non-cinema devices) with MR perspective function, etc., which are not limited here. The described MR perspective function can be understood as creating an interactive feedback information loop between the virtual world, the real world, and the user object by introducing real scene information into the virtual environment to enhance the realism of the user experience. In other words, through XR technology, users can interact with the real world in a virtual environment, superimpose virtual elements on the real environment through AR technology, and at the same time create a brand-new virtual scene using VR technology.

[0054] In addition, the mentioned XR shooting device can include, but is not limited to, a VR base station, or other photographing devices with VR function and shooting function, an AR base station, etc., which will not be elaborated here. In addition, the mentioned server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN), and big data and artificial intelligence platforms, etc. This application does not make specific limitations.

[0055] The above Figure 2The method of game processing mentioned above can be applied in fields such as cloud technology. The cloud technology described refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or a local area network to achieve data computing, storage, processing, and sharing. Cloud technology is the general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model, which can form a resource pool, be used as needed, and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. With the highly developed and applied Internet industry, in the future, each item may have its own identification mark and needs to be transmitted to the background system for logical processing. Data at different levels will be processed separately, and various industry data requires a powerful system support, which can only be achieved through cloud computing.

[0056] The cloud computing mentioned above is a computing model that distributes computing tasks on a resource pool composed of a large number of computing devices, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called the "cloud". The resources in the "cloud" seem to be infinitely expandable to users, and can be obtained at any time, used as needed, expanded at any time, and paid according to usage.

[0057] As a basic capability provider of cloud computing, a cloud computing resource pool (abbreviated as a cloud platform, generally called an infrastructure as a service (IaaS) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to choose and use. The cloud computing resource pool mainly includes: computing devices (virtual machines, including operating systems), storage devices, and network devices.

[0058] Currently, cloud technology has been widely applied in many fields, and cloud gaming is one of the application products of cloud technology. Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables thin clients with relatively limited graphics processing and data computing capabilities to run high-quality games. In the cloud gaming scenario, the game does not run on the terminal device, but on the cloud server, and the cloud server renders the game scene into a video and audio stream and transmits it to the terminal device through the network. The terminal device only needs to have basic streaming media playback capabilities and the ability to obtain input instructions and send them to the cloud server.

[0059] Exemplarily, the game processing method mentioned in this application can also be applied to scenarios such as artificial intelligence, which is specifically defined in this application.

[0060] The following introduces a game processing method provided by an embodiment of this application with reference to the accompanying drawings. Figure 3 A flowchart of a game processing method provided by an embodiment of this application is shown. As Figure 3 shown, the game processing method may include the following steps:

[0061] 301. The XR display terminal displays a first game interface, which includes a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. The first virtual character is controlled by the first object through a target account. The degree of preference of the first object for the second object is greater than a preset threshold. The target interaction condition is used to indicate the trigger condition when the first virtual character and the second virtual character perform a game interaction operation.

[0062] In this example, a virtual game application is deployed in the XR display terminal, such as a dance virtual game. The first object can pre-register for the virtual game application in the XR display terminal to obtain a target account for the virtual game application. In this way, during the subsequent process of the first object playing the virtual game application, the target account is entered at the login entry of the virtual game application to log in and start the virtual game application.

[0063] After the first object logs in and starts the virtual game application, the XR display terminal displays a second game interface. In this second game interface, it includes a first character list, a second character list, and an interaction condition list. In the first character list, it includes at least one first virtual image. For the second character list, it includes at least one second virtual image. In addition, in the interaction condition list, it also includes at least one interaction condition. Moreover, each first virtual image is different, each second virtual image is different, and each interaction condition is different.

[0064] The mentioned second character list can be determined based on the degree of preference of the first object for candidate objects. That is to say, for each second virtual image in the second character list, it can be understood as the virtual image corresponding to the candidate object. For example, assume that the degrees of preference of the first object for candidate objects 1 to 5 are 0.1, 0.2, 0.3, 0.4, and 0.5 respectively. At this time, the virtual images corresponding to these candidate objects 1 to 5 can be saved in the second character list. Or rather, the second character list includes virtual image 2-1 of candidate object 1, virtual image 2-2 of candidate object 2, virtual image 2-3 of candidate object 3, virtual image 2-4 of candidate object 4, and virtual image 2-5 of candidate object 5.

[0065] For each interaction condition in the interaction condition list, it can be understood as the condition for triggering the interaction between any first virtual character and any second virtual character. For example, the interaction conditions can include, but are not limited to, dance tracks or other game operation conditions, etc., which are not limited here.

[0066] For example, Figure 4 The schematic diagram showing the second game interface provided by the embodiment of the present application is shown. As Figure 4 shown, the first character list may include virtual characters 1-1 to 1-5, and the second character list includes virtual characters 2-1 to 2-10. Taking the dance track as the interaction condition as an example, the corresponding interaction condition list includes tracks 1 to 8.

[0067] After the XR display terminal displays the second game interface, it can obtain a first selection instruction for the first virtual character in the first character list. Through this first selection instruction, the first virtual character corresponding to the target account can be selected from at least one first virtual character in the first character list. For example, the first object clicks on virtual character 1-4. In this way, the XR display terminal then responds to the first selection instruction to display the first virtual character in the first game interface, for example, display virtual character 1-4.

[0068] Similarly, after the XR display terminal displays the second game interface, it can also obtain a second selection instruction for the second virtual character in the second character list. Through this second selection instruction, the second virtual character can be selected from at least one second virtual character in the second character list. For example, the first object clicks on virtual character 2-8. It should be noted that the described second virtual character can be understood as the second virtual image corresponding to the first object's preference degree for the second object being greater than the preset threshold in the second character list. In this way, after the XR display terminal obtains the second selection instruction, it then responds to the second selection instruction to display the second virtual character in the first game interface, for example, display virtual character 2-8.

[0069] In addition, after the XR display terminal also displays the second game interface, it obtains a third selection instruction for the target interaction condition in the interaction condition list. For example, the first object clicks on track 1. The described target interaction condition can be used to indicate the trigger condition for the first virtual character and the second virtual character to perform game interaction operations. In this way, the XR display terminal responds to the third selection instruction to be able to display the target interaction condition in the first game interface, for example, display track 1.

[0070] For example, as described above Figure 4Taking the example shown, the first object can click on the avatar identifiers of virtual avatars 1-4 in the first character list of the second display interface to select the virtual avatars corresponding to the avatar identifiers, that is, taking virtual avatars 1-4 as the first virtual characters corresponding to the target account. Additionally, the target player can also click on the avatar identifiers of virtual avatars 2-8 in the second character list to select the corresponding virtual avatars 2-8, and then take the virtual avatars 2-8 as the corresponding second virtual characters. Similarly, the target player can also click on the identifier of track 1 in the interaction condition list based on their own preferences and other requirements to select the target interaction condition, which is track 1.

[0071] In this way, after the first object completes the selection operations of the first virtual character, the second virtual character, and the target interaction condition in the second game interface, the XR display terminal then displays the first game interface on the display screen. In the described first game interface, it includes the aforementioned first virtual character, second virtual character, and target interaction condition. For example, based on the example Figure 4 shown above. Figure 5 FIG. shows a schematic diagram of the first game interface provided by an embodiment of the present application. As Figure 5 shown, virtual avatars 1-4, virtual avatars 2-8, and track 1 can be displayed in the first game interface.

[0072] It should be noted that for the aforementioned first selection instruction, second selection instruction, and third selection instruction, it can include but is not limited to click instructions, long press instructions, touch instructions, or swipe instructions, etc., and is not specifically limited. The described click instruction can include but is not limited to single click, double click, multiple clicks, etc. Additionally, the aforementioned avatar identifier can include but is not limited to the name of the virtual avatar, the avatar of the virtual avatar, etc., and is not specifically limited.

[0073] In some alternative examples, the XR display terminal can also, before performing the subsequent step s302, that is, after displaying the first game interface, in response to a trigger operation on the second virtual character, control the second virtual character to move to the first area. The described first area satisfies a preset condition with the area where the first virtual character is located.

[0074] That is to say, before making a game action, the first object can also pre-set an interaction area through the XR display terminal. For example, the first object uses a game controller that matches the XR display terminal to demarcate a certain area in a real-world open space, such as a square area of 2 meters × 2 meters. After receiving the signal from the game controller, the XR display terminal can learn the position and size of the interaction area in the real world, and then display the corresponding virtual interaction area on the display screen. In this way, subsequently, the first object can effectively interact with the second virtual character through the first virtual character within the set interaction area.

[0075] In this virtual interaction area, the first object can also select the second virtual character through the game controller and move to the first area, so that the XR display terminal can obtain a movement instruction for the second virtual character and respond to the movement instruction to complete the movement processing of the second virtual character.

[0076] It should be noted that the position of the described first area in the interaction area can be directly opposite to the area where the first virtual character is located, or it can also be located in the lower right corner, or it can also be located in a user-defined area, etc. The embodiments of the present application do not limit the position of the first area. In addition, the shapes of areas such as the first area and the interaction area can be circular, rectangular, or elliptical, etc. The embodiments of the present application do not make any limitations.

[0077] Optionally, the game actions mentioned in the present application can also be related to the difficulty level of the interaction conditions. The higher the difficulty level of the interaction conditions, the more difficult the corresponding game actions are to operate; conversely, the lower the difficulty level of the interaction conditions, the easier the corresponding game actions are to operate. In this way, it can prompt the first object to interact more with the second object to increase the intimacy between the first object and the second object, so that when the intimacy reaches a certain condition (such as the intimacy is greater than a preset intimacy threshold, etc.), different game levels can be unlocked to complete the upgrade operation of the game.

[0078] 302. The XR display terminal responds to the trigger operation for the target interaction condition and sends an indication message to the XR shooting device when the target interaction condition is met.

[0079] In this example, after the XR display terminal displays the first game interface, the first object can perform a trigger operation on the target interaction condition through the game controller, so that the XR display terminal responds to the trigger operation for the target interaction condition.

[0080] For example, when the target player triggers the target interaction condition by clicking or other means, the XR display terminal can obtain the trigger instruction for the target interaction condition, and then respond to the trigger operation for the target interaction condition based on the trigger instruction. The mentioned trigger operation can be one or more of a click operation, a touch operation, a swipe operation, and a long-press operation. The described click operation can include, but is not limited to, single-click, double-click, multiple clicks, etc. The touch operation can include, but is not limited to, single-finger touch, double-finger touch, etc. The swipe operation can also include, but is not limited to, single-finger swipe, double-finger swipe, etc., and the present application does not make specific limitations. In practical applications, in addition to the above-mentioned click operation, touch operation, swipe operation, and long-press operation, there may also be other types of operations in practical applications, such as: button operation, etc., and the present application does not make specific limitations.

[0081] After the target interaction condition is triggered, if the target interaction condition is met, the XR display terminal can also instruct the XR shooting device to capture the game actions of the first object. As a schematic description, the XR display terminal sends indication information to the XR shooting device through a message, an instruction, or other means. The XR shooting device is instructed through the indication information to collect the action information of the first object.

[0082] 303. The XR shooting device responds to the indication information and takes a photo of the game actions of the first object to obtain the action information of the first object.

[0083] In this example, after receiving the indication information sent by the XR display terminal, the XR shooting device responds to the indication information, and then, under the indication of the indication information, takes a photo of the game actions of the first object in the interaction area, thereby obtaining the action information of the first object. The described action information of the first object can reflect the actual action situation of the first object under the target interaction condition.

[0084] As a schematic description, the described XR shooting device can be multiple XR base stations, which are used to locate the first object in the interaction area and collect the game actions of the first object.

[0085] For example, Figure 6 shows the action capture schematic diagram provided by the embodiment of the present application. As Figure 6As shown, taking the XR base station as the XR shooting device as an example, two XR base stations can be set outside the interaction area, such as XR base station 1 and XR base station 2. Among them, XR base station 1 and XR base station 2 are set on the diagonal of the interaction area, and XR base station 1 and XR base station 2 can communicate with devices such as XR display terminals, gamepads, and servers. During the process of shooting the game actions of the first object, XR base station 1 and XR base station 2 can be utilized, and the game actions and positions of the first object can be determined through a preset outside-in positioning algorithm, thereby obtaining action information about the first object. More specifically, the space where the interaction area is located is covered by lasers, infrared rays, or visible light emitted by XR base station 1 and XR base station 2, and three-dimensional position information is established. In this way, the position and movement direction of the first object are determined through the method of triangulation, and thus the action information of the first object is obtained.

[0086] The described outside-in tracking algorithm is sometimes also referred to as outside-in positioning technology. It mainly covers the space between the positioning point devices (such as the aforementioned XR shooting device) through pre-placed positioning point devices (such as the space of the aforementioned interaction area), and establishes three-dimensional position information to determine the position and movement direction of the wearer (such as the aforementioned first object) through the method of triangulation.

[0087] 304. The XR shooting device sends the action information of the first object to the server.

[0088] In this example, after obtaining the action information of the first object, the XR shooting device can send the action information of the first object to the server. For example, the action information of the first object can be sent to the server through messages, instructions, or other sending methods.

[0089] 305. The server determines the action characteristics of the first virtual character based on the action information of the first object.

[0090] In this example, after receiving the action information of the first object sent by the XR shooting device, the server analyzes the action information to determine the action characteristics of the first virtual character. As a schematic description, the server extracts the action change situation of each key point from the action information, and then determines the action characteristics of the first virtual character based on the action change situations of all key points. The described key points can include but are not limited to hands, feet, head, etc., and are not limited here.

[0091] Exemplarily, the action characteristics of the described first virtual character include the displacement information and rotation information of the first virtual character. The described displacement information can be understood as the action displacement of the first object during the interaction process, and the rotation information is used to reflect the action rotation of the first object during the interaction process.

[0092] 306. The server sends the action characteristics of the first virtual character and the action characteristics of the second virtual character to the XR display terminal.

[0093] In this example, the server can send the action characteristics of the first virtual character and the action characteristics of the second virtual character to the XR display terminal by means of messages, instructions, etc. The described action characteristics of the second virtual character can be determined based on the action information of the second object and pre-stored in the server in advance; or, they can also be determined by collecting the action information of the second object in real time through the aforementioned XR shooting device. The specific method is not limited in this application.

[0094] 307. The XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, and displays the first interaction screen.

[0095] In this example, after receiving the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server, the XR display terminal can also generate a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character. Subsequently, the XR display terminal displays the first interaction screen on the display screen. Based on this, the first object can view the first interaction screen through the XR display terminal.

[0096] As a schematic description, regarding how to generate the first interaction screen, it can be understood with reference to the following method, that is: the XR display terminal determines the displacement information and rotation information of the first virtual character based on the action characteristics of the first virtual character. In addition, the XR display terminal also determines the displacement information and rotation information of the second virtual character based on the action characteristics of the second virtual character. After determining the displacement information and rotation information of the first virtual character, the displacement information and rotation information of the second virtual character, the XR display terminal then controls the first virtual character and the second virtual character to perform an interaction operation based on the displacement information and rotation information of the first virtual character, as well as the displacement information and rotation information of the second virtual character, to generate the first interaction screen.

[0097] In the above manner, in the embodiments of the present application, the action information of the first object is obtained by an independent XR shooting device to capture the game actions of the first object in real time, and then the action information captured in real time is used to control the actions of the first virtual character, rather than relying on triggering or methods such as keyboards and mice as in traditional dance solutions to notify, which can enable the first object to fully achieve an immersive experience in the game. In addition, in the embodiments of the present application, the degree of preference of the first object for the second object is greater than a preset threshold, and the action characteristics of the first virtual character and the action characteristics of the second virtual character are used to generate and display a first interaction screen, so that the first object can complete on-stage interaction with the second object whose degree of preference is greater than the preset threshold through the first virtual character at close range, increasing the interaction methods during the game process and enhancing the game interaction experience.

[0098] In some other examples, whether before the virtual game runs to completion or after the virtual game ends, the first player can control the first virtual character to enter the game lobby interface through the target account. Optionally, the first game interface mentioned above in the present application includes a mixed reality (MR) game lobby interface. The described MR game lobby interface can be understood as a virtual three-dimensional space. Through the MR game lobby interface, the first virtual character corresponding to the first object and the second virtual character of the second object can interact in the same space. Specifically, refer to Figure 7 , which shows another schematic flowchart of the game processing method provided by the embodiments of the present application. As Figure 7 shown, it at least includes the following steps:

[0099] 701. The XR display terminal displays the MR game lobby interface, and the MR game lobby interface includes the first virtual character of the first object and the second virtual character of the second object. The first virtual character is controlled by the first object through the target account, and the degree of preference of the first object for the second object is greater than a preset threshold.

[0100] In this example, different from the traditional game lobby scenario, the first game interface in the present application includes the MR game lobby interface. In the MR game lobby interface, the XR display terminal, by means of the perspective function in MR technology, can prompt the first virtual character and the second virtual character to complete interaction in the same three-dimensional space.

[0101] It should be noted that the content such as the first virtual character, the second virtual character, the first object, and the second object described can be understood with reference to the content described in step 301 above, and will not be elaborated here. Figure 3

[0102] 702. The XR display terminal obtains target information, and the target information includes one or more of the audio information, expression information, gesture information, and body information of the first object.

[0103] In this example, after the XR display terminal displays the MR game hall interface, it can also collect the target information of the first object. The described target information includes one or more of the audio information, expression information, gesture information, and body information of the first object. The described audio information can be understood as the voice and the like emitted by the first object during the interaction. The described expression information reflects the facial expression of the first object during the interaction. The gesture information is understood as the information displayed by the hand gesture of the first object during the interaction. The body information is understood as the information displayed by the body (such as legs, waist, etc.) gesture of the first object during the interaction.

[0104] As a schematic description, the XR display terminal can collect the voice audio data of the first object in real time through the built-in microphone to obtain the audio information of the first object.

[0105] In addition, the XR display terminal can also shoot the key points of the mouth of the first player through the built-in camera device to determine the mouth key point action of the first player. The mentioned camera device can include, but is not limited to, an unlimited number of cameras such as 1, 2, or 3. In this way, the XR display terminal matches the mouth key point action with each expression state in the preset expression state set, and then determines the expression corresponding to the matched expression state as the expression information of the first object. For example, different expressions such as laughing, smiling, sad, angry, or sighing can be matched. For example, referring to Figure 8 the schematic diagram of the display of the expression information shown, it can be known that the expression information of the first object is a smile.

[0106] Similarly, the XR display terminal can also shoot the key points of the hand of the first player through the built-in camera device, such as collecting the postures of the left hand fingers and the right hand fingers, to obtain the gesture information of the first object.

[0107] 703. The XR display terminal sends the target information to the server.

[0108] In this example, after obtaining the target information, the XR display terminal can also send the target information to the server by means of messages, instructions, etc.

[0109] 704. The server determines the feedback parameters corresponding to the target information based on the target information. The feedback parameters are used to indicate the situation when the second virtual character makes a feedback on the target information.

[0110] In this example, after receiving the target information sent by the XR display terminal, the server can also determine the feedback parameter corresponding to the target information based on the target information. Through this feedback parameter, the situation when the second virtual character makes a feedback on the target information can be indicated. As a schematic description, the server can determine the status information when the second virtual character makes a feedback on the target information based on the target information, and thus determine the feedback parameter corresponding to the target information based on the status information. For example, if the target information is "I want a signed CD" spoken by the first object, the second virtual character will respond to the "I want a signed CD", and at this time the server can determine that the corresponding feedback parameter is "Here is the signed CD for you".

[0111] 705. The server sends the feedback parameter to the XR display terminal.

[0112] In this example, after determining the feedback parameter, the server can also send the feedback parameter to the XR display terminal by means of messages, instructions, etc.

[0113] 706. The XR display terminal determines the information corresponding to the feedback parameter.

[0114] In this example, after receiving the feedback parameter sent by the server, the XR display terminal can also extract the information corresponding to the feedback parameter from the preset corpus based on the feedback parameter. For example, the XR display terminal matches the feedback parameter with the preset parameters in the preset corpus. When the feedback parameter matches a certain preset parameter, at this time the XR display terminal takes the feedback information associated with the preset parameter at the time of matching as the information corresponding to the feedback parameter.

[0115] 707. The XR display terminal generates a second interaction screen based on the target information and the information corresponding to the feedback parameter, and displays the second interaction screen.

[0116] In this example, after determining the feedback information, the XR display terminal can generate a second interaction screen based on the target information and the information corresponding to the feedback parameter, and display the second interaction screen on the display screen.

[0117] For example, Figure 9 shows a schematic diagram of displaying the second interaction screen provided by the embodiment of the present application. As Figure 9 shown, in the MR game hall interface, the first virtual character and the second virtual character can interact in the three-dimensional space. For example, the first virtual character says the target information "I want a signed CD", and at this time the second virtual character makes a feedback on the "I want a signed CD", and the corresponding feedback information is "Here is the signed CD for you".

[0118] It should be noted that the above Figure 9Taking only audio information as an example for illustration, in practical applications, for expression information, gesture information, etc., they can also be displayed in the MR game hall interface, and specific details will not be elaborated here. In addition, the target information mentioned in this application, in practical applications, in addition to the above-mentioned audio information, expression information, and gesture information, can also include other information, such as appearance, clothing, etc. Specific details are not limited in this application.

[0119] Through the above method, the interaction process can be set in any three-dimensional space, enabling the first object to interact with the second object at close range, not only increasing the sense of presence and immersion in the game interaction, but also enhancing the game activity value of the first object.

[0120] The above mainly introduced the solution provided by the embodiments of this application from the perspective of the interaction method among the XR display terminal, the server, and the XR shooting device. It can be understood that in order to implement the above functions, it includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the modules and algorithm steps of each example described in the embodiments disclosed in this application, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described function for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0121] The embodiments of this application can divide the device into function modules according to the above method examples. For example, each function module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiments of this application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0122] In the embodiments of this application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be fully or partially implemented by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of the overall module or unit that includes the function of this module or unit.

[0123] Next, the XR display terminal in the embodiments of this application will be described in detail. Figure 10This is an optional schematic diagram of the functional modules of the XR display terminal provided in the embodiments of this application. As Figure 10 shown, the XR display terminal includes a processing unit 1001, a sending unit 1002, and a receiving unit 1003.

[0124] Among them, the processing unit 1001 is used to display a first game interface. The first game interface includes a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. The first virtual character is controlled by the first object through a target account. The degree of preference of the first object for the second object is greater than a preset threshold. The target interaction condition is used to indicate the trigger condition when the first virtual character and the second virtual character perform a game interaction operation. Specifically, reference can be made to the content described in step 301 above Figure 3 for understanding, and details are not described here.

[0125] The sending unit 1002 is used to respond to a trigger operation for the target interaction condition, and when the target interaction condition is met, send an indication message to the XR shooting device. The indication message is used to instruct the XR shooting device to take a photo of the game action of the first object to obtain the action information of the first object. Specifically, reference can be made to the content described in step 302 above Figure 3 for understanding, and details are not described here.

[0126] The receiving unit 1003 is used to receive the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server. The action characteristics of the first virtual character are determined by the server based on the action information of the first object, and the action characteristics of the second virtual character are determined by the server based on the action of the second virtual character. Specifically, reference can be made to the content described in step 306 above Figure 3 for understanding, and details are not described here.

[0127] The processing unit 1001 is used to generate a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, and display the first interaction screen. Specifically, reference can be made to the content described in step 307 above Figure 3 for understanding, and details are not described here.

[0128] In some optional examples, the processing unit 1001 is used to: determine the displacement characteristics and rotation characteristics of the first virtual character based on the action characteristics of the first virtual character; determine the displacement characteristics and rotation characteristics of the second virtual character based on the action characteristics of the second virtual character; control the first virtual character and the second virtual character to perform a game interaction operation based on the displacement characteristics and rotation characteristics of the first virtual character and the displacement characteristics and rotation characteristics of the second virtual character, so as to generate a first interaction screen.

[0129] In some other alternative embodiments, the first game interface includes a mixed reality game lobby interface. A receiving unit 1003 is configured to, after the first game interface is displayed, obtain target information, where the target information includes one or more of audio information, expression information, gesture information, and body information of a first object. A sending unit 1002 is configured to send the target information to a server, where the target information is used for the server to calculate a feedback parameter corresponding to the target information, and the feedback parameter is used to indicate a situation when a second virtual character makes a feedback to the target information. The receiving unit 1003 is configured to receive the feedback parameter sent by the server and determine information corresponding to the feedback parameter. A processing unit 1001 is configured to generate a second interaction screen based on the target information and the information corresponding to the feedback parameter and display the second interaction screen.

[0130] In some other alternative embodiments, the processing unit 1001 is configured to, before responding to a trigger operation for a target interaction condition, respond to a trigger operation for the second virtual character to control the second virtual character to move to a first area, where a distance between the first area and an area where the first virtual character is located satisfies a preset condition.

[0131] In some other alternative embodiments, the processing unit 1001 is configured to display a second game interface before displaying the first game interface, where the second game interface includes a first character list. The receiving unit 1003 is configured to obtain a first selection instruction for the first virtual character in the first character list. The processing unit 1001 is configured to respond to the first selection instruction to display the first virtual character in the first game interface.

[0132] In some other alternative embodiments, the second game interface further includes a second character list; the obtaining unit is further configured to obtain a second selection instruction for the second virtual character in the second character list. The processing unit 1001 is configured to respond to the second selection instruction to further display the second virtual character in the first game interface.

[0133] In some other alternative embodiments, the second game interface further includes an interaction condition list; the obtaining unit is further configured to obtain a third selection instruction for the target interaction condition in the interaction condition list. The processing unit 1001 is configured to respond to the third selection instruction to further display the target interaction condition in the first game interface.

[0134] The server in the embodiments of the present application will be described in detail below. Figure 11 is an optional schematic diagram of a functional module of the server provided in the embodiments of the present application. As Figure 11 shown, the server may include a receiving unit 1101, a processing unit 1102, and a sending unit 1103.

[0135] Among them, the receiving unit 1101 is configured to receive the action information of the first object sent by the extended reality (XR) shooting device. The action information of the first object is obtained by the XR shooting device taking pictures of the game actions of the first object. The first virtual character is controlled by the first object through the target account. Specifically, reference can be made to the content described in step 304 above Figure 3 for understanding, and details are not described here.

[0136] The processing unit 1102 is configured to determine the action characteristics of the first virtual character based on the action information of the first object. Specifically, reference can be made to the content described in step 305 above Figure 3 for understanding, and details are not described here.

[0137] The sending unit 1103 is configured to send the action characteristics of the first virtual character and the action characteristics of the second virtual character to the XR display terminal corresponding to the target account, so that the XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character. The second virtual character corresponds to the second object, and the degree of preference of the first object for the second object is greater than a preset threshold. Specifically, reference can be made to the content described in step 306 above Figure 3 for understanding, and details are not described here.

[0138] In some alternative embodiments, the receiving unit 1101 is further configured to receive the target information sent by the XR display terminal. The target information includes one or more of the audio information, expression information, and gesture information of the first object. The processing unit 1102 is configured to determine the feedback parameter corresponding to the target information. The feedback parameter is used to indicate the situation when the second virtual character makes a feedback to the target information. The sending unit 1103 is configured to send the feedback parameter to the XR display terminal. The feedback parameter is used for the XR display terminal to determine the information corresponding to the feedback parameter, so that the XR display terminal generates a second interaction screen based on the target information and the information corresponding to the feedback parameter.

[0139] Next, the XR shooting device in the embodiments of the present application will be described in detail. Figure 12 It is an optional schematic diagram of the functional modules of the XR shooting device provided in the embodiments of the present application. As Figure 12 shown, the XR shooting device includes a receiving unit 1201, a processing unit 1202, and a sending unit 1203.

[0140] Among them, the receiving unit 1201 is configured to receive the indication information for the first object sent by the XR display terminal. Specifically, reference can be made to the content described in step 302 above Figure 3 for understanding, and details are not described here.

[0141] The processing unit 1202 is configured to take a photo of the game action of the first object in response to the indication information, so as to obtain the action information of the first object. Specifically, reference may be made to the content described in step 303 above, which will not be elaborated here. Figure 3 For understanding, please refer to the content described in step 303 above, which will not be elaborated here.

[0142] The sending unit 1203 is configured to send the action information of the first object to the server. The action information of the first object is used for the server to determine the action characteristics of the first virtual character, and the first virtual character corresponds to the first object. Specifically, reference may be made to the content described in step 304 above, which will not be elaborated here. Figure 3 For understanding, please refer to the content described in step 304 above, which will not be elaborated here.

[0143] In some alternative embodiments, the processing unit 1202 is configured to take a photo of the game action of the first object in response to the indication information by using a preset outward-inward positioning algorithm, so as to obtain the action information of the first object.

[0144] The game processing system in the embodiments of the present application will be described in detail below. Figure 13 It is an optional schematic diagram of the functional modules of the game processing system provided in the embodiments of the present application. As Figure 13 shown, the game processing system includes an XR display terminal, an XR shooting device, and a server. Among them, the XR display terminal can be understood with reference to the functional module structure diagram described above, and is configured to execute the game processing method performed by the XR display terminal in the above Figure 10 or Figure 3 or Figure 7 The server can be understood with reference to the functional module structure diagram described above, and is configured to execute the game processing method performed by the server in the above Figure 11 or Figure 3 or Figure 7 The XR shooting device can be understood with reference to the functional module structure diagram described above, and is configured to execute the game processing method performed by the XR shooting device in the above Figure 12 or Figure 3 or Figure 7 or

[0145] The XR display terminal, server, XR shooting device, etc. in the embodiments of the present application are described above from the perspective of modular functional entities. Next, the game processing device in the embodiments of the present application will be described from the perspective of hardware processing. Figure 14 It is a schematic diagram of the hardware structure of the game processing device provided in the embodiments of the present application. The game processing device may vary greatly due to different configurations or performances, including but not limited to the XR display terminal described above, the server shown above, Figure 10 the XR shooting device shown above, etc. Figure 11 the server shown above, Figure 12 the XR shooting device shown above, etc.

[0146] As Figure 14 shown, the game processing device 300 can vary significantly due to different configurations or performances, and may include one or more central processing units (CPUs) 322 (e.g., one or more processors) and a memory 332, and one or more storage media 330 (e.g., one or more mass storage devices) for storing application programs 342 or data 344. Among them, the memory 332 and the storage media 330 can be transient storage or persistent storage. The programs stored in the storage media 330 can include one or more modules (not shown in the figure), and each module can include a series of instruction operations on the game processing device. Further, the central processing unit 322 can be configured to communicate with the storage media 330 and execute the application programs 342 in the storage media 330 on the game processing device 300. Exemplarily, the central processing unit 322 is used to execute the computer-executable instructions stored in the memory 332, so as to implement the game processing method provided in the above embodiments of the present application.

[0147] The game processing device 300 may further include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input / output interfaces 358, and / or one or more operating systems 341, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0148] Exemplarily, Figure 14 the central processing unit 322 in Figure 3 can cause the game processing device to execute the methods in the corresponding method embodiments by calling the computer-executable instructions stored in the memory 332 as Figure 7 or

[0149] Specifically, Figure 10 the function / implementation process of the processing unit 1001 in Figure 11 the processing unit 1102 in Figure 12 and the function / implementation process of the processing unit 1202 in Figure 14 can be implemented by the central processing unit 322 in Figure 10 calling the computer-executable instructions stored in the memory 332. Figure 11 The function / implementation process of the sending unit 1002 and the receiving unit 1003 in Figure 12 the receiving unit 1101 and the sending unit 1103 in Figure 14 and the function / implementation process of the receiving unit 1201 and the sending unit 1203 in

[0150] The steps performed by the game processing device in the above embodiments may be based on the Figure 13 game processing device structure shown.

[0151] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program or instruction is stored. When the computer program or instruction is executed by a processor, the steps of the methods described in the foregoing embodiments are implemented.

[0152] An embodiment of the present application also provides a computer program product, including a computer program or instruction. When the computer program or instruction is executed by a processor, the steps of the methods described in the foregoing embodiments are implemented.

[0153] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be described herein again.

[0154] In each embodiment of the present application, the functional units can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0155] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in each embodiment of the present application. The foregoing storage medium includes: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc that can store program codes.

[0156] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for game processing, characterized in that, Applied to an extended reality (XR) display terminal corresponding to a target account, the method includes: Displaying a first game interface, the first game interface including a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition, where the first virtual character is controlled by the first object through the target account, the degree of affection of the first object for the second object is greater than a preset threshold, and the target interaction condition is used to indicate a trigger condition when the first virtual character and the second virtual character perform a game interaction operation; Responding to a trigger operation for the target interaction condition, when the target interaction condition is satisfied, sending an indication message to an XR shooting device, the indication message being used to indicate that the XR shooting device takes a photo of the game action of the first object to obtain action information of the first object; Receiving an action feature of the first virtual character and an action feature of the second virtual character sent by a server, where the action feature of the first virtual character is determined by the server based on the action information of the first object, and the action feature of the second virtual character is determined by the server based on the action of the second virtual character; Generating a first interaction screen based on the action feature of the first virtual character and the action feature of the second virtual character, and displaying the first interaction screen.

2. The method according to claim 1, characterized in that, Generating a first interaction screen based on the action feature of the first virtual character and the action feature of the second virtual character includes: Determining a displacement feature and a rotation feature of the first virtual character based on the action feature of the first virtual character; Determining a displacement feature and a rotation feature of the second virtual character based on the action feature of the second virtual character; Based on the displacement feature and rotation feature of the first virtual character, and the displacement feature and rotation feature of the second virtual character, controlling the first virtual character and the second virtual character to perform the game interaction operation to generate a first interaction screen.

3. The method according to any one of claims 1 to 2, characterized in that The first game interface includes a mixed reality game lobby interface; After displaying the first game interface, the method further includes: Obtaining target information, the target information including one or more of audio information, expression information, gesture information, and body information of the first object; Sending the target information to the server, the target information being used for the server to calculate a feedback parameter corresponding to the target information, the feedback parameter being used to indicate a situation when the second virtual character makes a feedback to the target information; Receiving the feedback parameter sent by the server, and determining information corresponding to the feedback parameter; Generating a second interaction screen based on the target information and the information corresponding to the feedback parameter, and displaying the second interaction screen.

4. The method according to any one of claims 1 to 2, characterized in that Before responding to the trigger operation for the target interaction condition, the method further includes: Responding to a trigger operation for the second virtual character to control the second virtual character to move to a first area, where the distance between the first area and the area where the first virtual character is located satisfies a preset condition.

5. The method according to any one of claims 1 to 2, characterized in that, Before displaying the first game interface, the method further includes: Display a second game interface, wherein the second game interface includes a first character list; Obtain a first selection instruction for the first virtual character in the first character list; Display a first game interface, including: In response to the first selection instruction, display the first virtual character in the first game interface.

6. The method according to claim 5, wherein The second game interface further includes a second character list, and the method further includes: Obtain a second selection instruction for the second virtual character in the second character list; Display a first game interface, including: In response to the second selection instruction, also display the second virtual character in the first game interface.

7. The method according to claim 5, characterized in that, The second game interface further includes an interaction condition list, and the method further includes: Obtain a third selection instruction for the target interaction condition in the interaction condition list; Display a first game interface, including: In response to the third selection instruction, also display the target interaction condition in the first game interface.

8. A method for game processing, characterized in that, Applied to a server, the method includes: Receive the action information of a first object sent by an extended reality (XR) shooting device, where the action information of the first object is obtained by the XR shooting device taking a photo of the game action of the first object, and the first virtual character is controlled by the first object through a target account; Determine the action characteristics of the first virtual character based on the action information of the first object; Send the action characteristics of the first virtual character and the action characteristics of a second virtual character to the XR display terminal corresponding to the target account, so that the XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, where the second virtual character corresponds to a second object, and the degree of preference of the first object for the second object is greater than a preset threshold.

9. The method according to claim 8, wherein The method further includes: Receive target information sent by the XR display terminal, where the target information includes one or more of the audio information, expression information, gesture information, and body information of the first object; Determine a feedback parameter corresponding to the target information based on the target information, where the feedback parameter is used to indicate the situation when the second virtual character makes a feedback to the target information; Send the feedback parameter to the XR display terminal, where the feedback parameter is used for the XR display terminal to determine the information corresponding to the feedback parameter, so that the XR display terminal generates a second interaction screen based on the target information and the information corresponding to the feedback parameter.

10. A method for game processing, characterized in that, Applied to an extended reality (XR) shooting device, the method includes: Receive instruction information for a first object sent by an XR display terminal; In response to the instruction information, take a photo of the game action of the first object to obtain the action information of the first object; Send the action information of the first object to the server, where the action information of the first object is used for the server to determine the action characteristics of a first virtual character, and the first virtual character corresponds to the first object.

11. The method according to claim 10, characterized in that, In response to the instruction information, taking a photo of the game action of the first object to obtain the action information of the first object, includes: In response to the indication information, the game action of the first object is photographed by a preset outside-in positioning algorithm to obtain the action information of the first object.

12. A game processing system, characterized in that, The game processing system includes an XR display terminal, an XR shooting device, and a server. Among them, the XR display terminal is used to execute the method according to any one of claims 1 to 7, the server is used to execute the method according to any one of claims 8 to 9, and the XR shooting device is used to execute the method according to any one of claims 10 to 11.

13. An XR display terminal, characterized in that, Comprising: A processing unit for displaying a first game interface, the first game interface including a first virtual character of a first object, a second virtual character of a second object, and a target interaction condition. The first virtual character is controlled by the first object through the target account, and the degree of preference of the first object for the second object is greater than a preset threshold. The target interaction condition is used to indicate the trigger condition when the first virtual character and the second virtual character perform a game interaction operation; A sending unit for, in response to a trigger operation for the target interaction condition, when the target interaction condition is satisfied, sending indication information to the XR shooting device, the indication information being used to instruct the XR shooting device to photograph the game action of the first object to obtain the action information of the first object; A receiving unit for receiving the action characteristics of the first virtual character and the action characteristics of the second virtual character sent by the server, the action characteristics of the first virtual character being determined by the server based on the action information of the first object, and the action characteristics of the second virtual character being determined by the server based on the action of the second virtual character; The processing unit for generating a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character, and displaying the first interaction screen.

14. A server, characterized in that, Comprising: A receiving unit for receiving the action information of the first object sent by an extended reality (XR) shooting device, the action information of the first object being obtained by the XR shooting device photographing the game action of the first object, and the first virtual character being controlled by the first object through a target account; A processing unit for determining the action characteristics of the first virtual character based on the action information of the first object; A sending unit for sending the action characteristics of the first virtual character and the action characteristics of the second virtual character to the XR display terminal corresponding to the target account, so that the XR display terminal generates a first interaction screen based on the action characteristics of the first virtual character and the action characteristics of the second virtual character. The second virtual character corresponds to a second object, and the degree of preference of the first object for the second object is greater than a preset threshold.

15. An XR shooting device, characterized in that, Comprising: A receiving unit for receiving the indication information for the first object sent by the XR display terminal; A processing unit for, in response to the indication information, photographing the game action of the first object to obtain the action information of the first object; A sending unit, configured to send the action information of the first object to a server, where the action information of the first object is used by the server to determine the action characteristics of a first virtual character, and the first virtual character corresponds to the first object.

16. A game processing device, characterized in that, Comprising: An input / output interface, a processor, and a memory, where program instructions are stored in the memory; The processor is configured to execute the program instructions stored in the memory to execute the method according to any one of claims 1 to 7; or execute the method according to any one of claims 8 to 9; or execute the method according to any one of claims 10 to 11.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when running on a computer device, cause the computer device to execute the method according to any one of claims 1 to 7; or execute the method according to any one of claims 8 to 9; or execute the method according to any one of claims 10 to 11.

18. A computer program product, characterized in that, The computer program product includes instructions that, when running on a computer device, cause the computer device to execute the method according to any one of claims 1 to 7; or execute the method according to any one of claims 8 to 9; or execute the method according to any one of claims 10 to 11.

Images