Methods, devices, media, and electronic devices for running immersive cloud gaming in VisionPro
By generating and displaying target messages on VisionPro devices, the problem of cloud gaming not being able to display in any position in full screen was solved, achieving an immersive out-of-window effect and improving the user experience.
Patent Information
- Application Number
- CN202311278017.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-28
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-09-28
AI Technical Summary
In existing technologies, when running cloud games through VisionPro devices, it is impossible to achieve an immersive out-of-window effect in any position on the full screen, resulting in a poor user experience.
The server obtains the special effects display instructions for the object to be displayed, generates a target message including the name and display position, and displays the window effect on the VisionPro device through RealKit, achieving full-screen display at any position.
Users can experience an immersive out-of-window effect when playing cloud games through VisionPro devices, enhancing the immersion and quality of the gaming experience.
Smart Images

Figure CN117224940B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of cloud gaming technology, specifically to a method, apparatus, medium, and electronic device for running immersive cloud games in VisionPro. Background Technology
[0002] Cloud gaming is based on cloud computing technology. Games are deployed on cloud servers, and users receive the rendered game screen via the network. It allows for cross-screen, cross-device, and download-free gameplay anytime, anywhere. It doesn't require high-end processors or graphics cards, and can run even games with high hardware requirements and large computational demands smoothly. In recent years, cloud gaming has entered a phase of rapid development, with applications in more and more aspects of life. The most popular application is its integration with VR, specifically playing cloud games through a headset like VisionPro, which has gained widespread popularity among cloud gaming users.
[0003] Currently, when users wear the VisionPro device, cloud gaming runs in window mode on the VisionPro device. That is, the game screen is displayed flatly in a specific window, thus achieving the effect of playing cloud games through the head-mounted display device. However, in this way, running cloud games on the VisionPro device depends on the window in which the cloud game runs, and it is not possible to run it in any position in the full screen. As a result, users cannot experience the immersive out-of-window effect when playing cloud games on the VisionPro device. Summary of the Invention
[0004] To enable users to experience an immersive out-of-window effect when playing cloud games through VisionPro devices, this application provides a method, apparatus, medium, and electronic device for running immersive cloud games in VisionPro.
[0005] The first aspect of this application provides a method for running immersive cloud games in VisionPro, applied to a server, specifically including: Obtain the special effects display instructions for the objects to be displayed in the target game, wherein the objects to be displayed are the models or particles that need to be displayed in the current game scene of the target game; Based on the special effects display instructions, a target message is generated, the target message including the name of the object to be displayed and the display position of the object to be displayed in the current game scene; The target message is sent to the VisionPro device so that the VisionPro device displays the objects to be displayed in the packaged set of objects to be displayed at the display location.
[0006] By adopting the above technical solution, when the server receives a special effects display instruction, indicating that the game scene of the current target game is about to display a certain model or particle, a target message is generated based on the display position and name of the object to be displayed. Finally, the target message is sent to the VisionPro device worn by the user, thereby timely and accurately notifying the VisionPro device of the name and display position of the object to be displayed. This allows the VisionPro device to display the corresponding object in the pre-packaged local set of objects to be displayed at the display position, creating a window effect. This allows the user to experience an immersive window effect when playing cloud games through the VisionPro device.
[0007] Optionally, generating the target message based on the special effects display instruction specifically includes: Based on the special effects display instructions, obtain the name of the object to be displayed and obtain the coordinate information of the display position of the object to be displayed; Based on the name and coordinate information, a JSON array is combined to obtain the target message.
[0008] By adopting the above technical solution, after the server obtains the special effects display instruction, it obtains the name of the object to be displayed and the coordinate information of the display position. Finally, the name and coordinate information are combined and processed to obtain a JSON array, that is, the target message. Since the JSON array can be easily exchanged and understood in different systems, it facilitates the subsequent interaction between the server and the VisionPro device for the target message.
[0009] Optionally, obtaining the coordinate information of the display position of the object to be displayed specifically includes: Determine whether the object to be displayed is a particle. If so, determine the coordinate information of the preset special effect trigger position of the particle as the coordinate information of the display position of the object to be displayed. If not, the motion angle of the model of the object to be displayed is determined based on the trigger position of the model of the object to be displayed and the position of the player character in the target game; Based on the model's motion angle, the coordinate information of the display position of the object to be displayed is determined.
[0010] By adopting the above technical solution, if the object to be displayed is a particle, the coordinates of the preset effect trigger position of the particle are used as the coordinates of the display position. If it is not a particle, the object to be displayed is a model. The relative angle between the model's trigger position and the player character's position in the target game is determined, thus determining the model's movement angle. This indicates that the object is moving towards the screen along the model's movement angle. Finally, the coordinates of the display position are determined based on the model's movement angle. This facilitates subsequent notification to the VisionPro device regarding the display position of the out-of-window effect of the object.
[0011] Optionally, sending the target message to the VisionPro device so that the VisionPro device displays a window effect on the objects in the packaged set of objects to be displayed at the display location specifically includes: The target message is sent to the VisionPro device so that the VisionPro device can use RealKit to display the objects in the packaged set of objects to be displayed at the display location.
[0012] By adopting the above technical solution, since RealKit does not rely on the window for running cloud games, it can display the object to be displayed in any position on the full screen. Therefore, after the target message is sent to the VisionPro device, the VisionPro device can use RealKit to display the object to be displayed in the display position, thus bringing users an immersive out-of-window experience.
[0013] A second aspect of this application provides a method for running immersive cloud gaming in VisionPro, applied to VisionPro devices, specifically including: Based on the server obtaining the special effects display instructions of the object to be displayed in the target game, the target message sent by the server is received, and the object to be displayed is the model or particle that needs to be displayed in the current game scene of the target game; The target message is parsed to determine the name of the object to be displayed and its display position in the current game scene of the target game; Based on the name and the display position, the corresponding objects in the packaged set of objects to be displayed are displayed in a window effect at the display position.
[0014] By adopting the above technical solution, when the target game is about to display an object, the VisionPro device receives the target message sent by the server, parses the target message, determines the specific name and display position of the object to be displayed, and finally reads the corresponding object to be displayed from the locally packaged set of objects to be displayed according to the name, and finally displays the object in the display position, so that users can experience an immersive out-of-window effect when playing cloud games through the VisionPro device.
[0015] Optionally, the VisionPro device has a cloud gaming client installed, and before receiving the target message sent by the server, the process further includes: When the target game is launched, the cloud gaming client receives USD model files sent by the server. The USD model files are files corresponding to all objects to be displayed in the target game. The USD model file is packaged into the development project through the cloud gaming client to obtain a packaged collection of objects to be displayed.
[0016] By adopting the above technical solution, when the target game starts, the cloud gaming client in the VisionPro device will receive USD model files of all objects to be displayed sent by the server. Finally, the USD model files of the cloud gaming client are packaged into the development project, that is, packaged locally, so that the target game on the server can interact with the local model or particles, and finally achieve the purpose of displaying the window effect.
[0017] Optionally, the step of displaying the corresponding objects from the packaged set of objects to be displayed at the display position according to the name and the display position specifically includes: Based on the name and the display position, RealKit displays the corresponding object from the packaged set of objects to be displayed at the display position using a window effect.
[0018] By adopting the above technical solution, after determining the name and display position of the object to be displayed in the target game, RealKit is called to read the corresponding object from the locally packaged collection of objects to be displayed, and to display the corresponding pop-up effect at the display position, thereby enabling users to obtain an immersive gaming experience.
[0019] A third aspect of this application provides a device for running immersive cloud gaming in VisionPro, specifically comprising: The instruction acquisition module is used to acquire the special effect display instructions of the objects to be displayed in the target game, wherein the objects to be displayed are the models or particles that need to be displayed in the current game scene of the target game; The message determination module is used to generate a target message based on the special effect display instruction. The target message includes the name of the object to be displayed and the display position of the object to be displayed in the current game scene. The message delivery module is used to deliver the target message to the VisionPro device so that the VisionPro device can display the objects to be displayed in the packaged set of objects to be displayed at the display location.
[0020] By adopting the above technical solution, after the instruction acquisition module obtains the special effect display instruction, the message determination module generates a target message according to the special effect display instruction, that is, determines the name and display position of the object to be displayed. Finally, the message sending module sends the target message to the VisionPro device, so that the VisionPro device displays the object to be displayed in the packaged set of objects to be displayed at the display position, so that the user can experience an immersive out-of-window effect when playing cloud games through the VisionPro device.
[0021] In summary, this application includes at least one of the following beneficial technical effects: When the server receives a special effects display instruction, indicating that a certain model or particle is about to be displayed in the game scene of the target game, it generates a target message based on the display position and name of the object to be displayed. Finally, the target message is sent to the VisionPro device worn by the user, so as to promptly and accurately notify the VisionPro device of the name and display position of the object to be displayed. This allows the VisionPro device to display the corresponding object in the pre-packaged set of objects to be displayed locally at the display position, creating an out-of-window effect. This allows the user to experience an immersive out-of-window effect when playing cloud games through the VisionPro device. Attached Figure Description
[0022] Figure 1 This is a schematic diagram of the architecture of a system for running immersive cloud games in VisionPro, provided in an embodiment of this application. Figure 2 This is a flowchart illustrating a method for running immersive cloud games in VisionPro, as provided in an embodiment of this application. Figure 3 This is a flowchart illustrating another method for running immersive cloud gaming in VisionPro provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of a device for running immersive cloud games in VisionPro, provided in an embodiment of this application; Figure 5This is a schematic diagram of another device for running immersive cloud gaming in VisionPro, provided in an embodiment of this application.
[0023] Explanation of reference numerals in the attached diagram: 11. Instruction acquisition module; 12. Message confirmation module; 13. Message sending module; 21. Message receiving module; 22. Message parsing module; 23. Window display module. Detailed Implementation
[0024] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.
[0025] In the description of the embodiments in this application, words such as "illustrative," "for example," or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "illustrative," "for example," or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Rather, the use of words such as "illustrative," "for example," or "for example" is intended to present the relevant concepts in a specific manner.
[0026] In the description of the embodiments of this application, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, B existing alone, or A and B existing simultaneously. Furthermore, unless otherwise stated, the term "multiple" means two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the indicated technical features. Thus, a feature defined with "first" or "second" may explicitly or implicitly include one or more of that feature. The terms "comprising," "including," "having," and their variations all mean "including but not limited to," unless otherwise specifically emphasized.
[0027] See Figure 1This application discloses an architectural diagram of a system for running immersive cloud gaming in VisionPro, specifically including a VisionPro device and a server. The VisionPro device refers to a mixed reality headset, primarily used to allow users to see digital content in the real world. The VisionPro device has a cloud gaming client installed, which is an application that allows users to experience multiple games in the cloud. The VisionPro device can connect directly or indirectly to the server via wired or wireless networks. The server can be the backend server for the cloud gaming client; specifically, it can be a standalone physical server, a server cluster consisting of multiple physical servers, or a distributed system.
[0028] Specifically, when the target game on the server reaches a certain point in time and is about to trigger an event to display a model (game model) or particle effect, the position information of the model or particle to be displayed is sent to the cloud gaming client in the VisionPro device. Based on the position information, the cloud gaming client displays the out-of-window effect of the model or particle effect at the corresponding location, allowing users to experience an ultimate 4D immersive gaming experience when playing cloud games on the VisionPro device. Here, "model" refers to the 3D model in the target game, such as props, mechanisms, etc. "Particle effect" refers to the special effects in the target game, such as fire, flashes, explosions, etc. Displaying models or particle effects in the target game is to enhance the game's visual effects. The out-of-window effect, also known as immersive out-of-window effect, refers to the user seeing a 360-degree virtual space in a VR or AR environment. This virtual space is usually a simulation of the real world. Users can freely explore this virtual space by changing their perspective and moving their position using head-mounted devices, handheld devices, or other sensing devices. In this embodiment, "particle effect" can be understood as particles.
[0029] See Figure 2 This application discloses a flowchart illustrating a method for running immersive cloud gaming in VisionPro. This method can be implemented using a computer program or run on a VisionPro immersive cloud gaming device based on the von Neumann architecture. The computer program can be integrated into an application or run as a standalone utility application. This method for running immersive cloud gaming in VisionPro is applied to a server. Specifically, it includes: S101: Get the special effects display instructions for the objects to be displayed in the target game.
[0030] Specifically, the object to be displayed is a model or particle (particle effect) in the current game scene of the target game. When the target game is running on the server, if a model or particle is about to be displayed in the current game scene, an event to display the model or particle will be automatically triggered, generating a special effect display instruction. For the server, this is how it ultimately obtains the special effect display instruction for the object to be displayed in the target game. One feasible way to generate the special effect display instruction is to have the target game's game engine generate the corresponding special effect display instruction based on preset special effect control parameters, so that the corresponding special effects can be synchronously presented on the cloud gaming client later. In this embodiment, the game engine can be Unity; in other embodiments, the game engine can be Unreal Engine. The game framework refers to the software architecture used to manage and control the game's operation. The game framework typically consists of a series of modules used to implement various functions and features of the game. Furthermore, the special effect display instruction can be understood as the trigger instruction for displaying models or particles in the target game.
[0031] For example, in the current game scene, the user controls the game character to activate a game mechanism. After the mechanism is triggered, a corresponding firework effect will be generated. The target object to be displayed in the running game is the particle, i.e. the firework effect. Furthermore, the game engine will generate the corresponding effect display instructions for the particle based on the particle effect control parameters.
[0032] S102: Based on the special effects display instructions, generate a target message. The target message includes the name of the object to be displayed and the display position of the object in the current game scene.
[0033] In one feasible implementation, based on the special effects display instructions, the name of the object to be displayed and the coordinate information of the display position of the object to be displayed are obtained; Based on the name and coordinate information, a JSON array is combined to obtain the target message.
[0034] Specifically, after the special effects display instructions are generated, the name of the object to be displayed can be obtained through the name property of the GameObject class in Unity. In other embodiments, the name of the object to be displayed can also be obtained through the UGameplayStatics::GetAllActorsOfClass function in Unreal Engine.
[0035] Next, determine the position where the object to be displayed will be displayed. One feasible way to determine the coordinate information of the display position is to determine whether the object to be displayed is a particle. If so, determine the coordinate information of the particle's preset special effect trigger position as the coordinate information of the display position of the object to be displayed. If not, the motion angle of the model of the object to be displayed is determined based on the trigger position of the model of the object to be displayed and the position of the player character in the target game. Based on the model's motion angle, determine the coordinate information of the display position of the object to be displayed.
[0036] Specifically, after determining the name of the object to be displayed, it is necessary to further determine its display position. Therefore, it is necessary to first determine the type of the object. One feasible way to determine this is to obtain the `transform` property of the object using the `Property` function. If the `transform` property does not contain motion transformation information of the object, that is, the position of the object has not changed as the target game progresses, it means that the object is a particle. In this case, the coordinates of the preset effect trigger position of the particle are determined as its final display position coordinates. Specifically, the coordinates of the particle's corresponding effect trigger position are obtained through the `transform.position` property. For example, if the particle is a firework in the target game, then the preset effect trigger position is the position where the firework blooms.
[0037] If the `transform` property contains motion transformation information for the object to be displayed, it indicates that the object is a model and is in motion within the target game. Since the player character's position and perspective in the game are equivalent to the user's own position and perspective when the user is playing the target game on a VisionPro device, the movement of the object in the game can be seen as the object moving towards the VisionPro device's screen. For example, if a dungeon boss in the target game attacks the user's corresponding player character with a throwing knife, the throwing knife is equivalent to the object to be displayed. When the user is wearing the VisionPro device and is in the game scene corresponding to the player character, the visual experience is: a throwing knife flies out of the screen and towards the user's face—that is, an immersive out-of-the-window effect.
[0038] Furthermore, the coordinates of the trigger position of the model of the object to be displayed are obtained through the `transform.position` property. The trigger position can be understood as the position where the dungeon boss in the target game throws a flying knife at the player character. Next, the `PlayerPrefs` class obtains the coordinates of the player character's position in the current game scene of the target game. Then, a line is drawn connecting the trigger position of the model of the object to be displayed and the position of the player character to determine the angle between this line and the screen plane of the VisionPro device, i.e., the model's motion angle. Finally, the object to be displayed moves along this model's motion angle towards the screen plane facing the user. Based on the object's movement speed, its final position in the target game is determined, and then converted from the game coordinate system to the screen coordinate system of the VisionPro device, ultimately determining the coordinates of the object's display position.
[0039] After determining the name and coordinates of the object to be displayed, the built-in `json` module in Python is used to combine these elements into a JSON array, which is then used as the target message. For example, if the object's name is "Model 1" and its coordinates are x=100, y=100, the resulting JSON array would be: [{"mode":"Model 1","position":{"x":100,"y":100}}]. JSON is a universal data exchange format supported by many programming languages and platforms. Therefore, combining the object's name and coordinates into a JSON format makes it easier for different systems to exchange and understand data. In this embodiment, it facilitates data interaction between the server and the cloud gaming client in the VisionPro device.
[0040] S103: Send the target message to the VisionPro device so that the VisionPro device can display the objects in the packaged set of objects to be displayed at the display location.
[0041] In one feasible implementation, a target message is sent to the VisionPro device so that the VisionPro device can display a window effect on the object to be displayed at the display location via RealKit.
[0042] Specifically, after the target message is determined, the server sends the target message to the cloud gaming client on the VisionPro device via a data pipeline. The data pipeline refers to a data processing model used to manage and process data transmission between the server and the VisionPro device. Sending the target message to the cloud gaming client instructs the client to display the corresponding objects from the pre-packaged set of objects to be displayed with an out-of-window effect at the designated display location, based on the name in the target message. This allows users to experience an immersive gaming experience. The pre-packaged set of objects to be displayed includes all models and particles of the target game. When the target game starts, all models and particles involved in the target game are pre-packaged and stored locally on the cloud gaming client on the VisionPro device. It should be noted that the VisionPro device specifically uses RealKit to implement the out-of-window effect for the objects to be displayed. RealKit is an augmented reality (AR) framework developed by Apple that allows seamless integration of virtual objects in a game into the real world. In this embodiment, RealKit provides a set of methods from Apple for displaying models or particles. In other embodiments, the VisionPro device can also use ARKit to display the out-of-window effect for the objects to be displayed.
[0043] See Figure 3 This application discloses a flowchart illustrating another method for running immersive cloud gaming in VisionPro, which can be implemented using a computer program or run on a VisionPro immersive cloud gaming device based on the von Neumann architecture. The computer program can be integrated into an application or run as a standalone utility application. This method for running immersive cloud gaming in VisionPro is applied to VisionPro devices. Specifically, it includes: S201: Based on the server obtaining the special effects display instructions for the target object to be displayed in the game, receive the target message sent by the server.
[0044] Specifically, the object to be displayed is the model or particle that needs to be displayed in the current game scene of the target game. When the target game running on the server triggers an event to display the model or particle in the current game scene, that is, based on the server obtaining the special effect display instruction of the object to be displayed in the target game, the cloud gaming client in the VisionPro device receives the target message sent by the server through the data pipeline. The target message includes the name of the object to be displayed and its display position in the current game scene. The display position is mainly represented by coordinate information. The method for determining the target message can be found in step S101, and will not be repeated here. It should be noted that the target message is transmitted in the form of a JSON array. In other embodiments, it can also be transmitted in the form of an MQTT message.
[0045] S202: Parse the target message to determine the name of the object to be displayed and its display position in the current game scene of the target game.
[0046] Specifically, after obtaining the target message, the VisionPro device parses it using the JSON.parse() method to obtain the name and coordinates of the object to be displayed in the current game scene. In other embodiments, the target message can also be parsed using the jQuery or Lodash libraries. It should be noted that by parsing the target message, the cloud gaming client in the VisionPro device can know the specific model or particle to be displayed locally via the VisionPro device and its corresponding display location.
[0047] In one feasible implementation, before step S201, the method further includes: receiving a USD model file sent by the server via a cloud gaming client when the target game is launched; By packaging the USD model files into the development project through the cloud gaming client, a packaged collection of objects to be displayed is obtained.
[0048] Specifically, the Universal Scene Description (USD) model file refers to an easily extensible open-source 3D scene description and file format used for content creation and exchange between different tools. It supports describing elements such as geometry, textures, lighting, and materials in a scene, as well as various simulation and rendering techniques. It is also a universal method for representing accurate physical models. In this embodiment, the USD model file corresponds to all objects to be displayed in the target game. Specifically, the USD model file of the target game is obtained through the preset Ninja Repper tool. The user sends a launch command for the target game to the server through the cloud gaming client on the VisionPro device, causing the server to launch the target game according to the launch command. At the same time, the server sends the USD model file to the VisionPro device. The VisionPro device receives the USD model file through the cloud gaming client, and then the cloud gaming client packages the USD model file into the development project. One feasible packaging method is to package the USD model file into the development project using a preset FBX model packaging tool to obtain a packaged set of objects to be displayed. In other embodiments, the packaging can also be performed using a preset Collada model packaging tool.
[0049] Additionally, it's important to note that since each game scene or level in the target game may require importing corresponding USD model files, to avoid frequent imports, the cloud gaming client can pre-package all the USD model files corresponding to the objects to be displayed in the target game into the development project. When an object needs to be displayed, the corresponding USD model file can be directly read from the development project. The development project can be understood as an organizational structure containing multiple folders and files related to the cloud gaming client.
[0050] S203: Based on the name and display position, display the corresponding objects in the packaged collection of objects to be displayed in a window at the display position.
[0051] In one feasible implementation, RealKit displays the corresponding objects from the packaged set of objects to be displayed at the display location based on their names and display positions.
[0052] Specifically, obtaining the name and display position of the object to be displayed can be understood as the VisionPro device knowing the exact location on the screen where the corresponding object from the packaged set of objects to be displayed will be shown in the game. Further, RealKit, integrated into the cloud gaming client within the VisionPro device, is invoked. Based on the name of the object, the corresponding USD model file is retrieved from the packaged set of objects to be displayed. RealKit then determines the corresponding out-of-window effect parameters based on this USD model file, including transparency and size. The object to be displayed is then adjusted according to these parameters to achieve the desired out-of-window effect. Finally, the adjusted object is exported in the format used by the VisionPro device, and the out-of-window effect is displayed at the corresponding location based on the display position. This allows users to enjoy an immersive 4D out-of-window gaming experience when playing cloud games.
[0053] The implementation principle of the method for running immersive cloud games in VisionPro in this application embodiment is as follows: When the server obtains a special effect display instruction, indicating that the game scene of the current target game is about to display a certain model or particle, a target message is generated according to the display position and name of the object to be displayed. Finally, the target message is sent to the VisionPro device worn by the user, thereby timely and accurately notifying the VisionPro device of the name and display position of the object to be displayed. This allows the VisionPro device to display the corresponding object in the pre-packaged local set of objects to be displayed, i.e., the pre-packaged set of objects to be displayed, at the display position, creating a window effect, so that the user can experience an immersive window effect when playing cloud games through the VisionPro device.
[0054] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.
[0055] Please see Figure 4 This is a schematic diagram of a device for running immersive cloud games in VisionPro, provided in an embodiment of this application. This device for running immersive cloud games in VisionPro can be implemented as all or part of a device through software, hardware, or a combination of both. The device 1 includes an instruction acquisition module 11, a message determination module 12, and a message sending module 13.
[0056] The instruction acquisition module 11 is used to acquire the special effect display instructions of the objects to be displayed in the target game. The objects to be displayed are the models or particles that need to be displayed in the current game scene of the target game. The message determination module 12 is used to generate a target message based on the special effects display instructions. The target message includes the name of the object to be displayed and the display position of the object in the current game scene. The message delivery module 13 is used to deliver the target message to the VisionPro device so that the VisionPro device can display the objects in the packaged set of objects to be displayed at the display location.
[0057] Optionally, the message confirmation module 12 is specifically used for: Based on the special effects display instructions, obtain the name of the object to be displayed and the coordinate information of the display position of the object; Based on the name and coordinate information, a JSON array is combined to obtain the target message.
[0058] Optionally, the message confirmation module 12 is also used for: Determine whether the object to be displayed is a particle. If so, determine the coordinates of the preset special effect trigger position of the particle as the coordinates of the display position of the object to be displayed. If not, the motion angle of the model of the object to be displayed is determined based on the trigger position of the model of the object to be displayed and the position of the player character in the target game. Based on the model's motion angle, determine the coordinate information of the display position of the object to be displayed.
[0059] Optional, message delivery module 13, specifically used for: The target message is sent to the VisionPro device so that the VisionPro device can use RealKit to display the objects in the packaged set of objects to be displayed at the display location.
[0060] Please see Figure 5 This is a schematic diagram of another device for running immersive cloud games in VisionPro, provided in an embodiment of this application. This device for running immersive cloud games in VisionPro can be implemented as all or part of a device through software, hardware, or a combination of both. The device 2 includes a message receiving module 21, a message parsing module 22, and a pop-up display module 23.
[0061] The message receiving module 21 is used to receive the target message sent by the server based on the special effect display instructions of the object to be displayed in the target game obtained by the server. The object to be displayed is the model or particle that needs to be displayed in the current game scene of the target game. The message parsing module 22 is used to parse the target message and determine the name of the object to be displayed and its display position in the current game scene of the target game; The pop-up display module 23 is used to display the corresponding objects in the packaged set of objects to be displayed in a pop-up effect at the display position according to their names and display positions.
[0062] Optionally, device 2 further includes a set determination module 24, specifically used for: When the target game is launched, the cloud gaming client receives USD model files sent by the server. The USD model files are the files corresponding to all objects to be displayed in the target game. By packaging the USD model files into the development project through the cloud gaming client, a packaged collection of objects to be displayed is obtained.
[0063] Optional, the pop-up display module 23 is specifically used for: Based on the name and display location, RealKit displays the corresponding objects from the packaged collection of objects to be displayed in a window effect at the display location.
[0064] It should be noted that the above embodiments of the device for running immersive cloud games in VisionPro, when executing the method for running immersive cloud games in VisionPro, are only illustrative examples of the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. Furthermore, the above embodiments of the device for running immersive cloud games in VisionPro and the method embodiment for running immersive cloud games in VisionPro belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be repeated here.
[0065] This application also discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, it employs a method for running immersive cloud games in VisionPro as described in the above embodiments.
[0066] The computer program can be stored in a computer-readable medium. The computer program includes computer program code, which can be in the form of source code, object code, executable file, or certain middleware. The computer-readable medium includes any entity or device capable of carrying computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the computer-readable medium includes, but is not limited to, the above-mentioned components.
[0067] The method for running immersive cloud gaming in VisionPro according to the above embodiments is stored in the computer-readable storage medium and loaded and executed on the processor to facilitate the storage and application of the above method.
[0068] This application also discloses an electronic device in which a computer program is stored in a computer-readable storage medium. When the computer program is loaded and executed by a processor, it employs the above-described method for running immersive cloud games in VisionPro.
[0069] The electronic device can be a desktop computer, a laptop computer, or a cloud server, and the electronic device includes, but is not limited to, a processor and a memory. For example, the electronic device may also include input / output devices, network access devices, and buses.
[0070] The processor can be a central processing unit (CPU). Of course, depending on the actual use, it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc., and this application does not limit it.
[0071] The memory can be an internal storage unit of an electronic device, such as a hard disk or RAM, or an external storage device, such as a plug-in hard disk, smart memory card (SMC), secure digital card (SD), or flash memory card (FC) equipped on the electronic device. Furthermore, the memory can be a combination of an internal storage unit and an external storage device. The memory is used to store computer programs and other programs and data required by the electronic device. The memory can also be used to temporarily store data that has been output or will be output. This application does not limit this.
[0072] In this electronic device, a method for running immersive cloud gaming in VisionPro according to the above embodiment is stored in the memory of the electronic device and loaded and executed on the processor of the electronic device for convenient use.
[0073] The foregoing description is merely an exemplary embodiment of this disclosure and should not be construed as limiting the scope of this disclosure. Any equivalent changes and modifications made in accordance with the teachings of this disclosure shall still fall within the scope of this disclosure. Other embodiments of this disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not described herein. The specification and embodiments are to be considered exemplary only, and the scope and spirit of this disclosure are defined by the claims.
Claims
1. A method for running immersive cloud games in VisionPro, characterized in that, Applied to a server, the method includes: Obtain the special effects display instructions for the objects to be displayed in the target game, wherein the objects to be displayed are the models or particles that need to be displayed in the current game scene of the target game; Based on the special effects display instructions, a target message is generated, the target message including the name of the object to be displayed and the display position of the object to be displayed in the current game scene; The target message is sent to the VisionPro device so that the VisionPro device displays the objects to be displayed in the packaged set of objects to be displayed at the display location.
2. The method for running immersive cloud gaming in VisionPro according to claim 1, characterized in that, The generation of the target message based on the special effects display instruction specifically includes: Based on the special effects display instructions, obtain the name of the object to be displayed and obtain the coordinate information of the display position of the object to be displayed; Based on the name and coordinate information, a JSON array is combined to obtain the target message.
3. The method for running immersive cloud gaming in VisionPro according to claim 2, characterized in that, The step of obtaining the coordinate information of the display position of the object to be displayed specifically includes: Determine whether the object to be displayed is a particle. If so, determine the coordinate information of the preset special effect trigger position of the particle as the coordinate information of the display position of the object to be displayed. If not, the motion angle of the model of the object to be displayed is determined based on the trigger position of the model of the object to be displayed and the position of the player character in the target game; Based on the model's motion angle, the coordinate information of the display position of the object to be displayed is determined.
4. The method for running immersive cloud gaming in VisionPro according to claim 1, characterized in that, The step of sending the target message to the VisionPro device, so that the VisionPro device displays a window effect on the objects to be displayed in the packaged set of objects to be displayed at the display location, specifically includes: The target message is sent to the VisionPro device so that the VisionPro device can use RealKit to display the objects in the packaged set of objects to be displayed at the display location.
5. A method for running immersive cloud games in VisionPro, characterized in that, Applied to VisionPro devices, the method includes: Based on the server obtaining the special effects display instructions of the object to be displayed in the target game, the target message sent by the server is received, and the object to be displayed is the model or particle that needs to be displayed in the current game scene of the target game; The target message is parsed to determine the name of the object to be displayed and its display position in the current game scene of the target game; Based on the name and the display position, the corresponding objects in the packaged set of objects to be displayed are displayed in a window effect at the display position.
6. The method for running immersive cloud gaming in VisionPro according to claim 5, characterized in that, The VisionPro device has a cloud gaming client installed, and before receiving the target message sent by the server, the process further includes: When the target game is launched, the cloud gaming client receives USD model files sent by the server. The USD model files are files corresponding to all objects to be displayed in the target game. The USD model file is packaged into the development project through the cloud gaming client to obtain a packaged collection of objects to be displayed.
7. The method for running immersive cloud gaming in VisionPro according to claim 5, characterized in that, The step of displaying the corresponding objects from the packaged set of objects to be displayed at the specified display position based on the name and the display position specifically includes: Based on the name and the display position, RealKit displays the corresponding object from the packaged set of objects to be displayed at the display position using a window effect.
8. A device for running immersive cloud gaming in VisionPro, characterized in that, include: The instruction acquisition module (11) is used to acquire the special effect display instructions of the object to be displayed in the target game, wherein the object to be displayed is the model or particle that needs to be displayed in the current game scene of the target game; The message determination module (12) is used to generate a target message based on the special effect display instruction. The target message includes the name of the object to be displayed and the display position of the object to be displayed in the current game scene. The message delivery module (13) is used to deliver the target message to the VisionPro device so that the VisionPro device can display the window effect of the object to be displayed in the packaged set of objects to be displayed at the display position.
9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is loaded and executed by the processor, it employs the method described in any one of claims 1-7.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, characterized in that, When the processor loads and executes the computer program, it employs the method described in any one of claims 1-7.
Citation Information
Patent Citations
Method for realizing game special effects, and game client
CN102739608A
Cloud game implementation method and device
CN110841278A
