Data processing method, device, system and electronic equipment for cloud gaming
By receiving and processing vibration event data in cloud gaming, the problem of users being unable to experience vibration effects has been solved, resulting in a better gaming experience.
Patent Information
- Application Number
- CN202111262943.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-28
- Publication Date
- 2026-01-20
- Estimated Expiration
- 2042-01-20
AI Technical Summary
In cloud gaming scenarios, users cannot experience vibration effects in the game, resulting in a poor gaming experience.
By receiving the target audio and video data and the target vibration event identifier carried in the playback message sent by the cloud host, the terminal queries the vibration event list to obtain the target vibration event data, and performs vibration based on the vibration event data, or performs vibration using preset vibration parameters.
The vibration effects in the game have been improved, enhancing the gaming experience and overall game performance.
Smart Images

Figure CN113996055B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of cloud computing, and particularly relates to a data processing method, device and system of cloud game and electronic equipment. BACKGROUND
[0002] With the development of cloud computing technology, cloud game has become a popular game mode. In the cloud game scenario, the processing logic of the game does not run in the terminal of the player, but runs in the cloud host in the cloud server. Cloud game is free from the dependence on hardware resources. Since it runs in the server, the terminal does not need to have powerful graphics operation and data processing capabilities, but only needs to have basic streaming media playback capabilities, instruction acquisition capabilities and data transmission capabilities.
[0003] In the cloud game process, the terminal collects game operation data of the user, such as various operation instructions and coordinates corresponding to the operation instructions. The terminal transmits the game operation data to the cloud host. The cloud host renders and generates audio and video data of the game based on the game operation data, the processing logic of the game and the game scene, and sends the audio and video data to the terminal for playing.
[0004] However, in the cloud game scenario, the data transmitted between the cloud host and the terminal is relatively single, and the user cannot experience the vibration effect in the game, and the game effect is poor. SUMMARY
[0005] The present disclosure provides a data processing method, device, system and electronic equipment of cloud game to at least solve the problem that the user cannot experience the vibration effect in the game and the game effect is poor in the related art. The technical solutions of the present disclosure are as follows.
[0006] According to a first aspect of an embodiment of the present disclosure, a data processing method of cloud game is provided, comprising:
[0007] receiving a playing message sent by a cloud host, the playing message carrying target audio and video data and a target vibration event identifier;
[0008] querying target vibration event data corresponding to the target vibration event identifier in a vibration event list; the vibration event list is used to store vibration event data sent by the cloud host, and the vibration event data includes a vibration event identifier and a vibration parameter;
[0009] in a case where the target vibration event data is queried, playing the target audio and video data, and vibrating according to a first target vibration parameter in the target vibration event data.
[0010] In one of the embodiments, after the querying of the target vibration event data corresponding to the target vibration event identifier in the vibration event list, the method further comprises:
[0011] In the case where the target vibration event data is not queried, the target audio and video data is played, and vibration is performed according to a preset vibration parameter.
[0012] In one of the embodiments, the target vibration event identifier is a generated serial number of the target vibration event.
[0013] Before the receiving of the playing message sent by the cloud host or after the receiving of the playing message sent by the cloud host, the method further comprises:
[0014] The target vibration event data sent by the cloud host is received, and the target vibration event data contains the target vibration event identifier and the first target vibration parameter.
[0015] It is judged whether the generated serial number of the target vibration event is greater than the maximum generated serial number in the vibration event list.
[0016] If the generated serial number of the target vibration event is greater than the maximum generated serial number, the target vibration event data is stored to the vibration event list.
[0017] If the generated serial number of the target vibration event is less than or equal to the maximum generated serial number, the target vibration event data is discarded.
[0018] In one of the embodiments, before the receiving of the playing message sent by the cloud host, the method further comprises:
[0019] In response to a cloud game starting instruction, a vibration template list is acquired, and the vibration template list contains a corresponding relationship between a game operation instruction and a vibration parameter.
[0020] In response to a target game operation instruction, a second target vibration parameter corresponding to the target game operation instruction is queried in the vibration template list.
[0021] In the case where the second target vibration parameter is queried, vibration is performed according to the second target vibration parameter.
[0022] In one of the embodiments, the acquiring of the vibration template list in response to the cloud game starting instruction comprises:
[0023] In response to a cloud game starting instruction, a vibration template list is acquired, and the vibration template list contains a corresponding relationship between a game operation instruction and a vibration parameter.
[0024] The vibration template list sent by the cloud host or the game server is received and stored.
[0025] According to a second aspect of the embodiments of the present disclosure, a data processing method of cloud game is provided, comprising:
[0026] In a case where a target vibration event is monitored to occur, target vibration event data corresponding to the target vibration event is acquired, the target vibration event data including a first target vibration parameter and a target vibration event identifier;
[0027] The target vibration event data is sent to a terminal, and a play message is generated according to target audio / video data corresponding to the target vibration event and the target vibration event identifier, and the play message is sent to the terminal.
[0028] In one of the embodiments, the acquiring of the target vibration event data corresponding to the target vibration event includes:
[0029] A target vibration event identifier corresponding to the target vibration event is generated, and a first target vibration parameter of the target vibration event is acquired.
[0030] The target vibration event identifier and the first target vibration parameter constitute the target vibration event data corresponding to the target vibration event.
[0031] In one of the embodiments, before the acquiring of the target vibration event data corresponding to the target vibration event in a case where a target vibration event is monitored to occur, the method further includes:
[0032] In response to a download request of a vibration template list sent by a terminal, the vibration template list is sent to the terminal.
[0033] According to a third aspect of the embodiments of the present disclosure, a data processing apparatus of cloud game is provided, including:
[0034] A first receiving unit is configured to perform receiving a play message sent by a cloud host, the play message carrying target audio / video data and a target vibration event identifier;
[0035] A first querying unit is configured to perform querying target vibration event data corresponding to the target vibration event identifier in a vibration event list, the vibration event list being used to store vibration event data sent by the cloud host, the vibration event data including a vibration event identifier and a vibration parameter;
[0036] A first vibration unit is configured to perform, in a case where the target vibration event data is queried, playing the target audio / video data and vibrating according to a first target vibration parameter in the target vibration event data.
[0037] In one of the embodiments, the apparatus further includes:
[0038] The second vibration unit is configured to play the target audio / video data and vibrate according to preset vibration parameters if the target vibration event data is not queried.
[0039] In one of the embodiments, the target vibration event identifier is a generated serial number of the target vibration event.
[0040] The device further comprises:
[0041] The second receiving unit is configured to receive the target vibration event data sent by the cloud host, wherein the target vibration event data comprises the target vibration event identifier and the first target vibration parameter.
[0042] The judging unit is configured to judge whether the generated serial number of the target vibration event is greater than the maximum generated serial number in the vibration event list.
[0043] The storage unit is configured to store the target vibration event data to the vibration event list if the generated serial number of the target vibration event is greater than the maximum generated serial number.
[0044] The discarding unit is configured to discard the target vibration event data if the generated serial number of the target vibration event is less than or equal to the maximum generated serial number.
[0045] In one of the embodiments, the device further comprises:
[0046] The obtaining unit is configured to obtain a vibration template list comprising a corresponding relationship between a game operation instruction and a vibration parameter in response to a cloud game starting instruction.
[0047] The second querying unit is configured to query a second target vibration parameter corresponding to a target game operation instruction in the vibration template list in response to the target game operation instruction.
[0048] The third vibration unit is configured to vibrate according to the second target vibration parameter if the second target vibration parameter is queried.
[0049] In one of the embodiments, the obtaining unit comprises:
[0050] The sending subunit is configured to send a download request of the vibration template list to the cloud host or a game server in response to a cloud game starting instruction.
[0051] The receiving subunit is configured to receive and store the vibration template list sent by the cloud host or the game server.
[0052] According to a fourth aspect of embodiments of the present disclosure, a data processing apparatus for cloud gaming is provided, comprising:
[0053] The acquisition unit is configured to acquire target vibration event data corresponding to the target vibration event in a case where it is monitored that the target vibration event occurs, the target vibration event data containing a first target vibration parameter and a target vibration event identifier;
[0054] The first sending unit is configured to send the target vibration event data to the terminal, and generate a play message according to the target audio / video data corresponding to the target vibration event and the target vibration event identifier, and send the play message to the terminal.
[0055] In one embodiment, the acquisition unit comprises:
[0056] The acquisition subunit is configured to generate a target vibration event identifier corresponding to the target vibration event, and acquire a first target vibration parameter of the target vibration event;
[0057] The constituent subunit is configured to constitute the target vibration event data corresponding to the target vibration event by using the target vibration event identifier and the first target vibration parameter.
[0058] In one embodiment, the apparatus further comprises:
[0059] The second sending unit is configured to send the vibration template list to the terminal in response to a download request of the vibration template list sent by the terminal.
[0060] According to a fifth aspect of embodiments of the present disclosure, a data processing system for cloud gaming is provided, the system comprising a terminal and a cloud host, wherein:
[0061] The cloud host is configured to acquire target vibration event data corresponding to the target vibration event in a case where it is monitored that the target vibration event occurs, the target vibration event data containing a first target vibration parameter and a target vibration event identifier; send the target vibration event data to the terminal; and generate a play message according to the target audio / video data corresponding to the target vibration event and the target vibration event identifier, and send the play message to the terminal.
[0062] The terminal is configured to perform receiving a playing message sent by the cloud host, the playing message carrying target audio and video data and a target vibration event identifier; in a vibration event list, querying target vibration event data corresponding to the target vibration event identifier; the vibration event list is used to store vibration event data sent by the cloud host, the vibration event data including a vibration event identifier and vibration parameters; in the case of querying the target vibration event data, playing the target audio and video data, and vibrating according to first target vibration parameters in the target vibration event data.
[0063] According to a sixth aspect of the embodiments of the present disclosure, an electronic device is provided, comprising:
[0064] a processor;
[0065] a memory for storing instructions executable by the processor;
[0066] The processor is configured to execute the instructions to implement the data processing method for cloud gaming according to any one of the first aspect or the second aspect.
[0067] According to a seventh aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, when instructions in the computer readable storage medium are executed by a processor of an electronic device, the electronic device can execute the data processing method for cloud gaming according to any one of the first aspect or the second aspect.
[0068] According to an eighth aspect of the embodiments of the present disclosure, a computer program product is provided, the computer program product comprising instructions, when the instructions are executed by a processor of an electronic device, the electronic device can execute the data processing method for cloud gaming according to any one of the first aspect or the second aspect.
[0069] The technical solutions provided by the embodiments of the present disclosure at least bring the following beneficial effects: receiving a playing message sent by a cloud host, the playing message carrying target audio and video data and a target vibration event identifier, then in a vibration event list, querying target vibration event data corresponding to the target vibration event identifier; the vibration event list is used to store vibration event data sent by the cloud host, the vibration event data including a vibration event identifier and vibration parameters. In the case of querying the target vibration event data, playing the target audio and video data, and vibrating according to first target vibration parameters in the target vibration event data. In this way, vibration event data can be transmitted between the device and the cloud host, improving the diversity of transmitted data, enabling users to experience vibration effects in the game, and improving the game effect.
[0070] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0071] The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate embodiments consistent with the present disclosure and, together with the description, further serve to explain the principles of the disclosure and, do not limit the disclosure.
[0072] Figure 1 is an application environment diagram of a data processing method of a cloud game according to an example embodiment.
[0073] Figure 2 is a schematic diagram of a terminal communicating with a cloud host according to an example embodiment.
[0074] Figure 3 is a flowchart of a data processing method of a cloud game according to an example embodiment.
[0075] Figure 4 is a flowchart of a data processing method of a cloud game according to an example embodiment.
[0076] Figure 5 is a flowchart of a data processing method of a cloud game according to an example embodiment.
[0077] Figure 6 is a flowchart of a data processing method of a cloud game according to an example embodiment.
[0078] Figure 7 is a flowchart of an example of data processing of a cloud game according to an example embodiment.
[0079] Figure 8 is a flowchart of an example of data processing of a cloud game according to an example embodiment.
[0080] Figure 9 is a flowchart of an example of data processing of a cloud game according to an example embodiment.
[0081] Figure 10 is a block diagram of a data processing apparatus of a cloud game according to an example embodiment.
[0082] Figure 11 is a block diagram of a data processing apparatus of a cloud game according to an example embodiment.
[0083] Figure 12 is a block diagram of an electronic device according to an example embodiment.
[0084] Figure 13 is a block diagram of another electronic device according to an example embodiment. DETAILED DESCRIPTION
[0085] In order for those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.
[0086] It should be noted that the terms "first", "second" and the like in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0087] It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, analyzed data, etc.) involved in the present disclosure are all information and data authorized by the user or authorized by all parties.
[0088] The data processing method of cloud game provided by the present disclosure can be applied to, for example, Figure 1The application environment shown. Among them, the terminal 110 interacts with the cloud host 120 through the network. Among them, the terminal 110 can be a terminal actually used by the user, including but not limited to various personal computers, notebook computers, smart phones or tablet computers, etc., and the cloud host 120 can be a virtual host deployed on the cloud server. In the cloud game scenario, the game process (including various game data processing logic and image processing logic, etc.) and the communication process run in the cloud host, therefore, the cloud game is free from the dependence on the terminal hardware resources, since it runs on the cloud server, the user's terminal does not need to have powerful graphics operation and data processing capability, only needs to have basic streaming media playback capability, instruction acquisition capability, data transmission capability. Specifically, the cloud host can capture the audio and video stream of the game process through the communication process and transmit it to the terminal; the cloud host can also receive the game operation data sent by the terminal through the communication process, such as various operation instructions and coordinates corresponding to each operation instruction, etc., and simulate the real operation event in the game according to the game operation data, and transmit the simulated event to the game process for processing. In addition, the cloud host can also transmit other business related data and instructions, such as login data, payment data, etc., wherein the communication process and the game process can transmit these business related data and instructions through the Binder cross-process communication mode. The terminal can receive the audio and video data sent by the cloud host, and play the game picture and audio based on the received audio and video data. The terminal can also collect the user's game operation data and transmit it to the cloud host. In addition, the terminal can also transmit other business related data and instructions, such as login data, payment data, etc. For example Figure 2 As shown in FIG. 1, a schematic diagram of communication between the terminal and the cloud host.
[0089] In the cloud game mode, the communication between the cloud host and the terminal currently mainly transmits three types of data: 1. Audio and video data, usually transmitted by a one-way uplink channel, the audio and video stream of the game is captured by the cloud host end and transmitted to the terminal; 2. Game operation data is usually transmitted by a one-way downlink channel, the terminal collects game operation data such as various operation instructions and coordinates corresponding to each operation instruction, and transmits it to the cloud host end; 3. Business instructions are usually transmitted by a two-way uplink and downlink channel, and business related instructions and data are transmitted between the terminal and the cloud host.
[0090] The data processing method of the cloud game provided by the embodiment of the present disclosure can transmit vibration event data between the terminal and the cloud host in addition to the above three types of data, which improves the diversity of the transmitted data, enables the user to experience the vibration effect in the game, and improves the game effect.
[0091] Figure 3 is a flowchart of a data processing method of a cloud game according to an example embodiment, as shown in Figure 3As shown, taking the terminal as an example, the method comprises the following steps.
[0092] In step S310, a play message sent by the cloud host is received, and the play message carries target audio and video data and a target vibration event identifier.
[0093] In the embodiments of the present disclosure, the cloud host can send a play message to the terminal during cloud gaming, and the play message can carry audio and video data to enable the terminal to play the audio and video data. When the cloud host monitors the occurrence of a vibration event, the cloud host can send target vibration event data corresponding to the vibration event to the terminal, and the target vibration event data contains target vibration parameters (referred to as first target vibration parameters for convenience) and a target vibration event identifier. In addition, the cloud host can also send a play message carrying target audio and video data and a target vibration event identifier to the terminal. The specific processing process of the cloud host will be described in detail later.
[0094] After receiving the play message sent by the cloud host, the terminal can parse the play message to obtain the target audio and video data and the target vibration event identifier. In one example, the terminal can parse the play message to obtain the target audio and video data and its encapsulation data, and then obtain the data carried by the tag field in the encapsulation data of the target audio and video data to obtain the target vibration event identifier.
[0095] In step S320, the target vibration event data corresponding to the target vibration event identifier is queried in the vibration event list.
[0096] The vibration event list is used to store the vibration event data sent by the cloud host, and the vibration event data contains a vibration event identifier and vibration parameters.
[0097] In the embodiments of the present disclosure, the terminal can store a vibration event list. The vibration event list is a list used to store the vibration event data issued by the cloud host. The vibration event data can contain a vibration event identifier and vibration parameters. The vibration event identifier is an identifier (such as an ID) generated by the cloud host to uniquely identify a vibration event, and the vibration event identifier can be incremented over time to represent the order of vibration events. The vibration parameters can include intensity, vibration duration, cycle number, etc. For example, the vibration parameters corresponding to a certain vibration event can be vibration intensity of level 3, vibration duration of 1s, and cycle number of 1.
[0098] The process of the cloud host issuing vibration event data is parallel to the process of issuing audio and video data, but since the audio and video data need to be encoded and decoded before being sent to the terminal, in general, the vibration event data will be sent to the terminal earlier than the audio and video data. It can be understood that, in actual processing, due to the uncertainty of the processing speed of the cloud host, network communication conditions and the like, the time when the terminal receives the vibration event data and the audio and video data is uncertain. That is, the terminal may first receive the vibration event data and then receive the audio and video data, or it may first receive the audio and video data and then receive the vibration event data. After the terminal receives the vibration event data, it can store the vibration event data in the vibration event list based on a preset storage strategy, and the specific storage process will be described later.
[0099] After the terminal obtains the target vibration event identifier carried by the target audio and video data, it can query whether the target vibration event data corresponding to the target vibration event identifier exists in the vibration event list.
[0100] In step S330, in the case where the target vibration event data is queried, the target audio and video data is played, and vibration is performed according to the first target vibration parameter in the target vibration event data.
[0101] In the case where the target vibration event data is queried in the embodiment of the disclosure, the terminal can further obtain the target vibration parameter (i.e., the first target vibration parameter) in the target vibration event data. Then, the terminal can display the game picture based on the target audio and video data and play the audio, while performing vibration according to the first target vibration parameter.
[0102] In the data processing method of cloud game provided by the embodiment of the disclosure, the terminal can receive the play message sent by the cloud host, the play message carries the target audio and video data and the target vibration event identifier, and then query the target vibration event data corresponding to the target vibration event identifier in the vibration event list. The vibration event list is used to store the vibration event data sent by the cloud host, and the vibration event data contains a vibration event identifier and a vibration parameter. In the case where the target vibration event data is queried, the terminal plays the target audio and video data and performs vibration according to the first target vibration parameter in the target vibration event data. In this way, the vibration event data can be transmitted between the terminal and the cloud host, the diversity of the transmitted data is improved, the user can experience the vibration effect in the game, and the game effect is improved.
[0103] Moreover, the cloud host carries the vibration event identifier in the audio and video data by means of tagging in the encapsulated data of the audio and video data, and the terminal can find the corresponding vibration event data according to the vibration event identifier, so as to output the audio and video data while performing vibration, thereby realizing the synchronization of audio and video and vibration event.
[0104] Optionally, for the case that the target vibration event data arrives at the terminal later than the target audio and video data, the target vibration event data will not exist in the vibration event list, and correspondingly, the processing procedure of the terminal is: playing the target audio and video data and vibrating according to the preset vibration parameter in the case that the target vibration event data is not queried.
[0105] In the embodiments of the present disclosure, the terminal can store the default configuration parameter of the vibration event, i.e., the preset vibration parameter. In the case that the target vibration event data is not queried, the terminal can display the game picture and play the audio based on the target audio and video data, and simultaneously vibrate according to the preset vibration parameter.
[0106] In this way, even if the terminal does not receive the target vibration event data issued by the cloud host, the vibration can be performed at the same time as playing the audio and video data, so that the user can experience the vibration effect in the game, and the game effect is improved.
[0107] In an example embodiment, as shown in Figure 4 The target vibration event identifier is the generation serial number of the target vibration event, and correspondingly, the specific process of the terminal storing the target vibration event data includes the following steps:
[0108] In step S410, the target vibration event data sent by the cloud host is received.
[0109] The target vibration event data contains the target vibration event identifier (i.e., the generation serial number of the target vibration event) and the first target vibration parameter.
[0110] In the embodiments of the present disclosure, the terminal can receive the target vibration event data sent by the cloud host. As described above, the time when the terminal receives the target vibration event data and the target audio and video data is uncertain, so step S410 can be executed before step S310 or after step S310.
[0111] The terminal can analyze the target vibration event data to obtain the target generation serial number.
[0112] In step S420, it is judged whether the generation serial number of the target vibration event is greater than the maximum generation serial number in the vibration event list.
[0113] In the embodiments of the present disclosure, the terminal can compare the generation serial number of the target vibration event with the maximum generation serial number in the vibration event list. If the target generation serial number is greater than the maximum generation serial number, it means that the vibration event corresponding to the target generation serial number is a new event, and step S430 is executed. If the target generation serial number is less than or equal to the maximum generation serial number, it means that the vibration event corresponding to the target generation serial number is an old event, and step S440 is executed.
[0114] In step S430, the target vibration event data is stored into the vibration event list.
[0115] In step S440, the target vibration event data is discarded.
[0116] For example, if the terminal receives vibration event data with a sequence ID of ID8, and the maximum ID in the vibration event list is ID7, the vibration event data is stored into the vibration event list; if the maximum ID in the vibration event list is ID10, the vibration event data is discarded.
[0117] In this way, the terminal only stores new vibration events in the vibration event list, avoids storing data of old vibration events into the vibration event list, reduces the amount of invalid data in the vibration event list, and saves storage resources.
[0118] Optionally, the terminal can also delete vibration event data of vibration events that have been executed in the vibration event list. For example, after the terminal plays audio and video data A (containing vibration event ID9) and vibrates according to vibration parameters corresponding to ID9, the terminal can delete vibration event data corresponding to ID9 in the vibration event list.
[0119] In an example embodiment, as shown in FIG. 5, the terminal can also vibrate according to a vibration template list stored locally, and the specific processing process can be as follows: Figure 5
[0120] In step S510, in response to a cloud game start instruction, a vibration template list is obtained.
[0121] The vibration template list contains a corresponding relationship between game operation instructions and vibration parameters.
[0122] In the embodiments of the present disclosure, when a user starts a cloud game on a terminal, the terminal can receive a cloud game start instruction. In response to the cloud game start instruction, the terminal can obtain a vibration template list corresponding to the cloud game. The vibration template list can contain a corresponding relationship between game operation instructions and vibration parameters, as shown in Table 1.
[0123] Table 1
[0124] Game operation instructions Vibration parameters Gun firing instructions Vibration intensity: 3 levels; vibration time: 1 s; cycle times: 1 time Shaking pistol instructions Vibration intensity: 1 level; vibration event: 0.6 s; cycle times: 1 time
[0125] In step S520, in response to a target game operation instruction, a second target vibration parameter corresponding to the target game operation instruction is queried in the vibration template list.
[0126] In the embodiments of the present disclosure, the user can perform a game operation in the game process, and the terminal can receive a corresponding game operation instruction. When the terminal receives a certain game operation instruction (i.e., a target game operation instruction), the terminal can query whether a target vibration parameter (i.e., a second target vibration parameter) corresponding to the target game operation instruction exists in the vibration template list.
[0127] Referring to Table 1, when the terminal receives a shooting instruction, the terminal can query that the corresponding vibration parameter in the vibration template list is that the vibration intensity is level 3, the vibration duration is 1 s, and the cycle number is 1 time. When the terminal receives a character jumping instruction, the terminal does not query the corresponding vibration parameter in the vibration template list.
[0128] In step S530, when the second target vibration parameter is queried, vibration is performed according to the second target vibration parameter.
[0129] In the embodiments of the present disclosure, after the terminal queries the second target vibration parameter, vibration can be performed according to the second target vibration parameter. In this way, the terminal can directly obtain the vibration parameter corresponding to the game operation instruction according to the locally stored vibration template list to perform vibration, without the need to transmit vibration event data through the cloud host, so that the vibration response speed is faster and the hand following performance is better.
[0130] In addition, if the terminal does not query the target game operation instruction in the vibration template list, it means that the target game operation instruction is not configured with a vibration event, and the terminal does not perform vibration.
[0131] Optionally, the terminal obtains the vibration template list in the following process: in response to a cloud game starting instruction, the terminal sends a download request of the vibration template list to the cloud host or a game server; and the terminal receives and stores the vibration template list sent by the cloud host or the game server.
[0132] In the embodiments of the present disclosure, the terminal can obtain the vibration template list from the cloud host or the game server, and the specific selection manner can be set according to actual needs, which is not limited in the embodiments of the present disclosure. Taking the cloud host as an example, after the terminal receives the cloud game starting instruction, the terminal can send a download request of the vibration template list to the cloud host, and the download request can carry an identifier of the cloud game. After the cloud host receives the download request, the cloud host can obtain the corresponding vibration template list according to the identifier of the cloud game, and then send the vibration template list to the terminal. The terminal can receive and store the vibration template list. The process of obtaining the vibration template list from the game server is similar, and is not described herein.
[0133] Based on the above scheme, the terminal can obtain the vibration template list from the cloud host or the game server, so as to directly obtain the vibration parameter corresponding to the game operation instruction according to the vibration template list to perform vibration, without the need to transmit through the cloud host, so that the vibration response speed is faster and the hand following performance is better.
[0134] Figure 6 is a flowchart of a data processing method of cloud game according to an exemplary embodiment, as Figure 6 shown, taking the method used for a cloud host as an example, comprising the following steps.
[0135] In step S610, in the case where the target vibration event is monitored to occur, target vibration event data corresponding to the target vibration event is acquired.
[0136] The target vibration event data contains a first target vibration parameter and a target vibration event identifier.
[0137] In the embodiments of the present disclosure, the game process of cloud game can be run in the cloud host, so as to realize various game data processing logic, image processing logic, etc. of cloud game. In the game process, the cloud host can judge the game event occurred according to the game operation data sent by the terminal, and when a preset game event occurs, a vibration event (i.e. target vibration event) can be triggered. For example, when the user-controlled character dies or the user-controlled vehicle collides with the object in the game scene, the target vibration event is triggered. At this time, the game process can call the preset interface of the cloud host to pass the vibration parameter of the target vibration event to the cloud host. In this way, the cloud host can monitor the generation of the target vibration event and obtain the vibration parameter corresponding to the target vibration event. The vibration parameter can include intensity, vibration duration, cycle number, etc. The cloud host can obtain the vibration event data (i.e. target vibration event data) corresponding to the target vibration event according to these vibration parameters.
[0138] In step S620, the target vibration event data is sent to the terminal.
[0139] In the embodiments of the present disclosure, after the cloud host acquires the target vibration event data, the cloud host can send the target vibration event data to the terminal, so that the terminal vibrates according to the target vibration event data. In one example, the cloud host can transmit the target vibration event data through a bidirectional uplink and downlink channel.
[0140] In step S630, a play message is generated according to the target audio / video data corresponding to the target vibration event and the target vibration event identifier, and the play message is sent to the terminal.
[0141] In the embodiments of the present disclosure, when the cloud host monitors that the target vibration event occurs, the cloud host can also acquire audio and video data corresponding to the target vibration event (i.e., target audio and video data). For example, when a user-controlled character dies, a game screen and sound of the character death will be generated, or when a user-controlled vehicle collides with an object in the game scene, a collision screen and sound will be generated. The correspondence between the target vibration event and the audio and video data can be set by the technical personnel in the game program in advance. The cloud host can add a target vibration event identifier in the encapsulation information of the target audio and video data. In an example, a tag field can be added in the encapsulation information of the audio and video data, and the tag field is used to carry the vibration event identifier, and then the cloud host can write the target vibration event identifier into the tag field of the target audio and video data. Then, the cloud host can generate a play message (such as an audio and video data packet) according to the target audio and video data and the encapsulation information thereof, and then send the play message to the terminal. In an example, the cloud host can send the play message to the terminal through a one-way uplink channel.
[0142] The cloud game data processing method provided by the embodiments of the present disclosure, when the cloud host monitors that the target vibration event occurs, the cloud host can acquire target vibration event data corresponding to the target vibration event, and the target vibration event data includes a first target vibration parameter and a target vibration event identifier. Then, the cloud host sends the target vibration event data to the terminal; and generates a play message according to the target audio and video data corresponding to the target vibration event and the target vibration event identifier, and sends the play message to the terminal. In this way, the terminal can query the target vibration event data corresponding to the target vibration event identifier in the vibration event list according to the target vibration event identifier carried by the target audio and video data, and play the target audio and video data when the target vibration event data is queried, and vibrate according to the first target vibration parameter in the target vibration event data. Based on the above process, the vibration event data can be transmitted between the terminal and the cloud host, which improves the diversity of the transmitted data, enables the user to experience the vibration effect in the game, and improves the game effect.
[0143] Moreover, the cloud host carries the vibration event identifier in the audio and video data by means of tag in the encapsulation data of the audio and video data, and the terminal can find the corresponding vibration event data according to the vibration event identifier, so as to output the audio and video data while vibrating, and realize the synchronization of the audio and video and the vibration event.
[0144] Optionally, the execution processes of step S620 and step S630 can be performed simultaneously, but since the audio and video data needs to be encoded and decoded first before being sent to the terminal, generally, the sending time of the target vibration event data is earlier than the sending time of the target audio and video data. It can be understood that in actual processing, due to the uncertainty of the processing speed of the cloud host, network communication conditions and the like, the time when the terminal receives the target vibration event data and the target audio and video data is uncertain. That is, the terminal can first receive the target vibration event data and then receive the target audio and video data; or it can first receive the target audio and video data and then receive the target vibration event data.
[0145] In an example embodiment, in step S610, the specific process of obtaining the target vibration event data can be: generating a target vibration event identifier corresponding to the target vibration event, and obtaining a first target vibration parameter of the target vibration event; and constructing the target vibration event identifier and the first target vibration parameter into the target vibration event data corresponding to the target vibration event.
[0146] In the embodiments of the present disclosure, after the cloud host monitors the occurrence of the target vibration event, the cloud host can generate a vibration event identifier corresponding to the target vibration event. The vibration event identifier is an identifier (such as ID) generated by the cloud host and capable of uniquely identifying the target vibration event. For example, the vibration event identifier can be a generated serial number, such as ID1, ID2, ID3, etc. The cloud host can generate a vibration event identifier for the vibration event according to the order in which the vibration event is generated. That is, the vibration event identifier can be incremented with time to represent the order in which the vibration event is generated.
[0147] The cloud host can also obtain the vibration parameter of the target vibration event based on the interface call of the game process. Then, the cloud host can construct the target vibration event identifier and the first target vibration parameter into the target vibration event data corresponding to the target vibration event. That is, the target vibration event data contains the target vibration event identifier and the first target vibration parameter.
[0148] Based on the above process, the cloud host can obtain the target vibration event data, which contains the target vibration event identifier and the first target vibration parameter, so that the terminal can vibrate according to the target vibration event data.
[0149] Optionally, the processing process of the cloud host further includes: in response to the download request of the vibration template list sent by the terminal, sending the vibration template list to the terminal.
[0150] In the embodiment of the present disclosure, after receiving the cloud game starting instruction, the terminal can send a download request of the vibration template list to the cloud host, and the download request can carry the identifier of the cloud game. After receiving the download request, the cloud host can obtain the corresponding vibration template list according to the identifier of the cloud game, and then send the vibration template list to the terminal. The terminal can receive and store the vibration template list.
[0151] Based on the above scheme, the terminal can obtain the vibration template list from the cloud host, so as to directly obtain the vibration parameters corresponding to the game operation instruction according to the vibration template list, without transmitting the vibration event data through the cloud host, so that the vibration response speed is faster and the hand following performance is better.
[0152] Figure 7 is an example of data processing of a cloud game according to an example embodiment. In this example, the terminal first receives vibration event data and then receives audio and video data. As shown in Figure 7 , the example includes the following steps.
[0153] In step S710, the terminal receives the vibration event data sent by the cloud host, and the vibration event data contains a target ID and vibration parameters.
[0154] In step S720, the terminal compares the target ID with the maximum ID in the vibration event list, and determines that the target ID is greater than the maximum ID.
[0155] In step S730, the terminal stores the vibration event data to the vibration event list.
[0156] In step S740, the terminal receives the audio and video data packet sent by the cloud host. The target ID is carried in the tag of the audio and video data packet.
[0157] In step S750, the terminal queries the vibration event data corresponding to the target ID in the vibration event list.
[0158] In step S760, the terminal plays the audio and video data based on the audio and video data packet, and vibrates according to the vibration parameters in the vibration event data.
[0159] Figure 8 is another example of data processing of a cloud game according to an example embodiment. In this example, the terminal first receives audio and video data, and then receives vibration event data. As shown in Figure 8 , the example includes the following steps.
[0160] In step S810, the terminal receives the audio and video data packet sent by the cloud host. The target ID is carried in the tag of the audio and video data packet.
[0161] In step S820, the terminal does not query the vibration event data corresponding to the target ID in the vibration event list, plays the audio and video data based on the audio and video data packet, and vibrates according to the preset vibration parameters.
[0162] In step S830, the terminal receives vibration event data sent by the cloud host, which includes the target ID and vibration parameters.
[0163] In step S840, the terminal compares the target ID with the maximum ID in the vibration event list and determines that the target ID is less than the maximum ID.
[0164] In step S850, the terminal discards the vibration event data.
[0165] Figure 9 This is an example of data processing for cloud gaming according to an exemplary embodiment, in which the terminal vibrates according to a list of vibration templates. Figure 9 As shown, this example includes the following steps.
[0166] In step S910, in response to the cloud game launch command, the terminal sends a download request for the vibration template list to the cloud host.
[0167] In step S920, the terminal receives and stores the list of vibration templates sent by the cloud host.
[0168] In step S910', the terminal responds to the cloud game launch command by sending a download request for the vibration template list to the game server.
[0169] In step S920', the terminal receives and stores the list of vibration templates sent by the game server.
[0170] In step S930, the terminal responds to the target game operation command by querying the vibration parameters corresponding to the target game operation command in the vibration template list.
[0171] In step S940, if the vibration parameters are found, vibration is performed according to the vibration parameters.
[0172] The processing steps S910 to S920 are different implementations of the same process as the processing steps S910' to S920'. The terminal device can execute S910 to S920, or execute S910' to S920'.
[0173] It should be understood that, although Figures 1-9The steps in the flowchart of FIG. 1 are displayed in sequence according to the direction of the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other orders. Moreover, Figures 1-9 At least part of the steps in the flowchart of FIG. 1 can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be alternately executed with other steps or steps or stages in other steps.
[0174] It can be understood that the same / similar parts between each embodiment of the above method in the specification can be mutually referred to, and each embodiment focuses on the differences from other embodiments, and the related parts can be referred to the description of other method embodiments.
[0175] Figure 10 is a block diagram of a data processing device for cloud game according to an exemplary embodiment. Referring to Figure 10 The device includes a first receiving unit 1010, a first query unit 1020, and a first vibration unit 1030.
[0176] The first receiving unit 1010 is configured to receive a play message sent by a cloud host, the play message carrying target audio / video data and a target vibration event identifier;
[0177] The first query unit 1020 is configured to query target vibration event data corresponding to the target vibration event identifier in a vibration event list, the vibration event list being used to store vibration event data sent by the cloud host, the vibration event data including a vibration event identifier and vibration parameters;
[0178] The first vibration unit 1030 is configured to play the target audio / video data and vibrate according to first target vibration parameters in the target vibration event data when the target vibration event data is queried.
[0179] In one embodiment, the device further includes:
[0180] The second vibration unit is configured to play the target audio / video data and vibrate according to preset vibration parameters when the target vibration event data is not queried.
[0181] In one embodiment, the target vibration event identifier is a generated serial number of the target vibration event;
[0182] The device further includes:
[0183] The second receiving unit is configured to receive target vibration event data sent by the cloud host, wherein the target vibration event data comprises a target vibration event identifier and a first target vibration parameter.
[0184] The determining unit is configured to determine whether a generation sequence number of the target vibration event is greater than a maximum generation sequence number in the vibration event list.
[0185] The storage unit is configured to store the target vibration event data into the vibration event list if the generation sequence number of the target vibration event is greater than the maximum generation sequence number.
[0186] The discarding unit is configured to discard the target vibration event data if the generation sequence number of the target vibration event is less than or equal to the maximum generation sequence number.
[0187] In one of the embodiments, the device further comprises:
[0188] The obtaining unit is configured to obtain a vibration template list comprising a corresponding relationship between a game operation instruction and a vibration parameter in response to a cloud game starting instruction.
[0189] The second querying unit is configured to query a second target vibration parameter corresponding to the target game operation instruction in the vibration template list in response to the target game operation instruction.
[0190] The third vibration unit is configured to vibrate according to the second target vibration parameter if the second target vibration parameter is queried.
[0191] In one of the embodiments, the obtaining unit comprises:
[0192] The sending sub-unit is configured to send a download request of the vibration template list to the cloud host or the game server in response to the cloud game starting instruction.
[0193] The receiving sub-unit is configured to receive and store the vibration template list sent by the cloud host or the game server.
[0194] Figure 11 is a data processing device block diagram of a cloud game according to an exemplary embodiment. Referring to Figure 10 The device comprises an obtaining unit 1110 and a first sending unit 1120.
[0195] The obtaining unit 1110 is configured to obtain target vibration event data corresponding to a target vibration event if the occurrence of the target vibration event is monitored, wherein the target vibration event data comprises a first target vibration parameter and a target vibration event identifier.
[0196] The first sending unit 1120 is configured to send the target vibration event data to the terminal, and generate a playing message according to the target audio / video data corresponding to the target vibration event and the target vibration event identifier, and send the playing message to the terminal.
[0197] In one of the embodiments, the obtaining unit 1110 includes:
[0198] The obtaining sub-unit is configured to generate the target vibration event identifier corresponding to the target vibration event, and obtain the first target vibration parameter of the target vibration event.
[0199] The constituting sub-unit is configured to constitute the target vibration event data corresponding to the target vibration event by using the target vibration event identifier and the first target vibration parameter.
[0200] In one of the embodiments, the apparatus further includes:
[0201] The second sending unit is configured to send the vibration template list to the terminal in response to the download request of the vibration template list sent by the terminal.
[0202] As to the apparatus in the above-mentioned embodiments, the specific manners in which various modules perform operations have been described in details in the embodiments of the method, and will not be described in details here.
[0203] Figure 12 FIG. 12 is a block diagram of an electronic device 1200 for data processing of cloud gaming according to an example embodiment. The electronic device can be a terminal used by a user, for example, the electronic device 1200 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0204] Referring to Figure 12 The electronic device 1200 can include one or more of the following components: a processing component 1202, a memory 1204, a power supply component 1206, a multimedia component 1208, an audio component 1210, an input / output (I / O) interface 1212, a sensor component 1214, and a communication component 1216.
[0205] The processing component 1202 generally controls the overall operation of the electronic device 1200. The processing component 1202 can be, for example, a central processing unit (CPU), a microprocessor, a microcomputer, a microcontroller, a digital signal processor (DSP), or other control logic circuitry. The processing component 1202 can include one or more processors to execute instructions as described above to complete all or part of the steps of the methods described above. Additionally, the processing component 1202 can include one or more modules to facilitate interaction between the processing component 1202 and other components. For example, the processing component 1202 can include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.
[0206] The memory 1204 is configured to store various types of data to support the operations of the electronic device 1200. Examples of such data include instructions for any application or method operating on the electronic device 1200, contact data, phonebook data, messages, pictures, videos, and the like. The memory 1204 can be implemented by any type of volatile or non-volatile memory or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, a magnetic disc, an optical disc, or graphene memory.
[0207] The power supply component 1206 supplies power for the various components of the electronic device 1200. The power supply component 1206 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1200.
[0208] The multimedia component 1208 includes a screen providing an output interface between the electronic device 1200 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swiping, and gestures on the touch panel. The touch sensors can not only sense a boundary of a touching or swiping action, but also detect duration and pressure related to the touching or swiping action. In some embodiments, the multimedia component 1208 includes a front camera and / or a rear camera. The front camera and / or the rear camera can receive external multimedia data when the electronic device 1200 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0209] The audio component 1210 is configured to output and / or input audio signals. For example, the audio component 1210 includes a microphone (MIC) that is configured to receive an external audio signal when the electronic device 1200 is in a mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 1204 or transmitted via the communication component 1216. In some embodiments, the audio component 1210 also includes a speaker for outputting audio signals.
[0210] The I / O interface 1212 provides an interface between the processing component 1202 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.
[0211] The sensor component 1214 includes one or more sensors for providing various state assessments for the electronic device 1200. For example, the sensor component 1214 can detect an open / closed state of the electronic device 1200, relative positioning of components, such as a display and a keypad of the electronic device 1200, a change in position of the electronic device 1200 or components of the electronic device 1200, presence or absence of user contact with the electronic device 1200, the orientation or acceleration / deceleration of the device 1200, and a temperature change of the electronic device 1200. The sensor component 1214 can include a proximity sensor configured to detect presence of a nearby object without any physical touch. The sensor component 1214 can further include a light sensor, such as a CMOS or CCD image sensor, for use in an imaging application. In some embodiments, the sensor component 1214 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0212] The communication component 1216 is configured to facilitate wired or wireless communication between the electronic device 1200 and other devices. The electronic device 1200 can access a wireless network based on a communication standard, such as WiFi, a operator network, such as 2G, 3G, 4G, or 5G, or a combination thereof. In an example embodiment, the communication component 1216 receives broadcast signals or broadcast-related information from an external broadcasting management system via a broadcast channel. In an example embodiment, the communication component 1216 further includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technology.
[0213] In an exemplary embodiment, the electronic device 1200 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements for performing the above-described methods.
[0214] In an exemplary embodiment, a computer-readable storage medium including instructions, such as the memory 1204 including instructions, is also provided, which can be executed by the processor 1220 of the electronic device 1200 to complete the above-described methods. For example, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.
[0215] In an exemplary embodiment, a computer program product including instructions, which can be executed by the processor 1220 of the electronic device 1200 to complete the above-described methods, is also provided.
[0216] Figure 13 is a block diagram of an electronic device 1300 for data processing for cloud gaming according to an exemplary embodiment. The electronic device can be used to implement a cloud host, for example, the electronic device 1300 can be a server. Referring to Figure 13 , the electronic device 1300 includes a processing component 1320, which further includes one or more processors, and a memory resource represented by a memory 1322, for storing instructions executable by the processing component 1320, such as an application program. The application program stored in the memory 1322 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 1320 is configured to execute the instructions to perform the above-described methods.
[0217] The electronic device 1300 can also include a power supply component 1324 configured to perform power management of the electronic device 1300, a wired or wireless network interface 1326 configured to connect the electronic device 1300 to a network, and an input / output (I / O) interface 1328. The electronic device 1300 can operate based on an operating system stored in the memory 1322, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, or the like.
[0218] In an example embodiment, a computer readable storage medium, for example, a memory 1322 including instructions, is also provided, which can be executed by the processor of the electronic device 1300 to complete the above method. The storage medium can be a computer readable storage medium, for example, the computer readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.
[0219] In an example embodiment, a computer program product including instructions, which can be executed by the processor of the electronic device 1300 to complete the above method, is also provided.
[0220] It should be noted that the above apparatus, electronic device, computer readable storage medium, computer program product, etc. according to the description of the method embodiment can also include other implementation manners, and the specific implementation manners can be referred to the description of the related method embodiment, which will not be described here.
[0221] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the features of the present disclosure disclosed herein. It is intended that the present disclosure cover any and all variations of the present disclosure that come within the scope of the claims and a concept of equivalents thereof. The specification and examples are exemplary only, with the true scope and spirit of the disclosure being indicated by the claims.
[0222] It should be understood that the present disclosure is not limited to the precise structures as herein described and illustrated in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the claims appended hereto.
Claims
1. A data processing method for cloud gaming, characterized in that, include: Receive a playback message sent by the cloud host, the playback message carrying target audio and video data and target vibration event identifier; In the vibration event list, query the target vibration event data corresponding to the target vibration event identifier; the vibration event list is used to store the vibration event data sent by the cloud host, the vibration event data includes the vibration event identifier and vibration parameters, and the target vibration event is the vibration event triggered by the game event determined by the cloud host based on the game operation data sent by the terminal; If the target vibration event data is found, the target audio and video data is played, and vibration is performed according to the first target vibration parameter in the target vibration event data.
2. The data processing method according to claim 1, characterized in that, After querying the target vibration event data corresponding to the target vibration event identifier in the vibration event list, the process further includes: If the target vibration event data is not found, the target audio and video data is played, and vibration is performed according to preset vibration parameters.
3. The data processing method according to claim 1, characterized in that, The target vibration event is identified by its generation sequence number. Before or after receiving the playback message sent by the cloud host, the method further includes: The system receives the target vibration event data sent by the cloud host; the target vibration event data includes the target vibration event identifier and the first target vibration parameter. Determine whether the generation sequence number of the target vibration event is greater than the largest generation sequence number in the vibration event list; If the generation sequence number of the target vibration event is greater than the maximum generation sequence number, then the target vibration event data is stored in the vibration event list; If the generation sequence number of the target vibration event is less than or equal to the maximum generation sequence number, then the target vibration event data is discarded.
4. The data processing method according to claim 1, characterized in that, Before receiving the playback message sent by the cloud host, the process also includes: In response to the cloud gaming launch command, a vibration template list is obtained, wherein the vibration template list contains the correspondence between game operation commands and vibration parameters; In response to a target game operation command, the second target vibration parameter corresponding to the target game operation command is queried from the vibration template list; If the second target vibration parameters are found, vibration is performed according to the second target vibration parameters.
5. The data processing method according to claim 4, characterized in that, The process of obtaining the vibration template list in response to the cloud gaming launch command includes: In response to the cloud gaming launch command, a download request for the vibration template list is sent to the cloud host or game server; Receive and store the list of vibration templates sent by the cloud host or the game server.
6. A data processing method for cloud gaming, characterized in that, include: When a target vibration event is detected, target vibration event data corresponding to the target vibration event is obtained. The target vibration event data includes a first target vibration parameter and a target vibration event identifier. The target vibration event is a vibration event triggered by a game event determined based on game operation data sent by the terminal. Send the target vibration event data to the terminal; and generate a playback message based on the target audio and video data corresponding to the target vibration event and the target vibration event identifier, and send the playback message to the terminal.
7. The data processing method according to claim 6, characterized in that, The step of acquiring the target vibration event data corresponding to the target vibration event includes: Generate a target vibration event identifier corresponding to the target vibration event, and obtain the first target vibration parameter of the target vibration event; The target vibration event identifier and the first target vibration parameter constitute the target vibration event data corresponding to the target vibration event.
8. The data processing method according to claim 6, characterized in that, Before acquiring the target vibration event data corresponding to the target vibration event upon detecting the occurrence of the target vibration event, the method further includes: In response to a download request for a list of vibration templates sent by a terminal, the list of vibration templates is sent to the terminal.
9. A data processing device for cloud gaming, characterized in that, include: The first receiving unit is configured to receive a playback message sent by the cloud host, the playback message carrying target audio and video data and a target vibration event identifier; The first query unit is configured to query the target vibration event data corresponding to the target vibration event identifier in the vibration event list; the vibration event list is used to store the vibration event data sent by the cloud host, the vibration event data includes the vibration event identifier and vibration parameters, and the target vibration event is the vibration event triggered by the game event determined by the cloud host based on the game operation data sent by the terminal; The first vibration unit is configured to, upon querying the target vibration event data, play the target audio and video data and vibrate according to the first target vibration parameter in the target vibration event data.
10. The data processing apparatus according to claim 9, characterized in that, The device further includes: The second vibration unit is configured to play the target audio and video data and vibrate according to preset vibration parameters when the target vibration event data is not found.
11. The data processing apparatus according to claim 9, characterized in that, The target vibration event is identified by its generation sequence number. The device further includes: The second receiving unit is configured to receive the target vibration event data sent by the cloud host; the target vibration event data includes the target vibration event identifier and the first target vibration parameter; The judgment unit is configured to judge whether the generation sequence number of the target vibration event is greater than the largest generation sequence number in the vibration event list; The storage unit is configured to store the target vibration event data into the vibration event list if the generation sequence number of the target vibration event is greater than the maximum generation sequence number; The discard unit is configured to discard the target vibration event data if the generation sequence number of the target vibration event is less than or equal to the maximum generation sequence number.
12. The data processing apparatus according to claim 9, characterized in that, The device further includes: The acquisition unit is configured to execute a response to a cloud game launch command, acquiring a vibration template list, wherein the vibration template list contains the correspondence between game operation commands and vibration parameters; The second query unit is configured to perform a query in response to a target game operation command, querying the vibration template list for a second target vibration parameter corresponding to the target game operation command. The third vibration unit is configured to perform vibration based on the second target vibration parameters when the second target vibration parameters are found.
13. The data processing apparatus according to claim 12, characterized in that, The acquisition unit includes: The sending subunit is configured to execute a download request for a vibration template list to the cloud host or game server in response to a cloud game launch command; The receiving subunit is configured to receive and store a list of vibration templates sent by the cloud host or the game server.
14. A data processing device for cloud gaming, characterized in that, include: The acquisition unit is configured to acquire target vibration event data corresponding to the target vibration event when the target vibration event is detected. The target vibration event data includes a first target vibration parameter and a target vibration event identifier. The target vibration event is a vibration event triggered by a game event determined based on game operation data sent by the terminal. The first sending unit is configured to send the target vibration event data to the terminal; and to generate a playback message based on the target audio and video data corresponding to the target vibration event and the target vibration event identifier, and send the playback message to the terminal.
15. The data processing apparatus according to claim 14, characterized in that, The acquisition unit includes: The acquisition subunit is configured to generate a target vibration event identifier corresponding to the target vibration event and acquire the first target vibration parameter of the target vibration event; The constituent subunit is configured to perform the task of forming target vibration event data corresponding to the target vibration event using the target vibration event identifier and the first target vibration parameters.
16. The data processing apparatus according to claim 14, characterized in that, The device further includes: The second sending unit is configured to send the vibration template list to the terminal in response to a download request for the vibration template list sent by the terminal.
17. A cloud gaming data processing system, characterized in that, The system includes a terminal and a cloud host, wherein: The cloud host is configured to, upon detecting a target vibration event, acquire target vibration event data corresponding to the target vibration event, the target vibration event data including a first target vibration parameter and a target vibration event identifier; send the target vibration event data to the terminal; and generate a playback message based on the target audio / video data corresponding to the target vibration event and the target vibration event identifier, and send the playback message to the terminal, wherein the target vibration event is a vibration event triggered by a game event determined based on game operation data sent by the terminal. The terminal is configured to receive a playback message sent by the cloud host, the playback message carrying target audio and video data and a target vibration event identifier; query the target vibration event data corresponding to the target vibration event identifier in the vibration event list; the vibration event list is used to store vibration event data sent by the cloud host, the vibration event data including a vibration event identifier and vibration parameters; if the target vibration event data is found, play the target audio and video data, and vibrate according to the first target vibration parameter in the target vibration event data.
18. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the cloud gaming data processing method as described in any one of claims 1 to 5 or 6 to 8.
19. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the cloud gaming data processing method as claimed in any one of claims 1 to 5 or 6 to 8.
20. A computer program product, the computer program product comprising instructions, characterized in that, When the instruction is executed by the processor of the electronic device, the electronic device is able to perform the cloud gaming data processing method as described in any one of claims 1 to 5 or 6 to 8.
Citation Information
Patent Citations
Method for setting multimedia file, and terminal device
CN109451154A
Cloud game data processing method, device thereof and system and storage medium
CN112755530A
Multimedia resource sharing method and device, electronic equipment and storage medium
CN113542773A