Method and device for collecting multimedia data in cloud game, equipment and medium

By providing direct multimedia acquisition methods in cloud games, players can take screenshots or record screenshots through control devices in cloud games, solving the problem of low multimedia data acquisition efficiency in cloud games, improving human-computer interaction efficiency and simplicity of operation .

CN119015702APending Publication Date: 2024-11-26TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310612647.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In cloud games, players need to use complex steps to take screenshots or recording screenshots of screenshots or videos, resulting in low human-computer interaction efficiency and affecting the game progress.

Method used

By providing multimedia collection methods in cloud games, players are allowed to directly perform screenshots or screen recording operations on the control device, and collect and process multimedia data using cloud game servers and display devices, avoiding the traditional shooting process.

Benefits of technology

It improves the efficiency of multimedia data collection and human-computer interaction efficiency, simplifies the player's operation process, and avoids interference with cloud gaming processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119015702A_ABST
    Figure CN119015702A_ABST
Patent Text Reader

Abstract

The invention discloses a method, a device and equipment for collecting multimedia data in a cloud game and a medium, and relates to the field of interface interaction. The method comprises the steps that a control interface of a cloud game is displayed, the control interface comprises a control for controlling the cloud game, a communication connection relation is established between a control device and a display device, and a cloud game picture of the cloud game is generated by a cloud game server and then sent to the display device to be displayed; receiving a multimedia acquisition operation in the control interface; and in response to the multimedia acquisition operation, displaying multimedia data acquired based on the cloud game picture displayed on the display equipment. In the cloud game scene, a player can control the display device and the cloud game server to collect the multimedia data based on the displayed cloud game picture through the multimedia collection operation, so that the multimedia data is obtained on the control device, the collection efficiency of the multimedia data is improved, and the man-machine interaction efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of interface interaction, and in particular to a method, device, equipment and medium for collecting multimedia data in cloud games. Background Art

[0002] Cloud gaming is a gaming method based on cloud computing. In the cloud gaming mode, all games are run on the server side, and the server side will transmit the rendered game screen to the display device through the network for display.

[0003] In the related art, cloud games display the game screen through a display device, and the game operation is performed through a control device (such as a mobile phone, a game controller, etc.). Taking the control device implemented as a mobile phone as an example, during the game, when there are pictures or clips that the user needs to record, it is usually necessary to switch the control device from the control interface to the image acquisition program to capture the picture.

[0004] However, the process of recording the above-mentioned pictures or clips is relatively cumbersome and requires the user to perform multiple steps to achieve it, resulting in low human-computer interaction efficiency. Summary of the invention

[0005] The embodiments of the present application provide a method, device, equipment and medium for collecting multimedia data in cloud games, which can improve the human-computer interaction efficiency of multimedia collection of cloud game screens. The technical solution is as follows:

[0006] In one aspect, a method for collecting multimedia data in a cloud game is provided, the method comprising:

[0007] Displaying a control interface of the cloud game, wherein the control interface includes control controls for controlling the cloud game, the control device and the display device have a communication connection relationship, and the cloud game screen of the cloud game is generated by the cloud game server and then sent to the display device for display;

[0008] Receiving a multimedia acquisition operation in the control interface, where the multimedia acquisition operation is used to instruct to acquire the cloud game screen;

[0009] In response to the multimedia acquisition operation, the multimedia data acquired based on the cloud game screen displayed on the display device is displayed.

[0010] On the other hand, a method for collecting multimedia data in a cloud game is provided, which is executed by a display device, and the method includes:

[0011] Displaying a cloud game screen of a cloud game, wherein the cloud game screen is a screen generated by a cloud game server and sent to the display device for display, a communication connection relationship is established between the display device and a control device, and the control device is used to control the cloud game;

[0012] In response to receiving a first acquisition signal sent by the control device, displaying a multimedia acquisition result, wherein the first acquisition signal is used to acquire multimedia data based on the cloud game screen;

[0013] In response to receiving a sending operation based on the multimedia acquisition result, the multimedia data is sent to the control device.

[0014] On the other hand, a method for collecting multimedia data in a cloud game is provided, which is executed by a cloud game server, and the method includes:

[0015] Sending screen data of a cloud game screen to a display device, the display device being used to display the cloud game screen based on the screen data, a communication connection relationship being established between the display device and a control device, the control device being used to control the cloud game;

[0016] In response to receiving a second acquisition signal, performing multimedia data acquisition based on the generated cloud game screen, wherein the second acquisition signal is used to instruct to acquire multimedia data;

[0017] The multimedia data is sent to the display device, where the display device is used to display the multimedia data and send the multimedia data to the control device.

[0018] In another aspect, a device for collecting multimedia data in a cloud game is provided, the device comprising:

[0019] A display module is used to display a control interface of the cloud game, wherein the control interface includes control controls for controlling the cloud game, the control device and the display device have a communication connection relationship, and the cloud game screen of the cloud game is generated by the cloud game server and then sent to the display device for display;

[0020] A receiving module, used to receive a multimedia acquisition operation in the control interface, where the multimedia acquisition operation is used to instruct to acquire the cloud game screen;

[0021] The display module is also used to display the multimedia data obtained by collecting the cloud game screen displayed on the display device in response to the multimedia collection operation.

[0022] In another aspect, a device for collecting multimedia data in a cloud game is provided, the device comprising:

[0023] A display module, used to display a cloud game screen of a cloud game, wherein the cloud game screen is a screen generated by a cloud game server and sent to the display device for display, and a communication connection relationship is established between the display device and a control device, and the control device is used to control the cloud game;

[0024] The display module is further used to display the multimedia acquisition result in response to receiving a first acquisition signal sent by the control device, wherein the first acquisition signal is used to acquire multimedia data based on the cloud game screen;

[0025] The sending module is used to send the multimedia data to the control device in response to receiving a sending operation based on the multimedia acquisition result.

[0026] In another aspect, a device for collecting multimedia data in a cloud game is provided, the device comprising:

[0027] A sending module, used for sending screen data of a cloud game screen to a display device, the display device is used for displaying the cloud game screen based on the screen data, a communication connection relationship is established between the display device and a control device, and the control device is used for controlling the cloud game;

[0028] a collection module, configured to collect multimedia data based on the generated cloud game screen in response to receiving a second collection signal, wherein the second collection signal is used to instruct to collect multimedia data;

[0029] The sending module is further used to send the multimedia data to the display device, and the display device is used to display the multimedia data and send the multimedia data to the control device.

[0030] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement a method for collecting multimedia data in a cloud game as described in any of the above-mentioned embodiments of the present application.

[0031] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, a code set or an instruction set is stored in the storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement a method for collecting multimedia data in a cloud game as described in any of the above-mentioned embodiments of the present application.

[0032] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for collecting multimedia data in a cloud game described in any of the above embodiments.

[0033] The beneficial effects brought by the technical solution provided in the embodiments of the present application include at least:

[0034] In the cloud gaming scenario, players can use multimedia acquisition operations to control the display device and the cloud gaming server to acquire multimedia data based on the displayed cloud gaming screen, thereby obtaining multimedia data on the control device, such as screenshots or recorded videos. This avoids the need for players to use a complex shooting process to hinder the progress of the cloud gaming and the problem of low human-computer interaction efficiency, thereby improving the efficiency of multimedia data acquisition and human-computer interaction efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0036] Figure 1 It is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;

[0037] Figure 2 is a flowchart of a method for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application;

[0038] Figure 3 is based on Figure 2 A schematic diagram of a control interface provided by the illustrated embodiment;

[0039] Figure 4 is based on Figure 2 A schematic diagram of displaying a data receiving pop-up window provided in the illustrated embodiment;

[0040] Figure 5 is a flowchart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0041] Figure 6 is based on Figure 5 A schematic diagram of establishing a connection between a display device and a control device provided in the illustrated embodiment;

[0042] Figure 7 is based on Figure 5 The illustrated embodiment provides a schematic diagram of performing wallpaper setting based on received multimedia data;

[0043] Figure 8 is a flowchart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0044] Fig. 9 is based on Figure 8 A schematic diagram of displaying multimedia acquisition results provided by the illustrated embodiment;

[0045] Fig.10 is based on Figure 8 A schematic diagram of a display control device list provided by the illustrated embodiment;

[0046] Fig.11 is a system flow chart of a method for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application;

[0047] Fig.12 is based on Fig.11 A schematic diagram of starting a cloud gaming application provided by the illustrated embodiment;

[0048] Fig.13 is an overall flow chart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0049] Fig.14 This is a structural block diagram of a device for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application;

[0050] Fig.15 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0051] Fig.16 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0052] Fig.17 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application;

[0053] Fig.18 It is a structural block diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation mode of the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0055] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is there any limitation on quantity and execution order.

[0056] During the operation of the cloud game, after the cloud server generates the cloud game screen, it sends the screen data of the cloud game screen to the display device for display. A connection relationship is established between the display device and the control device. The control device is used to operate and control the cloud game, such as: the control device is used to control the actions of the main virtual character in the cloud game. In some embodiments, the display device can be implemented as a device with a screen display function such as a TV, a tablet computer, a laptop computer, a mobile phone, and a car terminal, and the control device can be implemented as a device with a control function such as a handle and a mobile phone.

[0057] In this embodiment, the control device is implemented as a mobile phone, and the display device is implemented as a TV as an example for explanation. During the operation of cloud games, players usually have the need to record game screens or clips. For example, when a player triggers a highlight moment, there is usually a need to capture the highlight moment screen. In the related art, when there is a need to record game screens or clips, the player needs to switch the control interface of the control device to an image acquisition interface, such as a camera interface, so as to capture the highlight moment screen through the camera. However, the above-mentioned acquisition method is relatively cumbersome, and requires players to perform multiple steps such as exiting control, turning on the camera, and shooting to achieve it, and the human-computer interaction efficiency is low.

[0058] The present application provides a method for collecting multimedia data in cloud games. In a cloud game scenario, players control the operation of cloud games by operating control devices. When players need to record cloud game screens or clips, they can directly take screenshots or record screens of the cloud game screens by operating control devices, thereby improving the efficiency of human-computer interaction and avoiding complex operations during screenshots or recordings.

[0059] Figure 1 is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application, such as Figure 1As shown, the implementation environment includes: a display device 110, a control device 120 and a cloud server 130, the display device 110 and the cloud server 130 are connected via a communication network, and the control device 120 and the cloud server 130 are connected via a communication network.

[0060] The display device 110 can be implemented as a terminal device with a picture display function, such as a television, a tablet computer, a laptop computer, a mobile phone, a vehicle-mounted terminal, etc. A cloud game application is installed and run in the display device 110, and the cloud game application is used to provide a cloud game function.

[0061] Illustratively, the cloud gaming application can be implemented as a cross-terminal gaming platform for providing multiple cloud gaming portals; the cloud gaming application enables the terminal to launch multiple cloud games through the cloud gaming portal without downloading the games.

[0062] In the embodiment of the present application, the cloud game can be any one of a simulation program, a virtual reality (VR) game, an augmented reality (AR) game, a three-dimensional map game, a first-person shooter game (FPS), a third-person shooter game (TPS), a multiplayer online tactical competitive game, a strategy game (Simulation Game, SLG), etc.

[0063] The control device 120 can be implemented as a terminal device such as a smart handle, a smart keyboard, a tablet computer, a laptop computer, a mobile phone, a vehicle-mounted terminal, etc. A cloud game control program runs in the control device 120, and the cloud game control program is used to provide a control function for the cloud game application program.

[0064] Optionally, the cloud game control program can generate corresponding control instructions based on the operation of the physical buttons received on the control device 120; the control instructions are used to control the cloud game application on the display device 110; the cloud game control program can also generate corresponding control instructions based on the operation of the virtual control received on the control device 120; the control instructions are used to control the cloud game application on the display device 110. Among them, the virtual control is a function provided by the cloud game control program. Schematically, the cloud game control program provides a virtual control interface, receives the player's control operation on the virtual control interface, and thus controls the cloud game application on the display device 110.

[0065] In some embodiments, the control device 120 also provides a multimedia data (e.g., motion data and sound data) acquisition function. Optionally, the control device 120 includes a video acquisition device (e.g., a camera) and an audio acquisition device (e.g., a microphone). Schematically, the control device 120 acquires motion data through a video acquisition device and acquires sound data through an audio acquisition device. In some embodiments, the control device 120 can also acquire voice content through an audio acquisition device and convert the voice content into control instructions to control the cloud game.

[0066] In some embodiments, the control device 120 and the display device 110 may be connected via wired or wireless communication. For example, the display device 110 may be connected to the control device 120 via Bluetooth, Wireless Fidelity (WiFi), or other communication connection methods.

[0067] When the control device 120 and the display device 110 have established a communication connection, the data generated on the control device 120, such as the first behavior control instruction and activity data, can be sent by the control device 120 to the display device 110, and the display device 110 sends the data to the cloud server 130; or, in some embodiments, the control device 120 and the cloud server 130 have established a communication connection, and the control device 120 directly uploads the data to the cloud server 130.

[0068] In the embodiment of the present application, the display device 110 is used to display the game screen of the cloud game; the control device 120 is used to receive the game operation of the cloud game; and the cloud server 130 is used to provide data generation services for the game screen of the cloud game.

[0069] Schematically, taking the control of the master virtual object in the cloud game by the control device 120 as an example, after receiving the behavior control operation, the control device 120 sends the behavior control instruction to the display device 110, and the display device 110 sends the behavior control instruction to the cloud server 130; the cloud server 130 generates the action data of the master virtual object and the data of the virtual scene based on the behavior control instruction, obtains the picture data, and feeds back the picture data to the display device 110; after receiving the picture data, the display device 110 renders the picture data and displays on the screen that the master virtual object performs the virtual behavior in the cloud game.

[0070] In the embodiment of the present application, a multimedia acquisition function is also provided, taking the screenshot function as an example. The control interface of the control device 120 also includes a screenshot control. When a trigger operation on the screenshot control is received, the control device 120 sends a screenshot signal to the display device 110, and the display device 110 sends a screenshot signal to the cloud server 130, so that the cloud server 130 generates a screenshot image based on the currently generated cloud game screen, and sends the screenshot image to the display device 110, so that the display device 110 sends the screenshot image to the control device 120, and the control device 120 can perform downstream applications based on the screenshot image, such as: setting as wallpaper, sharing with friends, setting as chat background image, image editing, etc., which is not limited in this embodiment.

[0071] It is worth noting that the cloud server 130 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. The cloud server 130 can also provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0072] Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other series of resources in a wide area network or local area network to realize data calculation, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model application, which can form a resource pool, which is used on demand and flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the high development and application of the Internet industry, each item may have its own identification mark in the future, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately, and all kinds of industry data require strong system backing support, which can only be achieved through cloud computing. Optionally, the cloud server 130 can also be implemented as a node in the blockchain system.

[0073] It should be noted that before collecting relevant data of users and during the process of collecting relevant data of users, this application can display a prompt interface, pop-up window or output voice prompt information, and the prompt interface, pop-up window or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data collected by this application are collected with the consent and authorization of the user, and the collection, use and processing of relevant user data need to comply with the relevant laws, regulations and standards of the relevant regions.

[0074] In some embodiments, when a cloud gaming application is started, authorization information is displayed on the control terminal interface or the display terminal interface, expressing the collection of data, the detailed content of the data, and the application method of the data, etc., and data collection is performed after receiving the user's authorization.

[0075] Combined with the above-mentioned noun introduction and implementation environment description, the method for collecting multimedia data in the cloud game provided in the embodiment of the present application is described. Please refer to Figure 2 , which shows a flowchart of a method for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application, and takes the method applied to the above-mentioned control terminal as an example for explanation, such as Figure 2 As shown, the method includes:

[0076] Step 201, displaying a control interface for the cloud game, wherein the control interface includes control components for controlling the cloud game.

[0077] A communication connection is established between the control device and the display device. The cloud game screen of the cloud game is generated by the cloud game server and sent to the display device for display.

[0078] The above-mentioned cloud gaming refers to a gaming method based on cloud computing. In the cloud gaming operation mode, the game data is calculated in the cloud server, and the cloud server transmits the generated game screen to the terminal device (such as the display device in this application) through the network for display.

[0079] In some embodiments, a target application is installed in the display device, and a first account is logged in to the target application; a cloud game entrance is provided in the target application, and the cloud game entrance is used to trigger a game interface of the cloud game; optionally, in response to receiving a trigger operation on the cloud game entrance in the target application, a game interface of the cloud game is displayed, and the game interface includes a first virtual object.

[0080] The target application may be implemented as an independent application or as a small program that is parasitic on the host application.

[0081] In the embodiment of the present application, the display device is responsible for displaying the game screen, and the control device is responsible for the game operation.

[0082] The target application is started on the display device, and the cloud game is selected in the target application to start, so that the game interface of the cloud game is displayed. When a communication connection relationship is established between the control device and the display device, the control interface for controlling the cloud game is displayed on the control device. Among them, the control device that establishes a communication connection relationship with the display device can be one or more, and this embodiment does not limit this. In some embodiments, the number of control devices that establish a communication connection relationship with the display device is determined based on the game mode of the cloud game, or the number of control devices that establish a communication connection relationship with the display device is any number within a preset number range.

[0083] In some embodiments, the control interface is used to simulate the control mode of a game controller. Figure 3 As shown, it shows a schematic diagram of a control interface provided by an exemplary embodiment of the present application, in which the control interface 300 includes a joystick control 310, an operation control 320, etc. The control interface 300 also includes a selection control 330, a start control 340, a connection control 350 and a multimedia acquisition control 360.

[0084] The above controls are described in turn:

[0085] Joystick control 310: used to simulate the joystick module on the game controller. By controlling the joystick control 310, the game perspective of the cloud game can be adjusted, or the moving direction or facing direction of the main virtual object in the cloud game can be adjusted.

[0086] Operation controls 320: The control interface 300 includes a variety of different operation controls 320, which are used to implement different functions, such as: controlling the main control virtual object to jump, controlling the main control virtual object to release skills, controlling the exit of the program, etc.

[0087] Selection control 330: used to confirm the selection of an object selected by the cursor or other means in the cloud game, such as: after moving the cursor to the target object, further interaction with the target object is generated through the selection operation.

[0088] Start control 340: used to resume the operation of the cloud game when the process of the cloud game is suspended.

[0089] Connection control 350: used to disconnect the communication connection relationship established between the display device and the control device.

[0090] Multimedia acquisition control 360: used to take screenshots or record the cloud game screen displayed on the display device. Figure 3 The screenshot is taken as an example for explanation, and the screenshot control can also be implemented as a screen recording control, which is not limited in this embodiment.

[0091] It is worth noting that the above controls are merely illustrative examples, and the embodiments of the present application do not limit the types and quantities of controls displayed in the control interface.

[0092] In some embodiments, the control interface can be displayed on the screen of the control device in full screen, in the form of a floating window, or in the form of a split screen. This embodiment does not limit this.

[0093] Step 202: receiving a multimedia acquisition operation in a control interface.

[0094] The multimedia acquisition operation is used to instruct the acquisition of the cloud game screen. The multimedia acquisition operation is used to instruct the acquisition of the cloud game screen, or the multimedia acquisition operation is used to instruct the acquisition of the segment video of the cloud game screen, which is not limited in this embodiment.

[0095] In some embodiments, the multimedia acquisition operation can also determine the acquisition range in the cloud game screen. In an exemplary embodiment, after receiving the multimedia acquisition operation, a range selection box is displayed in the display device, and the image acquisition range of the cloud game screen is set by performing a control operation in the control device.

[0096] Schematically, a range selection box is displayed in a display device, and two diagonally related endpoints of the range selection box are displayed. First, the position of the first endpoint is adjusted using the joystick control of the handle. Then, the switch control is used to switch from the first endpoint to the second diagonally opposite endpoint, and the position of the second endpoint is adjusted using the joystick control. Based on the positions of the first endpoint and the second endpoint, the picture capture range of the cloud game screen is selected.

[0097] Alternatively, in another embodiment, a cursor is displayed in the cloud game screen of a display device, the starting position of the cursor is determined by a determination operation, and the cursor is controlled to draw in the cloud game screen by controlling a joystick control until the cursor position obtained by drawing coincides with the starting position, and the drawing path of the cursor is used as the boundary of the selection range, and the screen content within the boundary is used as the screen capture range of the cloud game screen.

[0098] In some embodiments, for the image data acquisition scenario, the control interface also includes a screenshot control, and a click operation on the screenshot control is received as a multimedia acquisition operation; or, a long press operation on the screenshot control is received in the control interface, and the long press of the screenshot control is maintained, the long press operation is used to trigger the display of a screenshot range box on the display device, the screenshot range box is used to control the screenshot range of the cloud game screen, and a trigger operation on the joystick control in the control interface is received, the trigger operation is used to adjust the selection range of the screenshot range box, and in response to the end of the long press operation on the screenshot control, the selection range of the screenshot range box is determined to be the screenshot range of the cloud game screen.

[0099] When the screenshot range frame is adjusted through the joystick control, the specified point in the cloud game screen is used as the frame selection center, and the specified ratio is used as the ratio of the screenshot range frame. The size of the screenshot range frame is adjusted by controlling the joystick control in different directions, such as: controlling the joystick control to the left joystick to enlarge the screenshot range frame, and controlling the joystick control to the right joystick to reduce the screenshot range frame. In some embodiments, the position of the frame selection center in the cloud game screen can also be adjusted through the position adjustment control in the control interface, or the aspect ratio of the screenshot range frame can be adjusted through the ratio adjustment control.

[0100] In some embodiments, the manner of receiving the multimedia acquisition operation includes at least one of the following.

[0101] First, the control interface includes a multimedia acquisition control, and a trigger operation on the multimedia acquisition control is received as a multimedia acquisition operation.

[0102] Second, a trigger operation on a preset physical button on the control device is received as a multimedia acquisition operation.

[0103] Third, receiving a trigger operation on a voice input control on a control device, and after the microphone is turned on, the voice input preset control instruction is used as a multimedia acquisition operation.

[0104] The above-mentioned triggering method of the multimedia acquisition operation is only an illustrative example, and this embodiment does not limit this.

[0105] Step 203, in response to the multimedia acquisition operation, displays the multimedia data acquired based on the cloud game screen displayed on the display device.

[0106] In some embodiments, in response to a multimedia acquisition operation, a first acquisition signal is sent to a display device, the first acquisition signal is used to indicate the acquisition of multimedia data, the display device is used to send a second acquisition signal to a cloud gaming server, and receive multimedia data sent by the cloud gaming server, and receive and display the multimedia data sent by the display device.

[0107] In some embodiments, since multimedia acquisition includes at least one of screenshot and screen recording, the multimedia acquisition operation includes at least one of the following situations:

[0108] The first type is that multimedia data includes image data corresponding to the cloud game screen.

[0109] In response to the screenshot image acquisition operation, a screenshot image acquisition signal is sent to the display device, and image data corresponding to the cloud game screen sent by the display device is received and displayed.

[0110] The second type of multimedia data includes screen recording data corresponding to the cloud game screen.

[0111] In response to the screen recording capture operation, a screen recording capture signal is sent to the display device; in response to the screen recording termination operation, a screen recording end signal is sent to the display device; the screen recording image corresponding to the cloud game screen sent by the display device is received and played, and the screen recording image is an image obtained by recording the cloud game screen between the screen recording capture signal and the screen recording end signal.

[0112] In some embodiments, in the screenshot scenario, in order to avoid delays in the capture results, after receiving the multimedia capture operation, the changes in the cloud game screen are paused, and the current display timestamp of the cloud game screen is stayed until the screenshot is completed.

[0113] In some embodiments, in response to a multimedia acquisition operation, a data reception pop-up window is displayed, the data reception pop-up window is used to prompt the reception of multimedia data, and in response to receiving a data reception operation in the data reception pop-up window, the multimedia data is displayed.

[0114] Indicative, such as Figure 4 As shown, a data receiving pop-up window 410 is displayed on the control interface of the control device, and the sender of the multimedia data, that is, the above-mentioned display device, is displayed in the data receiving pop-up window 410. The data receiving pop-up window 410 also includes a receiving control 411 and a rejecting control 412. However, when a trigger operation is received on the receiving control 411, the multimedia data received from the display device is displayed.

[0115] To sum up, the method for collecting multimedia data in cloud games provided in the embodiments of the present application, in a cloud game scenario, players can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, thereby obtaining multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that players need to use a complicated shooting process to shoot, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0116] The method provided in this embodiment, under the premise that the display device itself does not have the screenshot or screen recording function, sends a first acquisition signal to the display device, and the display device sends a second acquisition signal to the cloud game server. Through the feedback of the cloud game server, the control device can obtain the multimedia data of the cloud game, thereby improving the accuracy and success rate of obtaining the multimedia data.

[0117] The method provided in this embodiment, in response to the player's screenshot needs, sends a screenshot image acquisition signal from the control device to the display device, so that the cloud game screen is captured through the display device and the cloud game server to obtain image data corresponding to the cloud game screen, thereby improving the human-computer interaction efficiency of taking screenshots of the cloud game screen.

[0118] The method provided in this embodiment, in response to the player's screen recording needs, sends a screen recording acquisition signal and a screen recording end signal by the control device to the display device, so that the cloud game screen is recorded and collected through the display device and the cloud game server, and the screen recording data corresponding to the cloud game screen is obtained, thereby improving the human-computer interaction efficiency of recording the cloud game screen.

[0119] The method provided in this embodiment first displays a data receiving pop-up window before the control device receives multimedia data, and displays the multimedia data when a data receiving operation is received, thereby avoiding the waste of data transmission resources caused by selecting an incorrect control device on the display device to transmit multimedia data.

[0120] In some embodiments, after a communication connection relationship is first established between the control device and the display device, a control interface is displayed on the control device. Figure 5 A flowchart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application is shown, and the method is applied to the above-mentioned control terminal as an example for explanation. Figure 5 As shown, the method includes:

[0121] Step 501: display a scanning interface, where the scanning interface is used to scan a graphic identification code.

[0122] Optionally, the scanning interface is an interface displayed in the control program on the control device, and the control program can be an independent program or a small program parasitic on the host program. In some embodiments, when the control program is implemented as a small program, the scanning interface can be an interface in the control program or an interface in the host program. After scanning in the host program through the scanning interface, it can jump directly to the control program.

[0123] When the scanning interface is displayed, the image acquisition module of the control device, such as a camera, is turned on, and the image acquired by the image acquisition module is displayed in the scanning interface.

[0124] Step 502: In response to the scanned image including the graphic identification code content and the graphic identification code matching the display device, a communication connection relationship with the display device is established.

[0125] In some embodiments, the matching of the graphic identification code and the display device means that the graphic identification code is an identification code displayed on the interface of the display device.

[0126] Optionally, the control device and the display device meet a network access matching relationship, such as: the control device and the display device are in the same network environment, such as: accessing the same wifi, or the display device accesses a wireless access point (Access Point, AP) established by the control device.

[0127] In some embodiments, when launching a cloud gaming application on a display device, first determine whether the current display device is connected to a control device. When no control device is connected, display an access interface, which includes a graphic identification code. Optionally, the access interface also includes options for different types of control devices, such as options for mobile phones, controllers, keyboards, and mice. When the selected control device type is a mobile phone, the access interface also includes the network environment to which the current display device is connected.

[0128] In some embodiments, during the operation of the cloud gaming application, the access interface can also be triggered to be displayed through a connection control.

[0129] Indicative, such as Figure 6 As shown, an access interface 600 is displayed on the display device, which includes a graphic identification code 610 and information 620 of the wifi network to which the display device is currently connected; a scanning interface 630 is started on the control device, and after scanning the graphic identification code 610 through the scanning interface 630, a communication connection relationship is established between the display device and the control device.

[0130] Optionally, after the user scans the code to open the specified control program, the graphic identification code carries the Internet Protocol Address (IP address) of the socket service of the display device. The control program searches for the IP address and establishes a connection with the display device through webSocket. At the same time, the display device informs the cloud gaming server through a Hyper Text Transfer Protocol (HTTP) request that the user has started the cloud game, and the cloud gaming server can start rendering the game.

[0131] Step 503: Display the control interface of the cloud game, where the control interface includes control components for controlling the cloud game.

[0132] A communication connection is established between the control device and the display device. The cloud game screen of the cloud game is generated by the cloud game server and sent to the display device for display.

[0133] In the embodiment of the present application, the display device is responsible for displaying the game screen, and the control device is responsible for the game operation.

[0134] In some embodiments, the control interface can be displayed on the screen of the control device in full screen, in the form of a floating window, or in the form of a split screen. This embodiment does not limit this.

[0135] Step 504: receiving a multimedia acquisition operation in the control interface.

[0136] The multimedia acquisition operation is used to instruct the acquisition of the cloud game screen. The multimedia acquisition operation is used to instruct the acquisition of the cloud game screen, or the multimedia acquisition operation is used to instruct the acquisition of the segment video of the cloud game screen, which is not limited in this embodiment.

[0137] Step 505, in response to the multimedia acquisition operation, displays the multimedia data acquired based on the cloud game screen displayed on the display device.

[0138] In some embodiments, in response to a multimedia acquisition operation, a first acquisition signal is sent to a display device, the first acquisition signal is used to indicate the acquisition of multimedia data, the display device is used to send a second acquisition signal to a cloud gaming server, and receive multimedia data sent by the cloud gaming server, and receive and display the multimedia data sent by the display device.

[0139] Step 506: Display an application control for the multimedia data, where the application control is used to use the multimedia data.

[0140] Optionally, the application control is used to indicate downstream application of the multimedia data.

[0141] In some embodiments, when multimedia data is displayed, an application control is displayed, and the multimedia data is applied downstream; or, the multimedia data is displayed in the photo album of the control device, and the multimedia data is applied downstream based on the application control in the system photo album. In some embodiments, when a data receiving pop-up window is displayed, an application control is displayed in the data receiving pop-up window, thereby indicating that after receiving the multimedia data, the multimedia data is directly applied downstream.

[0142] Step 507: In response to receiving a trigger operation on the application control, display the application result of the multimedia data.

[0143] Optionally, the application of multimedia data includes at least one of the following situations:

[0144] 1. The application controls include wallpaper setting controls;

[0145] In response to receiving a trigger operation on a wallpaper setting control, a wallpaper setting interface is displayed, where the wallpaper setting interface is used to set the multimedia data as the wallpaper of the control device.

[0146] Indicative, such as Figure 7 As shown, after receiving multimedia data, the multimedia data 710 is displayed, and the wallpaper setting control 720 is displayed. When a trigger operation is received on the wallpaper setting control 720, the wallpaper setting interface 730 is displayed, and the details of the wallpaper setting can be adjusted in the wallpaper setting interface 730. In some embodiments, the wallpaper setting interface 730 is an interface provided by the system when setting wallpaper.

[0147] 2. The application controls include sharing controls;

[0148] In response to receiving a trigger operation on a sharing control, a social contact list corresponding to the social application is displayed, wherein the contact list includes contact accounts in the social application that have established an association relationship with a master control account; in response to receiving a selection operation on a first contact, multimedia data is sent to the first contact and the sending result is displayed.

[0149] The social application may be implemented as a host program of the control program, or as a program that establishes a calling relationship with the control program.

[0150] 3. The application control includes an edit control;

[0151] In response to receiving a trigger operation on the editing control, an editing interface corresponding to the multimedia editing program is displayed, and an editing operation on the multimedia data is received in the editing interface.

[0152] The editing interface may be an image editing interface or a video editing interface;

[0153] 4. The application controls include background setting controls;

[0154] In response to receiving a trigger operation on a background setting control, the multimedia data is set as an interface background image of the control interface.

[0155] Among them, when the multimedia data is a screenshot image, the screenshot image is used as a static background image of the control interface; when the multimedia data is a screen recording video, the screen recording video is used as a dynamic background image of the control interface, or, when the control interface does not receive a touch operation, any image frame or a specified image frame in the screen recording video is statically displayed as the background image; when a touch operation is received in the control interface, the dynamic screen recording video is displayed as the background screen.

[0156] It should be noted that the above application methods are merely illustrative examples, and this embodiment does not limit the application methods of multimedia data.

[0157] To sum up, the method for collecting multimedia data in cloud games provided in the embodiments of the present application, in a cloud game scenario, players can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, thereby obtaining multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that players need to use a complicated shooting process to shoot, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0158] The method provided in this embodiment performs downstream applications on received multimedia data through application controls, thereby improving the utilization rate and efficiency of the multimedia data.

[0159] The method provided in this embodiment quickly sets the received multimedia data as the wallpaper of the control device through the wallpaper setting control, thereby improving the efficiency of human-computer interaction and the convenience of wallpaper setting.

[0160] In some embodiments, the display device needs to receive a sending operation for multimedia acquisition results and send the multimedia data to the control device. Figure 8 A flowchart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application is shown, and the method is applied to the above-mentioned display terminal as an example for explanation. Figure 8 As shown, the method includes:

[0161] Step 801, display the cloud game screen of the cloud game.

[0162] Among them, the cloud game screen is the screen generated by the cloud game server and sent to the display device for display. A communication connection is established between the display device and the control device, and the control device is used to control the cloud game.

[0163] Step 802: Display multimedia acquisition results in response to receiving a first acquisition signal sent by a control device.

[0164] In some embodiments, the multimedia collection result is collected in at least one of the following ways:

[0165] 1. When the display device itself has the acquisition capability, the display device acquires the multimedia data and previews and displays the multimedia acquisition results;

[0166] 2. The display device sends a second acquisition signal to the cloud game server, instructing the cloud game server to collect multimedia data based on the currently generated cloud game screen. After the cloud game server collects the multimedia data, it sends the multimedia acquisition result to the display device and displays the multimedia acquisition result on the display device.

[0167] Indicative, such as Fig. 9 As shown, when the multimedia data collection is completed, the multimedia collection result 910 including the collected multimedia data is displayed on the display device. While displaying the multimedia collection result 910, a send control 920 and a cancel control 930 are displayed, and the send control 920 is used to send the multimedia data to the control device.

[0168] It is worth noting that in the above embodiments, the control device sends a first acquisition signal to the display device, and the display device sends a second acquisition signal to the cloud game server. In some embodiments, the control device can also directly send a multimedia acquisition signal to the cloud game server to collect multimedia data.

[0169] Step 803: In response to receiving a sending operation based on the multimedia acquisition result, sending multimedia data to the control device.

[0170] Illustratively, when a trigger operation on the sending control 920 is received, multimedia data is sent to the control device.

[0171] In some embodiments, when a communication connection relationship is established between the display device and multiple control devices, a list of control devices is displayed, and one or more control devices that need to receive the multimedia data are selected.

[0172] Indicative, such as Fig.10 As shown, the display device is connected to a control device 1010 , a control device 1020 and a control device 1030 , and when a selection operation is received on the control device 1010 , the multimedia data is sent to the control device 1010 .

[0173] In some embodiments, a check box is displayed in the position corresponding to the control device in the control device list. When the control device is checked, it is determined that the multimedia data needs to be sent to the control device. When multiple control devices are checked, the multimedia data needs to be sent to multiple control devices at the same time.

[0174] Optionally, the display device and the control device are connected via a communication network. Since the display device and the control device are in the same network environment, taking the display device and the control device being connected to the same WiFi network as an example, multimedia data are sent from the display device to the control device via the WiFi network.

[0175] To sum up, the method for collecting multimedia data in cloud games provided in the embodiments of the present application, in a cloud game scenario, players can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, thereby obtaining multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that players need to use a complicated shooting process to shoot, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0176] Fig.11 This is a system flow chart of a method for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application. Fig.11 As shown, the method includes:

[0177] Step 1101, the cloud game server sends the screen data of the cloud game screen to the display device.

[0178] In some embodiments, when the display device starts the cloud game and establishes a communication connection with the control device, it requests the cloud game server to render the cloud game screen, so that the cloud game server sends the screen data to the display device, and the display device displays the cloud game screen.

[0179] Optionally, the player first starts a cloud gaming application in the display device, where the cloud gaming application is one of the multiple cloud games integrated in the target application. Fig.12 As shown, the interface 1200 of the target application is displayed, including multiple cloud game options 1210. When a selection operation is received on the cloud game option 1210, the cloud game screen of the selected cloud game is obtained from the cloud game server. In some embodiments, a device management control 1220 is displayed in the interface 1200 of the target application, and the control device that has a communication connection relationship with the display device can be added or deleted through the device management control 1220.

[0180] Step 1102, the display device displays the cloud game screen of the cloud game.

[0181] The display device displays the cloud game screen based on the screen data sent by the cloud game server.

[0182] Step 1103, the control device displays the control interface of the cloud game.

[0183] After the control device establishes a communication connection with the display device, a control interface is displayed, and the control controls in the control interface are used to control the operation of the cloud game.

[0184] Step 1104: The control device receives a multimedia acquisition operation in the control interface.

[0185] Optionally, the control interface includes a multimedia acquisition control, and a trigger operation on the multimedia acquisition control is received as a multimedia acquisition operation.

[0186] Step 1105: The control device sends a first acquisition signal to the display device in response to the multimedia acquisition operation.

[0187] The first acquisition signal is used to indicate the acquisition of multimedia data, wherein the first acquisition signal can be implemented as a screenshot image acquisition signal, or can be implemented as a combination signal of a screen recording acquisition signal and a screen recording end signal.

[0188] Step 1106: In response to receiving the first acquisition signal sent by the control device, the display device sends a second acquisition signal to the cloud gaming server.

[0189] In some embodiments, the display device does not perform multimedia acquisition operations, and the cloud game server acquires multimedia data based on the generated cloud game screen data. Therefore, the display device sends a second acquisition signal to the cloud game server.

[0190] Step 1107: In response to receiving the second acquisition signal, the cloud game server acquires multimedia data based on the generated cloud game screen.

[0191] The second acquisition signal is used to instruct the cloud game server to acquire images or videos based on the currently generated cloud game screen.

[0192] Step 1108, the cloud gaming server sends multimedia data to the display device.

[0193] After collecting multimedia data, the cloud gaming server first feeds the multimedia data back to the display device.

[0194] Step 1109: The display device displays the multimedia collection result.

[0195] The display device displays the collection result of the multimedia data, and displays a sending control and a canceling control, and the sending control is used to determine whether the multimedia data is sent to the control device.

[0196] Step 1110 : In response to receiving a sending operation based on the multimedia acquisition result, the display device sends multimedia data to the control device.

[0197] When the display device is connected to multiple control devices, in response to receiving a sending operation based on the multimedia acquisition result, a control device list is displayed, and the control device list includes multiple control devices connected to the display device. In response to receiving a selection operation for a first control device, multimedia data is sent to the first control device.

[0198] Step 1111: The control device receives and displays the multimedia data sent by the display device.

[0199] Optionally, after the control device receives the multimedia data, it can use the multimedia data for downstream applications, such as: setting as wallpaper, setting as an avatar in a social program, setting as a chat background, editing / cutting, sharing with friends, etc.

[0200] To sum up, the method for collecting multimedia data in cloud games provided in the embodiments of the present application, in a cloud game scenario, players can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, thereby obtaining multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that players need to use a complicated shooting process to shoot, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0201] Fig.13 FIG. 1 is an overall flow chart of a method for collecting multimedia data in a cloud game provided by another exemplary embodiment of the present application. Fig.13 As shown, taking the display device implemented as a TV client and the control device implemented as a small program client on a mobile phone as an example, the method includes:

[0202] Step 1301: The user selects a specified game.

[0203] That is, the user selects the cloud game to be launched in the cloud game list.

[0204] Optionally, after the user starts the TV client, the TV client starts a socket service in the background as a server for mobile phone connection, waiting for subsequent mobile phone connection.

[0205] Step 1302: The TV client identifies whether a mobile phone is connected.

[0206] That is, the TV client determines whether there is a control device that can control the cloud game.

[0207] The user selects a designated game to start on the TV through the remote control. The TV client detects whether there is a mobile device connected to the current socket service. If so, the cloud game is started directly.

[0208] Step 1303, if the mobile phone is not connected, the TV client obtains the QR code link from the background and displays it on the interface for the mobile phone to scan.

[0209] If there is no mobile phone connected to the TV at present, the TV client obtains the link of the mini program client from the cloud game server to generate a QR code image, which is displayed on the interface and waits for the user to scan the code.

[0210] Step 1304: The user scans the code to open the mini program client, and the TV client starts the cloud game, and the cloud game server starts rendering the cloud game screen.

[0211] After the user scans the code to open the designated mini program client, the QR code will carry the IP address of the TV client's socket service. The mini program searches for the IP address through webSocket and establishes a connection with the TV client. At the same time, the TV client informs the server through HTTP requests that the user has started the game, and the server can start rendering the game.

[0212] Step 1305, the user clicks on the one-click screenshot on the mini program, and the mini program client sends the screenshot time to the TV client.

[0213] A "one-click screenshot" button is always displayed on the mini program client. When the user clicks the button, the mini program sends the screenshot event to the TV client through the socket. The client forwards the event to the cloud game server with the screenshot timestamp.

[0214] Step 1306: The TV client sends the screenshot event to the cloud game server.

[0215] Step 1307, the cloud gaming server captures the video frame of the current timestamp, generates a picture, and sends it to the TV client.

[0216] After receiving the screenshot event, the cloud gaming server captures the video frame at the screenshot timestamp, generates a screenshot, and sends the screenshot to the TV client.

[0217] Step 1308: After receiving the picture, the TV client pops up a dialog box with the picture as the background for the user to choose whether to send it to the mobile phone.

[0218] After the TV client receives the screenshot, a pop-up window will pop up to ask the user whether to send it to the mobile app, and use the picture as the background picture of the pop-up window. If the user chooses no, the subsequent steps will be terminated directly.

[0219] Step 1309: If the data needs to be sent to a mobile phone, the TV client displays a list of currently connected mobile phones.

[0220] When the user chooses to send to a mobile phone, the TV client needs to detect the list of mobile phones currently connected to its own socket service through socket, and let the user select the designated mobile phone to be sent. After the user selects the designated mobile phone, the TV client sends the picture to the designated mobile phone through socket.

[0221] Step 1310, the user selects a designated mobile phone, the TV client sends the picture to the designated mobile phone, the mini program receives the picture, and asks whether to accept it.

[0222] Step 1311, after receiving the picture, the user uses the wallpaper setting function provided by the mobile phone system to set the picture as the wallpaper of the mobile phone system.

[0223] After the mobile phone receives the picture, it asks the user whether he needs to accept the picture. After the user accepts it, the mini program saves the picture in its own application directory and displays an interface, providing a button to ask the user whether he needs to set it as wallpaper. If the user chooses yes, the mini program calls the system's application programming interface (Application Programming Interface, API) to set it as wallpaper.

[0224] Optionally, the applet will call the API of the album to store the wallpaper in the system album, and the user can share the wallpaper to a third-party application as needed, such as an instant messaging application.

[0225] In order to reduce the number of user operation steps, the button for receiving pictures can be changed to "Receive and set as wallpaper". After the user clicks to confirm, the mini program receives the picture and stores it in the album. At the same time, it calls the system's wallpaper setting interface to directly set it as the system wallpaper. The user no longer needs to actively open the system album and manually set it as wallpaper.

[0226] To sum up, the method for collecting multimedia data in cloud games provided in the embodiments of the present application, in a cloud game scenario, players can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, thereby obtaining multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that players need to use a complicated shooting process to shoot, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0227] Fig.14 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application, such as Fig.14 As shown, the device comprises:

[0228] Display module 1410, used to display the control interface of the cloud game, the control interface includes control controls for controlling the cloud game, the control device and the display device establish a communication connection relationship, and the cloud game screen of the cloud game is generated by the cloud game server and sent to the display device for display;

[0229] A receiving module 1420, configured to receive a multimedia acquisition operation in the control interface, wherein the multimedia acquisition operation is used to instruct to acquire the cloud game screen;

[0230] The display module 1410 is further used to display the multimedia data obtained by collecting the cloud game screen displayed on the display device in response to the multimedia collection operation.

[0231] In an optional embodiment, if Fig.15 As shown, the device further includes:

[0232] A sending module 1430 is used to send a first acquisition signal to the display device in response to the multimedia acquisition operation, wherein the first acquisition signal is used to instruct to collect the multimedia data, and the display device is used to send a second acquisition signal to the cloud game server and receive the multimedia data sent by the cloud game server;

[0233] The receiving module 1420 is further configured to receive and display the multimedia data sent by the display device.

[0234] In an optional embodiment, the multimedia data includes image data corresponding to the cloud game screen;

[0235] The sending module 1430 is further configured to send a screenshot image acquisition signal to the display device in response to a screenshot image acquisition operation;

[0236] The receiving module 1420 is also used to receive and display image data corresponding to the cloud game screen sent by the display device.

[0237] In an optional embodiment, the multimedia data includes screen recording data corresponding to the cloud game screen;

[0238] The sending module 1430 is further configured to send a screen recording acquisition signal to the display device in response to a screen recording acquisition operation; and send a screen recording end signal to the display device in response to a screen recording termination operation;

[0239] The receiving module 1420 is also used to receive and play the screen recording image corresponding to the cloud game screen sent by the display device, and the screen recording image is an image obtained by recording the cloud game screen between the screen recording acquisition signal and the screen recording end signal.

[0240] In an optional embodiment, the multimedia data includes image data corresponding to the cloud game screen;

[0241] The receiving module 1420 is further configured to receive a click operation on a screenshot control in the control interface as the multimedia acquisition operation; or

[0242] The receiving module 1420 is further used to receive a long press operation on the screenshot control in the control interface, the long press operation is used to trigger the display of a screenshot range box on the display device, and the screenshot range box is used to control the screenshot range of the cloud game screen; receive a trigger operation on the joystick control in the control interface, the trigger operation is used to adjust the selection range of the screenshot range box; in response to the end of the long press operation on the screenshot control, determine the selection range of the screenshot range box as the screenshot range of the cloud game screen.

[0243] In an optional embodiment, the display module 1410 is further used to display a data receiving pop-up window in response to the multimedia acquisition operation, and the data receiving pop-up window is used to prompt the reception of the multimedia data;

[0244] The display module 1410 is further configured to display the multimedia data in response to a data receiving operation received in the data receiving pop-up window.

[0245] In an optional embodiment, the display module 1410 is further used to display an application control for the multimedia data, and the application control is used to use the multimedia data;

[0246] The display module 1410 is further configured to display an application result interface of the multimedia data in response to receiving a trigger operation on the application control.

[0247] In an optional embodiment, the application control includes a wallpaper setting control;

[0248] The display module 1410 is further configured to display a wallpaper setting interface in response to receiving a trigger operation on the wallpaper setting control, wherein the wallpaper setting interface is configured to set the multimedia data as the wallpaper of the control device.

[0249] In an optional embodiment, the application control includes a sharing control;

[0250] The display module 1410 is further configured to display a social contact list corresponding to the social application in response to receiving a trigger operation on the sharing control, wherein the contact list includes contact accounts in the social application that have established an association relationship with the master account;

[0251] The display module 1410 is further configured to, in response to receiving a selection operation on a first contact, send the multimedia data to the first contact and display a sending result.

[0252] In an optional embodiment, the application control includes a background setting control;

[0253] The display module 1410 is further configured to set the multimedia data as an interface background image of the control interface in response to receiving a triggering operation on the background setting control.

[0254] In an optional embodiment, the display module 1410 is further used to display a scanning interface, and the scanning interface is used to scan the graphic identification code;

[0255] The display module 1410 is also used to establish the communication connection relationship with the display device in response to the scanned image including graphic identification code content, and the graphic identification code matches the display device, wherein the control device and the display device have a network access matching relationship.

[0256] Fig.16 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application, such as Fig.16 As shown, the device comprises:

[0257] The display module 1610 is used to display the cloud game screen of the cloud game. The cloud game screen is a screen generated by the cloud game server and sent to the display device for display. A communication connection relationship is established between the display device and the control device, and the control device is used to control the cloud game;

[0258] The display module 1610 is further configured to display multimedia acquisition results in response to receiving a first acquisition signal sent by the control device, wherein the first acquisition signal is used to acquire multimedia data based on the cloud game screen;

[0259] The sending module 1620 is configured to send the multimedia data to the control device in response to receiving a sending operation based on the multimedia acquisition result.

[0260] Fig.17 is a structural block diagram of a device for collecting multimedia data in a cloud game provided by an exemplary embodiment of the present application, such as Fig.17 As shown, the device comprises:

[0261] A sending module 1710 is used to send screen data of a cloud game screen to a display device, wherein the display device is used to display the cloud game screen based on the screen data, and a communication connection relationship is established between the display device and a control device, and the control device is used to control the cloud game;

[0262] A collection module 1720, configured to collect multimedia data based on the generated cloud game screen in response to receiving a second collection signal, wherein the second collection signal is used to instruct to collect multimedia data;

[0263] The sending module 1710 is further configured to send the multimedia data to the display device, and the display device is configured to display the multimedia data and send the multimedia data to the control device.

[0264] To sum up, the multimedia data collection device in the cloud game provided by the embodiment of the present application, in the cloud game scenario, the player can control the display device and the cloud game server through multimedia collection operations to collect multimedia data based on the displayed cloud game screen, so as to obtain multimedia data on the control device, such as: screenshot images or screen recording videos, thereby avoiding the problem that the player needs to shoot through a complicated shooting process, which hinders the cloud game process and the low efficiency of human-computer interaction, thereby improving the efficiency of multimedia data collection and the efficiency of human-computer interaction.

[0265] It should be noted that the device for collecting multimedia data in cloud games provided in the above embodiments is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the device for collecting multimedia data in cloud games provided in the above embodiments and the embodiment of the method for collecting multimedia data in cloud games belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0266] Fig.18 The block diagram of a computer device 1800 provided by an exemplary embodiment of the present application is shown. The computer device 1800 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer IV) player, a laptop computer or a desktop computer. The computer device 1800 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0267] Typically, the computer device 1800 includes a processor 1801 and a memory 1802 .

[0268] The processor 1801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1801 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1801 may also include an AI processor, which is used to process computing operations related to machine learning.

[0269] The memory 1802 may include one or more computer-readable storage media, which may be non-transitory. The memory 1802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1802 is used to store at least one instruction, which is executed by the processor 1801 to implement the method for collecting multimedia data in the cloud game provided in the method embodiment of the present application.

[0270] In some embodiments, the computer device 1800 further includes other components, which can be understood by those skilled in the art. Fig.18 The structure shown in the figure does not constitute a limitation on the terminal 1800, and the terminal 1800 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0271] Optionally, the computer readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid state drive (SSD), or an optical disk. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM). The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0272] An embodiment of the present application also provides a computer device, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the method for collecting multimedia data in a cloud game as described in any of the above embodiments of the present application.

[0273] An embodiment of the present application also provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set or an instruction set is stored. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement a method for collecting multimedia data in a cloud game as described in any of the above embodiments of the present application.

[0274] The embodiment of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method for collecting multimedia data in a cloud game described in any of the above embodiments.

[0275] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0276] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for collecting multimedia data in a cloud game, characterized in that: Executed by a control device, the method includes: Displaying a control interface of the cloud game, wherein the control interface includes control controls for controlling the cloud game, the control device and the display device have a communication connection relationship, and the cloud game screen of the cloud game is generated by the cloud game server and then sent to the display device for display; Receiving a multimedia acquisition operation in the control interface, where the multimedia acquisition operation is used to instruct to acquire the cloud game screen; In response to the multimedia acquisition operation, the multimedia data acquired based on the cloud game screen displayed on the display device is displayed.

2. The method according to claim 1, characterized in that The step of displaying the multimedia data acquired based on the cloud game screen displayed on the display device in response to the multimedia acquisition operation includes: In response to the multimedia acquisition operation, a first acquisition signal is sent to the display device, wherein the first acquisition signal is used to instruct to acquire the multimedia data, and the display device is used to send a second acquisition signal to the cloud game server and receive the multimedia data sent by the cloud game server; The multimedia data sent by the display device is received and displayed.

3. The method according to claim 2, characterized in that The multimedia data includes image data corresponding to the cloud game screen; The step of sending a first acquisition signal to the display device in response to the multimedia acquisition operation includes: In response to the screenshot image acquisition operation, sending a screenshot image acquisition signal to the display device; The receiving and displaying the multimedia data sent by the display device includes: Receive and display image data corresponding to the cloud game screen sent by the display device.

4. The method according to claim 2, characterized in that: The multimedia data includes screen recording data corresponding to the cloud game screen; The step of sending a first acquisition signal to the display device in response to the multimedia acquisition operation includes: In response to the screen recording and collecting operation, sending a screen recording and collecting signal to the display device; In response to the screen recording termination operation, sending a screen recording end signal to the display device; The receiving and displaying the multimedia data sent by the display device includes: Receive and play the screen recording image corresponding to the cloud game screen sent by the display device, wherein the screen recording image is an image obtained by recording the cloud game screen between the screen recording acquisition signal and the screen recording end signal.

5. The method according to any one of claims 1 to 4, characterized in that: The multimedia data includes image data corresponding to the cloud game screen; The multimedia acquisition operation received in the control interface includes: receiving a click operation on a screenshot control in the control interface as the multimedia acquisition operation; or, Receive a long press operation on the screenshot control in the control interface, the long press operation is used to trigger display of a screenshot range box on the display device, and the screenshot range box is used to control the screenshot range of the cloud game screen; receive a trigger operation on the joystick control in the control interface, the trigger operation is used to adjust the selection range of the screenshot range box; in response to the end of the long press operation on the screenshot control, determine the selection range of the screenshot range box as the screenshot range of the cloud game screen.

6. The method according to any one of claims 1 to 4, characterized in that: The step of displaying the multimedia data acquired based on the cloud game screen displayed on the display device in response to the multimedia acquisition operation includes: In response to the multimedia acquisition operation, displaying a data receiving pop-up window, wherein the data receiving pop-up window is used to prompt the reception of the multimedia data; In response to receiving a data receiving operation in the data receiving pop-up window, displaying the multimedia data.

7. The method according to any one of claims 1 to 4, characterized in that: After the multimedia data obtained by collecting the cloud game screen displayed on the display device is displayed in response to the multimedia collection operation, the method further includes: For the multimedia data display application control, the application control is used to use the multimedia data; In response to receiving a trigger operation on the application control, an application result interface of the multimedia data is displayed.

8. The method according to claim 7, characterized in that The application controls include wallpaper setting controls; The step of displaying the application result interface of the multimedia data in response to receiving the trigger operation on the application control comprises: In response to receiving a trigger operation on the wallpaper setting control, a wallpaper setting interface is displayed, where the wallpaper setting interface is used to set the multimedia data as the wallpaper of the control device.

9. The method according to claim 7, characterized in that: The application controls include sharing controls; The step of displaying the application result interface of the multimedia data in response to receiving the trigger operation on the application control comprises: In response to receiving a trigger operation on the sharing control, displaying a social contact list corresponding to the social application, the contact list including contact accounts in the social application that have established an association relationship with the master account; In response to receiving a selection operation on a first contact, the multimedia data is sent to the first contact and a sending result is displayed.

10. The method according to claim 7, characterized in that The application controls include a background setting control; The step of displaying the application result interface of the multimedia data in response to receiving the trigger operation on the application control comprises: In response to receiving a trigger operation on the background setting control, the multimedia data is set as an interface background image of the control interface.

11. The method according to any one of claims 1 to 4, characterized in that: Before displaying the control interface of the cloud game, the method further includes: Display a scanning interface, wherein the scanning interface is used to scan the graphic identification code; In response to the scanned image including graphic identification code content, and the graphic identification code matches the display device, the communication connection relationship with the display device is established, wherein the control device and the display device are in a network access matching relationship.

12. A method for collecting multimedia data in a cloud game, characterized in that: The method is performed by a display device and includes: Displaying a cloud game screen of a cloud game, wherein the cloud game screen is a screen generated by a cloud game server and sent to the display device for display, a communication connection relationship is established between the display device and a control device, and the control device is used to control the cloud game; In response to receiving a first acquisition signal sent by the control device, displaying a multimedia acquisition result, wherein the first acquisition signal is used to acquire multimedia data based on the cloud game screen; In response to receiving a sending operation based on the multimedia acquisition result, the multimedia data is sent to the control device.

13. A method for collecting multimedia data in a cloud game, characterized in that: Executed by a cloud gaming server, the method includes: Sending screen data of a cloud game screen to a display device, the display device being used to display the cloud game screen based on the screen data, a communication connection relationship being established between the display device and a control device, the control device being used to control the cloud game; In response to receiving a second acquisition signal, performing multimedia data acquisition based on the generated cloud game screen, wherein the second acquisition signal is used to instruct to acquire multimedia data; The multimedia data is sent to the display device, where the display device is used to display the multimedia data and send the multimedia data to the control device.

14. A device for collecting multimedia data in a cloud game, characterized in that: The device comprises: A display module is used to display a control interface of the cloud game, wherein the control interface includes control controls for controlling the cloud game, the control device and the display device have a communication connection relationship, and the cloud game screen of the cloud game is generated by the cloud game server and sent to the display device for display; A receiving module, used to receive a multimedia acquisition operation in the control interface, where the multimedia acquisition operation is used to instruct to acquire the cloud game screen; The display module is also used to display the multimedia data obtained by collecting the cloud game screen displayed on the display device in response to the multimedia collection operation.

15. A device for collecting multimedia data in a cloud game, characterized in that: The device comprises: A display module, used to display a cloud game screen of a cloud game, wherein the cloud game screen is a screen generated by a cloud game server and sent to the display device for display, and a communication connection relationship is established between the display device and a control device, and the control device is used to control the cloud game; The display module is further used to display the multimedia acquisition result in response to receiving a first acquisition signal sent by the control device, wherein the first acquisition signal is used to acquire multimedia data based on the cloud game screen; The sending module is used to send the multimedia data to the control device in response to receiving a sending operation based on the multimedia acquisition result.

16. A device for collecting multimedia data in a cloud game, characterized in that: The device comprises: A sending module, used for sending screen data of a cloud game screen to a display device, the display device is used for displaying the cloud game screen based on the screen data, a communication connection relationship is established between the display device and a control device, and the control device is used for controlling the cloud game; a collection module, configured to collect multimedia data based on the generated cloud game screen in response to receiving a second collection signal, wherein the second collection signal is used to instruct to collect multimedia data; The sending module is further used to send the multimedia data to the display device, and the display device is used to display the multimedia data and send the multimedia data to the control device.

17. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method for collecting multimedia data in a cloud game as described in any one of claims 1 to 13.

18. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method for collecting multimedia data in a cloud game as described in any one of claims 1 to 13.

19. A computer program product, characterized in that It includes a computer program or an instruction, which, when executed by a processor, implements the method for collecting multimedia data in a cloud game as described in any one of claims 1 to 13.