Screen recording method and device

[0031] For ease of understanding, the following describes the application architecture of the screen recording method of the present invention:

[0032] Application program: refers to software written for a certain application purpose for users. In Windows system, the file name is generally *.exe. The file name is generally *.app under Apple operating system (ie Mac OS X) or Android (Android) system. The application program may provide a plug-in interface for plug-in access. The architecture of the application and screen recording plug-in can be as follows figure 2 As shown, when a screen recording plug-in is set in the application, the application can call the screen recording plug-in to perform the screen recording function.

[0033] Software Development Kit (SDK): refers to a platform for managing plug-ins, mainly responsible for plug-in download, installation, update and initialization. The application can provide multiple plug-in interfaces through the SDK, and communicate with the plug-ins through the SDK. For example, the application can provide various plug-in interfaces such as screen recording plug-in, button plug-in or sound effect plug-in through SDK, such as image 3 Shown.

[0034] Screen recording plug-in: refers to a plug-in that can perform screen recording functions, and can realize screen recording, editing and other functions. Plug-in (Plug-in) is a program written in accordance with a certain standard application program interface. It can only run under the system platform specified by the application (may support multiple platforms at the same time), and cannot run separately from the specified platform. Plug-ins are also called addin, add-in, addon or add-on, and can also be called plug-ins.

[0035] The following takes the application architecture of the application, SDK, and plug-in as an example. The application uses the game application as an example to introduce the communication principle of the game application, SDK and plug-in:

[0036] Figure 4 It is a schematic diagram of the communication framework between game applications and SDK.

[0037] The game and basic App of the Cocos2d engine communicate directly with the java interface of the SDK (such as QmiSDKApi.java) by calling the java file interface. The Cocos2d engine can also be called the Cocos2d-x engine.

[0038] The game of U3d engine needs to call SDK interface through c# file. U3d engine provides JavaClass (such as AndroidJavaClass) through GameJoy.cs component to map Java class to SDK interface. The U3d engine can also be called the Unity3d engine.

[0039] Figure 5 Schematic diagram of the communication framework between SDK and plug-in.

[0040] 1. The plug-in includes class files, dynamic link library (so) files, component package (jar) file resource files and four major components. In Android, the four major components include activity components, service components, content provider components, and broadcast receiver components.

[0041] 2. The SDK generates a screen recording plug-in instance through the plug-in configuration file reflection, and then communicates with the plug-in through the write and read functions in the plug-in command component (PluginCommander). Among them, the plug-in configuration file includes (class information, plug-in version number, etc.).

[0042] Image 6 Schematic diagram of the screen recording plugin:

[0043] The screen recording plugin includes a screen recording module, a user interface (UI) module, and a video sharing module.

[0044] 1. The screen recording mode can include root recording mode, game engine recording mode and Android 5.0 recording mode.

[0045] The following is a brief introduction to the process of obtaining image data streams in each mode:

[0046] (1) Root recording mode: After obtaining root permission, the terminal can read the designated memory of the device, obtain the image data stored in it, and then convert the obtained image data into RGB format images. The designated memory generally refers to the fb0 image data memory.

[0047] (2) Game engine recording mode: U3d engine recording and Cocos2d engine recording.

[0048] In the U3d engine recording mode, the terminal obtains the image data through the Camera, and then re-renders the image data (CameraRender).

[0049] In the recording mode of the Cocos2d engine, after the terminal acquires the image data, it renders the acquired image (RenderScene) through the visit method.

[0050] (3) Android5.0 recording mode: call the MediaProjection class function to create an event for obtaining image data, and then capture the current screen image through the VirtualDisplay function, and then render the image to the Surface of MediaCodec.

[0051] The image data stream is obtained through the above three methods and then encoded and synthesized to generate a video file.

[0052] 2. The UI interface includes advanced floating windows and normal windows.

[0053] Advanced floating windows can be displayed on all interfaces of the application to prevent being blocked. It does not depend on the life cycle of the application, has a low degree of integration with the application, and has a strong overall effect. The floating window can be a full-screen window or an adaptive window. The adaptive form can be a movable form or a static form.

[0054] The normal form depends on the life cycle of the application and can be the Fragment control in the FragmentActivity component. When the application ends, the normal form also disappears. It has a high degree of integration with applications and is suitable for local interface layout. The life cycle of a normal window is short, and the current state needs to be saved at an appropriate time for the next restoration.

[0055] 3. The screen recording plug-in can also include a video sharing module. Through the video sharing module, you can share the recorded video to instant messaging software (such as WeChat, QQ), Weibo (such as Tencent Weibo), blog (such as Qzone), etc., so that more wonderful videos can be shared with your friends .

[0056] Based on the above application architecture, the present invention provides a screen recording method, and the specific implementation process of the method can refer to the following embodiments. See Figure 7 , An embodiment of the screen recording method provided by the present invention includes:

[0057] Step 701: The terminal obtains application data of the application program.

[0058] In this embodiment, the application data may be application scenario information, character information, or event information, and may also be item information or other types of application data, which is not limited here.

[0059] Step 702: During the running period of the application program, the terminal collects screen image data by using the screen recording plug-in built in the application program.

[0060] The application running period refers to the period from the start of the application to the closing of the application. It can be understood that the time period during which the terminal collects screen image data may be all or part of the application program running time period.

[0061] The terminal uses the screen recording plug-in to collect screen image data in the following ways:

[0062] In an optional embodiment, when the operating system version of the application is Andriod 5.0 or later, the terminal can call the MediaProjection class function to create an image data acquisition event, capture the current screen image through the VirtualDisplay function, and then capture the image data obtained Save it.

[0063] In another optional embodiment, when the application type is a game application and the game engine type is a U3D engine, the terminal can create a camera in the application, use the camera to obtain image data, and then convert the obtained image data Perform rendering.

[0064] In another optional embodiment, when the application type is a game application and the game engine type is a Cocos2d engine, the terminal may render the image data through the visit method after acquiring the image data.

[0065] In another optional embodiment, when the application type is a non-game application, the terminal can obtain the root authority of the system, read the image data from the memory (such as the FrameBuffer file) storing the image data, and then convert it to RGB format Image. The path of FrameBuffer is generally /dev/graphics/fb0.

[0066] Step 703: In the application running period, the terminal selects at least one period in which the application data is consistent with the preset application data, and uses the selected period as the target period.

[0067] Step 703 can be specifically implemented in the following implementation manners:

[0068] In an optional embodiment, the application data is scene information. The terminal may select a time period when the scene information is the same as the preset scene information as the target time period. The scene information includes the location, time, objects or obstacles set in the application. For example, when the application is a simulated reality game, the scene information can be city A in the game or a store or pub in city A, or it can be noon or evening, etc. Due to space limitations, it is difficult to list them all. There is no limitation here.

[0069] When the application is running, the scene information can change with changes in real time. When the scene information in the application program changes to the preset scene information, the terminal can record the above-mentioned time. When the scene information in the application program and the preset scene information change from the same to different, the terminal can also record the above-mentioned time to obtain the scene The information is the same time period as the preset scene.

[0070] For example, the scenes of the application program include a first scene, a second scene, a third scene, and a fourth scene, and the predetermined scene information is the third scene. When the application program ends the second scene and enters the third scene, the terminal records the actual time t1 from the second scene to the third scene. When the application program ends the third scene and enters the fourth scene, the terminal records the entry from the third scene At the actual time t2 of the fourth scene, the obtained target time period is t1 to t2.

[0071] In another optional embodiment, the application data is event information. The terminal may select a time period when the event information is the same as the preset event information as the target time period. The preset event information may be event information generated by the character in the application scenario under preset conditions, and generally occurs in a special event. For example, combos, a single skill combination is a continuous skill, defeating multiple characters in less than a predetermined time, etc., can also be other event information, which is not limited here.

[0072] For example, the default event information is double kill. When a double kill is generated when the application is running, the terminal can record the corresponding time t3, and when the double kill is not displayed, the terminal can record the corresponding time t4, so that the target time period is t3 to t4.

[0073] In another optional embodiment, the application data is role information. The terminal may select a time period when the role information is the same as the preset role information as the target time period. The role information refers to the role attributes set in the application, such as role name, role gender, role shape, or other role attributes (such as role camp, role skills), etc.

[0074] For example, the application program can set monster A as the default role in the program. When monster A appears in the application, the terminal records the corresponding time t5. When monster A is defeated and disappears, the terminal can also record the corresponding time t6, and the target time period is t5 to t6.

[0075] It should be noted that the application program can preset one or more application data, or combine the above preset application data, and then determine multiple time periods according to the preset application data.

[0076] Step 704: The terminal generates a video file according to the screen image data collected in the target period.

[0077] After the terminal determines the target time period, it selects the screen image data corresponding to the target time period from the collected screen image data to generate a video file.

[0078] In this embodiment, the terminal can realize the automatic screen recording function through preset application data. Moreover, the generated video files are very streamlined and occupy very little storage space.

[0079] Secondly, since the terminal can start screen recording much faster than manually, it can improve the accuracy of screen recording.

[0080] Third, the screen recording plug-in is a separable functional module of the application, and its screen recording function can be customized by the developer to facilitate adding, deleting or updating the screen recording function.

[0081] It should be noted that the screen recording plug-in can access the application through the plug-in interface provided by the application, or through the SDK. The terminal can directly start the screen recording plug-in or send a prompt message to the user, and the user decides whether to start the screen recording plug-in. For example, the terminal displays a prompt window, which may be a floating window or a message control built into the application. The prompt window includes controls for receiving screen recording instructions, and may also include prompt messages. For example, when the application is started, the terminal can display a prompt message to prompt the user to start the screen recording plug-in. At this time, the terminal can control the screen recording plug-in according to the screen recording instruction input by the user. It can be seen that in addition to automatically collecting image data, the terminal in the embodiment of the present invention may also collect image data according to user operations. For details, please refer to the following embodiments.

[0082] based on Figure 7 In the illustrated embodiment, in another optional embodiment of the present invention, the screen recording method of the present invention further includes: during the application running period, the terminal receives a screen recording start instruction, and starts the built-in recording of the application according to the screen recording start instruction. Screen plug-in, the terminal receives the screen recording stop instruction, and stops the built-in screen recording plug-in of the application according to the screen recording stop instruction; selects the time period when the application data is consistent with the preset application data during the period from when the screen recording plug-in is started to when the screen recording plug-in is stopped. Generate video files based on the screen image data collected in the selected time period.

[0083] In this embodiment, the user can start or stop the screen recording function to realize autonomous control of the screen recording. In this way, in the application running time period, the user can arbitrarily select one or more time periods to record the screen. In this way, the terminal can realize automatic screen recording or manual screen recording through the screen recording plug-in, which improves the flexibility of the implementation of the screen recording method.

[0084] based on Figure 7 In the illustrated embodiment, in another optional embodiment of the present invention, before step 702, the screen recording method of the present invention further includes: the terminal sends a request for acquiring the screen recording plug-in to the server; receiving the screen recording plug-in sent by the server; Screen plug-in for initial settings.

[0085] In this embodiment, when the terminal starts the application, if the screen recording plug-in is not detected in the application, the terminal can send a request for obtaining the screen recording plug-in to the server, obtain the screen recording plug-in from the server, and store the screen recording plug-in in the designated folder And initialize it, such as Figure 8 Shown.

[0086] It should be noted that, if the specified screen recording plug-in is not detected in the application, the terminal may also send a request for obtaining the screen recording plug-in to the server, and download the specified screen recording plug-in from the server. The specified screen recording plug-in can be a plug-in of a specific version.

[0087] According to the video files provided in the above embodiments, it is difficult for users to obtain information before the event occurs. However, in practical applications, users usually also want to know the information before the event. The present invention provides a screen recording method that can obtain information before an event occurs. For details, refer to the following embodiments. See Picture 9 , Another embodiment of the screen recording method of the present invention includes:

[0088] Steps 901 to 903 are similar to steps 701 to 703, and will not be repeated here.

[0089] Step 904: The terminal determines the advance period according to the preset advance period and the target period.

[0090] Step 905: The terminal generates a video file according to the screen image data collected in the advance period and the screen image data collected in the target period.

[0091] In this embodiment, the terminal can set a preset advance time that can be 1 second, 2 seconds, 3 seconds, 30 seconds, 1 minute, or 10 minutes, etc., which can be set according to actual conditions and is not limited here. The elapsed time from the start time of the advance period to the start time of the target period is the preset advance period, and the end time of the advance period is the start time of the target period.

[0092] For example, the target time period is t1~t2, and the advance time is 2 seconds. The terminal can determine t3 according to t1~t2 and 2 seconds, t3 is the time corresponding to 2 seconds before t1, and then generated according to the screen image data obtained from t3~t2 Video files. In this way, the video file generated by the terminal can include the entire process of acquiring the event from the occurrence to the end of the event.

[0093] based on Picture 9 In the illustrated embodiment, in an optional embodiment of the present invention, the target period includes a first period and a second period;

[0094] Step 905 may specifically be as follows: if the time interval between the first time period and the second time period is less than the preset advance time period, the third time period is determined according to the first time period and the second time period, according to the screen image data collected in the advance time period, and The screen image data collected in the third period generates a video file.

[0095] In this embodiment, the start time of the third time period is the start time of the first time period, and the end time of the third time period is the end time of the second time period. The target time period may include two or more time periods, and the application data in each time period are consistent with the preset application data. If the time interval between the two periods is particularly small, the advance period of the second period may overlap with the first period. In this embodiment, the terminal selects the start time of the first period as the start time of the third period, and the first period The end time of the second time period is used as the end time of the third time period to avoid selecting screen image data in the overlapping time period. It should be noted that if the first time period and the second time period overlap, similar to the above process, the terminal can select the start time of the first time period and the end time of the second time period as the start time and the end time of the third time period respectively. End time.

[0096] For example, the first time period is 1 minute 20 seconds to 1 minute 40 seconds, the second time period is 1 minute 42 seconds to 1 minute 50 seconds, and the preset advance time is 3s, due to the time interval from the first time period to the second time period It is less than 3s, so the terminal determines that the third time period is 1 minute 20 seconds to 1 minute 50 seconds, and then generates a video file based on the screen image data collected from 1 minute 17 seconds to 1 minute 50 seconds. In this way, the terminal can avoid using screen image data of overlapping time periods to generate video files.

[0097] It is understandable that if the time interval between multiple time periods in the target time period is not greater than the preset advance time, then the first time and the last time of the multiple time periods can be selected, and the data collected between the first time and the last time The screen image data is synthesized into a video file.

[0098] For ease of understanding, the screen recording method of the embodiment of the present invention will be described in detail below with a specific application scenario:

[0099] See Picture 10 , The application takes the game as an example. The game provides functional modules such as "Basic Settings", "Operation Settings", "General Settings", "Sound Effect Settings", "Network Acceleration" and "Video Settings", which can be turned on through the video settings Or close the video plug-in. In the video recording settings, it includes the screen recording switch, prompt information of the screen recording switch, and controls for viewing the video. When the state of the screen recording switch is "off", the screen recording plug-in is in an inactive state. When the state of the screen recording switch is "on", the screen recording plug-in is active. It should be noted, Picture 10 It is used to illustrate the overall framework of the software execution interface. Some details in the illustration do not affect the understanding of the recorded technical solutions, and are only used for illustration and as a limitation to the present invention.

[0100] When the game starts, the terminal can start the screen recording plug-in to start collecting screen image data. Or the terminal displays a prompt window to prompt the user to capture the content displayed on the screen.

[0101] The preset application data uses "double kill" and "triple kill" as examples. When the game generates "doublekill", the terminal records the corresponding time, such as 9:6:5. When the "double kill" disappears in the game, the terminal Record the corresponding time, such as 9:6:15. The terminal can obtain the screen image data collected between 9:6:5 and 9:6:15 to generate video files.

[0102] If the terminal sets the advance time length, the advance time length is 3 seconds, then in the above case, the terminal can determine the advance time period is 9:6:2 to 9:6:5, and then get 9:6:2 to 9:00 The screen image data collected between 6 minutes and 15 seconds generates a video file.

[0103] If the terminal acquires multiple time periods, for example, 9:6:5 to 9:6:15 corresponds to the "double kill" event, and 9:6:7 to 9:6:17 corresponds to the "triple kill" event . Since the time interval between the two time periods is less than 3 seconds, the terminal determines that 9:6:5 and 9:6:17 are the time periods when the above two events occur, and then combined with the advance time period of the "doublekill" event, according to 9:6 The screen image data collected from 2 seconds to 9:6:17, generate video files.

[0104] It is understandable that the terminal can also display a screen recording control button in the application, and the user can operate the screen recording control button to turn on or off the screen recording plug-in. The terminal can receive the screen recording stop instruction, and the terminal stops the screen recording plug-in. The terminal can also display a prompt window for generating a video file.

[0105] When the terminal starts the game, if the screen recording plug-in is not detected in the game, the terminal sends a request for obtaining the screen recording plug-in to the server, and the server responds to the request for obtaining the screen recording plug-in and sends the screen recording plug-in to the terminal, and then the terminal can send the screen recording plug-in Initialize.

[0106] After the terminal generates the video file, it can also obtain an image from the video file as a preview image of the video for the user to preview. The terminal can also send video files to sharing platforms, such as instant messaging applications, Moments of Friends, Weibo, or blogs, for other users to access.

[0107] The above describes the screen recording method of the present invention from a method perspective, and the following describes the screen recording device provided by the present invention from a device perspective. The screen recording device 1100 provided by the present invention has the function of realizing the screen recording method shown in the above embodiments. An embodiment of the screen recording device 1100 provided by the present invention includes:

[0108] The obtaining module 1101 is used to obtain application data of the application;

[0109] The image acquisition module 1102 is used to collect screen image data by using the built-in screen recording plug-in of the application program during the running period of the application program;

[0110] The determining module 1103 is configured to select at least one time period when the application data is consistent with the preset application data in the application program running time period, and use the selected time period as the target time period;

[0111] The video generation module 1104 is configured to generate a video file according to the screen image data collected in the target period.

[0112] In this embodiment, the image acquisition module 1102 can collect screen image data during the application running period, and the determination module 1103 can compare the application data acquired by the acquisition module 1101 with preset application data, and record the time period when the two are consistent and corresponding as the target time period. Then, the video generation module 1104 generates a video file based on the screen image data collected in the target period. It can be seen that the screen recording device of the present invention can realize the automatic screen recording function through preset application data. Moreover, the generated video files are very streamlined and occupy very little storage space.

[0113] Secondly, since the screen recording device can start the screen recording much faster than manually, it can improve the accuracy of the screen recording.

[0114] based on Picture 11 The illustrated embodiment, in an alternative embodiment of the present invention,

[0115] The determining module 1103 is also used to determine the advance period according to the preset advance period and the target period. The elapsed time from the start time of the advance period to the start time of the target period is the preset advance period, and the end time of the advance period is the target period. The beginning of

[0116] The video generation module 1104 is specifically configured to generate a video file according to the screen image data collected in the advance period and the screen image data collected in the target period.

[0117] In this embodiment, the determining module 1103 determines the advance period according to the preset advance period and the target period, and the video generation module 1104 generates a video file according to the screen image data collected in the advance period and the screen image data collected in the target period. In this way, the video file generated by the video generation module 1104 may include the entire process of acquiring the event from the occurrence to the end of the event.

[0118] Further, in another optional embodiment of the present invention, the target period includes a first period and a second period;

[0119] The determining module 1103 is configured to determine the third time period according to the first time period and the second time period if the time interval between the first time period and the second time period is less than the preset advance time, and the start time of the third time period is the beginning of the first time period The start time, the end time of the third period is the end time of the second period;

[0120] The video generating module 1104 is specifically configured to generate a video file according to the screen image data collected in the advance period and the screen image data collected in the third period.

[0121] In this embodiment, after the determining module 1103 determines the third time period according to the first time period and the second time period, the video generating module 1104 can avoid using screen image data of overlapping time periods to generate a video file.

[0122] based on Picture 11 In the illustrated embodiment, in another optional embodiment of the present invention, the screen recording device 1100 further includes:

[0123] The sending module 1201 is used to send a request for acquiring the screen recording plug-in to the server;

[0124] The receiving module 1202 is used to receive the screen recording plug-in sent by the server;

[0125] The setting module 1203 is used to initialize the screen recording plug-in.

[0126] based on Picture 11 In the illustrated embodiment or alternative embodiment, in another alternative embodiment of the present invention, the application data is scene information, event information or role information.

[0127] For ease of understanding, the interaction between the modules in the screen recording device in the embodiment of the present invention will be described in detail below with a specific application scenario:

[0128] The application takes the game as an example, and connects the screen recording plug-in in the game, such as Picture 10 Shown. The screen recording plug-in can provide a screen recording switch, as well as a video file storage path or prompt information.

[0129] When the game starts, the acquisition module 1101 can start the screen recording plug-in, and the image acquisition module 1102 starts to collect screen image data. Or the terminal displays a prompt window to prompt the user to capture the content displayed on the screen.

[0130] The preset application data takes "double kill" and "triple kill" as examples. When the game generates "doublekill", the determining module 1103 records the corresponding time, such as 9:6:5, when the "double kill" disappears in the game , The determining module 1103 records the corresponding time, for example, 9:06:15. The video generation module 1104 can obtain the screen image data collected between 9:6:5 and 9:6:15 to generate a video file.

[0131] If the determining module 1103 sets the advance time, and the advance time is 3 seconds, then in the above case, the determining module 1103 can determine that the advance time is 9:6:2 to 9:6:5, and then the video generation module 1104 obtains 9 Video files are generated from the screen image data collected from 6 minutes 2 seconds to 9: 6 minutes 15 seconds.

[0132] If the determination module 1103 determines multiple time periods, for example, 9:6:5 to 9:6:15 corresponds to the "doublekill" event, and 9:6:7 to 9:6:17 corresponds to the "triple kill" event. event. Since the time interval between the two periods is less than 3 seconds, the determining module 1103 determines that 9:6:5 to 9:6:17 is the time period when the above two events occur, and then the video generation module 1104 combines the "double kill" event to advance During the time period, a video file is generated based on the screen image data collected from 9:6:2 to 9:6:17.

[0133] It is understandable that the image capture module 1102 can also display a screen recording control button in the application program, and the user can operate the screen recording control button to turn on or turn off the screen recording plug-in. The image capture module 1102 can receive a screen recording stop instruction, and the image capture module 1102 stops the screen recording plug-in. The image capturing module 1102 can also display a prompt window for generating a video file.

[0134] When the acquiring module 1101 starts the game, if no screen recording plug-in is detected in the game, the sending module 1201 sends a request for acquiring the screen recording plug-in to the server, and the server responds to the request for acquiring the screen recording plug-in and sends the screen recording plug-in to the receiving module 1201, and then The setting module 1203 may initialize the screen recording plug-in received by the receiving module 1201.

[0135] After the video generation module 1104 generates the video file, it can also obtain an image from the video file as a preview image of the video for the user to preview. The sending module 1201 can also send the video file to a sharing platform, such as an instant messaging application, Moments of Friends, Weibo or blog, etc., for other users to access.

[0136] See Figure 13 , The present invention provides a terminal 1300, which can implement Figure 11 to Figure 12 The function of the screen recording device in the illustrated embodiment. The terminal 1300 includes an input device 1301, an output device 1302, a processor 1303, a memory 1304, and a bus; the input device 1301, an output device 1302, the processor 1303, and the memory 1304 communicate through a bus connection;

[0137] By calling the operation instructions and application data stored in the memory 1304, the processor 1303 can execute the following methods:

[0138] Obtain application data of the application;

[0139] During the running time of the application, use the built-in screen recording plug-in to collect screen image data;

[0140] In the application running period, select at least one period in which the application data is consistent with the preset application data, and use the selected period as the target period;

[0141] According to the screen image data collected in the target period, a video file is generated.

[0142] In an optional embodiment of the present invention, before the processor 1303 generates a video file according to the screen image data collected in the target period, the processor 1303 is further configured to determine the advance period according to the preset advance period and the target period, and obtain the For the screen image data collected in the advance period, the elapsed time from the start time of the advance period to the start time of the target period is the preset advance time, and the end time of the advance period is the start time of the target period;

[0143] The processor 1303 is specifically configured to generate a video file according to the screen image data collected in the advance period and the screen image data collected in the target period.

[0144] In another optional embodiment of the present invention, the target period includes a first period and a second period;

[0145] The processor 1303 is specifically configured to determine the third time period according to the first time period and the second time period if the time interval between the first time period and the second time period is less than the preset advance time, and the start time of the third time period is the beginning of the first time period. The start time, the end time of the third time period is the end time of the second time period; the video file is generated according to the screen image data collected in the advance time period and the screen image data collected in the third time period.

[0146] In another optional embodiment of the present invention, before the processor 1303 collects screen image data by using the built-in screen recording plug-in of the application program during the running period of the application program, the processor 1303 is further configured to send a request for obtaining the screen recording plug-in to the server; Receive the screen recording plug-in sent by the server, and initialize the screen recording plug-in.

[0147] Based on the above embodiment or alternative embodiment, in another alternative embodiment of the present invention, the application data acquired by the processor 1303 is scene information, event information or role information.

[0148] In the several embodiments provided by the present invention, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the above-mentioned units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

[0149] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

[0150] In addition, the functional units in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized in the form of hardware or software functional unit.

[0151] If the aforementioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the above methods of the various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM for short), magnetic disks or optical disks, etc., which can store program code Medium.

[0152] The above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that: The recorded technical solutions are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.