Game plot interaction method, device and system

By monitoring and obtaining the current game screen on the game client and synchronizing the matching barrage information from the video platform, the problem of lag in the game plot interaction mode in the existing technology is solved, and an efficient and instant game plot interaction experience is achieved.

CN115193039BActive Publication Date: 2025-03-25SHANGHAI HODE INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210887269.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-26
Publication Date
2025-03-25
Estimated Expiration
2042-07-26

AI Technical Summary

Technical Problem

In the prior art, the interaction mode of game plots has lag, which affects the user's interactive experience.

Method used

By monitoring players to enter the plot stage on the game client, the current game screen is obtained every preset time, and the barrage information corresponding to the matching plot video frame is obtained from the video platform, and the barrage information is displayed simultaneously in the game screen.

Benefits of technology

Real-time interaction of game plots is realized, users' interactive experience and immediacy are improved, and spoilers are avoided due to uploading screen-recorded videos.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115193039B_ABST
    Figure CN115193039B_ABST
Patent Text Reader

Abstract

The present application provides a method, device and system for interacting with game plots, wherein the method for interacting with game plots includes: when the game client detects that the first player has entered the plot stage of the target game, it can obtain the current game screen of the first player at preset time intervals; obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen; obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information to the current game screen. In this way, the current game process of the first player can be synchronized with the barrage through the game plot matching of the two parties in the game client and the video platform. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction, thereby improving the user's interactive experience with the game plot.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and more particularly to a method for interacting with a game plot. The present application also relates to an interactive device for a game plot, an interactive system for a game plot, a computing device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of computer technology and Internet technology, various games emerge in an endless stream, and the gameplay is also varied. In addition to game functions such as game battles and card drawing, the game can also provide plot-based game functions.

[0003] In the prior art, in order to make the game plot interactive with other players, the game plot content is often uploaded to the video platform in the form of screen recording, and each player can interact with the game plot in the video platform in the form of bullet screen and comment. However, in this interactive mode, the player who uploaded the game plot content has often completed the game, and the interaction has a lag, which affects the user's interactive experience with the game plot. Summary of the invention

[0004] In view of this, the embodiment of the present application provides a method for interacting with a game plot. The present application also relates to an interactive device for a game plot, an interactive system for a game plot, a computing device, and a computer-readable storage medium, so as to solve the technical problem that the interaction in the prior art has a lag, which affects the user's interactive experience with the game plot.

[0005] According to a first aspect of an embodiment of the present application, a game plot interaction method is provided, which is applied to a game client, comprising:

[0006] When it is detected that the first player has entered the plot stage of the target game, the current game screen of the first player is obtained at a preset time interval;

[0007] Get the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen;

[0008] Obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0009] According to a second aspect of an embodiment of the present application, a game plot interaction method is provided, which is applied to a video platform, and includes:

[0010] Receive the screen recording video of the target game uploaded by the second player, and receive the barrage content sent by the viewing user in response to the screen recording video;

[0011] Receiving a bullet comment acquisition request sent by a game client, wherein the bullet comment acquisition request carries a plot video frame, where the plot video frame is a video frame determined by the game client and matching a current game screen of the first player;

[0012] The target barrage information corresponding to the plot video frame is obtained and returned to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client.

[0013] According to a third aspect of an embodiment of the present application, a game plot interaction device is provided, which is applied to a game client, including:

[0014] The acquisition module is configured to acquire the current game screen of the first player at a preset time interval when the first player enters the plot stage of the target game;

[0015] A determination module is configured to obtain a screen recording video corresponding to a target game, and determine a plot video frame in the screen recording video that matches a current game screen;

[0016] The synchronization module is configured to obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0017] According to a fourth aspect of an embodiment of the present application, there is provided a game plot interaction device, which is applied to a video platform and includes:

[0018] A first receiving module is configured to receive a screen recording video of a target game uploaded by a second player, and receive bullet comment content sent by a viewing user in response to the screen recording video;

[0019] The second receiving module is configured to receive a bullet comment acquisition request sent by a game client, wherein the bullet comment acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching the current game screen of the first player;

[0020] The first return module is configured to obtain target barrage information corresponding to the plot video frame and return it to the game client, wherein the target barrage information is used to be synchronously displayed in the current game screen of the game client.

[0021] According to a fifth aspect of the embodiments of the present application, there is provided a game plot interactive system, the system comprising a video platform and a game client;

[0022] The video platform is configured to receive a screen recording video of a target game uploaded by a second player, and receive barrage content sent by a viewing user for the screen recording video; receive a barrage acquisition request sent by a game client, wherein the barrage acquisition request carries a plot video frame, which is a video frame determined by the game client and matches the current game screen of the first player; obtain target barrage information corresponding to the plot video frame, and return it to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client;

[0023] The game client is configured to obtain the current game screen of the first player at preset time intervals when detecting that the first player has entered the plot stage of the target game; obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen; obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0024] According to a sixth aspect of an embodiment of the present application, a computing device is provided, including:

[0025] Memory and processor;

[0026] The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions to implement the steps of the above-mentioned game plot interaction method.

[0027] According to a seventh aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the steps of the above-mentioned game plot interaction method are implemented.

[0028] The game plot interaction method provided in the embodiment of the present application is that the game client can obtain the current game screen of the first player at preset time intervals when monitoring the first player entering the plot stage of the target game; obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen; obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0029] In this case, when the first player is playing the game in the game client, if the game client detects that the first player has entered the plot stage of the target game, the current game screen of the first player can be obtained at preset time intervals, and then the plot video frame corresponding to the current game screen is determined in the screen recording video corresponding to the target game. The plot video frame can represent the current plot progress of the first player in the screen recording video, and then the barrage sent by other users in the video platform for the plot video frame is synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress is synchronized to the corresponding game progress screen in the game client for display.

[0030] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is a flowchart of a game plot interaction method provided by an embodiment of the present application;

[0032] Figure 2 is a flowchart of another game plot interaction method provided by an embodiment of the present application;

[0033] Figure 3 This is an interactive schematic diagram of a game plot provided by an embodiment of the present application;

[0034] Figure 4 It is a structural schematic diagram of a game plot interaction device provided by an embodiment of the present application;

[0035] Figure 5 It is a structural schematic diagram of another interactive device for game plots provided in one embodiment of the present application;

[0036] Figure 6 It is a structural diagram of an interactive system for game plots provided by an embodiment of the present application;

[0037] Figure 7 It is a structural block diagram of a computing device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0038] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0039] The terms used in one or more embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of the present application. The singular forms of "a" and "the" used in one or more embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more associated listed items.

[0040] It should be understood that, although the terms first, second, etc. may be used to describe various information in one or more embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0041] First, the terms involved in one or more embodiments of the present application are explained.

[0042] Plug-ins: The plug-ins here correspond to embedded ones. Embedded ones refer to the systems built into the game, while plug-ins refer to the software functions that are displayed in the game client in the form of floating, hanging, etc. from the software that is opened simultaneously outside the game client.

[0043] Game plot: This refers to the pure game plot that excludes other game functions such as game battles and card drawing, and is preset by the producer in a linear manner, consisting of plot text, CG (Computer Animation), cutscenes, and BGM (Background music). Among them, cutscenes are part of the game, during which players cannot actively control the progress of the game (or have very little control). Cutscenes are often used to interrupt the current game to develop the storyline, show the development of the characters, or provide background information, environmental atmosphere, dialogue and clues. Cutscenes can be in the form of animations or actual film footage.

[0044] SURF (Speeded-Up Robust Features) algorithm: is a robust image recognition and description algorithm that can be used for computer vision tasks such as object recognition and 3D reconstruction. This algorithm not only maintains the excellent performance characteristics of the SIFT (Scale-invariant feature transform) algorithm, but also solves the shortcomings of SIFT's high computational complexity and long time consumption, improves the extraction of points of interest and their feature vector description, and improves the calculation speed. In the embodiments of the present application, it can be used for the recognition and calculation of the position of objects that can trigger a propulsion event in a video frame, as well as the recognition and calculation of the position of objects that can trigger a propulsion event in the current game screen.

[0045] OCR (Optical Character Recognition): Use optical technology and computer technology to read text printed or written on paper and convert it into a format that can be accepted by computers and understood by humans. In the embodiment of the present application, it can be used to extract the content of the bullet screen in the video.

[0046] It should be noted that, in order to interact with other players in the game plot, users currently upload part of the game plot to the video platform in the form of screen recording. Other players interact with the uploading user on the video platform through bullet screens and comments. This interaction has a lag. In addition, due to the risk of spoilers, such screen recording videos have been resisted by some game manufacturers, and they have signed agreements with video platforms to prohibit the uploading of screen recording videos of game plots.

[0047] The current game barrage embedding technology provides players with a platform for inputting barrage in a specific game plot in the game client. After a certain period of time, the database filters out sensitive terms and randomly extracts the barrage content input by the player and presents it in the game plot of the game client. The barrage content is small, repetitive, and lacks a good interactive atmosphere. After the player inputs the barrage, it cannot be displayed in the game plot in real time and lacks positive feedback. At present, it can only be realized in the automatically played animation plot, and the usage scenarios are very limited.

[0048] In the embodiment of the present application, a method for interacting with the game plot can be provided, the game client is connected to the interface of the video platform, the player's plot browsing behavior and browsing progress in the game client are identified, such as automatic play, clicking the next sentence, etc., and a video template for uploading is provided for the connected video platform. When the player uploads the plot screen recording to the video platform, the touch behavior and text changes within a specific range in the game screen can be identified, and the playback progress in the screen recording video can be determined to synchronize the plot game progress in the game client with the video playback progress in the video platform. When the user leaves a bullet screen in the uploaded video, the game player can voluntarily choose whether to synchronize the bullet screen in the video platform to the game client when browsing the plot in the game client. At the same time, the player's plot progress in the game client can be recorded to the video platform. When the video platform determines that the player has unlocked a certain plot, the corresponding plot video uploaded in the video platform will be open to it, thereby providing an interactive platform for the game plot and avoiding the risk of spoilers of the game plot caused by uploading the screen recording video.

[0049] In the embodiment of the present application, the game plots of the game client and the video platform can be matched, and the behavior nodes of the plot browsing operation can be used as references to synchronize and float the bullet screen of the video platform in the game client in the form of a plug-in. By matching the game plots of the game client and the video platform, it can help players to transfer and share the bullet screen in the recorded video content to the game interface of the game client without any barriers; at the same time, it can also provide the rights of screen recording viewing and bullet screen communication in the video platform for players who have opened the plot in the game, thereby effectively avoiding spoilers.

[0050] In the present application, a method for interacting with a game plot is provided. The present application also relates to an interactive device for a game plot, an interactive system for a game plot, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.

[0051] Figure 1 A flowchart of a game plot interaction method provided according to an embodiment of the present application is shown, which is applied to a game client and specifically includes the following steps:

[0052] Step 102: When it is detected that the first player has entered the plot stage of the target game, the current game screen of the first player is obtained at a preset time interval.

[0053] Specifically, the first player refers to the player who is currently playing the target game in the game client; the target game refers to the currently operated game; the plot stage refers to the stage of pure game plot in the target game; the preset duration refers to the pre-set interval duration for taking screenshots of the game screen, that is, the frequency of taking screenshots of the game screen.

[0054] It should be noted that the current game screen of the game client can be screenshotted every preset time to obtain the current game screen within the current preset time, for example, the game client screenshots the game screen of the game client every S seconds to obtain the current game screen P. Of course, in actual applications, the current game screen of the first player can also be obtained by other methods, such as obtaining the current game screen of the first player from the game data of the target game stored in the game client based on the process identifier of the current plot process of the target game. This application does not limit the specific method of obtaining the current game screen of the first player.

[0055] In an embodiment of the present application, when it is monitored that the first player enters the plot stage of the target game, the current game screen of the first player can be obtained at preset time intervals, so as to facilitate the subsequent matching of the corresponding game progress in the screen recording video of the target game based on the current game screen, thereby synchronizing the barrage of the corresponding progress to the current game screen of the game client for display.

[0056] Step 104: Obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen.

[0057] It should be noted that other players may have already operated the target game and unlocked the corresponding game plot, so other players can record the target game and upload the obtained screen recording video to the video platform for each viewing user with viewing permission to post bullet comments on the screen recording video. Therefore, in order to synchronize the bullet comments in the video platform to the game client, it is necessary to first match the current game progress in the game client with the game progress in the video platform. Specifically, the screen recording video corresponding to the target game can be obtained first, and then the plot video frame in the screen recording video that matches the current game screen can be determined. The plot video frame can represent the current plot progress corresponding to the first player in the screen recording video.

[0058] Among them, the video platform refers to a server that contains screen recording videos related to the game plot. The server can collect the barrage data of each video playback client and send it to the game server, and finally display it in the game client of the game player.

[0059] In actual applications, the screen recording video corresponding to the target game can be obtained from a server that stores the screen recording; or, after recording the target game to obtain the screen recording video, the player can upload the screen recording video to a video platform for other users to watch, and thus the screen recording video corresponding to the target game can also be obtained from the video platform.

[0060] In an optional implementation of this embodiment, the plot video frame in the screen recording video that matches the current game screen can be determined by page matching, that is, the plot video frame in the screen recording video that matches the current game screen can be determined. The specific implementation process can be as follows:

[0061] Determine that at least one progress key frame of the first plot advancement mark exists in the screen recording video;

[0062] Matching the current game screen with at least one progress key frame to determine a matching key frame corresponding to the current game screen;

[0063] According to the matching key frame, determine the plot video frame in the screen recording video that matches the current game screen.

[0064] It should be noted that since the target game may include other game stages such as battles and card drawing in addition to the game plot, the screen recording video of the target game will include not only video frames corresponding to the game plot, but also video frames other than the game plot. Moreover, some of the video frames corresponding to the game plot are automatically played video frames, which do not require user operation and will not advance the progress of the plot. Such video frames often do not have interactive barrages. Therefore, the video frames that can advance the progress of the game plot, i.e., the progress key frames, can be determined from the screen recording video.

[0065] In actual applications, after players record the target game and obtain the screen recording video of the target game, they can also mark the screen recording video, thereby marking the video frames in the screen recording video that can promote the progress of the game plot; specifically, a first plot advancement mark can be set for the video frames in the screen recording video of the target game that can promote the progress of the game plot.

[0066] Therefore, it is possible to search in each video frame included in the screen recording video of the target game to determine at least one progress key frame with a first plot advancement mark, which is a video frame in the screen recording video of the target game that can advance the game plot progress. Then, the current game screen and at least one progress key frame can be matched to determine the matching key frame corresponding to the current game screen, that is, to determine which key frame of the at least one progress key frame matches the current game screen, and then determine the plot video frame in the screen recording video that matches the current game screen based on the matching key frame, which plot video frame can represent the plot progress corresponding to the current game screen in the screen recording video of the target game.

[0067] In practical applications, the current game screen and at least one progress key frame are matched to determine the matching key frame corresponding to the current game screen. The screen feature vector Tu of the current game screen can be first extracted, and the frame feature vector Tv of each progress key frame can be determined. Then, the vector distance (such as Euler distance) between the screen feature vector Tu and the frame feature vector Tv of each progress key frame is calculated one by one. When the vector distance is less than the first distance threshold, it means that the distance between the screen feature vector Tu and the frame feature vector Tv of the corresponding progress key frame is close, and the progress key frame may be in the same game plot progress as the current game screen. Therefore, the target vector distance less than the first distance threshold can be determined among the vector distances, and the progress key frame corresponding to the target vector distance is used as the matching key frame.

[0068] In addition, based on the matching of the picture feature vector Tu of the current game screen and the frame feature vector Tv of each progress key frame, after the matching key frame is determined, the matching key frame can be directly used as the plot video frame that can represent the game plot progress of the current game screen; or, other verification methods can be used to verify whether the matched matching key frame is accurate, thereby determining the plot video frame that can represent the game plot progress of the current game screen.

[0069] In an embodiment of the present application, it is possible to first determine whether there is at least one progress key frame with a first plot advancement mark in the screen recording video, and then match the current game screen with at least one progress key frame to determine the matching key frame corresponding to the current game screen. Thereafter, based on the matching key frame, determine the plot video frame in the screen recording video that matches the current game screen. The plot video frame can represent the game plot progress corresponding to the current game screen in the screen recording video of the target game, thereby facilitating the subsequent synchronization of the barrage of the corresponding game plot progress in the video platform to the game client, thereby improving the timeliness of the interaction.

[0070] In an optional implementation of this embodiment, it is possible to monitor whether an advancement event occurs in the plot advancement area in the current game screen to verify whether the matched key frame is accurate, that is, according to the matching key frame, determine the plot video frame in the screen recording video that matches the current game screen. The specific implementation process can be as follows:

[0071] Identify and monitor the plot advancement area in the current game screen;

[0072] When an advancement event is detected in the plot advancement area, the matching key frame is used as the plot video frame that matches the current game screen.

[0073] Specifically, the plot advancement area may refer to an area that can trigger an advancement event to trigger the progress of the game plot. For example, the plot advancement area may include the location of a confirmation button and a plot text area. When a user clicks the confirmation button or the plot text area, an advancement event may be triggered, thereby advancing the progress of the game plot.

[0074] It should be noted that, based on the matching of the screen feature vector of the current game screen and the frame feature vector of each progress key frame, after the matching key frame is determined, only a rough match is performed through the vector distance. Therefore, the plot advancement area in the current game screen can also be identified and monitored. When an advancement event is monitored in the plot advancement area, it means that the user has triggered an advancement event in the current game screen. The current game screen is a game screen that can advance the progress of the game plot and unlocks the corresponding plot chapter. At this time, it can be determined that the matching key frame is the plot video frame that matches the current game screen, that is, the matching key frame can represent the game plot progress corresponding to the current game screen in the screen recording video of the target game.

[0075] In addition, if no advancement event is detected in the plot advancement area, it means that the player has not performed any operation in the current game screen, and the current game screen cannot advance the progress of the game plot. However, the determined matching key frame is the video frame in the screen recording video that can advance the progress of the game plot. Therefore, the match may be wrong. The next game screen can continue to be matched until the plot video frame corresponding to the game screen that can advance the progress of the game plot is determined.

[0076] In actual applications, when identifying the plot advancement area in the current game screen, the target object in the current game screen can be identified through the object video recognition algorithm. The target object refers to an object that can trigger an advancement event, such as a confirmation button, a plot text box, etc. For example, the current game screen can be identified through the SURF algorithm to determine the position Po of the confirmation button and the area Re of the plot text box in the current game screen, and monitor whether an advancement event occurs in the position Po and the area Re.

[0077] In an embodiment of the present application, the current game screen and at least one progress key frame are matched. After the matching key frame corresponding to the current game screen is determined, it is possible to monitor whether an advancement event occurs in the plot advancement area of ​​the current game screen to verify whether the matching key frame matched for the current game screen is accurate, thereby improving the accuracy of the game plot progress matching. By identifying touch behaviors and text changes within a specific range in the current game screen, the playback progress in the recorded video is determined to synchronize the plot game progress in the game client with the video playback progress in the video platform.

[0078] In an optional implementation of this embodiment, the game plot progress unlocked by the first player in the game client can also be synchronized to the video platform, so as to update the video viewing authority of the player. That is, after determining the plot video frame in the screen recording video that matches the current game screen, it can also include:

[0079] Based on the correspondence between the video frame and the plot chapter, determining the target plot chapter corresponding to the plot video frame;

[0080] A video permission unlocking instruction of the first player is sent to the video platform, wherein the video permission unlocking instruction carries the player information of the first player and the target plot chapter.

[0081] It should be noted that when the plot video frame in the screen recording video that matches the current game screen is determined, it means that the first player has unlocked the game plot progress corresponding to the plot video frame in the game client, and the first player can have the authority to watch the video content before the plot video frame on the video platform. Therefore, based on the correspondence between the video frame and the plot chapter, the target plot chapter corresponding to the plot video frame can be determined, and the video permission unlocking instruction of the first player can be sent to the video platform, wherein the video permission unlocking instruction carries the player information and the target plot chapter of the first player, thereby instructing the video platform to update the video permission information of the first player. The video platform can then determine whether the user requesting to watch has the viewing permission based on the permission information to avoid spoilers of the game plot.

[0082] In an embodiment of the present application, the game client can be connected to the interface of the video platform to identify the player's plot browsing behavior and browsing progress in the game client, such as automatic playback, clicking the next sentence, etc., and by identifying the touch behavior and text changes within a specific range in the game screen, the playback progress in the screen recording video can be determined to synchronize the plot game progress in the game client and the video playback progress in the video platform. The player's plot progress in the game client can be recorded to the video platform. When the video platform determines that the player has unlocked a certain plot, the corresponding plot video uploaded in the video platform will be open to him, thereby providing an interactive platform for the game plot and avoiding the risk of spoilers of the game plot caused by uploading the screen recording video.

[0083] Step 106: Obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0084] It should be noted that the plot video frame in the screen recording video that matches the current game screen is determined, that is, the game plot progress in the game client and the playback progress of the screen recording video in the video platform are synchronized. At this time, the target barrage information corresponding to the plot video frame can be obtained from the video platform, and the target barrage information can be synchronously displayed on the current game screen.

[0085] In actual applications, when other viewing users leave comments in the screen recording of the target game, the first player can voluntarily choose whether to synchronize the comments in the video platform to the game client when browsing the plot and playing the target game in the game client. If the first player chooses to synchronize the comments in the video platform to the game client and browses the game plot completely, he can get game props rewards.

[0086] In the embodiment of the present application, the game plots of the game client and the video platform can be matched, and the behavior nodes of the plot browsing operation can be used as references to synchronize and flutter the bullet screen of the video platform in the game client in the form of a plug-in. By matching the game plots of the game client and the video platform, it can help players transfer and share the bullet screen in the recorded video content to the game interface of the game client without any barriers.

[0087] Furthermore, the target barrage content that receives more likes in the target barrage information can obtain customized barrage special effects and be displayed in the current game screen of the game client, such as highlighting, magnifying and other barrage display effects.

[0088] In an optional implementation of this embodiment, the bullet message information includes the bullet message content and the bullet message position, and the target bullet message information is synchronously displayed on the current game screen. The specific implementation process may be as follows:

[0089] Obtaining the target barrage content and the target barrage position from the target barrage information;

[0090] Based on the target bullet screen position, determine the corresponding display position in the current game screen;

[0091] Display the target barrage content at the display location.

[0092] It should be noted that the video platform can extract the barrage content Bt and barrage position Bp in the video frame through OCR recognition, and combine them into barrage information Map_B{Bt, Bp}. Therefore, the game client can obtain the target barrage information corresponding to the plot video frame through the video platform, and the target barrage information includes the target barrage content and the target barrage position. Therefore, the target barrage information can be parsed to obtain the target barrage content and the target barrage position. Based on the target barrage position, the corresponding display position is determined in the current game screen, and the target barrage content is displayed at the display position.

[0093] In an embodiment of the present application, the target barrage content can be displayed at a corresponding position in the current game screen based on the target barrage position, so that the barrage information on the recorded video in the video platform can be synchronously moved to the corresponding position in the game client for display, ensuring that the display effect of the barrage in the game client and the video platform is consistent, thereby improving the user's viewing experience.

[0094] In addition, the barrage information may also include the content feature vector Bf of the specific content of the plot advancement area in the video frame where the barrage is located, that is, the specific identification content of the plot advancement area, such as the specific button parameters of the confirmation button position (such as shape, size, interactive effects generated after clicking, etc.), the specific text content in the plot text area, and other corresponding feature vectors. In other words, the video platform can use the SURF algorithm to identify and calculate the position of the plot advancement area in the video frame where the barrage is located, identify the plot advancement area, and then identify the specific content in the plot advancement area to determine the content feature vector Bf. For example, the SURF algorithm can identify content changes in the plot advancement area, as well as the interactive effects generated by users clicking on the plot advancement area.

[0095] It should be noted that when a user uploads a screen recording video to a video platform, the screen recording video may contain an identification of the plot advancement area, namely, the confirmation button position and the plot text area selected by the user. However, since the user cannot mark the plot advancement area from the program code level, it can only be marked from the video frame by image capture. Therefore, the area identification selected by the user only assists in narrowing the scope of SRUF algorithm recognition. The SRUF algorithm does not need to recognize from the entire video frame, but only needs to apply the algorithm to the area selected by the user to identify and determine the plot advancement area.

[0096] In actual applications, the video platform can combine the extracted content feature vector Bf, the barrage content Bt and the barrage position Bp into the barrage information Map_B{Bf, Bt, Bp}. After the game client determines the plot video frame in the screen recording video that matches the current game screen, it means that the first player has unlocked the game plot progress corresponding to the plot video frame in the game client. At this time, the content feature vector Bfi of the specific content of the plot advancement area in the current game screen can be determined, and the content feature vector Bf carried in the barrage information and the content feature vector Bfi corresponding to the current game screen are matched. If the match is successful, it means that the specific content of the plot advancement area in the video frame where the barrage is located matches the specific content of the plot advancement area in the current game screen. At this time, the barrage content Bt can be displayed at the barrage position Bp, thereby synchronizing the barrage from the video platform to the game screen of the game client.

[0097] It should be noted that after the game client determines the plot video frame in the screen recording video that matches the current game screen, when synchronizing the barrage information in the plot video frame to the current game screen, it can further determine whether the plot video frame and the specific content in the plot advancement area in the current game screen match, thereby further verifying whether the plot video frame and the plot advancement area in the current game screen are the same, avoiding the incorrect synchronization of the barrage content to other game progress and ensuring the accuracy of the barrage synchronization.

[0098] In an optional implementation of this embodiment, the game client may further divide the plot stages of the target game to mark the chapter progress of the game plot, that is, the method may further include:

[0099] Divide the plot stage into at least one plot chapter, and determine a plot advancement page in at least one plot chapter;

[0100] For the plot advancement page, the page feature vector of the plot advancement page is extracted, and the corresponding relationship between the page feature vector and the plot chapter is stored.

[0101] It should be noted that the plot stage of the target game can often be divided into multiple plot chapters. Each plot chapter may include a page that automatically plays the plot content, and may also include a plot advancement page. The plot advancement page refers to a page that requires the user to trigger an advancement event to advance from the current plot chapter to the next plot chapter.

[0102] In actual applications, the game client can divide the plot stage into at least one plot chapter Ci, and determine the plot advancement page in at least one plot chapter. For each plot advancement page, the page feature vector Tai of the plot advancement page is extracted, and the correspondence between the page feature vector Tai and the plot chapter Ci is stored, so as to facilitate the subsequent determination of the plot chapter corresponding to the current game screen, so as to synchronize the current plot chapter progress of the first player to the video platform.

[0103] In an optional implementation of this embodiment, in addition to playing the game in the game client and advancing the game plot progress, the first player can also record the game screen of the target game and upload the recorded content to the video platform so that each viewing user can interact with the game plot content. That is, the method can also include:

[0104] When receiving a screen recording instruction, the game screen of the target game is recorded to obtain the screen recording result;

[0105] A second plot advancement mark is set for the screen recording result, the screen recording video is obtained, and the screen recording video is uploaded to the video platform.

[0106] It should be noted that the first player can trigger the screen recording control in the game client to trigger the screen recording instruction. When the game client receives the screen recording instruction, it can record the game screen during the target game, obtain the screen recording result, and then set the second plot advancement mark according to the screen recording result, obtain the screen recording video, and upload the screen recording video to the video platform.

[0107] In actual applications, the first player can record the game screen of the currently ongoing plot chapter, or can record the game screen of the completed chapter.

[0108] In an embodiment of the present application, the game client can mark the video frames in the screen recording results that can promote the progress of the game plot, obtain the screen recording video, and then upload the screen recording video to the video platform, so that when the current game screen and the screen recording video are matched later, only the video frames that can promote the progress of the game plot are matched, which saves computing resources and improves the matching efficiency of the game plot progress.

[0109] In an optional implementation of this embodiment, a second plot advancement mark is set for the screen recording result to obtain the screen recording video. The specific implementation process may be as follows:

[0110] Determine whether there is a corresponding setting mark template for the screen recording result;

[0111] In the case where there is a corresponding setting mark template in the screen recording result, the plot advancement frame in the screen recording result and the plot advancement area in the plot advancement frame are marked according to the setting mark template;

[0112] When there is no corresponding set marking template for the screen recording result, the marking operation of the player on the screen recording result is received, and the plot advancement frames in the screen recording result and the plot advancement areas in the plot advancement frames are marked according to the marking operation.

[0113] Specifically, the plot advancement frame refers to a video frame that can advance the game plot progress of the target game, and the plot advancement area refers to an area for players to operate to trigger advancement events to advance from the current plot chapter to the next plot chapter. For example, the plot advancement area may include a confirmation button position and a plot text area.

[0114] In addition, setting a marking template refers to a marking template created by the player in the game client for the screen recording video of the target game. The marking template can indicate how to mark the screen recording results, such as which video frames in the screen recording results are plot advancement frames, and which area in the plot advancement frame can trigger an advancement event to advance the progress of the game plot.

[0115] It should be noted that after player A marks the plot advancement of the screen recording video of the target game, he can create a marking template based on the marked plot advancement frames and the plot advancement areas in the plot advancement frames. When other players B subsequently mark the plot advancement of the screen recording video of the target game or the same type of game again, they can directly use the marking template created by player A without having to manually mark the plot advancement again.

[0116] In actual applications, when setting a second plot advancement mark for the screen recording result and obtaining the screen recording video, it is possible to first determine whether there is a corresponding setting mark template for the screen recording result. If there is a corresponding setting mark template for the screen recording result, it means that other players have previously marked the screen recording result (or the same type of screen recording result) for plot advancement. The setting mark template may include the identification of the plot advancement frame and the identification of the plot advancement area in the plot advancement frame. Therefore, the plot advancement frame in the screen recording result and the plot advancement area in the plot advancement frame can be directly marked according to the setting mark template. In specific implementation, when applying the setting mark template to set the second plot advancement mark for the screen recording result, the player's opinion can also be asked first, and the setting mark template can be applied after the player agrees. If the player disagrees, the player can mark it manually.

[0117] When there is no corresponding set marking template for the screen recording result, it means that the first player is marking the plot advancement of the screen recording result (or the same type of screen recording result) for the first time. At this time, the first player needs to mark it manually, that is, receive the player's marking operation on the screen recording result, and mark the plot advancement frame in the screen recording result and the plot advancement area in the plot advancement frame according to the marking operation.

[0118] In addition, after recording the plot advancement frames and plot advancement areas in the plot advancement frames according to the marking operation mark, the game client can also prompt the first player to create a marking template, which can be used by other users who upload the same game screen recording video when marking, that is, a corresponding marking template can be created based on the operation mark for subsequent use by other players. Furthermore, points can be awarded to players who create marking templates, and the playback volume of the screen recording video generated using the marking template can be partially added to the screen recording video uploaded by the player who created the marking template.

[0119] In an embodiment of the present application, a second plot advancement mark is set for the screen recording result. When the screen recording video is obtained, it can be determined first whether there is a corresponding setting mark template. If so, the setting mark template can be directly applied to mark the plot advancement; if not, manual marking is performed. A variety of marking methods are provided, and the marking efficiency of setting the second plot advancement mark for the screen recording result can be improved.

[0120] In an optional implementation of this embodiment, the correspondence between the plot advancement page and the plot chapter in the screen recording video may also be determined, that is, a second plot advancement mark is set for the screen recording result. After obtaining the screen recording video, the following may also be included:

[0121] Determine that at least one video frame having a second plot advancement mark exists in the screen recording video;

[0122] Determine a matching relationship between a page feature vector of a plot advancement page and at least one video frame;

[0123] Based on the matching relationship and the corresponding relationship between the page feature vector and the plot chapter, the plot chapter corresponding to at least one video frame is determined, and the corresponding relationship between the video frame and the plot chapter is stored.

[0124] It should be noted that since the subsequent video platform locates the progress of the game plot based on the video frames of the screen recording video, and the game client divides the plot stages and stores the correspondence between the page feature vectors of the plot advancement page and the plot chapters, it is necessary to match the page feature vectors with each video frame, determine the correspondence between the video frame and the page feature vector, and then determine the correspondence between the video frame and the plot chapter based on the correspondence between the page feature vector and the plot chapter, and store it to facilitate the subsequent positioning of the current game plot progress.

[0125] Accordingly, the game client can search for the target plot chapter corresponding to the plot video frame in the correspondence between the video frame and the plot chapter, and then send the first player's video permission unlocking instruction to the video platform to notify the video platform to update the first player's video permission information.

[0126] The interactive method of game plot provided in the embodiment of the present application is that when the first player is playing the game in the game client, if the game client detects that the first player has entered the plot stage of the target game, the current game screen of the first player can be obtained at preset time intervals, and then the plot video frame corresponding to the current game screen is determined in the screen recording video corresponding to the target game, and the plot video frame can represent the current plot progress of the first player, and then the barrage sent by other users in the video platform for the plot video frame is synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress is synchronized to the corresponding game progress screen in the game client for display.

[0127] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot.

[0128] Figure 2 A flowchart of another game plot interaction method provided according to an embodiment of the present application is shown, which is applied to a video platform, wherein the video platform refers to a server containing screen recording videos related to the game plot, and the server can collect the bullet screen data of each video playback client and send it to the game server, and finally display it in the game client of the game player. The method specifically includes the following steps:

[0129] Step 202: Receive the screen recording video of the target game uploaded by the second player, and receive the barrage content sent by the viewing user in response to the screen recording video.

[0130] Specifically, the second player refers to a player who uploads a screen recording video of the target game to the video platform. The second player may be the same as the first player or different from the first player.

[0131] It should be noted that the second player can record the target game and upload the recorded video to the video platform. The video platform can push the recorded video to each viewing user with video permissions for viewing. That is, the game plot progress of the viewing user in the game client determines the video playback progress that the viewing user can watch on the video platform.

[0132] In actual applications, when watching the screen recording video of the target game, each viewing user can send barrage content to interact with the game plot of the target game. At this time, the video platform can receive the barrage content sent by the viewing user for the screen recording video, synchronize it to each viewing user, and can also synchronize it to the game screen of the corresponding game plot progress in the game client.

[0133] In an optional implementation of this embodiment, the video platform may receive a video permission unlocking instruction synchronized by the game client to update the video permission of the corresponding player, that is, after receiving the screen recording video of the target game uploaded by the second player, the following may also be included:

[0134] receiving a video permission unlocking instruction sent by a game client, wherein the video permission unlocking instruction carries the player information of the first player and the target plot chapter;

[0135] Get the player information and target story chapter of the first player in the video permission unlocking command;

[0136] Update the first player's story progress based on the player information and target story chapter.

[0137] It should be noted that when the game client determines the plot video frame in the screen recording video that matches the current game screen, it means that the first player has unlocked the game plot progress corresponding to the plot video frame in the game client, and the first player can have the right to watch the video content before the plot video frame on the video platform. Therefore, the game client can determine the target plot chapter corresponding to the plot video frame based on the correspondence between the video frame and the plot chapter, and send the first player's video permission unlocking instruction to the video platform. After receiving the video permission unlocking instruction, the video platform can obtain the player information and target plot chapter of the first player in the video permission unlocking instruction, and update the first player's plot progress according to the player information and the target plot chapter, that is, the video platform can update the video permission information of the first player.

[0138] In an optional implementation of this embodiment, when receiving a viewing request from a user, the video platform may verify the video permission of the requesting user to determine the content of the screen recording video that the requesting user can view. That is, after receiving the screen recording video of the target game uploaded by the second player, the following may also be included:

[0139] receiving a viewing request for a screen recording video, wherein the viewing request carries user information of a requesting user;

[0140] Determine the target plot progress of the requesting user based on the user information;

[0141] Based on the target plot progress, the video data of the screen recording is returned to the requesting user.

[0142] It should be noted that when the video platform receives a viewing request from a user, it can verify the video permissions of the requesting user to determine the content of the screen recording video that the requesting user can watch. That is, upon receiving a viewing request for a screen recording video, the target plot progress of the requesting user is determined based on the user information of the requesting user, and based on the target plot progress, the video data of the screen recording video is returned to the requesting user.

[0143] In the embodiment of the present application, when the game plot progress of the requesting user in the game client reaches a target plot progress, the video platform can return the video data before the target plot progress in the screen recording video of the target game to the requesting user for viewing, that is, only the requesting user who has reached the corresponding plot progress in the game client can view the corresponding screen recording content. In this way, the plot progress of the player in the game client can be recorded to the video platform. When the video platform determines that the player has unlocked a certain plot in the game client, the corresponding plot video uploaded in the video platform is open to him, thereby providing an interactive platform for the game plot and avoiding the risk of spoilers of the game plot caused by uploading the screen recording video.

[0144] In an optional implementation of this embodiment, after the video platform receives the screen recording video of the target game uploaded by the second player, the following steps are further included:

[0145] Determine the plot advancement frames in the screen recording video and the plot advancement areas in the plot advancement frames;

[0146] Extract the frame vector of the plot advancement frame.

[0147] It should be noted that players can upload screen recording videos of the target game to the video platform. The screen recording video is marked with plot advancement frames and plot advancement areas in the plot advancement frames. Therefore, the video platform can identify the plot advancement frames in the screen recording video and the plot advancement areas in the plot advancement frames (confirmation buttons Tp and plot text areas Re), and extract the frame vectors Tv of the plot advancement frames.

[0148] Among them, the plot advancement area (confirmation button Tp and plot text area Re) can be framed and marked by the second player (i.e., the user who uploaded the video), which can narrow the recognition range of the SURF recognition algorithm when subsequently synchronizing the barrage information, thereby enhancing the recognition efficiency.

[0149] Step 204: receiving a bullet comment acquisition request sent by the game client, wherein the bullet comment acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching the current game screen of the first player.

[0150] Step 206: Obtain the target barrage information corresponding to the plot video frame and return it to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client.

[0151] In an optional implementation of this embodiment, obtaining target bullet screen information corresponding to a plot video frame includes:

[0152] Extract the content and position of the bullet comment in the plot video frame, and obtain the frame feature vector of the plot video frame;

[0153] The frame feature vector of the plot video frame, the bullet comment content and the bullet comment position are combined into the target bullet comment information corresponding to the plot video frame.

[0154] In the interactive method of game plot provided by the embodiment of the present application, the video platform can receive the screen recording video of the target game uploaded by the second player, and receive the barrage information sent by the viewing user for the screen recording video; receive the barrage acquisition request sent by the game client, wherein the barrage acquisition request carries the plot video frame, and the plot video frame is a video frame determined by the game client and matches the current game screen of the first player; obtain the target barrage information corresponding to the plot video frame, and return it to the game client, wherein the target barrage information is used to be synchronously displayed in the current game screen of the game client. In this case, when the current plot progress of the player in the game client is a plot video frame, the barrage sent by other users in the video platform for the plot video frame can be synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress can be synchronized to the corresponding game progress screen in the game client for display.

[0155] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot.

[0156] Figure 3 A schematic diagram of an interactive game plot provided according to an embodiment of the present application is shown. Figure 3 As shown, the specific steps include:

[0157] Step 1: The game client provides players with game plot experience.

[0158] It should be noted that the following steps 2 to 4 are the interactive process in which the player records the target game in the game client and uploads it to the video platform.

[0159] Step 2: Players can record the target game in the game client and obtain the recording results.

[0160] Step 3: The game client determines whether there is a corresponding set identification template for the screen recording result. If so, the screen recording result is marked according to the set identification template to obtain the screen recording video of the target game; if not, the screen recording result is marked based on the player's marking operation, the screen recording video of the target game is obtained, and an identification template corresponding to the screen recording result is created.

[0161] Step 4: The game client uploads the screen recording video to the video platform.

[0162] It should be noted that the following steps five to eight are the interactive process in which the player plays the target game in the game client and the game client synchronizes the barrage information in the video platform.

[0163] Step 5: The game client monitors the player entering the plot stage of the target game and applies for barrage synchronization permission.

[0164] Step 6: The game client obtains the current game screen of the first player at a preset time interval, obtains the screen recording video corresponding to the target game, and determines the plot video frame in the screen recording video that matches the current game screen.

[0165] Step 7: The game client obtains the target barrage information corresponding to the plot video frame from the video platform, and synchronously displays the target barrage information on the current game screen.

[0166] Step 8: The game client synchronizes the target plot chapter that the player has unlocked to the video platform based on the plot video frame, so that the video platform updates the player's video permissions.

[0167] Step 9: The video platform provides an interactive experience of the screen recording video of the target game.

[0168] It should be noted that the following steps 10 to 11 are the interactive process of synchronizing barrage information from the video platform to the game client.

[0169] Step 10: The video platform receives the screen recording video of the target game uploaded by the player, and receives the barrage content sent by the viewing user in response to the screen recording video.

[0170] Step 11: The video platform receives the barrage acquisition request sent by the game client. The barrage acquisition request carries the plot progress identifier, obtains the target barrage information corresponding to the plot progress identifier, and returns it to the game client for synchronous display.

[0171] It should be noted that the following steps twelve to thirteen are the process of the video platform verifying the video viewing permission of the requesting user.

[0172] Step 12: The video platform receives a viewing request for the screen recording video, which carries the user information of the requesting user. Based on the user information, the video permission corresponding to the target plot progress of the requesting user is determined. The video permission can be updated based on the unlocked target plot chapter synchronized with the game client.

[0173] Step 13: The video platform determines whether the requesting user has the viewing permission for the target video data of the screen recording video based on the video permission of the requesting user. If so, the target video data of the screen recording video is returned to the requesting user. If not, the requesting user is reminded that the target plot progress has not been reached and cannot be viewed temporarily.

[0174] The interactive method of the game plot provided in the embodiment of the present application can connect the game client to the interface of the video platform, identify the player's plot browsing behavior and browsing progress in the game client, such as automatic play, click the next sentence, etc., and provide an upload video template for the connected video platform. When the player uploads the plot screen recording to the video platform, the touch behavior and text changes within a specific range in the game screen can be identified, and the playback progress in the screen recording video can be determined to synchronize the plot game progress in the game client with the video playback progress in the video platform. When the user leaves a bullet screen in the uploaded video, the game player can voluntarily choose whether to synchronize the bullet screen in the video platform to the game client when browsing the plot in the game client. At the same time, the player's plot progress in the game client can be recorded to the video platform. When the video platform determines that the player has unlocked a certain plot, the corresponding plot video uploaded in the video platform will be open to it, thereby providing an interactive platform for the game plot and avoiding the risk of spoilers of the game plot caused by uploading the screen recording video.

[0175] In addition, the game plots in the game client and the video platform can be matched, and the behavior nodes of the plot browsing operation can be used as references to synchronize the bullet screens on the video platform in the game client. By matching the game plots in the game client and the video platform, players can transfer and share the bullet screens in the recorded video content to the game interface of the game client without any barriers; at the same time, players who have opened the plot in the game can be provided with the permission to watch the recorded video and communicate with the bullet screens on the video platform, thereby effectively avoiding spoilers.

[0176] Corresponding to the above method embodiment, the present application also provides an interactive device embodiment of a game plot, Figure 4 A schematic diagram of the structure of a game plot interaction device provided by an embodiment of the present application is shown, which is applied to a game client, such as Figure 4 As shown, the device comprises:

[0177] The acquisition module 402 is configured to acquire the current game screen of the first player at a preset time interval when the first player enters the plot stage of the target game;

[0178] The determination module 404 is configured to obtain a screen recording video corresponding to the target game, and determine a plot video frame in the screen recording video that matches the current game screen;

[0179] The synchronization module 406 is configured to obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0180] Optionally, the determination module 404 is further configured to:

[0181] Determine that at least one progress key frame of the first plot advancement mark exists in the screen recording video;

[0182] Matching the current game screen with at least one progress key frame to determine a matching key frame corresponding to the current game screen;

[0183] According to the matching key frame, determine the plot video frame in the screen recording video that matches the current game screen.

[0184] Optionally, the determination module 404 is further configured to:

[0185] Identify and monitor the plot advancement area in the current game screen;

[0186] When an advancement event is detected in the plot advancement area, the matching key frame is used as the plot video frame that matches the current game screen.

[0187] Optionally, the bullet screen information includes bullet screen content and bullet screen position; the synchronization module 406 is further configured to:

[0188] Obtaining the target barrage content and the target barrage position from the target barrage information;

[0189] Based on the target bullet screen position, determine the corresponding display position in the current game screen;

[0190] Display the target barrage content at the display location.

[0191] Optionally, the device further includes a sending module configured to:

[0192] Based on the correspondence between the video frame and the plot chapter, determining the target plot chapter corresponding to the plot video frame;

[0193] A video permission unlocking instruction of the first player is sent to the video platform, wherein the video permission unlocking instruction carries the player information of the first player and the target plot chapter.

[0194] Optionally, the device further includes a partitioning module configured to:

[0195] Divide the plot stage into at least one plot chapter, and determine a plot advancement page in at least one plot chapter;

[0196] For the plot advancement page, the page feature vector of the plot advancement page is extracted, and the corresponding relationship between the page feature vector and the plot chapter is stored.

[0197] Optionally, the device further includes an uploading module configured to:

[0198] When receiving a screen recording instruction, the game screen of the target game is recorded to obtain the screen recording result;

[0199] A second plot advancement mark is set for the screen recording result, the screen recording video is obtained, and the screen recording video is uploaded to the video platform.

[0200] Optionally, the upload module is further configured to:

[0201] Determine whether there is a corresponding setting mark template for the screen recording result;

[0202] In the case where there is a corresponding setting mark template in the screen recording result, the plot advancement frame in the screen recording result and the plot advancement area in the plot advancement frame are marked according to the setting mark template;

[0203] When there is no corresponding set marking template for the screen recording result, the marking operation of the player on the screen recording result is received, and the plot advancement frames in the screen recording result and the plot advancement areas in the plot advancement frames are marked according to the marking operation.

[0204] Optionally, the upload module is further configured to:

[0205] Determine that at least one video frame having a second plot advancement mark exists in the screen recording video;

[0206] Determine a matching relationship between a page feature vector of a plot advancement page and at least one video frame;

[0207] Based on the matching relationship and the corresponding relationship between the page feature vector and the plot chapter, the plot chapter corresponding to at least one video frame is determined, and the corresponding relationship between the video frame and the plot chapter is stored.

[0208] The interactive device for game plot provided in the embodiment of the present application is that when the first player is playing the game in the game client, if the game client detects that the first player has entered the plot stage of the target game, the current game screen of the first player can be obtained at preset time intervals, and then the plot video frame corresponding to the current game screen is determined in the screen recording video corresponding to the target game, and the plot video frame can represent the current plot progress of the first player, and then the barrage sent by other users in the video platform for the plot video frame is synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress is synchronized to the corresponding game progress screen in the game client for display.

[0209] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot.

[0210] Corresponding to the above method embodiment, the present application also provides another game plot interaction device embodiment, Figure 5 A schematic diagram of the structure of another game plot interaction device provided by an embodiment of the present application is shown, which is applied to a game client, such as Figure 5 As shown, the device comprises:

[0211] The first receiving module 502 is configured to receive the screen recording video of the target game uploaded by the second player, and receive the bullet comment content sent by the viewing user in response to the screen recording video;

[0212] The second receiving module 504 is configured to receive a bullet comment acquisition request sent by the game client, wherein the bullet comment acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching the current game screen of the first player;

[0213] The first return module 506 is configured to obtain target barrage information corresponding to the plot video frame and return it to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client.

[0214] Optionally, the device further includes an updating module configured to:

[0215] receiving a video permission unlocking instruction sent by a game client, wherein the video permission unlocking instruction carries the player information of the first player and the target plot chapter;

[0216] Get the player information and target story chapter of the first player in the video permission unlocking command;

[0217] Update the first player's story progress based on the player information and target story chapter.

[0218] Optionally, the device further includes a second returning module configured to:

[0219] receiving a viewing request for a screen recording video, wherein the viewing request carries user information of a requesting user;

[0220] Determine the target plot progress of the requesting user based on the user information;

[0221] Based on the target plot progress, the video data of the screen recording is returned to the requesting user.

[0222] Optionally, the first returning module 506 is further configured to:

[0223] Extract the content and position of the bullet comment in the plot video frame, and obtain the frame feature vector of the plot video frame;

[0224] The frame feature vector of the plot video frame, the bullet comment content and the bullet comment position are combined into the target bullet comment information corresponding to the plot video frame.

[0225] Optionally, the device further comprises an extraction module configured to:

[0226] Determine the plot advancement frames in the screen recording video and the plot advancement areas in the plot advancement frames;

[0227] Extract the frame vector of the plot advancement frame.

[0228] The interactive device for game plots provided in the embodiment of the present application is that the video platform can receive the screen recording video of the target game uploaded by the second player, and receive the barrage information sent by the viewing user for the screen recording video; receive the barrage acquisition request sent by the game client, wherein the barrage acquisition request carries the plot video frame, and the plot video frame is a video frame determined by the game client and matched with the current game screen of the first player; obtain the target barrage information corresponding to the plot video frame, and return it to the game client, wherein the target barrage information is used to be synchronously displayed in the current game screen of the game client. In this case, when the current plot progress of the player in the game client is a plot video frame, the barrage sent by other users in the video platform for the plot video frame can be synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress can be synchronized to the corresponding game progress screen in the game client for display.

[0229] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot.

[0230] The above is a schematic scheme of a game plot interaction device of this embodiment. It should be noted that the technical scheme of the game plot interaction device and the technical scheme of the game plot interaction method described above belong to the same concept, and the details of the technical scheme of the game plot interaction device that are not described in detail can all be referred to the description of the technical scheme of the game plot interaction method described above.

[0231] Corresponding to the above method embodiment, the present application also provides an interactive setting embodiment of a game plot, Figure 6 FIG. 1 shows a schematic diagram of a structure of an interactive system for a game plot provided by an embodiment of the present application. Figure 6 As shown, the system includes a video platform 602 and a game client 604;

[0232] The video platform 602 is configured to receive a screen recording video of a target game uploaded by a second player, and receive the barrage content sent by the viewing user for the screen recording video; receive a barrage acquisition request sent by a game client, wherein the barrage acquisition request carries a plot video frame, which is a video frame determined by the game client and matches the current game screen of the first player; obtain target barrage information corresponding to the plot video frame, and return it to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client;

[0233] The game client 604 is configured to, upon detecting that the first player has entered the plot stage of the target game, obtain the current game screen of the first player at preset time intervals; obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen; obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

[0234] The interactive system for game plots provided in the embodiment of the present application is that when the first player is playing the game in the game client, if the game client detects that the first player has entered the plot stage of the target game, the current game screen of the first player can be obtained at preset time intervals, and then the plot video frame corresponding to the current game screen is determined in the screen recording video corresponding to the target game, and the plot video frame can represent the current plot progress of the first player, and then the barrage sent by other users in the video platform for the plot video frame is synchronized to the current game screen in the game client for display, that is, the barrage information corresponding to the current plot progress is synchronized to the corresponding game progress screen in the game client for display.

[0235] In this way, the game plots of the game client and the video platform can be matched to synchronize the barrage of the current game process of the first player, so that the barrage of the corresponding progress in the screen recording video can be transferred and shared to the current game interface of the game client without any threshold. The first player can watch the barrage sent by other users in time when playing the game in the game client, which improves the timeliness of the interaction and thereby improves the user's interactive experience with the game plot.

[0236] The above is a schematic scheme of an interactive system for game plots of this embodiment. It should be noted that the technical scheme of the interactive system for game plots and the technical scheme of the interactive method for game plots described above are of the same concept, and the details of the technical scheme of the interactive system for game plots that are not described in detail can all be referred to the description of the technical scheme of the interactive method for game plots described above.

[0237] Figure 7 The block diagram of a computing device according to an embodiment of the present application is shown. The components of the computing device 700 include but are not limited to a memory 710 and a processor 720. The processor 720 is connected to the memory 710 via a bus 730, and the database 750 is used to store data.

[0238] The computing device 700 also includes an access device 740 that enables the computing device 700 to communicate via one or more networks 760. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 740 may include one or more of any type of network interface (e.g., a network interface card (NIC)) of wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a world-wide interoperability for microwave access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, a near field communication (NFC) interface, and the like.

[0239] In one embodiment of the present application, the above components of the computing device 700 and Figure 7 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 7 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of the present application. Those skilled in the art may add or replace other components as needed.

[0240] The computing device 700 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or PC. The computing device 700 may also be a mobile or stationary server.

[0241] The processor 720 is used to execute the following computer executable instructions to implement the steps of the above-mentioned game plot interaction method.

[0242] The above is a schematic scheme of a computing device of this embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the interactive method of the game plot described above are of the same concept, and the details not described in detail in the technical scheme of the computing device can be referred to the description of the technical scheme of the interactive method of the game plot described above.

[0243] An embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the steps of the above-mentioned game plot interaction method.

[0244] The above is a schematic scheme of a computer-readable storage medium of this embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the interactive method of the game plot described above are of the same concept, and the details not described in detail in the technical scheme of the storage medium can be found in the description of the technical scheme of the interactive method of the game plot described above.

[0245] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0246] Computer instructions include computer program codes, which may be in source code form, object code form, executable files, or some intermediate form, etc. Computer readable media may include: any entity or device capable of carrying computer program codes, recording media, USB flash drives, mobile hard disks, magnetic disks, optical disks, computer memories, read-only memories (ROM), random access memories (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0247] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0248] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0249] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The optional embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the present application. The present application selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present application, so that those skilled in the art can understand and use the present application well. The present application is only limited by the claims and their full scope and equivalents.

Claims

1. A game plot interaction method, characterized in that: Applied to game clients, including: When it is detected that the first player has entered the plot stage of the target game, the current game screen of the first player is obtained at a preset time interval; Obtaining a screen recording video corresponding to the target game, and determining a plot video frame in the screen recording video that matches the current game screen; The target barrage information corresponding to the plot video frame is obtained from the video platform, and the target barrage information is synchronously displayed on the current game screen.

2. The interactive method of game plot according to claim 1, characterized in that: The determining of the plot video frame in the screen recording video that matches the current game screen includes: Determine that at least one progress key frame marked with a first plot advancement exists in the screen recording video; Matching the current game screen with the at least one progress key frame to determine a matching key frame corresponding to the current game screen; According to the matching key frame, the plot video frame in the screen recording video that matches the current game screen is determined.

3. The interactive method of game plot according to claim 2, characterized in that: The determining, according to the matching key frame, a plot video frame in the screen recording video that matches the current game screen includes: Identify and monitor the plot advancement area in the current game screen; When an advancement event is detected in the plot advancement area, the matching key frame is used as a plot video frame that matches the current game screen.

4. The interactive method of game plot according to claim 1, characterized in that: The barrage information includes barrage content and barrage position; and the step of synchronously displaying the target barrage information on the current game screen includes: Acquire target barrage content and target barrage position from the target barrage information; Based on the target bullet screen position, determining a corresponding display position in the current game screen; The target bullet screen content is displayed at the display position.

5. The interactive method of game plot according to claim 1, characterized in that: After determining the plot video frame in the screen recording video that matches the current game screen, the method further includes: Determining a target plot chapter corresponding to the plot video frame based on a correspondence between the video frame and the plot chapter; A video permission unlocking instruction for the first player is sent to the video platform, wherein the video permission unlocking instruction carries the player information of the first player and the target plot chapter.

6. The game plot interaction method according to any one of claims 1 to 5, characterized in that: The method further comprises: Dividing the plot stage into at least one plot chapter, and determining a plot advancement page in the at least one plot chapter; For the plot advancement page, a page feature vector of the plot advancement page is extracted, and a corresponding relationship between the page feature vector and the plot chapter is stored.

7. The interactive method of game plot according to claim 6, characterized in that: The method further comprises: When receiving a screen recording instruction, recording the game screen of the target game to obtain a screen recording result; A second plot advancement mark is set for the screen recording result, a screen recording video is obtained, and the screen recording video is uploaded to a video platform.

8. The interactive method of game plot according to claim 7, characterized in that: The step of setting a second plot advancement mark on the screen recording result to obtain the screen recording video includes: Determine whether there is a corresponding setting mark template for the screen recording result; In the case where there is a corresponding setting mark template for the screen recording result, marking the plot advancement frame in the screen recording result and the plot advancement area in the plot advancement frame according to the setting mark template; In the case that there is no corresponding set marking template for the screen recording result, a marking operation of the player on the screen recording result is received, and the plot advancement frames in the screen recording result and the plot advancement areas in the plot advancement frames are marked according to the marking operation.

9. The interactive method of game plot according to claim 7, characterized in that: After setting a second plot advancement mark for the screen recording result and obtaining the screen recording video, the method further includes: Determining that at least one video frame having a second plot advancement mark exists in the screen recording video; Determining a matching relationship between a page feature vector of the plot advancement page and the at least one video frame; Based on the matching relationship and the corresponding relationship between the page feature vector and the plot chapter, the plot chapter corresponding to the at least one video frame is determined, and the corresponding relationship between the video frame and the plot chapter is stored.

10. A game plot interaction method, characterized in that: Applied to video platforms, including: Receiving a screen recording video of a target game uploaded by a second player, and receiving barrage content sent by a viewing user in response to the screen recording video; Receiving a bullet comment acquisition request sent by a game client, wherein the bullet comment acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching a current game screen of the first player; The target barrage information corresponding to the plot video frame is obtained and returned to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client.

11. The game plot interaction method according to claim 10, characterized in that: After receiving the screen recording video of the target game uploaded by the second player, the method further includes: receiving a video permission unlocking instruction sent by the game client, wherein the video permission unlocking instruction carries the player information of the first player and a target plot chapter; Obtain the player information and target plot chapter of the first player in the video permission unlocking instruction; The story progress of the first player is updated according to the player information and the target story chapter.

12. The game plot interaction method according to claim 11, characterized in that: After receiving the screen recording video of the target game uploaded by the second player, the method further includes: receiving a viewing request for the screen recording video, wherein the viewing request carries user information of the requesting user; Determining a target plot progress of the requesting user according to the user information; According to the target plot progress, the video data of the screen recording video is returned to the requesting user.

13. The game plot interaction method according to any one of claims 10 to 12, characterized in that: The obtaining of target bullet screen information corresponding to the plot video frame includes: Extracting the content and position of the bullet screen in the plot video frame, and obtaining a frame feature vector of the plot video frame; The frame feature vector of the plot video frame, the bullet screen content and the bullet screen position are combined into target bullet screen information corresponding to the plot video frame.

14. The game plot interaction method according to any one of claims 10 to 12, characterized in that: After receiving the screen recording video of the target game uploaded by the second player, the method further includes: Determine a plot advancement frame in the screen recording video, and a plot advancement area in the plot advancement frame; The frame vector of the plot advancement frame is extracted.

15. An interactive device for game plots, characterized in that: Applied to game clients, including: An acquisition module is configured to acquire a current game screen of the first player at a preset time interval when detecting that the first player has entered a plot stage of the target game; A determination module is configured to obtain a screen recording video corresponding to the target game, and determine a plot video frame in the screen recording video that matches the current game screen; The synchronization module is configured to obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

16. An interactive device for game plots, characterized in that: Applied to video platforms, including: A first receiving module is configured to receive a screen recording video of a target game uploaded by a second player, and receive bullet comment content sent by a viewing user in response to the screen recording video; A second receiving module is configured to receive a bullet comment acquisition request sent by a game client, wherein the bullet comment acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching the current game screen of the first player; The first return module is configured to obtain target barrage information corresponding to the plot video frame and return it to the game client, wherein the target barrage information is used to be synchronously displayed on the current game screen of the game client.

17. An interactive system for game plots, characterized in that: The system includes a video platform and a game client; The video platform is configured to receive a screen recording video of a target game uploaded by a second player, and receive barrage content sent by a viewing user for the screen recording video; receive a barrage acquisition request sent by a game client, wherein the barrage acquisition request carries a plot video frame, and the plot video frame is a video frame determined by the game client and matching the current game screen of the first player; obtain target barrage information corresponding to the plot video frame, and return it to the game client, wherein the target barrage information is used to be synchronously displayed in the current game screen of the game client; The game client is configured to, upon detecting that the first player has entered the plot stage of the target game, obtain the current game screen of the first player at preset time intervals; obtain the screen recording video corresponding to the target game, and determine the plot video frame in the screen recording video that matches the current game screen; obtain the target barrage information corresponding to the plot video frame from the video platform, and synchronously display the target barrage information on the current game screen.

18. A computing device, characterized in that include: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions to implement the steps of the game plot interaction method described in any one of claims 1-9 or 10-14 above.

19. A computer-readable storage medium, characterized in that: It stores computer executable instructions, which, when executed by a processor, can implement the steps of the game plot interaction method described in any one of claims 1-9 or 10-14.

Citation Information

Patent Citations

  • Video playback method and device, video transmission method and device, equipment and storage medium

    CN109348252A

  • Bullet screen generation method and device

    CN110121083A