Screenshot method and device in live broadcast scene, readable medium and electronic equipment

Abstract

The invention relates to the technical field of computers, and discloses a screenshot method and device in a live broadcast scene, a readable medium and electronic equipment. According to the method, the short-time video corresponding to the operation time point is acquired from the live video stream in response to the screen capture operation of the user, so that the problems of resolution reduction and picture blurring possibly caused by capturing or recording a system screen are avoided; an operation bar or a recommendation frame is provided for the user on the basis of the short-time video, so that the user can perform frame position selection in the short-time video based on the operation bar, or perform selection in the recommendation frame on the basis of analysis and processing of the server side to obtain a screenshot image, and the screenshot image is processed on the basis of the short-time video; through frame position selection, each frame of image does not need to be separated and extracted at the client, or the recommended frame is analyzed and processed by the server, so that the problem of delay of the screenshot opportunity is solved on the basis of avoiding the influence on the application performance of the client, and the screenshot quality is effectively improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology. More specifically, the embodiments of the present disclosure relate to a screenshot method in a live broadcast scene, a screenshot device in a live broadcast scene, a computer-readable medium, and an electronic device. Background Art

[0002] This section is intended to provide a background or context to the embodiments of the disclosure that are recited in the claims, and no description herein is admitted to be prior art by inclusion in this section.

[0003] Live broadcast is real-time and interactive. Users can watch the screen content and interact with the anchor through bullet screen messages or other methods. During the live broadcast, users can take screenshots to save the instantaneous screen content.

[0004] After receiving the screenshot operation of the user, there is a delay in obtaining the screen content in response to the screenshot operation. Therefore, when the screen content changes, the screen content actually captured may not meet the user's expectations. Summary of the invention

[0005] In this context, embodiments of the present disclosure are intended to provide a screenshot method in a live broadcast scenario, a screenshot device in a live broadcast scenario, a computer-readable medium, and an electronic device.

[0006] According to a first aspect of an embodiment of the present disclosure, a screenshot method in a live broadcast scene is provided, which can be applied to a client, and the method may include: in response to a user's screenshot operation, generating a short video of a preset duration based on a live video stream at an operation time point of the screenshot operation; obtaining an operation element corresponding to the short video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by a server after analyzing the short video; providing the operation element to the user, and receiving a frame selection operation of the user based on the operation element; and obtaining a screenshot image corresponding to the screenshot operation in response to the frame selection operation.

[0007] Optionally, the frame selection operation includes selecting an operation position on an operation bar, and obtaining a screenshot image corresponding to the screenshot operation in response to the frame selection operation, including: extracting a video frame of a corresponding frame position in the short video according to the operation position selected on the operation bar by the frame selection operation, and determining it as the screenshot image corresponding to the screenshot operation.

[0008] Optionally, providing operating elements to the user includes: providing the user with an operation bar corresponding to the short video, and receiving a position selection operation from the user on the operation bar; and displaying a thumbnail of the video frame at the corresponding frame position according to the operation position corresponding to the position selection operation.

[0009] Optionally, the frame selection operation includes selecting a thumbnail, and obtaining a screenshot image corresponding to the screenshot operation in response to the frame selection operation, including: determining an operation position on the operation bar according to the thumbnail selected by the frame selection operation; and extracting a video frame of a corresponding frame position in the short video according to the operation position corresponding to the thumbnail, and determining it as the screenshot image corresponding to the screenshot operation.

[0010] Optionally, obtaining the operation element corresponding to the short video includes: sending the short video to a server; the server is used to analyze the short video with the video frame corresponding to the operation time point of the screenshot operation as a reference frame to obtain at least one recommended frame; the analysis includes at least one of face recognition analysis, key point detection analysis and large model analysis; receiving at least one recommended frame provided by the server.

[0011] Optionally, acquiring a screenshot image corresponding to the screenshot operation in response to a frame selection operation includes: determining a recommended frame selected by the frame selection operation as the screenshot image corresponding to the screenshot operation.

[0012] Optionally, the server is further configured to perform super-resolution processing on the recommended frame.

[0013] According to a second aspect of an embodiment of the present disclosure, a screenshot device in a live broadcast scene is provided, which can be applied to a client, and the device may include: a short video generation module, which is used to respond to a user's screenshot operation and generate a short video of a preset duration based on a live video stream at an operation time point of the screenshot operation; an operation element acquisition module, which is used to acquire an operation element corresponding to the short video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by a server after analyzing the short video; an operation element display module, which is used to provide the operation element to the user and receive a frame selection operation based on the operation element; a screenshot image determination module, which is used to acquire a screenshot image corresponding to the screenshot operation in response to the frame selection operation.

[0014] Optionally, the frame selection operation includes selecting an operation position on an operation bar, and a screenshot image determination module is specifically used to extract a video frame of a corresponding frame position in the short video according to the operation position selected by the frame selection operation on the operation bar, and determine it as a screenshot image corresponding to the screenshot operation.

[0015] Optionally, the operation element display module is specifically used to provide the user with an operation bar corresponding to the short video, and receive the user's position selection operation on the operation bar; according to the operation position corresponding to the position selection operation, display the thumbnail of the video frame at the corresponding frame position.

[0016] Optionally, the frame selection operation includes selecting a thumbnail, and a screenshot image determination module is specifically used to determine the operation position on the operation bar according to the thumbnail selected by the frame selection operation; according to the operation position corresponding to the thumbnail, the video frame of the corresponding frame position is extracted from the short video, and determined as the screenshot image corresponding to the screenshot operation.

[0017] Optionally, the operation element acquisition module is specifically used to send the short video to the server; the server is used to analyze the short video with the video frame corresponding to the operation time point of the screenshot operation as the reference frame to obtain at least one recommended frame; the analysis includes at least one of face analysis, key point analysis and large model analysis; and receive at least one recommended frame provided by the server.

[0018] Optionally, the screenshot image determination module is specifically configured to determine the recommended frame selected by the frame selection operation as the screenshot image corresponding to the screenshot operation.

[0019] Optionally, the server is further configured to perform super-resolution processing on the recommended frame.

[0020] According to a third aspect of an embodiment of the present disclosure, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the screenshot method in at least one of the above-mentioned live broadcast scenarios is implemented.

[0021] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the screenshot method in at least one of the above-mentioned live broadcast scenarios by executing the executable instructions.

[0022] According to the screenshot method in the live broadcast scene of the embodiment of the present disclosure, the client can respond to the user's screenshot operation and generate a short video of a preset duration based on the live video stream at the operation time point of the screenshot operation; then obtain the operation element corresponding to the short video, the operation element can be an operation bar or a recommended frame, wherein the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by the server after analyzing the short video; on this basis, the operation element can be provided to the user, and the user's frame selection operation based on the operation element can be received, and then the screenshot image corresponding to the screenshot operation is obtained in response to the frame selection operation. The method obtains a short video corresponding to the operation time point from a live video stream in response to a user's screenshot operation, and then provides an operation bar or a recommended frame to the user based on the short video, so that the user can select a frame position in the short video based on the operation bar, or select from the recommended frames based on server-side analysis and processing, thereby obtaining a screenshot image, which is processed based on the short video. Through frame position selection, there is no need to separate and extract each frame image on the client, or the recommended frame is analyzed and processed by the server. On the basis of avoiding affecting the client application performance, the delay problem of screenshot timing is solved, and the screenshot quality is effectively improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, in which:

[0024] Figure 1 One of the step flow charts of the screenshot method in the live broadcast scenario of an embodiment of the present disclosure is shown.

[0025] Figure 2 A schematic diagram of a frame selection operation based on selection of an operation position on an operation bar according to an embodiment of the present disclosure is shown.

[0026] Figure 3 The second step flow chart of the screenshot method in the live broadcast scenario of the embodiment of the present disclosure is shown.

[0027] Figure 4 A schematic diagram of a frame selection operation based on thumbnail selection on an operation bar according to an embodiment of the present disclosure is shown.

[0028] Figure 5 The third step flow chart of the screenshot method in the live broadcast scenario of the embodiment of the present disclosure is shown.

[0029] Figure 6 A schematic diagram of a frame selection operation based on recommended frame selection according to an embodiment of the present disclosure is shown.

[0030] Figure 7A schematic diagram of a screenshot device in a live broadcast scenario according to an embodiment of the present disclosure is shown.

[0031] Figure 8 A schematic diagram of a computer readable medium illustrating an embodiment of the present disclosure is shown.

[0032] Fig. 9 A schematic diagram of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0033] The principles and spirit of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0034] Those skilled in the art will appreciate that the embodiments of the present disclosure may be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure may be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0035] According to an embodiment of the present disclosure, a screenshot method in a live broadcast scene, a screenshot device in a live broadcast scene, a computer-readable medium, and an electronic device are provided.

[0036] In this document, any number of elements in the drawings is used for illustration rather than limitation, and any naming is used only for distinction and does not have any limiting meaning.

[0037] The principle and spirit of the present disclosure are explained in detail below with reference to several representative embodiments of the present disclosure.

[0038] When using screenshots to capture and save instantaneous screen content in a live broadcast scenario, the saved screen content may not meet the user's expectations for triggering the screenshot operation, because there is a certain delay in the user's screenshot operation and the client's response to the screenshot operation. In a live broadcast scenario, it is also impossible to pause or replay the screen content, and the captured image may also be deformed and blurred as the screen content changes, greatly affecting the quality of the screenshot image.

[0039] In view of the above problems, in the art, the client-configured OpenGL ES (OpenGL for Embedded Systems), Metal and other graphics libraries can be used to capture the screen content as a screenshot image. The operating system can provide relevant APIs to access the pixel data in the GPU, such as the iOS system can provide glReadPixels and MTLTexture or the Android system can provide glReadPixels and EGLSurface, etc., so as to obtain a higher quality screenshot image. Although this solution obtains a better quality image than directly capturing the screen through the screenshot function, on the one hand, the code logic is relatively complex and requires adaptation and testing of the device model and system version; on the other hand, it still cannot solve the problem that the timing of the screenshot does not meet the user's expectations.

[0040] In the art, a large number of screenshot frames can be obtained by using the screenshot function or the screen recording function before and after the operation time point of the screenshot operation, and then these screenshot frames are provided to the user for the user to select the final screenshot result. On the one hand, the use of the screenshot or screen recording function may cause the screen content to be blurred and the resolution to be reduced; on the other hand, a large number of frame extraction operations need to be performed on the client, and these screenshot frames are decoded into the memory, resulting in a large amount of resource occupation, which may seriously affect the client application performance.

[0041] In an embodiment of the present disclosure, in response to the user's screenshot operation, a short-term video corresponding to the operation time point is obtained from the live video stream, thereby avoiding the problem of reduced resolution and blurred image caused by capturing or recording the system screen; and then an operation bar or a recommended frame is provided to the user based on the short-term video, so that the user can select a frame position in the short-term video based on the operation bar, or select from the recommended frames based on the analysis and processing on the server side to obtain a screenshot image, which is processed based on the short-term video. Through frame position selection, there is no need to separate and extract each frame image on the client side, or the recommended frame is analyzed and processed by the server side. On the basis of avoiding affecting the client application performance, the delay problem of screenshot timing is solved, and the screenshot quality is effectively improved.

[0042] After introducing the basic principles of the present invention, various non-limiting embodiments of the present invention are described in detail below.

[0043] Exemplary application scenarios

[0044] It should be noted that the following application scenarios are only shown to facilitate understanding of the spirit and principle of the present invention, and the embodiments of the present disclosure are not limited in this respect. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.

[0045] The screenshot method in the live broadcast scene of the embodiment of the present disclosure can be applied to a variety of application scenarios involving the capture of screen content.

[0046] In one application scenario, it can be an online live broadcast scenario such as e-commerce live broadcast, online class live broadcast, and monitoring live broadcast, and it is applied when the user uses the screenshot operation to capture the product information screen and knowledge display screen in the screen content.

[0047] In another application scenario, it may involve capturing video images in a video playback scenario, and capturing the desktop of a remote device in a remote control scenario, which is not specifically limited in the embodiments of the present disclosure.

[0048] Exemplary Methods

[0049] In combination with the above application scenarios, Figure 1 To describe a screenshot method in a live broadcast scenario according to an exemplary embodiment of the present disclosure.

[0050] like Figure 1 One of the step flow charts of the screenshot method in the live broadcast scene of the exemplary embodiment of the present disclosure is shown. The method can be applied to the client.

[0051] In the embodiments of the present disclosure, the client may refer to an application that provides different services and functions to users through a mobile device, such as instant messaging, email, gaming, trading, etc. The client usually has an operable interface and is adapted to the screen display and operation mode of the mobile device. It can also combine the hardware and software configuration of the mobile device, such as a camera, GPS (Global Positioning System), sensors, etc. to provide users with a variety of functions.

[0052] In the live broadcast scenario, the client can be a live broadcast application, which is used to broadcast video, audio or other content to users in real time. Live broadcast applications have high real-time and interactivity. When playing audio and video data collected by other devices, they can also interact with users of other devices through bullet screen messages and other methods. During the live broadcast process, it is usually impossible to pause or replay the screen content, and due to fluctuations in network quality, the live broadcast screen may also have problems with low resolution and blurred images. At this time, there are problems with delays in screenshot timing and low image quality when obtaining screenshot images.

[0053] The method may include the following steps 101 to 104:

[0054] Step 101: In response to a screenshot operation by a user, a short video of a preset duration is generated based on a live video stream at the time point of the screenshot operation.

[0055] In the embodiments of the present disclosure, the screenshot operation may be a preset user operation that triggers the screenshot function, such as a selection operation of a screenshot virtual button in the screen content, a tapping operation at a preset position or a preset number of times on the screen of a mobile device, or a pressing operation of a physical button on a mobile device, and the embodiments of the present disclosure do not limit this. When receiving the user's screenshot operation, it can be considered that the user has an intention to capture the screen content at the operation time point of the screenshot operation, so that a short-term video can be obtained at the operation time point in response to the screenshot operation.

[0056] In the disclosed embodiment, the short video is a preset duration generated based on the live video stream at the operation time point of the screenshot operation. The live video stream is video stream data that supports real-time playback pulled from the live broadcast party, and a short video of a preset duration is generated from the live video stream based on the operation time point, wherein the operation time point may correspond to the playback time point of the live video stream, so that the short video may include video clips before, after, or before and after the playback time point in the live video stream. The preset duration can be set according to conditions such as screenshot requirements and device configuration, such as 1 second, 3 seconds, 5 seconds, 10 seconds, etc., and the disclosed embodiment does not impose specific restrictions on this.

[0057] Step 102, obtaining the operation element corresponding to the short-time video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds one-to-one to the frame position in the short-time video, and the recommended frame is provided by the server after analyzing the short-time video.

[0058] In the embodiment of the present disclosure, the operation element can be an object generated after processing based on the extraction of frame information of the short-time video. The operation element is associated or corresponds to the video frame in the short-time video, and the video frame in the short-time video can be selected based on the operation element. For example, the operation element can be an operation bar, and the user can indirectly operate the short-time video through the operation bar. The operation position on the operation bar corresponds to the frame position in the short-time video one by one. Then, the corresponding frame position in the short-time video can be selected by selecting the operation position on the operation bar, and the frame position of the short-time video can be controlled to move forward or backward by controlling the front and back changes of the operation position on the operation bar; or, the operation element can be a recommended frame, which is provided by the server after analyzing the short-time video, and the video frame in the short-time video can be realized by selecting the recommended frame. Those skilled in the art can select the type and form of the operation element according to actual business needs, equipment configuration, etc., and the embodiment of the present disclosure does not impose specific restrictions on this.

[0059] Step 103: provide an operating element to the user, and receive a frame selection operation from the user based on the operating element.

[0060] On this basis, the operation element can be provided to the user so as to receive the frame selection operation based on the operation element. For example, when the operation element is an operation bar, the frame selection operation can be the selection of the operation position on the operation bar to select the corresponding frame position in the short video; when the operation element is a recommended frame, the frame selection operation can be the selection of the recommended frame.

[0061] Step 104: Acquire a screenshot image corresponding to the screenshot operation in response to the frame selection operation.

[0062] In the disclosed embodiment, in response to the frame selection operation of the user based on the operating element, a screenshot image corresponding to the screenshot operation is obtained based on the video frame selected by the user. For example, when the operating element is an operating bar, a screenshot image corresponding to the screenshot operation can be obtained in the short video based on the selected frame position, and when the operating element is a recommended frame, the selected recommended frame can be used as the screenshot image corresponding to the screenshot operation. On this basis, generating a short video based on a live video stream can avoid the delay problem of receiving and responding to the screenshot operation caused by the screenshot operation, and can also improve the image quality to a certain extent, and obtain a high-quality screenshot image that meets the user's expectations.

[0063] In an optional embodiment of the present disclosure, the frame selection operation includes selecting an operation position on the operation bar, and step 104 may specifically include the following step A.

[0064] Step A: according to the operation position selected by the frame selection operation on the operation bar, a video frame corresponding to the frame position is extracted from the short-time video, and determined as a screenshot image corresponding to the screenshot operation.

[0065] In the disclosed embodiment, the direction from one end to the other end of the operation bar can correspond to the temporal direction of the video frame in the short video. The starting end on the operation bar corresponds to the frame position of the starting video frame in the short video, and the end corresponds to the frame position of the ending video frame in the short video. On this basis, each operation position between the starting end and the end end on the operation bar corresponds in sequence to each video frame between the starting video frame and the ending video frame in the short video. The frame selection operation can be to select different operation positions on the operation bar, specifically, it can be to click on the corresponding operation position on the operation bar to make a selection, or it can be to pause at the corresponding operation position to make a selection during the process of dragging from one end to the other end of the operation bar.

[0066] Furthermore, according to the operation position selected by the frame selection operation on the operation bar, the video frame corresponding to the frame position is extracted from the short video, and the video frame is used as the screenshot image saved by the screenshot operation. At this time, a video frame image is decoded into the memory at the same time, which has little impact on application performance, small burden, and high processing efficiency.

[0067] In an optional embodiment of the present disclosure, the extracted video frame can be provided to the user, and the user's editing operation on the video frame can be received, such as operations such as zooming in, rotating, and cropping the video frame, or picture parameter adjustment operations, such as color tone, contrast, brightness, and other picture parameters. The user's saving operation, deletion operation, and sharing operation on the video frame can also be received. Among them, when the user's saving operation on the video is received, the video frame can be saved as a screenshot image, and when the user's deletion operation on the video frame is received, the video frame can be deleted from the memory and wait for the user's frame selection operation again.

[0068] like Figure 2 FIG. 1 is a schematic diagram of a frame selection operation based on the operation position selection on the operation bar according to an exemplary embodiment of the present disclosure. Figure 2 As shown, in the e-commerce live broadcast scenario, the user can watch the live broadcast through the display interface 201 of the client, and the display interface 201 includes a screenshot button 202. In response to the user's selection operation of the screenshot button 202, a short-time video of a preset duration is generated based on the live video stream at the operation time point. The operation bar 203 is obtained according to the short-time video. The operation bar 203 may include an operation key 2031 for indicating the operation position, and a display area 2032 for displaying the video frame corresponding to the frame position in the short-time video at the operation position. On this basis, the user drags the operation key 2031 to select different operation positions in the operation bar 203, and then extracts the video frame corresponding to the frame position in the short-time video at the operation position and displays it in the display area 2032.

[0069] like Figure 3 The second flowchart of the screenshot method in the live broadcast scene of the exemplary embodiment of the present disclosure is shown. The method can be applied to the client, wherein auxiliary information can be further provided on the operation bar based on the frame position of the short-time video. The method can include the following steps 301 to 307.

[0070] Step 301: In response to a screenshot operation by a user, a short video of a preset duration is generated based on a live video stream at the time point of the screenshot operation.

[0071] In the embodiment of the present disclosure, step 301 may correspond to the relevant description of the aforementioned step 101, and will not be described again here to avoid repetition.

[0072] Step 302: Obtain the operation element corresponding to the short video.

[0073] In the embodiment of the present disclosure, step 302 may correspond to the relevant description of the aforementioned step 102, and will not be described again here to avoid repetition.

[0074] In the embodiment of the present disclosure, the operating element may be an operation bar, and the operation bar may correspond to the relevant description in the aforementioned step A, and will not be described again here to avoid repetition.

[0075] Step 303: provide the user with an operation bar corresponding to the short video, and receive a position selection operation from the user on the operation bar.

[0076] In the embodiment of the present disclosure, an operation bar corresponding to the short video may be provided to the user, and a position selection operation of the user on the operation bar may be received. The triggering method of the position selection operation may correspond to the description of the frame selection operation in the aforementioned step A, and will not be described here to avoid repetition.

[0077] Step 304: Display a thumbnail of the video frame at the corresponding frame position according to the operation position corresponding to the position selection operation.

[0078] In the disclosed embodiment, when a user selects a position on the operation bar, the operation position of the position selection operation can be determined, and then the frame position corresponding to the operation position in the short video can be determined. At this time, a thumbnail of the video frame at the frame position in the short video can be obtained, that is, the corresponding video frame is extracted and decoded according to the frame position, and a thumbnail is generated based on the video frame. The thumbnail can be an image of the video frame after compression processing, which is smaller in size, fast in loading speed, suitable for quick browsing, and can efficiently and intuitively display relevant information of the video frame to the user.

[0079] Furthermore, the thumbnail may be displayed at the operation position corresponding to the operation bar, or may be displayed at other positions of the display interface, such as the center or corner of the display interface, which is not limited in this embodiment of the present disclosure.

[0080] Step 305: Receive a frame selection operation based on an operation element by the user.

[0081] In the embodiment of the present disclosure, step 305 may correspond to the relevant description of the aforementioned step 103, and will not be described again here to avoid repetition.

[0082] In an optional embodiment of the present disclosure, the frame selection operation includes selecting a thumbnail.

[0083] In the embodiment of the present disclosure, when thumbnails are displayed on the operation bar, the frame selection operation may include selecting the thumbnails.

[0084] Step 306: Determine the operation position on the operation bar according to the thumbnail selected by the frame selection operation.

[0085] In the embodiment of the present disclosure, when a thumbnail is selected in the frame selection operation, the selection of the thumbnail can be used as the selection of the operation position on the operation bar, so that the operation position on the operation bar is determined according to the thumbnail selected by the frame selection operation.

[0086] Step 307: extract a video frame at a corresponding frame position in the short video according to the operation position corresponding to the thumbnail, and determine it as a screenshot image corresponding to the screenshot operation.

[0087] In the embodiment of the present disclosure, step 307 of determining the screenshot image according to the operation position corresponding to the thumbnail may correspond to the related description of determining the screenshot image according to the operation position on the operation bar in the aforementioned step 104, which will not be described again to avoid repetition.

[0088] In an optional embodiment of the present disclosure, the video frame can also be saved when the thumbnail is generated. When the thumbnail is selected by a frame selection operation, the corresponding video frame is used as the screenshot image corresponding to the screenshot operation, thereby further improving the efficiency of determining the screenshot image.

[0089] like Figure 4 FIG. 1 is a schematic diagram of a frame selection operation based on thumbnail selection on an operation bar according to an exemplary embodiment of the present disclosure. Figure 4 As shown, in the e-commerce live broadcast scenario, the user can watch the live broadcast through the display interface 401 of the client, and the display interface 401 includes a screenshot button 402. In response to the user's selection operation of the screenshot button 402, a short-time video of a preset duration is generated based on the live video stream at the operation time point. The operation bar 403 is obtained according to the short-time video. The operation bar 403 may include an operation key 4031 for indicating the operation position, and a thumbnail 4033 corresponding to the video frame of the frame position in the short-time video corresponding to the operation position can be suspended on the operation key 4031, and a display area 4032 is used to display the video frame of the frame position in the short-time video corresponding to the operation position.

[0090] On this basis, the user drags the operation key 4031 to select a different operation position in the operation bar 403, and then a thumbnail 4033 corresponding to the video frame corresponding to the frame position in the short video at the operation position is displayed floating on the operation key 4031, and when the thumbnail 4033 is selected, the corresponding video frame is displayed in the display area 4032.

[0091] like Figure 5 The third step flow chart of the screenshot method in the live broadcast scene of the exemplary embodiment of the present disclosure is shown. The method can be applied to the client, and the method can include the following steps 501 to 505.

[0092] Step 501: In response to a screenshot operation by a user, a short video of a preset duration is generated based on a live video stream at the time point of the screenshot operation.

[0093] In the embodiment of the present disclosure, step 501 may correspond to the relevant description of the aforementioned step 101, and will not be described again here to avoid repetition.

[0094] Step 502: Send the short video to the server; the server is used to analyze the short video using the video frame corresponding to the operation time point of the screenshot operation as a reference frame to obtain at least one recommended frame; the analysis includes at least one of face recognition analysis, key point detection analysis and large model analysis.

[0095] In the disclosed embodiment, after the client generates a short-time video based on the live video stream, the client can send the short-time video to the server. Based on the interaction with the server, the server can be responsible for extracting, decoding and analyzing the video frames in the short-time video.

[0096] On the server side, since the operation time point of the screenshot operation indicates the time when the user intends to take a screenshot, it can be considered that the probability that the video frame corresponding to the operation time point of the screenshot operation in the short video meets the user's expectations is high. On this basis, the video frame corresponding to the operation time point of the screenshot operation can be used as a reference frame for analysis, and at least one recommended frame can be obtained from the video frames in the short video. The server side's analysis of the video frames in the short video can include face recognition analysis, key point detection analysis, and large model analysis, among which face recognition analysis can refer to the reference frame to determine whether there is a similar face and whether the face picture information is clear; key point detection analysis can refer to the reference frame to determine the change of the portrait action; large model analysis can refer to the reference frame to understand the semantic information of the video frame, such as the objects contained and the interactive relationship between objects. Different analysis strategies can be selected according to different live broadcast scenes, such as selecting video frames similar to the reference frame with clear facial expressions and clear portrait actions as recommended frames in the live broadcast scene of program performances, selecting video frames similar to the reference frame with interaction between portrait actions and commodities as recommended frames in the e-commerce promotion scene, and selecting video frames with no portraits or few portraits as recommended frames in the live broadcast scene of scenic spots. Those skilled in the art may configure appropriate analysis strategies on the server side according to actual business scenario requirements, such as repeatability analysis, fuzziness analysis, etc., and the embodiments of the present disclosure do not impose specific limitations on this.

[0097] On the server side, there is no specific limit on the number of recommended frames obtained, and it can be set according to the client's business needs and the configuration conditions of the mobile device, such as 3, 5, 10, etc. When there are many video frames in a short video, based on the analysis of the screen content, scoring, sorting, voting and other methods can be used to screen to obtain recommended frames with a high probability and high quality that meet the user's screenshot intention. After obtaining the recommended frame, the server can send the recommended frame to the client.

[0098] In an optional embodiment of the present disclosure, the server is further configured to perform super-resolution processing on the recommended frame.

[0099] Furthermore, on the basis of selecting the recommended frames from the video frames of the short video, the server may also perform super-resolution processing on the recommended frames to make them high-definition and improve the image quality.

[0100] Step 503: Receive at least one recommended frame provided by the server.

[0101] In the disclosed embodiment, the client may receive a recommended frame provided by the server. The recommended frame is obtained from the short-term video after being analyzed and processed by the server, and to a certain extent meets the user's screenshot intention and has a high picture quality.

[0102] Step 504: provide an operating element to the user, and receive a frame selection operation from the user based on the operating element.

[0103] In the embodiment of the present disclosure, the operation element at this time is a recommendation frame provided by the server, and step 504 may correspond to the relevant description of the aforementioned step 103, which will not be described again to avoid repetition.

[0104] Among them, providing recommended frames to users can display the recommended frames in the display interface of the client. When the number of recommended frames is greater than one, different recommended frames can be displayed independently in a tiled manner or in a stacked manner, and switched with animation effects such as page turning, sliding in and out, etc. At this time, there is no need to operate or even display the short video, and a preview of the recommended frames can be directly provided, and the frame selection operation of different recommended frames by the user can be received, which simplifies the operation process at the user level and improves the picture quality.

[0105] Step 505: determine the recommended frame selected by the frame selection operation as the screenshot image corresponding to the screenshot operation.

[0106] In the embodiment of the present disclosure, the frame selection operation is to select from the recommended frames, and at this time the selected recommended frame can be directly determined as the screenshot image corresponding to the screenshot operation.

[0107] like Figure 6 FIG. 1 is a schematic diagram of a frame selection operation based on recommended frame selection according to an exemplary embodiment of the present disclosure. Figure 6 As shown, in the e-commerce live broadcast scenario, the user can watch the live broadcast through the display interface 601 of the client, and the display interface 601 includes a screenshot button 602. In response to the user's selection operation of the screenshot button 602, a short video of a preset duration is generated based on the live video stream at the operation time point. According to the short video, the recommended frame is obtained from the server 603. In the display interface 601, the recommended frame 604 is displayed in a stacked form and can be switched with a page turning animation effect.

[0108] On this basis, the user selects a screenshot image in the recommended frame 604 .

[0109] According to the screenshot method in the live broadcast scene of the embodiment of the present disclosure, the client can respond to the user's screenshot operation and generate a short video of a preset duration based on the live video stream at the operation time point of the screenshot operation; then obtain the operation element corresponding to the short video, the operation element can be an operation bar or a recommended frame, wherein the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by the server after analyzing the short video; on this basis, the operation element can be provided to the user, and the user's frame selection operation based on the operation element can be received, and then the screenshot image corresponding to the screenshot operation is obtained in response to the frame selection operation. The method obtains a short video corresponding to the operation time point from a live video stream in response to a user's screenshot operation, and then provides an operation bar or a recommended frame to the user based on the short video, so that the user can select a frame position in the short video based on the operation bar, or select from the recommended frames based on server-side analysis and processing, thereby obtaining a screenshot image, which is processed based on the short video. Through frame position selection, there is no need to separate and extract each frame image on the client, or the recommended frame is analyzed and processed by the server. On the basis of avoiding affecting the client application performance, the delay problem of screenshot timing is solved, and the screenshot quality is effectively improved.

[0110] Exemplary Devices

[0111] After introducing the screenshot method in the live broadcast scene of the exemplary embodiment of the present disclosure, next, refer to Figure 7 A screenshot device in a live broadcast scenario according to an exemplary embodiment of the present disclosure is described.

[0112] It should be noted that other specific details of each functional module of the screenshot device in the live broadcast scene of the embodiment of the present disclosure have been described in detail in the implementation of the screenshot method in the above-mentioned live broadcast scene, and will not be repeated here.

[0113] Figure 7 A screenshot device 700 in a live broadcast scene of an exemplary embodiment of the present disclosure is shown. The device can be applied to a client, and the device may include: a short video generation module 701, for generating a short video of a preset duration based on a live video stream at an operation time point of the screenshot operation in response to a user's screenshot operation; an operation element acquisition module 702, for acquiring an operation element corresponding to the short video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by the server after analyzing the short video; an operation element display module 703, for providing the user with the operation element and receiving a frame selection operation of the user based on the operation element; a screenshot image determination module 704, for acquiring a screenshot image corresponding to the screenshot operation in response to the frame selection operation.

[0114] In an optional embodiment of the present disclosure, the frame selection operation includes selecting an operation position on an operation bar, and the screenshot image determination module 704 is specifically used to extract a video frame of a corresponding frame position in the short video according to the operation position selected by the frame selection operation on the operation bar, and determine it as a screenshot image corresponding to the screenshot operation.

[0115] In an optional embodiment of the present disclosure, the operation element display module 703 is specifically used to provide the user with an operation bar corresponding to the short video, and receive the user's position selection operation on the operation bar; according to the operation position corresponding to the position selection operation, a thumbnail of the video frame at the corresponding frame position is displayed.

[0116] In an optional embodiment of the present disclosure, the frame selection operation includes selecting a thumbnail, and the screenshot image determination module 704 is specifically used to determine the operation position on the operation bar according to the thumbnail selected by the frame selection operation; according to the operation position corresponding to the thumbnail, the video frame of the corresponding frame position is extracted in the short video, and determined as the screenshot image corresponding to the screenshot operation.

[0117] In an optional embodiment of the present disclosure, the operation element acquisition module 702 is specifically used to send the short video to the server; the server is used to analyze the short video with the video frame corresponding to the operation time point of the screenshot operation as the reference frame to obtain at least one recommended frame; the analysis includes at least one of face analysis, key point analysis and large model analysis; and receive at least one recommended frame provided by the server.

[0118] In an optional embodiment of the present disclosure, the screenshot image determination module 704 is specifically configured to determine the recommended frame selected by the frame selection operation as the screenshot image corresponding to the screenshot operation.

[0119] In an optional embodiment of the present disclosure, the server is further configured to perform super-resolution processing on the recommended frame.

[0120] According to the screenshot device in the live broadcast scene of the embodiment of the present disclosure, the client can respond to the user's screenshot operation and generate a short video of a preset duration based on the live video stream at the operation time point of the screenshot operation; then obtain the operation element corresponding to the short video, the operation element can be an operation bar or a recommended frame, wherein the operation position of the operation bar corresponds one-to-one to the frame position in the short video, and the recommended frame is provided by the server after analyzing the short video; on this basis, the operation element can be provided to the user, and the user's frame selection operation based on the operation element can be received, and then the screenshot image corresponding to the screenshot operation is obtained in response to the frame selection operation. The method obtains a short video corresponding to the operation time point from a live video stream in response to a user's screenshot operation, and then provides an operation bar or a recommended frame to the user based on the short video, so that the user can select a frame position in the short video based on the operation bar, or select from the recommended frames based on server-side analysis and processing, thereby obtaining a screenshot image, which is processed based on the short video. Through frame position selection, there is no need to separate and extract each frame image on the client, or the recommended frame is analyzed and processed by the server. On the basis of avoiding affecting the client application performance, the delay problem of screenshot timing is solved, and the screenshot quality is effectively improved.

[0121] It should be noted that although several modules or units of the screenshot device in the live broadcast scene are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units for concretization.

[0122] Exemplary computer readable media

[0123] The following is a description of a computer-readable medium according to an exemplary embodiment of the present disclosure.

[0124] In this exemplary embodiment, reference Figure 8 As shown, a program product 800 for implementing the above method according to an exemplary embodiment of the present disclosure is described, such as a portable compact disk read-only memory (CD-ROM) and including program code, and can be run on a device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a computer-readable medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus, or a device.

[0125] The program product 800 may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a computer readable medium. The computer readable medium may be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples (non-exhaustive list) of computer readable media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0126] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than computer readable media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0127] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RE, etc., or any suitable combination of the foregoing.

[0128] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user computing device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (FAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0129] Exemplary Electronic Devices

[0130] refer to Fig. 9 An electronic device according to an exemplary embodiment of the present disclosure is described.

[0131] Fig. 9 The electronic device 900 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0132] like Fig. 9 As shown, the electronic device 900 is in the form of a general computing device. The components of the electronic device 900 may include, but are not limited to: at least one processing unit 910, at least one storage unit 920, a bus 930 connecting different system components (including the storage unit 920 and the processing unit 910), and a display unit 940.

[0133] The storage unit stores program codes, which can be executed by the processing unit 910, so that the processing unit 910 performs the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 910 can perform the following steps: Figure 1 , 3 and the method steps shown in 5, etc.

[0134] The storage unit 920 may include a volatile storage unit, such as a random access storage unit (RAM) 921 and / or a cache storage unit 922 , and may further include a read-only storage unit (ROM) 923 .

[0135] The storage unit 920 may also include a program / utility 924 having a set (at least one) of program modules 925, such program modules 925 including but not limited to: an operating system, one or more server applications, other program modules and program data, each of which or some combination may include an implementation of a network environment.

[0136] The bus 930 may include a data bus, an address bus, and a control bus.

[0137] The electronic device 900 can also communicate with one or more external devices 1000 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), and this communication can be performed through an input / output (I / O) interface 950. The electronic device 900 also includes a display unit 940, which is connected to the input / output (I / O) interface 950 for display. In addition, the electronic device 900 can also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs) and / or public networks, such as the Internet) through a network adapter 960. As shown in the figure, the network adapter 960 communicates with other modules of the electronic device 900 through a bus 930. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 900, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0138] It should be noted that, although several modules or submodules of the device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.

[0139] In addition, although the operations of the disclosed method are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0140] Although the spirit and principle of the present disclosure have been described with reference to several specific embodiments, it should be understood that the present disclosure is not limited to the disclosed specific embodiments, and the division of various aspects does not mean that the features in these aspects cannot be combined to benefit, and such division is only for the convenience of expression. The present disclosure is intended to cover various modifications and equivalent arrangements included in the spirit and scope of the attached claims.

Claims

1. A screenshot method in a live broadcast scene, characterized in that: The method is applied to a client, and the method comprises: In response to a screenshot operation of a user, generating a short video of a preset duration based on the live video stream at the operation time point of the screenshot operation; Acquire an operation element corresponding to the short-time video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds to the frame position in the short-time video one by one, and the recommended frame is provided by the server after analyzing the short-time video; providing the operating element to a user, and receiving a frame selection operation of the user based on the operating element; In response to the frame selection operation, a screenshot image corresponding to the screenshot operation is acquired.

2. The method according to claim 1, characterized in that The frame selection operation includes selecting an operation position on the operation bar, and acquiring a screenshot image corresponding to the screenshot operation in response to the frame selection operation includes: According to the operation position selected by the frame selection operation on the operation bar, the video frame corresponding to the frame position is extracted from the short video and determined as the screenshot image corresponding to the screenshot operation.

3. The method according to claim 1, characterized in that The providing the operation element to the user comprises: Providing the user with an operation bar corresponding to the short video, and receiving a position selection operation from the user on the operation bar; According to the operation position corresponding to the position selection operation, a thumbnail of the video frame at the corresponding frame position is displayed.

4. The method according to claim 3, characterized in that The frame selection operation includes selecting the thumbnail, and acquiring the screenshot image corresponding to the screenshot operation in response to the frame selection operation includes: determining the operation position on the operation bar according to the thumbnail image selected by the frame selection operation; According to the operation position corresponding to the thumbnail, the video frame corresponding to the frame position is extracted from the short video and determined as the screenshot image corresponding to the screenshot operation.

5. The method according to claim 1, characterized in that The obtaining of the operation element corresponding to the short-time video includes: The short-time video is sent to a server; the server is used to analyze the short-time video to obtain at least one recommended frame by taking the video frame corresponding to the operation time point of the screenshot operation as a reference frame; the analysis includes at least one of face recognition analysis, key point detection analysis and large model analysis; Receive at least one recommendation frame provided by the server.

6. The method according to claim 5, characterized in that The acquiring, in response to the frame selection operation, a screenshot image corresponding to the screenshot operation comprises: The recommended frame selected by the frame selection operation is determined as the screenshot image corresponding to the screenshot operation.

7. The method according to claim 5, characterized in that The server is also used to perform super-resolution processing on the recommended frame.

8. A screenshot device in a live broadcast scene, characterized in that: The device is applied to a client, and comprises: A short-time video generation module, configured to generate a short-time video of a preset duration based on a live video stream at an operation time point of the screen capture operation in response to a user's screen capture operation; An operation element acquisition module is used to acquire an operation element corresponding to the short-time video; the operation element includes at least one of an operation bar and a recommended frame, the operation position of the operation bar corresponds to the frame position in the short-time video one by one, and the recommended frame is provided by the server after analyzing the short-time video; An operation element display module, used to provide the operation element to the user and receive a frame selection operation of the user based on the operation element; The screenshot image determination module is used to obtain the screenshot image corresponding to the screenshot operation in response to the frame selection operation.

9. A computer-readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the screenshot method in a live broadcast scene according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the screenshot method in the live broadcast scene described in any one of claims 1 to 7 by executing the executable instructions.

Images