Image-based work publishing method, device, electronic device and storage medium

Abstract

The present disclosure provides a method, device, electronic device and storage medium for publishing works based on images, belonging to the field of multimedia technology. The method includes: in response to a work publishing request, displaying multiple candidate resources, the multiple candidate resources include a video; in response to a selection operation of a video, displaying a video and an image capture control, the image capture control is used to capture an image from the video to publish the work; when the video is at any playback time point, in response to a triggering operation of the image capture control, a first image is captured from the video, the first image is rendered based on the video data at the playback time point in the video; the first image is displayed; in response to a work publishing operation, based on the first image, a work containing the first image is published. The above method can directly obtain the original image in the video without cropping, and the operation is simple, so that the work can be published based on the captured image more quickly, and the publishing efficiency of the work can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to a method, device, electronic device and storage medium for publishing image-based works. Background Art

[0002] With the development of multimedia technology, more and more people are accustomed to posting the photos they take on social platforms to interact with other users. Since most people don’t like the feeling of deliberately posing when taking photos, and recording videos is more like casual snapshots, most people usually record videos first, then capture the images they like and have a sense of snapshots from the videos to create works and publish them.

[0003] In the related art, the commonly used method is to use the screenshot function configured on the mobile phone system to capture the required image during video playback, and then crop it to cut out the redundant part of the screen (such as the time, power and other information at the top of the mobile phone screen), and finally create a work with the cropped image and publish it to the social platform. However, the above technical solution is cumbersome to operate and affects the efficiency of publishing the work. Summary of the invention

[0004] The present disclosure provides a method, device, electronic device and storage medium for publishing works based on images, which can directly obtain the original image in the video without cutting, and is easy to operate, so that works can be published based on the intercepted images quickly, and the publishing efficiency of works can be improved. The technical solution of the present disclosure is as follows.

[0005] According to one aspect of an embodiment of the present disclosure, a method for publishing an image-based work is provided, comprising:

[0006] In response to a work publishing request, displaying a plurality of candidate resources, wherein the plurality of candidate resources include a video, and the video is used to provide an image used for the work publishing;

[0007] In response to a selection operation on the video, displaying the video and an image capture control, wherein the image capture control is used to capture an image from the video to publish a work;

[0008] When the video is at any playback time point, in response to a triggering operation on the image capture control, a first image is captured from the video, where the first image is rendered based on video data at the playback time point in the video;

[0009] displaying the first image;

[0010] In response to a work publishing operation, based on the first image, a work including the first image is published.

[0011] According to another aspect of an embodiment of the present disclosure, there is provided an image-based work publishing device, comprising:

[0012] The display unit is configured to display a plurality of candidate resources in response to a work publishing request, wherein the plurality of candidate resources include a video, and the video is used to provide an image for publishing the work; in response to a selection operation of the video, the video and an image capture control are displayed, and the image capture control is used to capture an image from the video to publish the work;

[0013] a capture unit configured to capture a first image from the video in response to a triggering operation on the image capture control when the video is at any playback time point, the first image being rendered based on video data at the playback time point in the video;

[0014] The display unit is further configured to display the first image;

[0015] The publishing unit is configured to execute, in response to a work publishing operation, publishing a work including the first image based on the first image.

[0016] In some embodiments, the display unit is configured to execute, in response to a preview operation on the video, play the video in the resource preview interface, and display the image capture control.

[0017] In some embodiments, the display unit is further configured to display a playback progress bar of the video in the resource preview interface during the playback of the video; determine a playback time point indicated by the adjustment operation in response to an adjustment operation on the playback progress bar; and display a single frame image corresponding to the playback of the video to the playback time point.

[0018] In some embodiments, the resource preview interface includes a video display area and an image display area, the video display area is used to present a video providing an image, and the image display area is used to present an image captured from the video;

[0019] The display unit is configured to display the first image in the image display area in the resource preview interface.

[0020] In some embodiments, the image display area displays a plurality of images, and the plurality of images are images captured at different playback time points;

[0021] The device also includes:

[0022] The deleting unit is configured to execute, for any image among the multiple images, deleting the image from the image display area in response to a deleting operation on the image.

[0023] In some embodiments, a first publishing control is displayed in the resource preview interface, and the first publishing control is used to publish a work containing an image in the image display area;

[0024] The publishing unit is configured to execute, in response to a triggering operation on the first publishing control, generate a work based on all images in the image display area, and publish the work, wherein the image display area includes the first image.

[0025] In some embodiments, the display unit is configured to display the video in response to a selection operation on the video; and display the image capture control in a resource editing interface in response to an editing operation on the video.

[0026] In some embodiments, the display unit is further configured to execute in response to an editing operation on the video, display a timeline of the video in the resource editing interface, wherein the timeline displays multiple frames of images in the video; in response to an adjustment operation on the timeline, determine a playback time point indicated by the adjustment operation; and display that the picture currently presented by the video is a single frame image corresponding to the playback time point.

[0027] In some embodiments, the display unit is further configured to add the first image as a resource independent of the video to the timeline in the resource editing interface.

[0028] In some embodiments, a second publishing control is displayed in the resource editing interface, and the second publishing control is used to publish a work containing resources in the timeline;

[0029] The publishing unit is configured to execute, in response to a triggering operation on the second publishing control, generate a work based on resources in the timeline, and publish the work, wherein the resources in the timeline include the first image and the edited video.

[0030] In some embodiments, the publishing unit includes:

[0031] an acquisition subunit, configured to execute, in response to the work publishing operation, acquiring at least one work material based on the first image, wherein the at least one work material conforms to the style of the first image;

[0032] The publishing subunit is configured to generate a work including the first image based on the first image and at least one work material, and publish the work.

[0033] In some embodiments, the acquisition subunit is configured to perform at least one of the following:

[0034] Based on the first image, generate a title text, wherein the title text is used to describe the content of the first image;

[0035] Based on the first image, obtaining background audio;

[0036] Based on the first image, special effect materials are obtained, where the special effect materials are used to represent the presentation method of the first image in the work.

[0037] In some embodiments, the apparatus further comprises:

[0038] The adjustment unit is configured to execute: if the number of adjustments to the playback time point of the video within a preset time period exceeds a preset number, an adjustment range is determined based on the playback time point indicated by the adjustment operation of the adjustment number; if the adjustment range is lower than the preset range, the playback time points indicated by the adjustment operation of the adjustment number are averaged to obtain a first playback time point; and the video is adjusted to the first playback time point.

[0039] In some embodiments, the apparatus further comprises:

[0040] The adjustment unit is configured to determine an adjustment range based on the play time points indicated by the adjustment operations of the number of adjustments if the number of adjustments to the play time point of the video within a preset time period exceeds a preset number; if the adjustment range is lower than the preset range, average the play time points indicated by the adjustment operations of the number of adjustments to obtain a first play time point;

[0041] The capture unit is configured to capture and display a second image from the video based on the first playback time point, where the second image is rendered based on the video data at the first playback time point in the video.

[0042] In some embodiments, there are multiple videos, and the first image comes from the first video;

[0043] The device also includes:

[0044] The capture unit is further configured to execute, in response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, capture a third image from the second video, wherein the third image is rendered based on the video data at the playback time point in the second video;

[0045] The display unit is further configured to display the third image;

[0046] The publishing unit is configured to execute, in response to the work publishing operation, publishing a work including the first image and the third image based on the first image and the third image.

[0047] In some embodiments, the capture unit is configured to execute, in response to the first video switching to the second video, display the second video at a second playback time point based on the first image, and the image presented by the second video at the second playback time point is the same as the style of the first image; in response to the triggering operation of the image capture control, capture the third image from the second video, and the third image is the same as the style of the first image.

[0048] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0049] one or more processors;

[0050] A memory for storing program codes executable by the processor;

[0051] The processor is configured to execute the program code to implement the above-mentioned image-based work publishing method.

[0052] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When a program code in the computer-readable storage medium is executed by a processor of an electronic device, the electronic device is enabled to execute the above-mentioned image-based work publishing method.

[0053] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program / instruction, which implements the above-mentioned image-based work publishing method when executed by a processor.

[0054] The disclosed embodiment provides a method for publishing works based on images. In the process of publishing works based on images, by displaying a video and an image capture control, a user can directly capture an image at any playback time point from the video through the image capture control. Since the captured image is rendered based on the video data at the playback time point, compared with the screenshot function of the device in the prior art which reduces the clarity, the image captured by this solution not only has a clarity that meets the original clarity of the video, but also does not contain content outside the video. Therefore, this solution can directly obtain the original image in the video without cropping, and the operation is simple, so that the work can be published quickly based on the captured image, and there is no need to download it to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the publishing efficiency of the work.

[0055] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0057] Figure 1 The figure is a schematic diagram of an implementation environment of an image-based work publishing method according to an exemplary embodiment.

[0058] Figure 2 The figure is a flowchart of a method for publishing works based on images according to an exemplary embodiment.

[0059] Figure 3 The figure is a flowchart of another method for publishing works based on images according to an exemplary embodiment.

[0060] Figure 4 The figure is a schematic diagram of capturing an image in a video preview scenario according to an exemplary embodiment.

[0061] Figure 5 The figure is a schematic diagram of capturing an image in a video editing scenario according to an exemplary embodiment.

[0062] Figure 6 The invention is a block diagram of an apparatus for publishing works based on images according to an exemplary embodiment.

[0063] Figure 7 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0064] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0065] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0066] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the videos involved in this disclosure were obtained with full authorization.

[0067] Figure 1 FIG. 1 is a schematic diagram of an implementation environment of an image-based work publishing method according to an exemplary embodiment. Figure 1 , the implementation environment specifically includes: a terminal 101 and a server 102.

[0068] The terminal 101 is at least one of a smart phone, a smart watch, a desktop computer, a laptop, an MP3 player, an MP4 player, and a laptop computer. An application that supports the publication of works is installed and run on the terminal 101. The application may be a multimedia application, a social application, or a game application, etc., which is not limited in the embodiments of the present disclosure. A user can log in to the application through the terminal 101 to obtain the services provided by the application. For example, a user can create and publish a work through the application on the terminal 101. The work may be a short video or a photo album, etc., which is not limited in the embodiments of the present disclosure. The terminal 101 can be connected to the server 102 via a wireless network or a wired network, and can then send the work created by the user to the server 102, which is then sent to other terminals by the server 102.

[0069] The terminal 101 generally refers to one of a plurality of terminals, and the present embodiment is described by taking the terminal 101 as an example. Those skilled in the art may know that the number of the above terminals may be more or less. For example, the above terminals may be several, or the above terminals may be dozens or hundreds, or a greater number. The present embodiment does not limit the number and device type of the terminals.

[0070] The server 102 is at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. The server 102 can be connected to the terminal 101 and other terminals via a wireless network or a wired network. The server 102 can receive works created by users sent by the terminal 101, and send the received works to other terminals so that other users can view the works published by the user through other terminals. In some embodiments, the number of the above servers can be more or less, and the embodiments of the present disclosure are not limited to this. Of course, the server 102 also includes other functional servers to provide more comprehensive and diversified services.

[0071] Figure 2 is a flowchart of a method for publishing works based on images according to an exemplary embodiment. Figure 2 , the image-based work publishing method is applied in a terminal and includes the following steps.

[0072] In step 201, in response to a work publishing request, the terminal displays a plurality of candidate resources, the plurality of candidate resources including a video, and the video is used to provide an image used for the work publishing.

[0073] In the disclosed embodiment, a user can create and publish a work through a terminal. The work can be a short video or a photo collection, etc., which is not limited in the disclosed embodiment. In the process of creating a work, the terminal displays a work publishing interface (or a work creation interface). The user can upload the work material used to create the work in the work publishing interface. The work material can be resources such as videos and images, which is not limited in the disclosed embodiment.

[0074] The image used to make the work can come from a video. The video providing the image can be any video, which is not limited in the embodiment of the present disclosure. In response to the work publishing request, the terminal displays multiple candidate resources. The user can select the material for making the work from the multiple candidate resources.

[0075] In step 202, in response to the selection operation of the video, the terminal displays the video and an image capture control, where the image capture control is used to capture an image from the video to publish the work.

[0076] In the embodiment of the present disclosure, during the process of making a work, the terminal displays the video and image capture control selected by the user, so that the image used for making the work can be captured from the video through the image capture control. The embodiment of the present disclosure does not limit the display position of the image capture control.

[0077] In step 203, when the video is at any playback time point, in response to a triggering operation on an image capture control, the terminal captures a first image from the video, where the first image is rendered based on video data at the playback time point in the video.

[0078] In the disclosed embodiment, for any playback time point in the video, when the video is at the playback time point, in response to the image capture control being triggered, the terminal obtains a first image based on the video data at the playback time point in the video, so as to achieve the purpose of capturing the image at the playback time point from the video. The clarity of the first image is the same as the clarity of the video. That is, the first image is equivalent to the original image at the playback time point in the video.

[0079] The terminal can play the video, and when the video is played to any play time point, the terminal can capture the image at the play time point from the video. Alternatively, the terminal may not play the video. In response to the adjustment operation on the play progress of the video, the terminal adjusts the video to the play time point indicated by the adjustment operation, so that the image at the play time point can be captured from the video later. The embodiment of the present disclosure does not limit the play state of the video.

[0080] In step 204, the terminal displays the first image.

[0081] In the embodiment of the present disclosure, after the first image is captured, the terminal displays the first image to show the user the image capture effect. The embodiment of the present disclosure does not limit the display position of the first image.

[0082] In step 205, in response to the work publishing operation, the terminal publishes the work including the first image based on the first image.

[0083] In the embodiment of the present disclosure, when the work publishing operation is triggered, the terminal generates and publishes the work based on the first image. For example, the terminal can add background audio, stickers, special effects and other materials based on the first image to generate the work. The embodiment of the present disclosure does not limit the way of generating the work. Then, the terminal publishes the work so that other users can see the work.

[0084] The disclosed embodiment provides a method for publishing works based on images. In the process of publishing works based on images, by displaying a video and an image capture control, a user can directly capture an image at any playback time point from the video through the image capture control. Since the captured image is rendered based on the video data at the playback time point, compared with the screenshot function of the device in the prior art which reduces the clarity, the image captured by this solution not only has a clarity that meets the original clarity of the video, but also does not contain content outside the video. Therefore, this solution can directly obtain the original image in the video without cropping, and the operation is simple, so that the work can be published quickly based on the captured image, and there is no need to download it to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the publishing efficiency of the work.

[0085] In some embodiments, in response to a selection operation on a video, a video and image capture control is displayed, including:

[0086] In response to the preview operation on the video, the video is played in the resource preview interface and the image capture control is displayed.

[0087] The solution provided by the embodiments of the present disclosure can play videos during the process of publishing works based on images, allowing users to preview the videos so that users can find the images they want to capture from the videos, and then capture them through the image capture control to directly obtain the original images in the video. This is not only simple to operate and can improve the efficiency of publishing works based on images, but also ensures image quality and does not reduce clarity.

[0088] In some embodiments, the method further comprises:

[0089] During the video playback, the video playback progress bar is displayed in the resource preview interface;

[0090] In response to an adjustment operation on the play progress bar, determining a play time point indicated by the adjustment operation;

[0091] Displays a single frame image corresponding to the video playback time point.

[0092] The solution provided by the embodiment of the present disclosure allows the user to adjust the playback progress of the video by displaying the playback progress bar of the video when the video is played in the resource preview interface, which is beneficial for the user to find the image to be captured in the video. The operation is simple, and the efficiency of image capture can be improved, thereby improving the efficiency of publishing works.

[0093] In some embodiments, the resource preview interface includes a video display area and an image display area, the video display area is used to present the video providing the image, and the image display area is used to present the image captured from the video;

[0094] Display the first image, including:

[0095] In the image display area in the resource preview interface, the first image is displayed.

[0096] The solution provided by the embodiment of the present disclosure can display the image in the resource preview interface after it is captured, so as to intuitively show the user the image capture effect, which not only improves the utilization rate of the resource preview interface, but also facilitates the user to quickly understand the captured image, thereby publishing works based on the image, which is conducive to improving the publishing efficiency of the works.

[0097] In some embodiments, a plurality of images are displayed in the image display area, and the plurality of images are images captured at different playback time points;

[0098] The method also includes:

[0099] For any image among the multiple images, in response to a deletion operation on the image, the image is deleted from the image display area.

[0100] The solution provided by the disclosed embodiment can display the captured image in the image display area, intuitively showing the user the image capture effect, so that the user can quickly understand the captured image and make choices among the captured images, that is, delete unsatisfactory images, which is conducive to the subsequent production of works based on the images that satisfy the user. This not only meets the user's intention but also ensures the quality of the work.

[0101] In some embodiments, a first publishing control is displayed in the resource preview interface, and the first publishing control is used to publish a work containing an image in the image display area;

[0102] In response to the work publishing operation, based on the first image, publishing the work including the first image includes:

[0103] In response to a triggering operation on the first publishing control, a work is generated based on all images in the image display area, and the work is published, wherein the image display area includes the first image.

[0104] The solution provided by the embodiment of the present disclosure displays a first publishing control in the resource preview interface, so that the user can use the first publishing control to create and publish works based on all images captured from the video. The operation is simple and can improve the production efficiency and publishing efficiency of the works.

[0105] In some embodiments, in response to a selection operation on a video, a video and image capture control is displayed, including:

[0106] In response to a selection operation on a video, displaying the video;

[0107] In response to the editing operation on the video, an image capture control is displayed in the resource preview interface.

[0108] The solution provided by the embodiments of the present disclosure can edit (clip) a video in the process of publishing works based on images, so that the user can find the image to be captured from the video, and then capture it through the image capture control to directly obtain the original image in the video. This is not only simple to operate and can improve the efficiency of publishing works based on images, but also ensures image quality and does not reduce clarity.

[0109] In some embodiments, the method further comprises:

[0110] In response to the editing operation on the video, a timeline of the video is displayed in the resource editing interface, and multiple frames of images in the video are displayed in the timeline;

[0111] In response to an adjustment operation on the time axis, determining a playback time point indicated by the adjustment operation;

[0112] The current image displayed by the video is a single-frame image corresponding to the playback time point.

[0113] The solution provided by the disclosed embodiment can not only intuitively display multiple frames of images in a video to the user by displaying the timeline of the video during the video editing process, but also allow the user to adjust the playback time point (playback progress) of the video through the timeline, which is beneficial for the user to find the image to be captured from the video and capture it. The operation is simple, and can improve the efficiency of image capture, thereby improving the efficiency of publishing works.

[0114] In some embodiments, displaying the first image includes:

[0115] The first image is added as a resource independent of the video to the timeline in the resource editing interface.

[0116] The solution provided by the embodiment of the present disclosure can display the image in the resource editing interface after it is captured, so as to intuitively show the user the image capture effect, which not only improves the utilization rate of the resource editing interface, but also facilitates the user to quickly understand the captured image, thereby publishing works based on the image, which is conducive to improving the efficiency of publishing works; and because the captured image and the multiple frames of images in the video are in the same timeline, subsequent works can be produced and published based on the captured image and the original video, which not only enriches the work production method, so that the work includes both the captured image and the original video, but also can also improve the efficiency of publishing works.

[0117] In some embodiments, a second publishing control is displayed in the resource editing interface, and the second publishing control is used to publish a work containing resources in the timeline;

[0118] In response to the work publishing operation, based on the first image, publishing the work including the first image includes:

[0119] In response to a trigger operation on the second publishing control, a work is generated and published based on the resources in the timeline, where the resources in the timeline include the first image and the edited video.

[0120] The solution provided by the embodiment of the present disclosure displays a second publishing control in the resource editing interface, so that the user can use the second publishing control to create and publish works based on all images captured from the original video and the original video. The operation is simple and can improve the production efficiency and publishing efficiency of the works.

[0121] In some embodiments, in response to the work publishing operation, based on the first image, publishing the work including the first image includes:

[0122] In response to the work publishing operation, at least one work material is acquired based on the first image, and the at least one work material conforms to the style of the first image;

[0123] Based on the first image and at least one work material, a work including the first image is generated, and the work is published.

[0124] The solution provided by the disclosed embodiment, since the captured image is an image actively selected by the user and meets the user's intention, in the process of creating a work based on the captured image, at least one work material that meets the style of the captured image can be obtained, and the work is created based on the captured image and the at least one work material, so that the created work is more in line with the effect desired by the user. In other words, the work is more likely to meet the user's intention, which is equivalent to improving the accuracy of the work.

[0125] In some embodiments, based on the first image, obtaining at least one work material includes at least one of the following:

[0126] Based on the first image, generate a title text, where the title text is used to describe the content of the first image;

[0127] Based on the first image, obtaining background audio;

[0128] Based on the first image, special effect materials are obtained, and the special effect materials are used to represent the presentation method of the first image in the work.

[0129] The solution provided by the embodiments of the present disclosure can, in the process of producing works based on captured images, obtain title text, background audio or special effects materials that conform to the style of the captured images, which is conducive to the subsequent works produced based on the images and work materials to better conform to the effects desired by users, that is, the work is more likely to conform to the user's intentions, which is equivalent to improving the accuracy of the work, and can reduce the possibility of users editing the work again, thereby improving the efficiency of publishing the work.

[0130] In some embodiments, the method further comprises:

[0131] If the number of times the video playback time point is adjusted within the preset time period exceeds the preset number, then determining the adjustment range based on the playback time point indicated by the adjustment operation of the number of adjustments;

[0132] If the adjustment range is lower than the preset range, the play time points indicated by the adjustment operations of the number of adjustment times are averaged to obtain the first play time point;

[0133] Adjust the video to the first playback time point.

[0134] According to the solution provided by the embodiment of the present disclosure, when the number of adjustments to the playback time point of the video within a preset time period exceeds the preset number and the adjustment range is lower than the preset range, it means that the user frequently adjusts the playback time point in one place, and it is very likely that the user cannot adjust to the playback time point of the frame of image that he wants. In this case, averaging the playback time points adjusted by the user multiple times can more accurately determine the playback time point that the user wants. By adjusting the video to the playback time point, the user can subsequently capture the image he wants through the control. This not only meets the user's intention and ensures the accuracy of the image, but also does not require the user to adjust the playback time point more frequently, so that the image that the user is satisfied with can be captured more quickly, thereby improving the efficiency of publishing works.

[0135] In some embodiments, the method further comprises:

[0136] If the number of times the video playback time point is adjusted within the preset time period exceeds the preset number, then determining the adjustment range based on the playback time point indicated by the adjustment operation of the number of adjustments;

[0137] If the adjustment range is lower than the preset range, the play time points indicated by the adjustment operations of the number of adjustment times are averaged to obtain the first play time point;

[0138] Based on the first playback time point, a second image is captured from the video and displayed, and the second image is rendered based on the video data at the first playback time point in the video.

[0139] According to the solution provided by the embodiment of the present disclosure, when the number of adjustments to the playback time point of the video within a preset time period exceeds the preset number and the adjustment range is lower than the preset range, it means that the user frequently adjusts the playback time point at one place, and it is very likely that the user cannot adjust to the playback time point of the frame of image that the user wants. In this case, averaging the playback time points adjusted by the user multiple times can more accurately determine the playback time point that the user wants, so that the image at the playback time point can be directly captured from the video. This not only meets the user's intention and ensures the accuracy of the image, but also does not require the user to adjust the playback time point more frequently or to capture images, and the image that the user is satisfied with can be captured more quickly, thereby improving the efficiency of publishing works.

[0140] In some embodiments, there are multiple videos, and the first image is from the first video;

[0141] The method also includes:

[0142] In response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, a third image is captured from the second video, and the third image is rendered based on the video data at the playback time point in the second video;

[0143] displaying a third image;

[0144] In response to the work publishing operation, based on the first image, publishing the work including the first image includes:

[0145] In response to the work publishing operation, based on the first image and the third image, a work including the first image and the third image is published.

[0146] The solution provided by the disclosed embodiment can capture images from multiple videos to create works, which is not only conducive to enriching the content of the work, but also can directly obtain the original image in the video without cropping. The operation is simple, so that the work can be published quickly based on the captured image, and there is no need to download it to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the efficiency of work publishing.

[0147] In some embodiments, in response to the first video switching to the second video, when the second video is at any playback time point, in response to a triggering operation on an image capture control, capturing a third image from the second video includes:

[0148] In response to the first video switching to the second video, based on the first image, displaying the second video at a second playback time point, the image presented by the second video at the second playback time point being of the same style as the first image;

[0149] In response to a triggering operation on the image capture control, a third image is captured from the second video, and the third image has the same style as the first image.

[0150] The solution provided by the disclosed embodiment is that in the process of capturing images from multiple videos to create a work, after capturing a first image from a previous video, when capturing an image from a next video, the playback time point of the next video can be directly adjusted to a playback time point that matches the style of the first image according to the style of the image captured from the previous video, so that the user can quickly capture a second image that matches the style of the first image from the next video. Since the first image is an image actively selected by the user and meets the user's intention, when capturing an image for the next video, it is possible to directly jump to an image with the same style, which is convenient for the user to quickly obtain the image without the user having to watch the video from beginning to end to obtain the image. This can improve the efficiency of image capture, thereby improving the efficiency of publishing the work.

[0151] Above Figure 2 The above is only a basic process of publishing works based on images. The following is a further description of the solution provided by the present disclosure based on a specific implementation method. Figure 3 FIG. 1 is a flowchart of another method for publishing an image-based work according to an exemplary embodiment. Figure 3, the method comprises the following steps.

[0152] In step 301, in response to a work publishing request, a terminal displays a plurality of candidate resources, wherein the plurality of candidate resources include a video.

[0153] In the disclosed embodiment, a user can publish works such as short videos, photo collections, or graphic works through a terminal. Before publishing a work, the terminal can use any resource to create the work. The resource for creating the work can be a video or an image. The image can be a pre-stored image or an image captured from a video in real time, etc., which is not limited in the disclosed embodiment.

[0154] Taking the example of a terminal using images in a video to create a work, in response to a work publishing request, the terminal displays multiple candidate resources. The multiple candidate resources include a video. The video can be used to provide images for the work publishing. Afterwards, the terminal can capture images from the selected video to create the work.

[0155] Among them, the terminal can preview and display the video selected by the user in the resource preview interface so as to capture images from the video later, see step 302 for details. Alternatively, the terminal can also edit (cut) the video selected by the user in the resource editing interface so as to capture images from the video, see step 303 for details. That is, the method provided by the embodiment of the present disclosure can be applied to the video preview scenario or the video editing scenario. In the video preview scenario or the video editing scenario, the terminal can capture images from the video so as to produce the work to be published.

[0156] In step 302, in response to a preview operation on a video, the terminal plays the video in a resource preview interface and displays an image capture control.

[0157] In an embodiment of the present disclosure, in response to a preview operation on a video among multiple candidate resources, the terminal plays the video in the resource preview interface and displays an image capture control. The image capture control is used to capture images from the video to publish the work. The embodiment of the present disclosure does not limit the display position of the image capture control. The solution provided by the embodiment of the present disclosure can play the video in the process of publishing works based on images, allowing users to preview the video so that users can find the image to be captured from the video, and then capture it through the image capture control to directly obtain the original image in the video. Not only is the operation simple and can improve the efficiency of publishing works based on images, but also the image quality is guaranteed and the clarity will not be reduced.

[0158] In some embodiments, the terminal can also display a playback progress bar of the video so that the user can adjust the playback progress of the video through the playback progress bar to find the image that he has captured. Accordingly, during the playback of the video, the terminal displays the playback progress bar of the video in the resource preview interface. In response to the adjustment operation on the playback progress bar, the terminal determines the playback time point indicated by the adjustment operation. Then, the terminal displays the single-frame image corresponding to the playback time point when the video is played. The solution provided by the embodiment of the present disclosure, when playing a video, by displaying the playback progress bar of the video, the user can adjust the playback progress of the video through the playback progress bar, which is beneficial for the user to find the image to be captured in the video. The operation is simple, and the efficiency of image capture can be improved, thereby improving the efficiency of publishing works.

[0159] For example, Figure 4 FIG. 1 is a schematic diagram showing a method of capturing an image in a video preview scenario according to an exemplary embodiment. Figure 4 , during the work production process before the work is published, the terminal displays multiple candidate resources. The multiple candidate resources include images and videos. The user can select any resource to produce the work. The selected resource can display the lower area in the resource display interface, such as the selected video 1. In response to the preview operation of video 1 (such as clicking on video 1 in the lower area), the terminal plays video 1 in the resource preview interface and displays the image capture control 401. When video 1 is played to any playback time point, in response to the triggering operation of the image capture control 401, the terminal captures the image at the playback time point from video 1, such as image 1. During the playback of video 1, the terminal can also display the playback progress bar 402 of video 1, so that the user can adjust the playback progress of the video through the playback progress bar 402, which is conducive to the user finding the image to be captured in the video, so as to capture it through the image capture control 401, such as image 2.

[0160] In step 303, in response to the selection operation of the video, the terminal displays the video; in response to the editing operation of the video, the terminal displays an image capture control in the resource editing interface.

[0161] In an embodiment of the present disclosure, when any video among multiple candidate resources is selected, the terminal displays the selected video in the work production interface. An editing control is displayed in the work production interface. In response to a triggering operation on the editing control, the terminal displays an image capture control in the resource editing interface so that an image can be captured from the video later through the image capture control. The solution provided by the embodiment of the present disclosure can edit (cut) the video in the process of publishing works based on images, so that the user can find the image to be captured from the video, and then capture it through the image capture control to directly obtain the original image in the video. This is not only simple to operate and can improve the efficiency of publishing works based on images, but also ensures image quality and clarity.

[0162] In some embodiments, during the process of editing a video, the terminal can display a timeline for editing so that the user can adjust the progress of the video through the timeline to find the image that he wants to capture. Accordingly, in response to the editing operation of the video, the terminal displays the timeline of the video in the resource editing interface. The timeline displays multiple frames of images in the video. In response to the adjustment operation on the timeline, the terminal determines the playback time point indicated by the adjustment operation. Then, the terminal displays that the current picture presented by the video is a single-frame image corresponding to the playback time point. The solution provided by the embodiment of the present disclosure, during the process of editing a video, by displaying the timeline of the video, can not only intuitively show the user multiple frames of images in the video, but also enable the user to adjust the playback time point (playback progress) of the video through the timeline, which is conducive to the user to find the image to be captured from the video and capture it. The operation is simple, and the efficiency of image capture can be improved, thereby improving the efficiency of publishing works.

[0163] For example, Figure 5 FIG. 1 is a schematic diagram showing a method of capturing an image in a video editing scenario according to an exemplary embodiment. Figure 5 In the process of making a work before the work is published, the terminal displays multiple candidate resources in the resource display interface. The multiple candidate resources include images and videos. The user can select any resource to make a video. The selected resource can display the lower area in the resource display, such as the selected video 1. In response to further operation, the terminal displays video 1 and multiple operation controls in the work production interface. The multiple operation controls include an editing control 501. In response to the triggering operation of the editing control 501, the terminal displays the resource editing interface, and the resource editing interface includes an editing panel. The image capture control 502 is in the editing panel as an editing function. The editing panel also displays a timeline 503 of the video, and the timeline 503 includes multiple frames of images in the video. By sliding multiple images in the timeline, the picture (image) currently displayed by the video can be adjusted. When the image capture control 502 is triggered, the terminal captures the image currently displayed by the video and displays the image in the timeline 503, such as image 1, so that the work can be produced based on image 1 and the video in the timeline 503 later. Alternatively, the editing panel may be a panel directly displayed in the work production interface. In this case, the work production interface may be regarded as a work editing interface, which is not limited in the embodiments of the present disclosure.

[0164] In step 304, when the video is at any playback time point, in response to a triggering operation on an image capture control, the terminal captures a first image from the video, where the first image is rendered based on video data at the playback time point in the video.

[0165] In the disclosed embodiment, when the video is at any playback time point, in response to the image capture control being triggered, the terminal captures the currently displayed image from the video, that is, the first image. The definition of the first image is the same as the definition of the video. That is, the first image is equivalent to the original image at the playback time point in the video.

[0166] Among them, the playback time point of the video can be the progress automatically played during the video playback process; it can also be the playback time point specified by the user when adjusting the playback progress, please refer to the contents in step 302 and step 303; it can also be determined based on multiple adjustments of the playback progress by the user, which is not limited in the embodiments of the present disclosure.

[0167] In some embodiments, the terminal can determine the playback time point of the video according to multiple adjustment operations of the user on the playback progress. Accordingly, if the number of adjustments to the playback time point of the video within the preset time period exceeds the preset number, the terminal determines the adjustment range based on the playback time point indicated by the adjustment operation of the number of adjustments. If the adjustment range is lower than the preset range, the terminal averages the playback time points indicated by the adjustment operation of the number of adjustments to obtain the first playback time point. Then, the terminal adjusts the video to the first playback time point.

[0168] According to the solution provided by the embodiment of the present disclosure, when the number of adjustments to the playback time point of the video within a preset time period exceeds the preset number and the adjustment range is lower than the preset range, it means that the user frequently adjusts the playback time point in one place, and it is very likely that the user cannot adjust to the playback time point of the frame of image that he wants. In this case, averaging the playback time points adjusted by the user multiple times can more accurately determine the playback time point that the user wants. By adjusting the video to the playback time point, the user can subsequently capture the image he wants through the control. This not only meets the user's intention and ensures the accuracy of the image, but also does not require the user to adjust the playback time point more frequently, so that the image that the user is satisfied with can be captured more quickly, thereby improving the efficiency of publishing works.

[0169] In other embodiments, the terminal can also automatically capture images for the user based on multiple adjustments to the playback progress by the user, without the user triggering the image capture operation. Accordingly, if the number of adjustments to the playback time point of the video within a preset time period exceeds a preset number, the terminal determines the adjustment range based on the playback time point indicated by the adjustment operation of the number of adjustments. If the adjustment range is lower than the preset range, the terminal averages the playback time points indicated by the adjustment operation of the number of adjustments to obtain the first playback time point. Then, based on the first playback time point, the terminal captures and displays a second image from the video, and the second image is rendered based on the video data at the first playback time point in the video.

[0170] According to the solution provided by the embodiment of the present disclosure, when the number of adjustments to the playback time point of the video within a preset time period exceeds the preset number and the adjustment range is lower than the preset range, it means that the user frequently adjusts the playback time point at one place, and it is very likely that the user cannot adjust to the playback time point of the frame of image that the user wants. In this case, averaging the playback time points adjusted by the user multiple times can more accurately determine the playback time point that the user wants, so that the image at the playback time point can be directly captured from the video. This not only meets the user's intention and ensures the accuracy of the image, but also does not require the user to adjust the playback time point more frequently or to capture images, and the image that the user is satisfied with can be captured more quickly, thereby improving the efficiency of publishing works.

[0171] In step 305, the terminal displays the first image.

[0172] In the embodiment of the present disclosure, after the first image is captured, the terminal displays the first image to show the user the image capture effect. The embodiment of the present disclosure does not limit the display position of the first image.

[0173] In some embodiments, in a video preview scenario, the resource preview interface includes a video display area and an image display area. The video display area is used to present a video that provides an image. The image display area is used to present an image captured from a video. Accordingly, after the first image is captured, the terminal displays the first image in the image display area in the resource preview interface. The solution provided by the embodiment of the present disclosure can display the image in the resource preview interface after the image is captured, so as to intuitively show the user the image capture effect, which can not only improve the utilization rate of the resource preview interface, but also facilitate users to quickly understand the captured image, thereby publishing works based on the image, which is conducive to improving the publishing efficiency of the work.

[0174] For example, see Figure 4 The resource preview interface includes a video display area 403 and an image display area 404. The video display area 403 displays the video 1 selected by the user for capturing an image. The image display area 404 displays the captured image, such as image 1.

[0175] In some embodiments, the terminal can capture multiple images from the video for the user to select (or choose). Accordingly, multiple images are displayed in the image display area. The multiple images are images captured at different playback time points. For any of the multiple images, in response to an operation to delete the image, the terminal deletes the image from the image display area. The solution provided by the embodiment of the present disclosure can display the captured images in the image display area, intuitively showing the user the image capture effect, so that the user can quickly understand the captured images, and then choose the captured images, that is, delete the unsatisfactory images, which is conducive to the subsequent production of works based on the images that satisfy the user, which not only meets the user's intentions, but also can ensure the quality of the works.

[0176] For example, see Figure 4 , a delete control is displayed in the upper right corner of each image in the image display area 404. For any image, when the delete control on the image is triggered, the terminal deletes the image and no longer displays the image in the image display area 404.

[0177] In some embodiments, in a video editing scenario, the terminal can add the first image as a resource independent of the video to the timeline in the resource editing interface. Figure 5 , the captured image 1 is added to the head area of ​​the timeline, and the embodiment of the present disclosure does not limit the position of adding the image. The solution provided by the embodiment of the present disclosure can display the image in the resource editing interface after the image is captured, so as to intuitively show the user the image capture effect, which can not only improve the utilization rate of the resource editing interface, but also facilitate users to quickly understand the captured image, so as to publish works based on the image, which is conducive to improving the publishing efficiency of the work; and because the captured image and the multiple frames of images in the video are in the timeline together, so that the work can be produced and published based on the captured image and the original video later, it not only enriches the work production method, so that the work includes both the captured image and the original video, but also can improve the publishing efficiency of the work.

[0178] In step 306, in response to the work publishing operation, the terminal publishes the work including the first image based on the first image.

[0179] In the embodiment of the present disclosure, when the work publishing operation is triggered, the terminal can create and publish a work based on the captured first image so that other users can see the work. The terminal can only publish the captured image, that is, create and publish a work based on the captured image; or the terminal can also publish the captured image and video (image source) at the same time, that is, create and publish a work based on the captured image and video, which is not limited in the embodiment of the present disclosure.

[0180] In some embodiments, the terminal only publishes the captured image. Accordingly, in the video preview scenario, a first publishing control is displayed in the resource preview interface. The first publishing control is used to publish works containing images in the image display area. In response to the triggering operation of the first publishing control, the terminal generates a work based on all the images in the image display area, and publishes the work. The image display area contains the first image. The solution provided by the embodiment of the present disclosure, by displaying the first publishing control in the resource preview interface, allows the user to create and publish works based on all the images captured from the video through the first publishing control. The operation is simple and can improve the efficiency of creating and publishing works.

[0181] In other embodiments, the terminal publishes the captured images and videos (image sources) at the same time. Accordingly, in the video editing scenario, a second publishing control is displayed in the resource editing interface. The second publishing control is used to publish works containing resources in the timeline. In response to the triggering operation of the second publishing control, the terminal generates a work based on the resources in the timeline and publishes the work. The resources in the timeline include the first image and the edited video. The solution provided by the embodiment of the present disclosure displays the second publishing control in the resource editing interface, so that the user can use the second publishing control to create and publish works based on all the images captured from the original video and the original video. The operation is simple and can improve the efficiency of creating and publishing works.

[0182] Among them, in the process of making a work, on the basis of the captured image, the terminal can also add background audio, stickers, special effects and other work materials to generate the work. The embodiment of the present disclosure does not limit the way of generating the work. Accordingly, in response to the work publishing operation, the terminal obtains at least one work material based on the first image. At least one work material conforms to the style of the first image. Then, based on the first image and the at least one work material, the terminal generates a work containing the first image and publishes the work. The solution provided by the embodiment of the present disclosure, since the captured image is an image actively selected by the user and conforms to the user's intention, in the process of making a work based on the captured image, at least one work material conforming to the style of the captured image can be obtained, and the work is made according to the captured image and the at least one work material, so that the made work is more in line with the effect desired by the user. In other words, the work is more likely to conform to the user's intention, which is equivalent to improving the accuracy of the work.

[0183] Among them, the work material can be a text title, background audio or special effect material, etc. Correspondingly, the terminal obtains at least one work material based on the first image, including at least one of the following: the terminal generates a title text based on the first image, and the title text is used to describe the content of the first image. The terminal obtains background audio based on the first image. The terminal obtains special effect materials based on the first image, and the special effect materials are used to indicate the presentation method of the first image in the work. Special effect materials can be stickers, transition effects, magic effects or filters, etc., which are not limited in the embodiments of the present disclosure. The scheme provided by the embodiments of the present disclosure can obtain title text, background audio or special effect materials that conform to the style of the captured image in the process of producing a work based on the captured image, which is conducive to the subsequent works produced based on the image and the work material to be more in line with the effect desired by the user, that is, the work is more likely to meet the user's intention, which is equivalent to improving the accuracy of the work, and can reduce the possibility of the user editing the work again, thereby improving the publishing efficiency of the work.

[0184] In some embodiments, there are multiple videos, and the terminal captures images from the multiple videos to create a work. For example, the first image comes from the first video. Accordingly, in response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, the terminal captures a third image from the second video. The third image is rendered based on the video data at the playback time point in the second video. Then, the terminal displays the third image. In response to the work publishing operation, the terminal publishes a work containing the first image and the third image based on the first image and the third image.

[0185] The solution provided by the disclosed embodiment can capture images from multiple videos to create works, which is not only conducive to enriching the content of the work, but also can directly obtain the original image in the video without cropping. The operation is simple, so that the work can be published quickly based on the captured image, and there is no need to download it to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the efficiency of work publishing.

[0186] In which, in the process of capturing the third image, in response to the first video switching to the second video, the terminal displays the second video at the second playback time point based on the first image. The image presented by the second video at the second playback time point is of the same style as the first image. In response to the triggering operation of the image capture control, the terminal captures the third image from the second video, and the third image is of the same style as the first image. The scheme provided by the embodiment of the present disclosure, in the process of capturing images from multiple videos to create works, after capturing the first image from the previous video, when capturing the image from the next video, the playback time point of the next video can be directly adjusted to the playback time point that matches the style of the first image according to the style of the image captured from the previous video, so that the user can quickly capture the second image that matches the style of the first image from the next video. Since the first image is an image actively selected by the user and meets the user's intention, when capturing the image of the next video, it can directly jump to the image of the same style, which is convenient for the user to quickly obtain the image, without the user having to watch the video from beginning to end to obtain the image, which can improve the efficiency of image capture, thereby improving the efficiency of publishing the work.

[0187] The disclosed embodiment provides a method for publishing works based on images. In the process of publishing works based on images, by displaying a video and an image capture control, a user can directly capture an image at any playback time point from the video through the image capture control. Since the captured image is rendered based on the video data at the playback time point, compared with the screenshot function of the device in the prior art which reduces the clarity, the image captured by this solution not only has a clarity that meets the original clarity of the video, but also does not contain content outside the video. Therefore, this solution can directly obtain the original image in the video without cropping, and the operation is simple, so that the work can be published quickly based on the captured image, and there is no need to download it to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the publishing efficiency of the work.

[0188] Moreover, the above-mentioned function of capturing images from videos is provided in both the video preview scene and the video editing scene, which enriches the usage scenarios of the present solution and facilitates user operation. Users can capture images from videos in any scene according to their own needs. For example, if the user wants to publish a work consisting of only images, the user can capture images, create works and publish them in the video preview scene; or, if the user wants to publish a work consisting of images and videos, the user can capture images, create works based on the images and videos and publish them in the video editing scene.

[0189] In addition, the image-based work publishing method provided by the embodiment of the present disclosure can be applied to any application that supports work publishing. The interfaces in the above embodiments can all be interfaces in the application. That is, by adopting the method provided by the embodiment of the present disclosure, an image can be captured from a video through an image capture control in an application, the captured image can be displayed, and a work can be created and published based on the captured image. Without the help of other tools (such as other applications), the process from capturing an image to creating a work can be realized, and the efficiency of publishing the work can be significantly improved.

[0190] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0191] Figure 6 is a block diagram of an image-based work publishing device according to an exemplary embodiment. Figure 6 The device includes: a display unit 601, a capture unit 602 and a publishing unit 603.

[0192] The display unit 601 is configured to execute, in response to a work publishing request, display multiple candidate resources, the multiple candidate resources include a video, and the video is used to provide an image for the work publishing; in response to a selection operation on the video, display the video and an image capture control, the video is used to provide an image for the work publishing, and the image capture control is used to capture an image from the video to publish the work;

[0193] The capture unit 602 is configured to capture a first image from the video in response to a triggering operation on the image capture control when the video is at any playback time point, where the first image is rendered based on the video data at the playback time point in the video;

[0194] The display unit 601 is further configured to display a first image;

[0195] The publishing unit 603 is configured to execute, in response to the work publishing operation, publishing the work including the first image based on the first image.

[0196] In some embodiments, the display unit 601 is configured to execute a preview operation on the video in response to playing the video in the resource preview interface and displaying an image capture control.

[0197] In some embodiments, the display unit 601 is also configured to display a playback progress bar of the video in the resource preview interface during the playback of the video; determine the playback time point indicated by the adjustment operation in response to the adjustment operation of the playback progress bar; and display a single frame image corresponding to the playback time point when the video is played.

[0198] In some embodiments, the resource preview interface includes a video display area and an image display area, the video display area is used to present the video providing the image, and the image display area is used to present the image captured from the video;

[0199] The display unit 601 is configured to display a first image in an image display area in a resource preview interface.

[0200] In some embodiments, a plurality of images are displayed in the image display area, and the plurality of images are images captured at different playback time points;

[0201] The device also includes:

[0202] The deleting unit is configured to delete an image from the image display area in response to a deleting operation on any image among the multiple images.

[0203] In some embodiments, a first publishing control is displayed in the resource preview interface, and the first publishing control is used to publish a work containing an image in the image display area;

[0204] The publishing unit 603 is configured to generate and publish a work based on all images in the image display area in response to a trigger operation on the first publishing control, and the work is included in the image display area.

[0205] In some embodiments, the display unit 601 is configured to display the video in response to a selection operation on the video; and to display an image capture control in the resource editing interface in response to an editing operation on the video.

[0206] In some embodiments, the display unit 601 is further configured to execute in response to an editing operation on the video, display a timeline of the video in a resource editing interface, and display multiple frame images in the video in the timeline; in response to an adjustment operation on the timeline, determine the playback time point indicated by the adjustment operation; and display that the picture currently presented by the video is a single frame image corresponding to the playback time point.

[0207] In some embodiments, the display unit 601 is further configured to add the first image as a resource independent of the video to the timeline in the resource editing interface.

[0208] In some embodiments, a second publishing control is displayed in the resource editing interface, and the second publishing control is used to publish a work containing resources in the timeline;

[0209] The publishing unit 603 is configured to generate and publish a work based on resources in the timeline in response to a trigger operation on the second publishing control, where the resources in the timeline include the first image and the edited video.

[0210] In some embodiments, the publishing unit 603 includes:

[0211] An acquisition subunit is configured to execute, in response to the work publishing operation, acquiring at least one work material based on the first image, wherein the at least one work material conforms to the style of the first image;

[0212] The publishing subunit is configured to generate a work including the first image based on the first image and at least one work material, and publish the work.

[0213] In some embodiments, the acquisition subunit is configured to perform at least one of the following:

[0214] Based on the first image, generate a title text, where the title text is used to describe the content of the first image;

[0215] Based on the first image, obtaining background audio;

[0216] Based on the first image, special effect materials are obtained, and the special effect materials are used to represent the presentation method of the first image in the work.

[0217] In some embodiments, the apparatus further comprises:

[0218] The adjustment unit is configured to execute: if the number of adjustments to the playback time point of the video within a preset time period exceeds a preset number, an adjustment range is determined based on the playback time point indicated by the adjustment operation of the adjustment number; if the adjustment range is lower than the preset range, the playback time points indicated by the adjustment operation of the adjustment number are averaged to obtain a first playback time point; and the video is adjusted to the first playback time point.

[0219] In some embodiments, the apparatus further comprises:

[0220] The adjustment unit is configured to determine an adjustment range based on the play time points indicated by the adjustment operations of the number of adjustment times if the number of adjustment times of the play time points of the video within the preset time period exceeds the preset number; if the adjustment range is lower than the preset range, average the play time points indicated by the adjustment operations of the number of adjustment times to obtain a first play time point;

[0221] The capture unit 602 is configured to capture and display a second image from the video based on the first playback time point, where the second image is rendered based on the video data at the first playback time point in the video.

[0222] In some embodiments, there are multiple videos, and the first image is from the first video;

[0223] The capture unit 602 is further configured to execute, in response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, capture a third image from the second video, the third image being rendered based on the video data at the playback time point in the second video;

[0224] The display unit 601 is further configured to display a third image;

[0225] The publishing unit 603 is configured to execute, in response to the work publishing operation, publishing the work including the first image and the third image based on the first image and the third image.

[0226] In some embodiments, the capture unit is configured to execute, in response to the first video switching to the second video, display the second video at a second playback time point based on the first image, and the image presented by the second video at the second playback time point is the same as the style of the first image; in response to the triggering operation of the image capture control, capture a third image from the second video, and the third image is the same as the style of the first image.

[0227] The disclosed embodiment provides an image-based work publishing device. In the process of publishing works based on images, by displaying videos and image capture controls, users can use the image capture controls to directly capture images at any playback time point from the video. Since the captured images are rendered based on the video data at the playback time point, compared with the screenshot function of the device in the prior art that reduces the clarity, the images captured by this solution not only have a clarity that meets the original clarity of the video, but also do not contain content outside the video. Therefore, this solution does not need to crop to directly obtain the original image in the video, and the operation is simple, so that works can be published quickly based on the captured images, and there is no need to download to the device gallery and then obtain the image from the gallery to publish the work, which can significantly improve the publishing efficiency of the works.

[0228] It should be noted that the image-based work publishing device provided in the above embodiment only uses the division of the above functional units as an example when publishing works produced by images. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the image-based work publishing device provided in the above embodiment and the image-based work publishing method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0229] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0230] When an electronic device is provided as a terminal, Figure 7 700 is a block diagram of a terminal 700 according to an exemplary embodiment. The terminal 700 may be a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 700 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0231] Typically, the terminal 700 includes a processor 701 and a memory 702 .

[0232] The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0233] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one program code, which is used to be executed by the processor 701 to implement the image-based work publishing method provided by the method embodiment of the present disclosure.

[0234] In some embodiments, the terminal 700 may further optionally include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702 and the peripheral device interface 703 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 703 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707 and a power supply 708.

[0235] The peripheral device interface 703 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 701 and the memory 702. In some embodiments, the processor 701, the memory 702, and the peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 701, the memory 702, and the peripheral device interface 703 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0236] The radio frequency circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 704 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 704 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 704 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 704 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0237] The display screen 705 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to collect touch signals on the surface or above the surface of the display screen 705. The touch signal can be input as a control signal to the processor 701 for processing. At this time, the display screen 705 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 705 can be one, and the front panel of the terminal 700 is set; in other embodiments, the display screen 705 can be at least two, which are respectively set on different surfaces of the terminal 700 or are folded; in some other embodiments, the display screen 705 can be a flexible display screen, which is set on the curved surface or folded surface of the terminal 700. Even, the display screen 705 can also be set as a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 705 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0238] The camera assembly 706 is used to capture images or videos. Optionally, the camera assembly 706 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0239] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 701 for processing, or input them into the radio frequency circuit 704 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 700. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 707 may also include a headphone jack.

[0240] The power supply 708 is used to power various components in the terminal 700. The power supply 708 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 708 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0241] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the terminal 700, and the terminal 700 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0242] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 702 including instructions, and the instructions can be executed by a processor 701 of a terminal 700 to complete the above-mentioned method for publishing works based on images. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0243] A computer program product includes a computer program / instruction, which implements the above-mentioned image-based work publishing method when executed by a processor.

[0244] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0245] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for publishing works based on images, characterized in that: The method comprises: In response to a work publishing request, displaying a plurality of candidate resources, wherein the plurality of candidate resources include a video, and the video is used to provide an image used for the work publishing; In response to a selection operation on the video, display the video and an image capture control, the image capture control being used to capture an image from the video to publish a work; when the video is at any playback time point, in response to a triggering operation on the image capture control, capture a first image from the video, the first image being rendered based on video data at the playback time point in the video; and display the first image; If the number of times the playback time point of the video is adjusted within a preset time period exceeds a preset number, an adjustment range is determined based on the playback time point indicated by the adjustment operation of the adjustment number; if the adjustment range is lower than the preset range, the playback time points indicated by the adjustment operation of the adjustment number are averaged to obtain a first playback time point; based on the first playback time point, a second image is captured from the video and displayed; In response to a work publishing operation, at least one work material is obtained based on the first image and the second image; based on the first image, the second image and the at least one work material, a work including the first image and the second image is generated and published, wherein the at least one work material conforms to the style of the first image and the second image, and the at least one work material includes at least one of a title text, background audio and special effect materials.

2. The method for publishing works based on images according to claim 1, characterized in that: The step of displaying the video and the image capture control in response to the selection operation of the video comprises: In response to a preview operation on the video, the video is played in a resource preview interface and the image capture control is displayed.

3. The method for publishing works based on images according to claim 2, characterized in that: The method further comprises: During the playback of the video, a playback progress bar of the video is displayed in the resource preview interface; In response to an adjustment operation on the play progress bar, determining a play time point indicated by the adjustment operation; Display the single frame image corresponding to the video playing to the playing time point.

4. The method for publishing works based on images according to claim 2, characterized in that: The resource preview interface includes a video display area and an image display area, wherein the video display area is used to present the video providing the image, and the image display area is used to present the image captured from the video; The displaying the first image comprises: The first image is displayed in the image display area in the resource preview interface.

5. The method for publishing works based on images according to claim 4, characterized in that: The image display area displays a plurality of images, wherein the plurality of images are images captured at different playback time points; The method further comprises: For any image among the multiple images, in response to a deletion operation on the image, the image is deleted from the image display area.

6. The method for publishing works based on images according to claim 4, characterized in that: The resource preview interface displays a first publishing control, which is used to publish a work containing an image in the image display area; The step of publishing the work including the first image in response to the work publishing operation based on the first image includes: In response to a triggering operation on the first publishing control, a work is generated based on all images in the image display area, and the work is published, wherein the image display area includes the first image.

7. The method for publishing works based on images according to claim 1, characterized in that: The step of displaying the video and the image capture control in response to the selection operation of the video comprises: In response to a selection operation on the video, displaying the video; In response to an editing operation on the video, the image capture control is displayed in a resource editing interface.

8. The method for publishing works based on images according to claim 7, characterized in that: The method further comprises: In response to an editing operation on the video, a timeline of the video is displayed in the resource editing interface, wherein the timeline displays multiple frames of images in the video; In response to an adjustment operation on the time axis, determining a playback time point indicated by the adjustment operation; The picture currently presented by the video is displayed as a single frame image corresponding to the playback time point.

9. The method for publishing works based on images according to claim 8, characterized in that: The displaying the first image comprises: The first image is added to the timeline in the resource editing interface as a resource independent of the video.

10. The method for publishing works based on images according to claim 9, characterized in that: A second publishing control is displayed in the resource editing interface, and the second publishing control is used to publish a work containing resources in the timeline; The step of publishing the work including the first image in response to the work publishing operation based on the first image includes: In response to a triggering operation on the second publishing control, a work is generated based on resources in the timeline, and the work is published, wherein the resources in the timeline include the first image and the edited video.

11. The method for publishing works based on images according to claim 1, characterized in that: The method further comprises: The video is adjusted to the first playback time point.

12. The method for publishing works based on images according to claim 1, characterized in that: There are multiple videos, and the first image comes from the first video; The method further comprises: In response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, a third image is captured from the second video, wherein the third image is rendered based on the video data at the playback time point in the second video; displaying the third image; The step of publishing the work including the first image in response to the work publishing operation based on the first image includes: In response to the work publishing operation, based on the first image and the third image, a work including the first image and the third image is published.

13. The method for publishing works based on images according to claim 12, characterized in that: In response to the first video switching to the second video, when the second video is at any playback time point, in response to the triggering operation of the image capture control, capturing a third image from the second video, includes: In response to the first video switching to the second video, based on the first image, displaying the second video at a second playback time point, wherein the image presented by the second video at the second playback time point has the same style as the first image; In response to a triggering operation on the image capture control, the third image is captured from the second video, and the third image has the same style as the first image.

14. An image-based work publishing device, characterized in that: The device comprises: The display unit is configured to display a plurality of candidate resources in response to a work publishing request, wherein the plurality of candidate resources include a video, and the video is used to provide an image for publishing the work; in response to a selection operation of the video, the video and an image capture control are displayed, and the image capture control is used to capture an image from the video to publish the work; a capture unit configured to capture a first image from the video in response to a triggering operation on the image capture control when the video is at any playback time point, the first image being rendered based on video data at the playback time point in the video; The display unit is further configured to display the first image; The adjustment unit is configured to determine an adjustment range based on the play time points indicated by the adjustment operations of the number of adjustments if the number of adjustments to the play time point of the video within a preset time period exceeds a preset number; if the adjustment range is lower than the preset range, average the play time points indicated by the adjustment operations of the number of adjustments to obtain a first play time point; The capture unit is further configured to capture and display a second image from the video based on the first playback time point; A publishing unit is configured to execute a work publishing operation in response to which at least one work material is acquired based on the first image and the second image; based on the first image, the second image and the at least one work material, a work including the first image and the second image is generated and published, wherein the at least one work material conforms to the style of the first image and the second image, and the at least one work material includes at least one of a title text, background audio and special effect material.

15. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; The processor is configured to execute the program code to implement the image-based work publishing method as described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the image-based work publishing method as described in any one of claims 1 to 13.

17. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the image-based work publishing method according to any one of claims 1 to 13 is implemented.

Images