Video processing method and apparatus, device, and medium

Abstract

Embodiments of the present disclosure relate to a video processing method and apparatus, a device, and a medium. The method comprises: receiving a triggering operation for a first video frame of a video; and in response to the triggering operation, displaying associated information of the first video. In the embodiments of the present disclosure, associated information is recommended on the basis of a video, thus flexibly meeting requirements on the acquisition of the associated information of the first video in different scenes, improving the accuracy of acquiring the associated information of the video frame, and shortening an acquisition path of the associated information.

Description

Video processing method, device, equipment and medium

[0001] This application claims priority to the Chinese invention patent application entitled “Video processing method, device, equipment and medium” and application number 202310146762.1, filed on February 17, 2023. The entire contents of that application are incorporated by reference into this application. Technical Field

[0002] The present disclosure relates to the field of computer application technology, and in particular to a video processing method, apparatus, device, and medium. Background Art

[0003] With the development of computer application technology, information dissemination in the form of video has become a more common way. When a client watches a corresponding video, the client may have different understanding requirements for the relevant video objects in the video, for example, the client may have a need to understand further details about the product objects in the video.

[0004] In related technologies, when a client needs to further understand a video object while playing a video, the client needs to actively call a screenshot tool to take a screenshot, and obtain related information through the screenshot in the search platform, resulting in a longer path for obtaining the video object.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a video processing method, apparatus, device and medium.

[0007] An embodiment of the present disclosure provides a video processing method, which includes the following steps: receiving a trigger operation for a first video frame of a video; and displaying associated information of the first video in response to the trigger operation.

[0008] The embodiment of the present disclosure further provides a video processing device, comprising: a receiving module for receiving a trigger operation for a first video frame of a video; and a display processing module for displaying associated information of the first video in response to the trigger operation.

[0009] An embodiment of the present disclosure further provides an electronic device, comprising: a processor; a memory for storing instructions executable by the processor; the processor for reading the executable instructions from the memory and executing the instructions to implement the video processing method provided by the embodiment of the present disclosure.

[0010] An embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the video processing method provided by the embodiment of the present disclosure.

[0011] The embodiments of the present disclosure further provide a computer program product. When instructions in the computer program product are executed by a processor, the video processing method described in the above embodiments is implemented.

[0012] The technical solution provided by the embodiments of the present disclosure has the following advantages over the prior art:

[0013] The video processing solution provided by the disclosed embodiments receives a trigger operation for the first video frame of a video and, in response to the trigger operation, displays associated information for the first video. In the disclosed embodiments, the video-based recommendation of associated information can flexibly meet the needs of obtaining associated information for the first video frame in different scenarios, improve the accuracy of obtaining associated information for the video frame, and shorten the process of obtaining associated information. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0015] FIG1 is a flow chart of a video processing method provided by an embodiment of the present disclosure;

[0016] FIG2 is a schematic diagram of a video processing scenario provided by an embodiment of the present disclosure;

[0017] FIG3 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0018] FIG4 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0019] FIG5 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0020] FIG6 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0021] FIG7 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0022] FIG8 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0023] FIG9 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0024] FIG10 is a schematic diagram of another video processing scenario provided by an embodiment of the present disclosure;

[0025] FIG11 is a schematic structural diagram of a video processing device provided by an embodiment of the present disclosure;

[0026] FIG12 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0030] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0031] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0032] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0033] In order to solve the above problems, an embodiment of the present disclosure provides a video processing method, in which related information is recommended based on the first video frame contained in the first video, which can flexibly meet the needs of obtaining related information of the first video in different scenarios, and directly display the related information of the corresponding first object without the need for active search based on screenshots on the search platform, thereby greatly shortening the path of obtaining related information.

[0034] The method is described below with reference to specific embodiments.

[0035] FIG1 is a flow chart of a video processing method provided by an embodiment of the present disclosure. The method can be executed by a video processing device, wherein the device can be implemented using software and / or hardware and can generally be integrated into an electronic device such as a client. As shown in FIG1 , the method includes:

[0036] Step 101: Receive a trigger operation for a first video frame of a video.

[0037] The trigger operation may be any predefined trigger operation, for example, a long press operation on the first video frame, or a call operation on a preset trigger interface in the first video frame.

[0038] Step 102: In response to a trigger operation, display associated information of the first video.

[0039] In one embodiment of the present disclosure, the associated information of the first video is directly displayed in response to a trigger operation. Thus, the client can quickly obtain the corresponding associated information without taking a screenshot or searching. This can flexibly meet the needs of obtaining the associated information of the first video in different scenarios and shorten the path for obtaining the associated information.

[0040] In one embodiment of the present disclosure, the associated information with the first video may be associated with the first object of the first video, wherein the first object in the first video frame is determined based on the trigger operation on the first video. It should be emphasized that the first object in this embodiment corresponds to the trigger instruction. For example, the trigger area in which the client performs a trigger operation (such as the above-mentioned long press operation) can be obtained, and the video object corresponding to the trigger area in the first video frame is identified as the first object, or at least one candidate video object belonging to the operation area corresponding to the trigger operation is determined as the first object, and the trigger weight of each candidate video object is obtained. The trigger weight can be identified based on a pre-trained convolutional model, etc., and the candidate video object whose trigger weight is greater than a preset weight threshold is determined to be the first object. Therefore, in this embodiment, the first object whose associated information the client wants to obtain is accurately determined, which helps to ensure the accuracy of the associated information subsequently obtained.

[0041] In addition, in this embodiment, the trigger processing can be implemented by an existing object recognition algorithm, for example, upsampling the first video frame through a fully convolutional network (FCN), and performing convolution calculations on the upsampled image to obtain the first object; for example, segmenting the video object through a deep learning algorithm to obtain the corresponding first object, etc.

[0042] In addition, in one embodiment of the present disclosure, the above-mentioned associated information is determined according to the video type of the first video. It can also be understood that the above-mentioned associated information is determined in different ways under different video types.

[0043] The following describes how to obtain the associated information of the first video and control the client to display the corresponding associated information with reference to a specific embodiment.

[0044] In one embodiment of the present disclosure, the associated information of the first video is displayed, including: displaying multiple different types of multimedia content related to the first video, wherein the multiple different types of multimedia content related to the first video can be multiple different types of multimedia content related to the first object in the first video, and the multimedia content can be information information about the first object (the first object is, for example, okra, and the multiple different types of multimedia content related to the first object are, for example, a text introduction to okra, an okra display video or picture), etc. The multiple different types include video type, text type, picture type, etc.

[0045] In this embodiment, if the multimedia content of the first video is obtained as associated information, the server may obtain object feature information of the first object. The specific content of the object feature information depends on the specific application scenario. The server may then identify information in a preset information resource library that matches the object feature information to a degree greater than a preset matching threshold as the multimedia content.

[0046] In some possible embodiments, candidate search results that match object feature information can be received, and a preset number of information information can be randomly screened from the candidate search results as multimedia content; when the candidate search results contain preset popularity information, a preset number of information information can also be determined as multimedia content in descending order of popularity information.

[0047] Furthermore, in an embodiment of the present disclosure, the general purpose of obtaining multimedia content is to provide a multi-dimensional introduction to the first object. Therefore, when controlling the client to display the associated information of the first object, an information push card area corresponding to the multimedia content can also be generated according to a preset template display style. The size and shape of the push card area are determined according to the preset display template style, wherein different multimedia content corresponds to different information push card areas. A display page is generated based on the information push card area. For example, a page is generated based on a combination of individual information push card areas, and the corresponding client is controlled to display the corresponding page, so that the client can fully understand the specific first object.

[0048] The first object may be an object in the first video, and the second object may be an object obtained by processing the object with target special effects.

[0049] In one embodiment, in response to the trigger operation, the associated information of the first video is displayed, including: in response to the trigger operation, determining the first object associated with the first video; in response to the selection operation for the target special effect, displaying the second object, which is generated based on the first object and the target special effect.

[0050] In one embodiment, receiving a trigger operation for a first video frame of a first video includes: receiving a long press operation for the first video frame of the first video; in response to the trigger operation, obtaining a first object associated with the first video, including: displaying the first object associated with the first video in response to the long press operation; displaying a second object in response to a selection operation for a target special effect, including: displaying at least one special effect, and displaying the second object in response to an operation of moving the first object to a target special effect among the at least one special effect.

[0051] In one embodiment, in response to a selection operation for a target special effect, a second object is displayed, specifically, an image of the second object is displayed. Determining the first object associated with the first video may include determining an image of the first object associated with the first video, and further, the image of the first object may be displayed. Displaying the first object associated with the first video may include displaying an image of the first object associated with the first video, and moving the first object to a target special effect in the at least one special effect may include moving the image of the first object to a target special effect in the at least one special effect.

[0052] For example, as shown in Figure 2, when the first object is performer A in the figure, when a long press operation on performer A is detected on the client, the server obtains a trigger instruction for A, extracts the object feature information of performer A, and obtains multimedia content related to A. The multimedia content includes short videos related to A, related product information, etc., and generates a page a related to A according to a preset template style. Therefore, the client can fully understand the relevant information of A based on a, shortening the viewing path of A's multimedia content.

[0053] During the actual execution process, when there are multiple first objects (multiple first objects can be contained in the same video frame, or can be obtained after executing a trigger operation on multiple different video frames in the video stream), a switching menu of pages corresponding to different first objects can be displayed in the preset area of ​​the interface where the page is located. The style of the switching menu can be set according to the needs of the scene. When the switching operation is detected, the page of other first objects is switched to display.

[0054] For example, as shown in Figure 3, when the first object includes A and B, different image information of the first object can also be displayed in the upper area of ​​the interface where the page corresponding to A is located. When a right-swiping switching operation is detected, the page of the multimedia content of A currently displayed can be switched to the page of the multimedia content of B displayed.

[0055] In one embodiment of the present disclosure, in response to a display closing operation for multimedia content of multiple different multimedia types, thumbnail icons corresponding to multiple different types of multimedia content are displayed. That is, in this embodiment, in order to avoid interrupting the viewing of the video on the client, a closing operation can also be performed. In response to a display closing operation for multimedia content of multiple different multimedia types, thumbnail icons corresponding to multiple different types of multimedia content are displayed.

[0056] In one embodiment of the present disclosure, in order to avoid interrupting the viewing of the video on the client, a preset return control can also be set. The preset return control can be displayed in a floating window or embedded in the page displaying the multimedia content. Thus, in this embodiment, after obtaining the trigger operation of the preset return control in the page displaying the multimedia content, it is considered that the closing display operation of the multimedia content is obtained, and at least one thumbnail icon corresponding to at least one multimedia content is generated. The client continues to play the corresponding video, that is, returns to the playback page of the video, and can display at least one thumbnail icon in the first preset display area on the first video frame, wherein, when the corresponding thumbnail icon is triggered, the multimedia content corresponding to the corresponding thumbnail icon can be enlarged and displayed, wherein at least one thumbnail icon can be displayed in any style such as a list style.

[0057] For example, as shown in Figure 4, when the preset return control on the corresponding page is b, if a trigger instruction for b is detected, the corresponding video will be returned to continue playing, and at least one thumbnail icon will be displayed at the bottom of the video in a sliding manner. When the user triggers thumbnail icon c, the multimedia content corresponding to c will be magnified and displayed on the current video playback interface. This improves the efficiency of viewing multimedia content without affecting the viewing of the video.

[0058] When the first video type is a resource promotion type, the associated information includes the resources corresponding to the first video and the resource transfer control.

[0059] In one embodiment of the present disclosure, when a video is promoting a resource, such as a product, the first resource and resource transfer control corresponding to the first video frame can be displayed as associated information. In this case, the first object corresponding to the first video frame is also the product object, also known as the first resource or the first product. The first video can correspond to multiple product objects.

[0060] In this embodiment, the server can identify at least one object element contained in the first object based on semantic segmentation technology, where each object element can be each divisible object unit contained in the corresponding first object, and each object unit can be pushed as a separate product, etc. For example, when the first object is a set of clothing, the corresponding object elements include tops, bottoms, etc. in the set of clothing.

[0061] To push object elements, a first resource corresponding to each object element is determined as associated information for the first object. This first resource includes, but is not limited to, push link information for each object element. This push link information can be a link to any information, such as a push page or purchase information, and can be configured based on the application scenario. Different object elements correspond to different first resources, and each object element can correspond to one or more first resources. These resources can be, for example, virtual or real items, services, and the like.

[0062] In some possible embodiments, the first resource corresponding to each object element may be determined in a preset push resource library of push objects. The first resource may be screened based on parameters such as the purchase amount corresponding to each object element in the push resource library.

[0063] Furthermore, when the control client displays the associated information of the first object, the control client displays at least one first resource corresponding to at least one object element on the video interface, for example, displaying a thumbnail of the object element corresponding to the first resource as a push link of the first resource, etc., wherein, when at least one first resource of at least one object element is displayed, the corresponding display position and display method can be set according to the scene requirements, and are not limited here.

[0064] In this embodiment, to facilitate understanding of the first resource, a resource transfer control (e.g., a purchase control) for the first resource may also be displayed on the client. When the resource transfer control is triggered, detailed information of the corresponding first resource may be displayed. Furthermore, the display styles of the resource transfer control may be diverse, which are not listed here. For example, the resource transfer control may be a push link control for detailed information of the first resource.

[0065] For example, as shown in Figure 5, when the first object corresponding to the first video frame is a set of clothes in the picture, the object elements contained are a top, a belt and pants, then the push link information of the top, belt and pants are obtained as the first resources respectively, and the push link information of each object element is displayed in the form of a thumbnail in the area below the current video, where different object thumbnails can be switched by sliding switching operations. In this embodiment, order controls corresponding to each first resource can also be provided to facilitate the quick purchase of the relevant object elements.

[0066] Of course, in order to avoid the lack of clarity in displaying the corresponding first resource in the form of a thumbnail, in some possible examples, the corresponding resource transfer control - the details display control can also be displayed on the client. The display style of the details display control can be set according to the scenario. When the trigger operation of the details display control is detected on the client, the first resource page of the object element corresponding to the currently viewed thumbnail is displayed on the client. The first resource page contains richer first resources of the corresponding object elements, for example, it can contain detailed pictures of the corresponding elements, purchase link information, etc.

[0067] Among them, when the first resource is displayed in the form of the above-mentioned thumbnail, etc., it can respond to the enlarged display operation of the first resource, enlarge the first resource and display at least one second video related to the first resource, wherein the second video can be regarded as a video that provides a detailed description of the first resource, etc. For example, if the first resource is push information of clothing, the corresponding second video can be a push video corresponding to the clothing, etc.

[0068] For example, as shown in Figure 6, when the resource transfer control is integrated on the page of the first resource, after detecting the trigger operation of the thumbnail of the first resource corresponding to the top, it jumps to the details display page of the first resource corresponding to the top to display a richer first resource corresponding to the top.

[0069] In one embodiment of the present disclosure, when displaying a target first resource in at least one first resource, a second video frame can also be displayed in response to a video progress adjustment operation, and a second resource corresponding to the second video frame can be displayed, wherein the pushed second video frame can be the first video frame that focuses on introducing the corresponding object element, or any video frame that focuses on introducing the corresponding object element, wherein the object element associated with each video frame can be pre-labeled, or can be identified by matching degree based on image recognition technology, etc., and then, the client is controlled to jump to push the second video frame to play the first video, thereby realizing the correspondence between the object element and the first video, and achieving a further understanding of the corresponding object element.

[0070] In this embodiment, as shown in Figure 7, in response to the video progress adjustment operation, the second video frame is displayed, and the second resource corresponding to the second video frame is displayed. For example, when the video jumps to the second video frame of the second resource D, the second resource corresponding to D is displayed to facilitate further understanding of D.

[0071] In some possible embodiments, the associated information of the first video is obtained by performing special effect processing on the first object associated with the first video. In this embodiment, at least one special effect is displayed, and in response to the first object being moved to a target special effect in the at least one special effect, the second object is displayed.

[0072] In response to a trigger operation, a first object associated with the first video is determined. The method for determining the first object is similar to the above-mentioned embodiment. In response to a selection operation for a target special effect, for example, in response to a trigger operation on the first object, at least one special effect is displayed, the selected target special effect is determined, and then a second object is generated based on the first object and the target special effect. The second object can serve as association information. When the first video type is an interactive type or an object display type, the association information can include the second object generated based on the first object and the target special effect in the first video.

[0073] Among them, if there are multiple pre-set special effects, the server can identify object information such as the object type of the first object, match the object information with the standard object information corresponding to the preset special effect, and determine the preset special effect with a matching degree greater than the preset matching degree threshold as a candidate special effect for processing the first object based on the matching degree, so as to ensure the matching degree between the special effect and the first object and improve the special effect processing effect.

[0074] In one embodiment, when the target special effect corresponds to a first preset special effect processing function, an image corresponding to the first object is obtained, and special effect processing is performed on the image corresponding to the first object according to the target special effect processing function. The second object obtained after the special effect processing is used as the association information of the first object. That is, the association information corresponding to the first preset special effect processing function is obtained by performing special effect processing on the first object. In one embodiment, the second object can be synthesized based on the image of the first object and the image of the target special effect. In this embodiment, the need for secondary creation of the first object can be met.

[0075] In one embodiment, in response to the selection operation of the target special effect, comments corresponding to the second object are also sent, and the comments corresponding to the second object are displayed on the comment panel of the first video, for example, the image of the second object is displayed on the comment panel.

[0076] In one embodiment, referring to Figure 8, after a trigger operation of long pressing and dragging the "pet dog" in the first video frame on the client is recognized during video playback, the client's trigger operation on the "pet dog" is obtained, and thus, at least one special effect corresponding to the first object "pet dog" is displayed on the client.

[0077] After obtaining the selection instruction for the target special effect processing control e in at least one special effect, if the target special effect processing function corresponding to e is the first preset special effect processing function, the first object "pet dog" is subjected to special effect processing, and the "emoticon rain" corresponding to the first object "pet dog" is obtained as the second object.

[0078] In one embodiment, at least one special effect may be fixedly displayed on the video playback page of the first video, and the second object may be displayed in response to moving the first object to a target special effect among the at least one special effect.

[0079] In one embodiment, the first object may be an object in the first video frame corresponding to the trigger operation, or may be an object in other video frames of the first video except the first video frame.

[0080] In one embodiment of the present disclosure, a comment instruction from the client can also be received, and image comment information corresponding to the client is generated based on the associated information of the first object. The image comment information can be an image of the above-mentioned first object after being processed by a first preset special effect function, or it can be an image of the above-mentioned first object after being processed by a second preset special effect function. The comment page of the video is controlled to display the comment information, thereby enriching the client comment content.

[0081] In this embodiment, as shown in Figure 9, continuing with the scenario shown in Figure 8 as an example, when obtaining the associated information corresponding to the first special effect processing function, if a triggering operation of the preset comment control by the client is recognized, the special effect processed image corresponding to "pet dog" is used as the comment information of the corresponding client, in the figure, the corresponding client is "Xiao Ming". Thus, in this embodiment, the richness of the comments is further improved.

[0082] In this embodiment, the associated first object may also be the trigger object in the above-mentioned current video frame. In this embodiment, the first object in the first video frame in the video is identified, and the client overlays and displays special effect image information on the first object as the second object, etc.

[0083] For example, as shown in FIG10 , after obtaining a selection instruction for a target special effect processing control f in at least one special effect, if the target special effect processing function corresponding to f is the second preset special effect processing function, then each frame of “pet dog” in the video is identified, and corresponding mapping processing is performed following the “pet dog” in the video to enhance the fun of video playback. In summary, the video processing method of the embodiment of the present disclosure receives a trigger operation for a first video frame of a first video, displays related information of the first video in response to the trigger operation, and recommends related information based on the video, which can flexibly meet the needs of obtaining related information of the first video frame in different scenarios, improves the accuracy of obtaining related information of the video frame, and shortens the path for obtaining related information.

[0084] In order to implement the above embodiments, the present disclosure also proposes a video processing device.

[0085] FIG11 is a schematic diagram of the structure of a video processing device provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware and can generally be integrated into an electronic device for video processing. As shown in FIG11 , the device includes: a receiving module 1110, a display processing module 1120, wherein:

[0086] The receiving module 1110 is configured to receive a trigger operation for a first video frame of a video;

[0087] The display processing module 1120 is configured to display the associated information of the first video in response to a trigger operation.

[0088] The video processing device provided in the embodiments of the present disclosure can execute the video processing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method, which will not be described in detail here. In order to implement the above embodiments, the present disclosure also proposes a video processing device.

[0089] In order to implement the above embodiments, the present disclosure further proposes a computer program product, including a computer program / instruction, which implements the video processing method in the above embodiments when executed by a processor.

[0090] FIG12 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.

[0091] 12, which illustrates a schematic diagram of the structure of an electronic device 1200 suitable for implementing embodiments of the present disclosure. The electronic device 1200 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG12 is merely an example and should not limit the functionality or scope of use of the embodiments of the present disclosure.

[0092] As shown in FIG12 , the electronic device 1200 may include a processor (e.g., a central processing unit, a graphics processing unit, etc.) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a memory 1208 into a random access memory (RAM) 1203. Various programs and data required for the operation of the electronic device 1200 are also stored in the RAM 1203. The processor 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0093] Typically, the following devices may be connected to the I / O interface 1205: an input device 1206 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1207 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a memory 1208 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1209. The communication device 1209 may allow the electronic device 1200 to communicate with other devices wirelessly or by wire to exchange data. Although FIG12 shows the electronic device 1200 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0094] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program code for executing the method described in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1209, or installed from the memory 1208, or installed from the ROM 1202. When the computer program is executed by the processor 1201, the above-mentioned functions defined in the video processing method of the embodiment of the present disclosure are performed.

[0095] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0096] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0097] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0098] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0099] A trigger operation for a first video frame of a first video is received, and in response to the trigger operation, related information of the first video is displayed. Related information is recommended based on the video, which can flexibly meet the needs of obtaining related information of the first video frame in different scenarios, improve the accuracy of obtaining related information of the video frame, and shorten the path of obtaining related information.

[0100] The electronic device may write computer program code for performing the operations of the present disclosure in one or more programming languages, or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0101] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or can be implemented using a combination of dedicated hardware and computer instructions.

[0102] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0103] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0104] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0105] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0106] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0107] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video processing method comprising the following steps: receiving a trigger operation for a first video frame of a first video; In response to the trigger operation, associated information of the first video is displayed. 2 . The method according to claim 1 , wherein the associated information is determined according to a video type of the first video.

3. The method according to claim 1, wherein displaying the associated information of the first video comprises: The first resource and resource transfer control corresponding to the first video frame are displayed.

4. The method of claim 1 , further comprising: In response to the video progress adjustment operation, a second video frame is displayed, and a second resource corresponding to the second video frame is presented.

5. The method of claim 3, further comprising: In response to the zoom-in display operation on the first resource, the first resource is zoomed in and displayed, and at least one second video related to the first resource is presented.

6. The method according to claim 1, Displaying associated information of the first video, including: A plurality of different types of multimedia contents related to the first video are displayed.

7. The method of claim 6, further comprising: In response to a display closing operation on the plurality of different types of multimedia contents, thumbnail icons corresponding to the plurality of different types of multimedia contents are displayed.

8. The method of claim 1, wherein, in response to the triggering operation, displaying associated information of the first video comprises: In response to the triggering operation, determining a first object associated with the first video; In response to a selection operation on a target special effect, a second object is displayed, where the second object is generated based on the first object and the target special effect.

9. The method of claim 8, further comprising: Send a comment corresponding to the second object.

10. The method of claim 7, wherein receiving a trigger operation for a first video frame of a first video comprises: receiving a long press operation on a first video frame of a first video; In response to the trigger operation, acquiring the first object associated with the first video includes: in response to the long press operation, displaying the first object associated with the first video; In response to a selection operation on a target special effect, displaying a second object includes: displaying at least one special effect; in response to an operation of moving the first object to a target special effect among the at least one special effect, displaying the second object.

11. A video processing device, applied to a client, comprising: A receiving module, configured to receive a trigger operation for a first video frame of a video; A display processing module is used to display the associated information of the first video in response to the trigger operation.

12. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the video processing method according to any one of claims 1 to 10.

13. A computer-readable storage medium storing a computer program, wherein the computer program is configured to execute the video processing method according to any one of claims 1 to 10.

14. A computer program product, when instructions in the computer program product are executed by a processor, implements the video processing method according to any one of claims 1 to 10.

Images