Comment-based multimedia resource display method and device, electronic equipment and storage medium

Abstract

The invention relates to a comment-based multimedia resource display method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying at least one piece of comment information of a multimedia resource in a comment region of the multimedia resource, obtaining a triggering instruction for target comment information in the comment information which can be triggered, the playing progress node of the multimedia resource corresponding to the target comment information is determined, the playing progress node of the multimedia resource corresponding to the target comment information is one frame in the multimedia resource, and the playing page of the multimedia resource is jumped to from the comment area according to the trigger instruction. And playing the multimedia resource from the playing progress node of the multimedia resource in the playing page of the multimedia resource. According to the embodiment of the invention, the target comment information can be associated with the resource progress node in the multimedia resource, so that a user can watch the multimedia resource through the comment information, the efficiency of watching the multimedia resource by the user is improved, and the playing resource is saved.

Description

Technical Field

[0001] The present disclosure relates to the field of Internet technology, and in particular to a comment-based multimedia resource display method, device, electronic device and storage medium. Background Art

[0002] With the optimization of the network environment and the popularization of mobile smart devices, mobile terminals have become the main way for people to obtain information. Videos can express information more intuitively and clearly, so videos are widely disseminated and used as an important communication carrier.

[0003] After watching a video, users can generally leave comments on the comment page to share their thoughts and feelings after watching the video. However, when other users read the comments, they may find that they cannot understand the content of the comments very well. The reason is that other users ignore the video content corresponding to the comments when watching the video, which causes users to watch the video again, resulting in a large consumption of playback resources. Summary of the invention

[0004] The present disclosure provides a method, device, electronic device and storage medium for displaying multimedia resources based on comments. The technical solution of the present disclosure is as follows: According to a first aspect of an embodiment of the present disclosure, a method for displaying multimedia resources based on comments is provided, comprising: Displaying at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource; the at least one comment information includes triggerable comment information and non-triggerable comment information; Acquire a trigger instruction for target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to a playback page of the multimedia resource; Determine a playback progress node of the multimedia resource corresponding to the target comment information, where the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; According to the trigger instruction and the playback progress node of the multimedia resource, jump from the comment area to the playback page of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource on the playback page of the multimedia resource.

[0005] In some possible embodiments, starting to play the multimedia resource from the play progress node of the multimedia resource includes: Determine a target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource; Taking the target frame as a reference, determining the frame with a preset time length before the target frame as the advance frame; The multimedia resource is played starting from the target frame, or the multimedia resource is played starting from the advance frame.

[0006] In some possible embodiments, the method further includes: During the process of playing a multimedia resource starting from a playback progress node of the multimedia resource in the playback page of the multimedia resource, if a return instruction for returning to the comment area on the playback page of the multimedia resource is detected, the comment area is returned from the playback page of the multimedia resource.

[0007] In some possible embodiments, returning the comment area from the playback page of the multimedia resource includes: Return to the comment area from the multimedia resource playback page and locate the target comment information.

[0008] In some possible embodiments, according to the trigger instruction and the playback progress node of the multimedia resource, jumping from the comment area to the playback page of the multimedia resource, and starting to play the multimedia resource from the playback progress node of the multimedia resource on the playback page of the multimedia resource includes: Display resource display floating window in the comment area according to the trigger instruction; In the resource display floating window, the multimedia resource starts playing from the playback progress node of the multimedia resource.

[0009] In some possible embodiments, the method further includes: A correspondence between target comment information and a play progress node of a multimedia resource corresponding to the target comment information is established in advance.

[0010] In some possible embodiments, pre-establishing a correspondence between target comment information and a play progress node of a multimedia resource corresponding to the target comment information includes: Obtain target comment information, parse feature information in the target comment information, and determine a playback progress node of the multimedia resource corresponding to the feature information in the multimedia resource according to the feature information and global feature information of the multimedia resource; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0011] In some possible embodiments, parsing feature information in the target comment information, and determining, in the multimedia resource, a playback progress node of the multimedia resource corresponding to the feature information according to the feature information and global feature information of the multimedia resource, includes: If the target comment information is picture comment information, the picture feature information of the picture comment information is obtained by parsing; Acquire global feature information of multimedia resources; the global feature information includes picture feature information of each frame in the multimedia resources; The picture feature information of the picture comment information and the global feature information are matched and processed, and a play progress node of the multimedia resource corresponding to the picture feature information of the picture comment information is determined in the multimedia resource.

[0012] In some possible embodiments, parsing feature information in the target comment information, and determining, in the multimedia resource, a playback progress node of the multimedia resource corresponding to the feature information according to the feature information and global feature information of the multimedia resource, includes: If the target comment information is text comment information, semantic analysis is performed on the text comment information to determine semantic feature information of the text comment information; Acquire global feature information of multimedia resources; the global feature information includes semantic feature information of each frame in the multimedia resources; The semantic feature information of the text comment information and the global feature information are matched and processed, and the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information is determined in the multimedia resource.

[0013] In some possible embodiments, pre-establishing a correspondence between target comment information and a play progress node of a multimedia resource corresponding to the target comment information includes: Obtaining the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0014] In some possible embodiments, obtaining the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published includes: Obtain the playback progress node of the multimedia resource corresponding to the time when the user publishes the target comment information; or, Obtaining the playback progress node of the multimedia resource corresponding to the corresponding screenshot frame when the user captures a frame of the multimedia resource by screenshot and publishes the target comment information; or, Get the playback progress node of the multimedia resource linked by manual linking when the user publishes the target comment information.

[0015] In some possible embodiments, the triggerable comment information is displayed with a triggerable mark.

[0016] According to a second aspect of an embodiment of the present disclosure, there is provided a multimedia resource display device based on comments, comprising: A display module is configured to display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource; the at least one comment information includes triggerable comment information and non-triggerable comment information; An instruction acquisition module is configured to execute and acquire a trigger instruction for target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to a playback page of the multimedia resource; A node determination module is configured to determine a playback progress node of a multimedia resource corresponding to target comment information, wherein the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; The playback module is configured to execute according to the trigger instruction and the playback progress node of the multimedia resource, jump from the comment area to the playback page of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0017] In some possible embodiments, the playback module is configured to execute: Determine a target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource; Taking the target frame as a reference, determining the frame with a preset time length before the target frame as the advance frame; The multimedia resource is played starting from the target frame, or the multimedia resource is played starting from the advance frame.

[0018] In some possible embodiments, the device further includes a return display module; the return display module is configured to execute: During the process of playing a multimedia resource starting from a playback progress node of the multimedia resource in the playback page of the multimedia resource, if a return instruction for returning to the comment area on the playback page of the multimedia resource is detected, the comment area is returned from the playback page of the multimedia resource.

[0019] In some possible embodiments, the return display module is configured to execute: Return to the comment area from the multimedia resource playback page and locate the target comment information.

[0020] In some possible embodiments, the playback module is configured to execute: Display resource display floating window in the comment area according to the trigger instruction; In the resource display floating window, the multimedia resource starts playing from the playback progress node of the multimedia resource.

[0021] In some possible embodiments, the apparatus further includes a relationship establishment module; the relationship establishment module is configured to execute: A correspondence between target comment information and a play progress node of a multimedia resource corresponding to the target comment information is established in advance.

[0022] In some possible embodiments, the relationship establishing module is configured to execute: Obtain target comment information, parse feature information in the target comment information, and determine a playback progress node of the multimedia resource corresponding to the feature information in the multimedia resource according to the feature information and global feature information of the multimedia resource; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0023] In some possible embodiments, the relationship establishing module is configured to execute: If the target comment information is picture comment information, the picture feature information of the picture comment information is obtained by parsing; Acquire global feature information of multimedia resources; the global feature information includes picture feature information of each frame in the multimedia resources; The picture feature information of the picture comment information and the global feature information are matched and processed, and a play progress node of the multimedia resource corresponding to the picture feature information of the picture comment information is determined in the multimedia resource.

[0024] In some possible embodiments, the relationship establishing module is configured to execute: If the target comment information is text comment information, semantic analysis is performed on the text comment information to determine semantic feature information of the text comment information; Acquire global feature information of multimedia resources; the global feature information includes semantic feature information of each frame in the multimedia resources; The semantic feature information of the text comment information and the global feature information are matched and processed, and the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information is determined in the multimedia resource.

[0025] In some possible embodiments, the relationship establishing module is configured to execute: Obtaining the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0026] In some possible embodiments, the relationship establishing module is configured to execute: Obtain the playback progress node of the multimedia resource corresponding to the time when the user publishes the target comment information; or, Obtaining the playback progress node of the multimedia resource corresponding to the corresponding screenshot frame when the user captures a frame of the multimedia resource by screenshot and publishes the target comment information; or, Get the playback progress node of the multimedia resource linked by manual linking when the user publishes the target comment information.

[0027] In some possible embodiments, the triggerable comment information is displayed with a triggerable mark.

[0028] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement a method as described in any one of the first aspects above.

[0029] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the methods in the first aspect of the embodiment of the present disclosure.

[0030] According to the fifth aspect of an embodiment of the present disclosure, a computer program product is provided, the computer program product comprising a computer program, the computer program being stored in a readable storage medium, at least one processor of a computer device reading and executing the computer program from the readable storage medium, so that the computer device performs any one of the methods in the first aspect of the embodiment of the present disclosure.

[0031] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects: Display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource, the at least one comment information includes triggerable comment information and non-triggerable comment information, obtain a trigger instruction for the target comment information in the triggerable comment information, the trigger instruction is used to trigger the jump from the comment area to the playback page of the multimedia resource, determine the playback progress node of the multimedia resource corresponding to the target comment information, the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource, jump from the comment area to the playback page of the multimedia resource according to the trigger instruction and the playback progress node of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource. The embodiment of the present application can associate the target comment information with the resource progress node in the multimedia resource, so that the user can review or watch the position matching the comment information from the multimedia resource through the comment information. In this way, it can help the user quickly browse the content of interest in the multimedia resource obtained from the comment information, improve the efficiency of the user in watching the multimedia resource, and thus save playback resources.

[0032] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0034] Figure 1 is a schematic diagram of an application environment of a multimedia resource display method based on comments according to an exemplary embodiment; Figure 2 is a flow chart of a multimedia resource display method based on comments according to an exemplary embodiment; Figure 3 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 1 ; Figure 4 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 2 ; Figure 5 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 3 ; Figure 6 is a flow chart showing a method for determining a playback progress node of a multimedia resource according to an exemplary embodiment; Figure 7 is a flow chart showing a method for determining a playback progress node of a multimedia resource according to an exemplary embodiment; Figure 8 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 4 ; Fig. 9 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 5 ; Fig.10 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 6 ; Fig.11 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 7 ; Fig.12A schematic diagram of a resource playback page according to an exemplary embodiment Figure 8 ; Fig.13 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 9 ; Fig.14 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 10 ; Fig.15 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 10 one; Fig.16 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 10 two; Fig.17 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 10 three; Fig.18 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 10 Four; Fig.19 is a block diagram of a multimedia resource display device based on comments according to an exemplary embodiment; Fig. 20 It is a block diagram of an electronic device for displaying multimedia resources based on comments according to an exemplary embodiment. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0036] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar first objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0037] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0038] See also Figure 1 , Figure 1 is a schematic diagram of an application environment of a multimedia resource display method based on comments according to an exemplary embodiment. Figure 1 As shown, the application environment may include a server 011 and a client 012 .

[0039] In some possible embodiments, the server 011 may include an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The operating system running on the server may include but is not limited to Android, IOS, Linux, Windows, Unix, etc.

[0040] In some possible embodiments, the client 012 may include but is not limited to smartphones, desktop computers, tablet computers, laptop computers, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, smart wearable devices, and other image-type clients. It may also be software running on the client, such as applications, applets, etc. Optionally, the operating system running on the client may include but is not limited to Android, IOS, Linux, Windows, Unix, etc.

[0041] In some possible embodiments, the client 012 can display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource, the at least one comment information includes triggerable comment information and non-triggerable comment information, obtain a trigger instruction for the target comment information in the triggerable comment information, the trigger instruction is used to trigger the jump from the comment area to the play page of the multimedia resource, determine the play progress node of the multimedia resource corresponding to the target comment information, the play progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource, jump from the comment area to the play page of the multimedia resource according to the trigger instruction and the play progress node of the multimedia resource, and start playing the multimedia resource from the play progress node of the multimedia resource in the play page of the multimedia resource. The embodiment of the present application can associate the target comment information with the resource progress node in the multimedia resource, so that the user can review or watch the position matching the comment information from the multimedia resource through the comment information. In this way, it can help the user quickly browse the content of interest in the multimedia resource obtained from the comment information, improve the efficiency of the user watching the multimedia resource, and thus save the playback resources.

[0042] In an exemplary embodiment, the databases corresponding to the client and the server can both be node devices in the blockchain system, and can share the acquired and generated information with other node devices in the blockchain system, thereby realizing information sharing among multiple node devices. Multiple node devices in the blockchain system can be configured with the same blockchain, which is composed of multiple blocks, and the adjacent blocks have an association relationship, so that when the data in any block is tampered, it can be detected by the next block, thereby preventing the data in the blockchain from being tampered with, and ensuring the security and reliability of the data in the blockchain.

[0043] Figure 2 It is a flowchart of a multimedia resource display method based on comments according to an exemplary embodiment. It should be noted that this specification provides method operation steps as described in the embodiment or flowchart, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps listed in the embodiment is only one way of executing the steps among many orders, and does not represent the only order of execution. When the system or product is executed in practice, it can be executed in the order of the method shown in the embodiment or the drawings or in parallel (for example, in a parallel processor or multi-threaded processing environment). Specifically, Figure 2 As shown, the flow chart at least includes the following steps S201-S207: In step S201, at least one comment information of the multimedia resource is displayed in a comment area of ​​the multimedia resource; the at least one comment information includes triggerable comment information and non-triggerable comment information.

[0044] In the embodiment of the present application, the execution subject of steps S201 to S207 and the embodiments extended by steps S201 to S207 may be a client, and a user account created by a certain user may exist on the client.

[0045] In the embodiment of the present application, before the client displays at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource, the multimedia resource may be displayed on the resource playback page. Optionally, the resource playback page may be a page on the client corresponding to an application, and the application may include an instant messaging application, a short video application, a life service application, or a shopping application.

[0046] Figure 3 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 1 ,like Figure 3 As shown, it includes a resource playing page 300 , and multimedia resources 301 , multimedia content information 302 , and a comment control 303 on the resource playing page 300 .

[0047] Optionally, the multimedia resource 301 may include video, audio and video, audio, graphics or picture collection. The following takes the multimedia resource as video as an example for explanation. For other multimedia resources, please refer to video, which will not be repeated here.

[0048] Optionally, the multimedia content information 302 is text edited by the publisher of the multimedia resource to describe the multimedia resource. For example, the multimedia content information is a summary of the entire multimedia resource, which may also include the topic information involved, the account to be prompted to watch, etc. In some possible embodiments, the multimedia content information may be a channel to jump to the comment area. That is, in response to a preset operation on the multimedia content information, the comment area of ​​the multimedia resource may be displayed.

[0049] like Figure 3 As shown, there may be multiple controls on the right side of the resource playback page 300, which may include, from top to bottom, an account avatar control, a like control, a comment control 303, and a forwarding control.

[0050] Among them, the account avatar control can be triggered to display the homepage of the account corresponding to the account avatar, and the homepage can include multimedia resources published by the publisher corresponding to the account. The like control can be triggered to like the multimedia resources played on the resource playback page. The comment control can be triggered to display the comment area of ​​the multimedia resource and comment on the multimedia resource played on the resource playback page. The forwarding control can be triggered to forward the multimedia resource played on the resource playback page.

[0051] In some other possible embodiments, the comment barrage may be displayed in the resource playback page 300. Optionally, the displayed comment barrage may be the comment information in the comment area. Based on this, when the client detects that a preset operation is performed on the comment barrage, such as being double-clicked, the comment area of ​​the multimedia resource may be opened.

[0052] In the implementation of the present application, the client can play the multimedia resource on the resource playback page, wherein the resource playback page includes a comment control. Optionally, the client can display the comment area of ​​the multimedia resource in response to the comment display instruction triggered by the comment control, and display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource.

[0053] In some possible embodiments, the comment area of ​​the multimedia resource can be located on a comment panel, which can be located on a resource playing page. In other possible embodiments, the comment area of ​​the multimedia resource can be located on a comment page, which can be switched from a resource playing page.

[0054] Figure 4 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 2 ,like Figure 4 As shown, the resource playback page 300 includes before and after the comment control is triggered, wherein the resource playback page 300 before and after the comment control 303 is triggered may include multimedia resources 301, the resource playback page 300 before the comment control 303 is triggered may also include multimedia content information 302 and a comment control 303, and the resource playback page 300 after the comment control 303 is triggered may also include a comment panel 400 and at least one comment information 401 of the multimedia resource on the comment panel 400.

[0055] Combine the following Figure 4 An optional embodiment is described, in which a client can play a multimedia resource on a resource playback page. When the client detects that a comment control on the resource playback page is clicked, a comment panel can be displayed on the resource playback page, and at least one comment information of the multimedia resource can be displayed on the comment panel.

[0056] like Figure 4 As shown, the comment panel can occupy half or more than half of the screen interface. Optionally, the comment panel can be displayed on the upper layer of the multimedia resource.

[0057] In the embodiment of the present application, before the comment control is triggered, the multimedia resource can be displayed in full screen or in the first area of ​​the resource playback page, and after the comment control is triggered, the multimedia resource can be displayed in half screen or adjusted from the first area to the second area, and the multimedia resource can be displayed in the second area. Optionally, the half screen or the second area can be located in the upper half of the screen, and the area range of the second area is smaller than the area range of the first area.

[0058] In this way, when the comment control is triggered, while the comment panel is displayed on the resource playback page, the range and position of the area where the multimedia resource is played can be adjusted to reduce the possibility that the multimedia resource is blocked by the comment area.

[0059] In another optional embodiment, the client can play multimedia resources on the resource playback page. When the client detects that the comment control on the resource playback page is clicked, it can pause the playback of the multimedia resource, display a comment panel on the resource playback page, and display at least one comment information on the comment panel.

[0060] In another optional embodiment, the client can play multimedia resources on the resource playback page. When the client detects that the comment control on the resource playback page is clicked, it can jump from the resource playback page to the comment page and display at least one comment information of the multimedia resource on the comment page.

[0061] In another optional embodiment, the client can play the multimedia resource on the resource playing page, and when the client detects that the comment control on the resource playing page is clicked, the first area displaying the multimedia resource can be reduced to a second area, and the second area can be moved to the upper half of the resource playing page, and the comment panel can be displayed in the lower half of the resource playing page, and at least one comment information of the multimedia resource can be displayed on the comment panel. Optionally, the multimedia resource and the comment panel can not cover each other.

[0062] Optional, such as Figure 4 As shown, each comment information in at least one comment information refers to all the content 401 corresponding to each account, including the account avatar, account name and comment content. For example, the comment content corresponding to the account name "BB" is "The blooming fireworks are so beautiful." In actual application, the dotted box encircling all the content does not exist on the comment panel.

[0063] Optionally, each comment information in the at least one comment information refers to the comment content corresponding to each account, for example, the comment information corresponding to the name "BB" is "The blooming fireworks are so beautiful."

[0064] In some possible embodiments, the comment content or comment information may include comment information in text form, comment information in picture form, comment information in the form of a combination of text and picture, etc. In the embodiment of the present application, comment information in text form may be referred to as text comment information, comment information in the form of a picture may be referred to as picture comment information, and comment information in the form of a combination of text and picture may be referred to as picture and text comment information. In the embodiment of the present application, text comment information, picture comment information, and picture and text comment information may be collectively referred to as comment information.

[0065] In some possible embodiments, the picture comment information may be a certain image frame in the multimedia resource. The picture in the picture and text comment information may be a certain image frame in the multimedia resource.

[0066] In step S203, a trigger instruction for target comment information in the triggerable comment information is obtained; the trigger instruction is used to trigger a jump from the comment area to a playback page of the multimedia resource.

[0067] In an optional embodiment, the at least one comment information of the multimedia resource may include triggerable comment information and non-triggerable comment information.

[0068] In the embodiment of the present application, the triggerable comment information refers to the comment information that can be triggered to generate a trigger instruction, and the non-triggerable comment information refers to the comment information that cannot be triggered to generate a trigger instruction. The trigger instruction is used to trigger the jump from the comment area to the playback page of the multimedia resource.

[0069] In some possible embodiments, the playback page of the multimedia resource jumped from the comment area can be the above Figure 3-4 The resource playback page with the comment control shown may be, for example, a resource playback page corresponding to all multimedia resources in the resource recommendation stream.

[0070] In some other possible embodiments, the play page of the multimedia resource jumped from the comment area can be a newly created play page, which is created for the multimedia resource. Optionally, the newly created play page can be a resource display floating window displayed on the comment area. In other words, when jumping from the comment area of ​​different multimedia resources to the play page of the multimedia resource, different multimedia resources correspond to different play pages or different resource display floating windows.

[0071] As mentioned above, at least one comment information of a multimedia resource includes text comment information, picture comment information and picture and text comment information, therefore, the comment information that can be triggered may also include text comment information, picture comment information and picture and text comment information.

[0072] In some other possible embodiments, each comment information in the at least one comment information of the multimedia resource can be triggered.

[0073] In the embodiment of the present application, the comment information that can be triggered is displayed with a triggerable mark. Figure 5 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 3 ,like Figure 5 As shown, it includes a resource playing page 300, a multimedia resource 301 and a comment panel 400 on the resource playing page 300, and triggerable identifiers 501 and 502 marked on the comment information.

[0074] like Figure 5 As shown, when the comment information that can be triggered is text comment information, the triggerable mark can be an underline 501 under the text comment information, can be the text comment information in bold form, can be the text comment information in a preset color, optionally, the preset color can be red, and the color of the text comment information without a triggerable mark can be black.

[0075] Optionally, when the triggerable comment information is picture comment information, the triggerable mark may be a border 502 surrounding the picture comment information. Optionally, the border may be in a preset color, such as red.

[0076] In an embodiment of the present application, by setting a triggerable flag, it is possible to clearly and obviously identify which comment information in at least one comment information can be triggered, thereby effectively prompting the user, thereby preventing the user from performing invalid operations on triggerable comment information and improving page interaction efficiency.

[0077] In the embodiment of the present application, the client can obtain a trigger instruction for target comment information in the comment information that can be triggered.

[0078] In an alternative embodiment, when the user clicks Figure 5 When the client side displays the picture comment information in the triggerable comment information, the client side can obtain the trigger instruction of the picture comment information, wherein the trigger instruction of the picture comment information is used to trigger the jump from the comment area to the playback page of the multimedia resource.

[0079] In step S205, the play progress node of the multimedia resource corresponding to the target comment information is determined, and the play progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource.

[0080] Optionally, the client may first obtain a trigger instruction for the target comment information in the triggerable comment information, and then determine the playback progress node of the multimedia resource corresponding to the target comment information. Optionally, the client may first determine the playback progress node of the multimedia resource corresponding to the target comment information, and then obtain a trigger instruction for the target comment information in the triggerable comment information. Optionally, the client may determine the playback progress node of the multimedia resource corresponding to the target comment information while obtaining the trigger instruction for the target comment information in the triggerable comment information.

[0081] Optionally, the playback progress node of the multimedia resource corresponding to the target comment information may be a frame in the multimedia resource. For example, if the multimedia resource is a video resource, the playback progress node of the multimedia resource corresponding to the target comment information may be an image frame in the video resource.

[0082] In an embodiment of the present application, before determining the playback progress node of the multimedia resource corresponding to the target comment information, the client can pre-establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Then, when the target comment information in the triggerable comment information is triggered, the playback progress node of the multimedia resource corresponding to the target comment information can be obtained, thereby laying the foundation for which node of the multimedia resource to play from subsequently.

[0083] In the embodiment of the present application, the client can construct a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information based on the feature information in the target comment information and the global feature information of the multimedia resource.

[0084] Specifically, the client can obtain the target comment information and parse the characteristic information in the target comment information. According to the characteristic information and the global characteristic information of the multimedia resource, the playback progress node of the multimedia resource corresponding to the characteristic information is determined in the multimedia resource, and then the client can establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0085] In some possible embodiments, the target comment information is picture comment information, and the feature information in the target comment information and the global feature information of the multimedia resource may be related to the picture feature information. Figure 6 The present invention is a flowchart of a method for determining a playback progress node of a multimedia resource according to an exemplary embodiment, comprising: In step S601, if the target comment information is picture comment information, the picture feature information of the picture comment information is obtained by parsing.

[0086] In the embodiment of the present application, if the target comment information is picture comment information, that is, the target comment information is a picture, feature recognition can be performed on the picture to obtain picture feature information of the picture. Optionally, the picture feature information includes at least one of color feature information, texture feature information, shape feature information, and spatial relationship feature information.

[0087] In step S603, global feature information of the multimedia resource is obtained; the global feature information includes picture feature information of each frame in the multimedia resource.

[0088] In the embodiment of the present application, assuming that the multimedia resource is a video resource, the client can obtain the global feature information of the video resource. The global feature information of the video resource may include the picture feature information of each image frame in the multimedia resource. Optionally, the picture feature information of each image frame includes at least one of color feature information, texture feature information, shape feature information, and spatial relationship feature information.

[0089] In step S605, the picture feature information of the picture comment information and the global feature information are matched, and the play progress node of the multimedia resource corresponding to the picture feature information of the picture comment information is determined in the multimedia resource.

[0090] In an embodiment of the present application, the client may match the picture feature information of the picture comment information with the picture feature information of each image frame included in the global feature information, and determine the image frame in the multimedia resource that matches the picture feature information of the picture comment information, such as image frame A, as the playback progress node of the multimedia resource corresponding to the picture feature information of the picture comment information.

[0091] Next, the client can establish a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Optionally, the frame number of the image frame that matches in the multimedia resource, such as image frame A in the multimedia resource, such as frame number 1200, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and the frame number 1200 and the target comment information can be used to establish a correspondence. Optionally, the time point of the image frame that matches in the multimedia resource, such as the 10th second, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and the time point 10th second and the target comment information can be used to establish a correspondence.

[0092] In this way, by applying the image feature information, the comment information in the form of an image can be associated with the playback progress node of the multimedia resource, laying the foundation for which node of the multimedia resource to play from later.

[0093] In some other possible embodiments, the target comment information is text comment information, and the feature information in the target comment information and the global feature information of the multimedia resource may be related to the semantic feature information. Figure 7 The present invention is a flowchart of a method for determining a playback progress node of a multimedia resource according to an exemplary embodiment, comprising: In step S701, if the target comment information is text comment information, semantic analysis is performed on the text comment information to determine semantic feature information of the text comment information.

[0094] In the embodiment of the present application, if the target comment information is text comment information, that is, the text comment information is a paragraph of text, feature recognition can be performed on the paragraph of text to obtain semantic feature information of the text comment information.

[0095] In step S703, global feature information of the multimedia resource is obtained; the global feature information includes semantic feature information of each frame in the multimedia resource.

[0096] In the embodiment of the present application, assuming that the multimedia resource is a video resource containing text, the client can obtain the global feature information of the video resource, wherein the global feature information of the video resource may include the semantic feature information of each text in the multimedia resource.

[0097] In step S705, the semantic feature information of the text comment information and the global feature information are matched, and the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information is determined in the multimedia resource.

[0098] In an embodiment of the present application, the client can match the semantic feature information of the text comment information with the semantic feature information of each paragraph of text included in the global feature information, and determine the paragraph of text in the multimedia resource that matches the semantic feature information of each paragraph of text, such as the 9th paragraph of text, as the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information.

[0099] Next, the client can establish a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Optionally, the matching paragraph of text in the multimedia resource, such as the frame number of the first image frame corresponding to the 9th paragraph of text, such as the frame number 1200th frame, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and the frame number 1500th frame and the target comment information are used to establish a correspondence. Optionally, the matching paragraph of text in the multimedia resource, such as the time point when the 9th paragraph of text appears, such as the 20th second, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and the time point 20th second and the target comment information are used to establish a correspondence.

[0100] In this way, by applying semantic feature information, the comment information in text form can be associated with the playback progress node of the multimedia resource, laying the foundation for which node of the multimedia resource to play from later.

[0101] In some other possible embodiments, the target comment information is graphic comment information in the form of text and pictures, then the client can determine the playback progress node of the multimedia resource corresponding to the feature information by combining the picture feature information and the semantic feature information corresponding to the picture comment information and the text comment information, and then the client can establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Figure 6 and Figure 7 The implementation method shown will not be described in detail here.

[0102] In this way, the embodiments of the present application can be based on different types of comment information. Through the application of different types of feature information, comment information in text form or picture form can be associated with the playback progress node of the multimedia resource, laying the foundation for which node of the multimedia resource to play from later.

[0103] In an embodiment of the present application, the client can construct a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information based on the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published.

[0104] Specifically, the client may obtain the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published, and then the client may establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0105] In an optional embodiment, the client can obtain the playback progress node of the multimedia resource corresponding to the time when the user publishes the target comment information, and then establish a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Take the multimedia resource as a video resource as an example, assuming that the entire video resource is 1 minute, assuming that the user clicks the comment control when watching the 30th second of the video resource and publishes the target comment information in the comment area, then the 30th second of the video resource can be used as the playback progress node of the multimedia resource corresponding to the published target comment information. Then, the client can use the target comment information and the 30th second of the video resource to establish a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0106] In other possible embodiments, the client can obtain the playback progress node of the multimedia resource corresponding to the screenshot frame when the user captures a frame of the multimedia resource by screenshot and publishes target comment information, and then establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0107] In the embodiment of the present application, in response to a screenshot operation of a multimedia resource currently being played on a resource playback page, a screenshot and a first comment publishing control are displayed. In response to a comment publishing instruction triggered by the first comment publishing control, the screenshot is published in the comment area of ​​the multimedia resource as target comment information, and the image frame corresponding to the screenshot is used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0108] Figure 8 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 4 ,like Figure 8 As shown, the left figure shows that a multimedia resource 301 is played on a resource playing page 300. Assuming that a user takes a screenshot of the multimedia resource 301 currently being played, Figure 8 The screenshot 800 shown in the middle figure is displayed, and the screenshot 800 and the first comment publishing control 801 "one-click comment" are displayed. Among them, the screenshot 800 is a screenshot of the image frame B in the entire multimedia resource. After the screenshot 800 and the first comment publishing control 801 are displayed on the resource playback page, if the client detects that the first comment publishing control 801 is triggered, the comment area of ​​the multimedia resource can be displayed, and the screenshot 802 can be displayed in the comment area. At this time, the screenshot 802 can be displayed in the comment area as a target comment information.

[0109] Optionally, when the user clicks the comment control to publish the target comment information, assuming that the published target comment information includes the image frame B of the screenshot, that is, the screenshot 802 included in the picture comment information shown in the figure on the right, the image frame B in the multimedia resource can be used as the playback progress node of the multimedia resource corresponding to the published target comment information. Then, the client can use the target comment information and the image frame B in the video resource to establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0110] In some possible embodiments, before taking a screenshot of the multimedia resource 301 currently being played, pre-processing before taking the screenshot may be performed. Optionally, in response to a screen clearing instruction triggered based on a screen clearing control, the text on the screen (e.g. Figure 3The multimedia content information 302 in the image and various controls are displayed separately to display the played multimedia resources. In this way, a screenshot containing only one image frame in the multimedia resources can be obtained.

[0111] In some other possible embodiments, after obtaining the screenshot, the screenshot may be processed. Optionally, when the resource playback page displays the screenshot 800 and the first published comment control 801, the screenshot 800 may also include a screenshot processing control, and when the screenshot processing control is triggered, at least one of the following processing may be performed on the screenshot: zoom-in processing, zoom-out processing, cropping processing, screenshot area adjustment processing, text emoticon package addition processing, picture style adjustment processing, etc.

[0112] In another optional embodiment, the client can obtain the playback progress node of the multimedia resource linked by manual linking when the user publishes the target comment information, and then establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0113] In some possible embodiments, the screenshot on the playing resource page may be combined with the manual linking method, and the comment information may be connected to the playing progress node of the multimedia resource while being released.

[0114] In an embodiment of the present application, in response to a screenshot operation on a multimedia resource currently being played on a resource playback page, a screenshot and a second comment publishing control are displayed. In response to a comment publishing instruction triggered based on the second comment publishing control, a seconds link box of the multimedia video can be displayed. If it is detected that the seconds in the seconds link box of the multimedia video have been obtained, the screenshot can be published as the target comment information in the comment area of ​​the multimedia resource in response to the comment publishing instruction, and the seconds of the multimedia resource corresponding to the screenshot can be used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0115] Fig. 9 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 5 ,like Fig. 9 As shown, the first sub-picture shows that a multimedia resource 301 is played on a resource playing page 300. If a user takes a screenshot of the multimedia resource 301 currently being played, a screenshot 800 shown in the second sub-picture can be obtained, and the screenshot 800, the first comment posting control 801 "one-click comment posting" and the second comment posting control 900 "one-click comment posting, and video link posting" are displayed. Among them, the screenshot 800 is a screenshot of the image frame B in the entire multimedia resource.

[0116] Optionally, if the client detects that the second comment posting control 900 is triggered, it can be as shown in the third figure. Figure 1Similarly, the preset area of ​​the second post comment control 900 displays the seconds link box 901 of the multimedia video. After the user fills in the seconds in the seconds link box 901 of the multimedia video, the screenshot 802 can be posted as the target comment information in the comment area of ​​the multimedia resource shown in the fourth sub-picture in response to the post comment instruction, and the seconds of the multimedia resource corresponding to the screenshot are used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0117] Taking the multimedia resource as a video resource as an example, assuming that when the user publishes the target comment information, the manually linked multimedia resource node in the multimedia video second link box 901 is the 20th second, then the 20th second of the multimedia resource can be used as the playback progress node of the multimedia resource corresponding to the published target comment information. Then, the client can use the target comment information and the 20th second of the video resource to establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0118] In some other possible embodiments, the comment information on the comment area of ​​the multimedia resource may be combined with the manual linking method, and the comment information may be connected to the playback progress node of the multimedia resource while being released.

[0119] In an embodiment of the present application, the comment area of ​​a multimedia resource may include a comment box. If it is detected that a preset operation is performed on the comment box, a virtual keyboard may be displayed, and an input box and a link control may be displayed on the virtual keyboard. In response to a link instruction triggered based on the link control, a seconds link box of the multimedia video may be displayed. If it is detected that the seconds in the seconds link box of the multimedia video have been obtained, the input information in the input box may be published in the comment area of ​​the multimedia resource as the target comment information in response to the comment publishing instruction, and the seconds of the multimedia resource corresponding to the input information may be used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0120] Fig.10 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 6 ,like Fig.10 As shown, the first sub-image shows that a multimedia resource is played on a resource playback page. When the client detects that a comment control on the resource playback page is clicked, a comment panel can be displayed on the resource playback page, and at least one comment information can be displayed on the comment panel. Optionally, the comment panel can include a comment box. If it is detected that a preset operation is performed on the comment box, a virtual keyboard can be displayed as shown in the second sub-image, and an input box 410 and a link control 411 can be displayed on the virtual keyboard.

[0121] Optionally, after input information is input into the input box 410, the seconds link box 412 of the multimedia video shown in the third sub-picture may be displayed in response to a link instruction triggered based on the link control 411. If it is detected that the seconds in the seconds link box 412 of the multimedia video have been obtained, the input information 413 in the input box may be published as the target comment information in the comment area of ​​the multimedia resource in response to a comment publishing instruction, as shown in the fourth sub-picture, and the seconds of the multimedia resource corresponding to the input information may be used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0122] Taking the multimedia resource as a video resource as an example, assuming that when the user publishes the target comment information, the manually linked multimedia resource node in the multimedia video second link box 412 is the 30th second, then the 30th second of the multimedia resource can be used as the published target comment information, that is, the playback progress node of the multimedia resource corresponding to the input information. Then, the client can use the target comment information and the 30th second of the video resource to establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.

[0123] As above Fig. 9 The third sub-image and Fig.10 In the third sub-picture, the seconds are filled in the seconds link box of the multimedia video, so that the filled seconds are used as the play progress node of the multimedia resource of the published target comment information. However, there may be other implementation methods to realize manual linking.

[0124] Fig.11 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 7 ,like Fig.11 As shown, it includes a link window 420 on the resource playing page and a resource drag bar control 430 in the link window.

[0125] In some possible embodiments, when a virtual keyboard is displayed on the comment panel, the virtual keyboard may include an input box 410 and a link control 411. After input information is input into the input box 410, in response to a link instruction triggered by the link control 411, the client may display Fig.11 The link window 420 shown is used to display the multimedia resource, wherein the displayed multimedia resource is not played. Optionally, the resource drag bar control 430 is used to be manually controlled by the user to drag the multimedia resource, thereby determining the image frame corresponding to the target comment information.

[0126] Optionally, after the user determines the image frame by dragging the resource drag bar control 430, the input information in the input box can be published as target comment information in the comment area of ​​the multimedia resource in response to a comment publishing instruction, and the image frame corresponding to the input information can be used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0127] In the embodiment of the present application, Fig.11 yes Fig.10 The alternative embodiment of the third sub-image in the same way can also be used Fig.11 right Fig. 9 In this way, the embodiment of the present application can determine the playback progress node of the multimedia resource corresponding to the target comment information based on the user's various operation methods, lay a foundation for constructing the corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information, and improve the efficiency of constructing the corresponding relationship.

[0128] In step S207, according to the trigger instruction and the playback progress node of the multimedia resource, the comment area is jumped to the playback page of the multimedia resource, and the multimedia resource is played from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0129] In the embodiment of the present application, the client can jump from the comment area to the playback page of the multimedia resource according to the trigger instruction, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0130] In some possible embodiments, the client can jump from the comment area to the playback page of the multimedia resource according to a trigger instruction, determine the target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource, and based on the target frame, determine the frame with a preset time length in front of the target frame as the advance frame, and start playing the multimedia resource from the target frame in the playback page of the multimedia resource, or start playing the multimedia resource from the advance frame in the playback page of the multimedia resource.

[0131] Fig.12 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 8 ,like Fig.12 As shown, the resource playback page 300 includes before and after the target comment information is triggered, wherein the resource playback page 300 before and after the target comment information is triggered may include multimedia resources 301, and the resource playback page 300 before the target comment information is triggered may also include a comment panel 400 and at least one comment information on the comment panel 400, and the comment panel 400 on the resource playback page 300 after the target comment information 1100 is triggered has disappeared.

[0132] In some optional embodiments, the multimedia resource can be in the playing state all the time from clicking the comment control on the resource playback page, the comment panel appears, to clicking the triggerable target comment information on the comment panel, and the comment panel disappears. Based on this, when the user clicks the target comment information in the triggerable comment information (such as the picture under the account "DD"), the client can obtain the trigger instruction of the target comment information, determine the playback progress node of the multimedia resource corresponding to the target comment information, and the client can jump from the comment area to the playback page of the multimedia resource according to the trigger instruction, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0133] Combine the following Fig.13 The example shown illustrates the whole process. Fig.13 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 9 ,like Fig.13 As shown, the left figure shows that a multimedia resource 301 is played on a resource playing page 300. Assuming that the total duration of the multimedia resource is 2 minutes, when the multimedia resource is played to the 1st minute and 5 seconds represented by the progress bar 600, the client detects that the comment control on the resource playing page is clicked. Fig.13 As shown in the middle figure, the client can display a comment panel 400 on the resource playing page, and display multiple comment information on the comment panel. During the display of the comment panel, the multimedia resource is always playing.

[0134] Optionally, when the multimedia resource is played to the 1st minute and 20th second, the client detects that the picture comment information corresponding to the account "DD" on the comment panel is clicked and triggered, and the client can determine that the playback progress node of the multimedia resource corresponding to the picture comment information corresponding to the account "DD" is the image frame corresponding to the 35th second. At this time, Fig.13 As shown in the figure on the right, the comment panel disappears from the resource playing page 300, the progress bar 600 returns from 1 minute 20 seconds to the 35th second, and the multimedia resource starts playing from the image frame corresponding to the 35th second.

[0135] Alternatively, when the multimedia resource is played to the 1st minute and 20th second, the client detects that the picture comment information corresponding to the account "DD" on the comment panel is clicked and triggered, and the client can determine that the playback progress node of the multimedia resource corresponding to the picture comment information corresponding to the account "DD" is the image frame corresponding to the 35th second, and the image frame corresponding to the 35th second is the target frame. Optionally, the client can use the target frame as a reference to determine the frame of a preset duration in front of the target frame as an advance frame. Optionally, the preset duration is pre-set, assuming that the preset duration is 3 seconds, the advance frame is the image frame corresponding to the 32nd second. At this point, the comment panel disappears from the resource playback page 300, the progress bar returns from 1 minute and 20 seconds to the 32nd second, and the multimedia resource starts playing from the image frame corresponding to the 32nd second.

[0136] In this way, by starting to play from the early frame, the user can avoid missing the resource content of interest due to lack of time to react. By starting to play from the early frame, the user can get a brief summary of the previous situation and deepen his understanding of the content. At the same time, it can also ensure that the resource content of interest is not missed.

[0137] Alternatively, when the multimedia resource is played to the 1st minute and 20th second, the client detects that the picture comment information corresponding to the account "DD" on the comment panel is clicked and triggered, and the client can determine that the playback progress node of the multimedia resource corresponding to the picture comment information corresponding to the account "DD" is the image frame corresponding to the 35th second, and the image frame corresponding to the 35th second is the target frame. Optionally, the client can use the target frame as a reference to determine that the frame that is a preset number of frames in front of the target frame is the advance frame. Optionally, the preset duration is pre-set, assuming that the preset number of frames is 120 frames, then the advance frame is the image frame corresponding to 120 frames from the 35th second (for example, the image frame corresponding to the 31st second). At this time, the comment panel disappears from the resource playback page 300, the progress bar returns from 1 minute and 20 seconds to the 31st second, and the multimedia resource starts playing from the image frame corresponding to the 31st second.

[0138] In this way, by starting to play from the early frame, the user can avoid missing the resource content of interest due to lack of time to react. By starting to play from the early frame, the user can get a brief summary of the previous situation and deepen his understanding of the content. At the same time, it can also ensure that the resource content of interest is not missed.

[0139] In the embodiment of the present application, when the advance frame does not exist, the first image frame of the multimedia resource can be determined as the advance frame.

[0140] As mentioned above, the preset frame number is 120 frames. Assuming that the target frame is the 100th image frame in the multimedia resource, obviously, the image frames 120 before the target frame do not exist. Therefore, the first image frame of the multimedia resource can be determined as the advance frame.

[0141] As shown above, the preset duration is 3 seconds, and the false target frame is the image frame corresponding to the 2nd second in the multimedia resource. Obviously, the image frame 3 seconds before the target frame does not exist, so the first image frame of the multimedia resource is determined as the advance frame.

[0142] In an embodiment of the present application, after the client obtains the trigger instruction of the target comment information and determines the playback progress node of the multimedia resource corresponding to the target comment information, it can display a resource display floating window on the comment area according to the trigger instruction, and start playing the multimedia resource from the playback progress node of the multimedia resource in the resource display floating window.

[0143] Fig.14 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 10 ,like Fig.14 As shown, when the user clicks on the target comment information on the comment panel 400, a trigger instruction can be generated. The trigger instruction is used to create a resource display pop-up window corresponding to the target comment information in the comment area, and start playing the multimedia resource from the playback progress node of the multimedia resource in the resource display pop-up window.

[0144] Optionally, when the multimedia resource in the resource display floating window is finished playing, the resource display floating window may disappear.

[0145] In the embodiment of the present application, the execution subject of the playback progress node of the multimedia resource corresponding to the target comment information involved in step S205 can be a server or a client.

[0146] In an embodiment of the present application, during the process of playing a multimedia resource starting from the playback progress node of the multimedia resource in the playback page of the multimedia resource, if a return instruction for returning to the comment area on the playback page of the multimedia resource is detected, the client can return to the comment area from the playback page of the multimedia resource.

[0147] Fig.15 The following is a schematic diagram of a resource playback page in a process of playing a video through comment information according to an exemplary embodiment. Figure 10 One, such as Fig.15 As shown, Fig.15 As shown in the figure on the left, the client can display a comment panel 400 on the resource playback page, and display multiple comment information on the comment panel 400, including target comment information. When the client detects that the target comment information is clicked and triggered, the client can obtain a trigger instruction for the target comment information in the triggerable comment information, and determine the playback progress node of the multimedia resource corresponding to the target comment information. Fig.14As shown in the middle figure, the client can jump from the comment area to the playback page of the multimedia resource according to the trigger instruction, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0148] In some possible embodiments, after the client jumps from the comment area to the play page of the multimedia resource, the play page of the multimedia resource may display a return to comment area control 1100. The client may return to the comment area from the play page of the multimedia resource in response to a return instruction to return to the comment area triggered by the return to comment area control 1100.

[0149] Specifically, when the client detects that the return to comment area control 1100 is clicked, the comment panel may reappear on the playback page of the multimedia resource, and a plurality of comment information may be displayed on the comment panel.

[0150] In this way, by displaying a return to the comment area control on the playback page of the multimedia resource, the user can quickly return to the comment area, reduce the number of interactions, and improve interaction efficiency.

[0151] In some possible embodiments, when returning to the comment area from the playback page of the multimedia resource, the client can locate the target comment information. That is, before the client jumps from the comment area to the playback page of the multimedia resource according to the trigger instruction, assuming that the target comment information is in the middle of the comment area, when the client displays the comment area again according to the return instruction of returning to the comment area triggered by the return comment area control, the target comment information is still in the middle of the comment area, that is, the comment information displayed in the comment area is unchanged.

[0152] In an optional embodiment, the target comment information is text comment information.

[0153] Fig.16 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 10 Second, such as Fig.16 As shown, the first sub-image shows that a multimedia resource is played on a resource playback page. When the client detects that a comment control on the resource playback page is clicked, a comment panel can be displayed on the resource playback page, and at least one comment information can be displayed on the comment panel. Optionally, the comment panel can include a comment box. If it is detected that a preset operation is performed on the comment box, a virtual keyboard can be displayed as shown in the second sub-image, and an input box and a link control can be displayed on the virtual keyboard.

[0154] Optionally, after input information is input into the input box, the seconds link box 412 of the multimedia video shown in the third sub-picture may be displayed in response to a link instruction triggered based on the link control 411. If it is detected that the seconds in the seconds link box 412 of the multimedia video have been obtained, the input information in the input box may be published as the target comment information in the comment area of ​​the multimedia resource in response to a comment publishing instruction, as shown in the fourth sub-picture, and the seconds of the multimedia resource corresponding to the input information may be used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0155] Taking the multimedia resource as a video resource as an example, assuming that when the user publishes the target comment information, the manually linked multimedia resource node in the second link box of the multimedia video is the 30th second, then the 30th second of the multimedia resource can be used as the target comment information to be published, that is, the playback progress node of the multimedia resource corresponding to the input information. Then, the client can use the target comment information and the 30th second of the video resource to establish a corresponding relationship between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. At this time, the target comment information is a comment information that can be triggered.

[0156] In some possible embodiments, a trigger control 1400 may be displayed at the end of the target comment information to indicate that the target comment information in text form can be triggered. Optionally, in response to a trigger instruction triggered by the trigger control 1400, the user may jump from the comment area to the play page of the multimedia resource, and start playing the multimedia resource from the play progress node of the multimedia resource, as shown in the fifth sub-figure.

[0157] Optionally, the playback page of the multimedia resource may include a return to comment area control 1401. The client may return to the comment area from the playback page of the multimedia resource in response to a return instruction to return to the comment area triggered by the return to comment area control 1401. Specifically, when the client detects that the return to comment area control 1401 is clicked, a comment panel may appear again on the playback page of the multimedia resource, and multiple comment information may be displayed on the comment panel.

[0158] Optionally, before the client jumps from the comment area to the playback page of the multimedia resource according to the trigger instruction, assuming that the target comment information is in the middle of the comment area, when the client displays the comment area again according to the return instruction of returning to the comment area triggered by the return comment area control, the target comment information is still in the front position of the comment area, that is, the comment information displayed in the comment area remains unchanged. As shown in the sixth sub-picture, the words "Return to the original comment" 1403 can be displayed, and the words "Return to the original comment" can disappear after being displayed for a preset time period.

[0159] In an optional embodiment, the target comment information is picture comment information.

[0160] Fig.17 The following is a schematic diagram of a resource playback page in a process of commenting through screenshots according to an exemplary embodiment. Figure 10 Three, such as Fig.17 As shown, the first sub-image shows that a multimedia resource is played on the resource playing page 300. If a user takes a screenshot of the multimedia resource currently being played, the screenshot shown in the second sub-image can be obtained, and the screenshot, the first comment posting control "one-click comment posting" and the second comment posting control "one-click comment posting, and video link" are displayed. Among them, the screenshot is a screenshot of the image frame B in the entire multimedia resource.

[0161] Optionally, if the client detects that the second comment posting control 900 is triggered, it can be as shown in the third figure. Figure 1 Similarly, the preset area of ​​the second post comment control 900 displays the seconds link box 901 of the multimedia video. After the user fills in the seconds in the seconds link box 901 of the multimedia video, the screenshot can be posted as the target comment information in the comment area of ​​the multimedia resource shown in the fourth sub-picture in response to the post comment instruction, and the seconds of the multimedia resource corresponding to the screenshot are used as the playback progress node of the multimedia resource corresponding to the target comment information.

[0162] In some possible embodiments, a trigger control 1600 may be displayed at the end of the target comment information to indicate that the target comment information in the form of a picture can be triggered. Optionally, in response to a trigger instruction triggered by the trigger control 1600, the page may be jumped from the comment area to the play page of the multimedia resource, and the multimedia resource may be played from the play progress node of the multimedia resource, as shown in the fifth sub-figure.

[0163] Optionally, the playback page of the multimedia resource may include a return to comment area control 1601. The client may return to the comment area from the playback page of the multimedia resource in response to a return instruction to return to the comment area triggered by the return to comment area control 1601. Specifically, when the client detects that the return to comment area control 1401 is clicked, a comment panel may appear again on the playback page of the multimedia resource, and multiple comment information may be displayed on the comment panel.

[0164] Optionally, before the client jumps from the comment area to the playback page of the multimedia resource according to the trigger instruction, assuming that the target comment information is in the middle of the comment area, when the client displays the comment area again according to the return instruction of returning to the comment area triggered by the return comment area control, the target comment information is still in the middle of the comment area, that is, the comment information displayed in the comment area remains unchanged. As shown in the sixth sub-picture, the words "Return to the original comment" 1603 can be displayed, and the words "Return to the original comment" can disappear after being displayed for a preset time period.

[0165] In the embodiment of the present application, when the target comment information is a picture and text comment information combined with pictures and text, the trigger control behind the picture can be used to trigger the generation of the trigger instruction, and the trigger control behind the picture can be used to trigger the generation of the trigger instruction, and then the playback page of the multimedia resource can be returned to start playing the multimedia resource from the playback progress node of the multimedia resource. The specific embodiment can refer to the contents of the above picture comment information and text comment information, which will not be repeated here.

[0166] In the embodiment of the present application, the trigger control can be as follows Fig.16 and Fig.17 As shown in , it is a simple symbol, but it can also be a control in other forms. Fig.18 A schematic diagram of a resource playback page according to an exemplary embodiment Figure 10 Second, such as Fig.18 As shown, the multiple comment information displayed in the comment area on the resource playback page may include two triggerable comment information, wherein each triggerable comment information may be followed by a trigger control with the words "view the corresponding position of the original video".

[0167] Thus, by setting a trigger control with the words "view the corresponding position of the original video" after the triggerable comment information, the function of the comment information can be more easily understood, thereby providing the interactivity of the page. Thus, by displaying a return to the comment area control on the playback page of the multimedia resource, the user can quickly return to the comment area, avoiding the situation where the target comment information is at a relatively late position in the comment area and the user has to start searching for the target comment information from the beginning, thereby reducing the number of interactions and improving the interaction efficiency.

[0168] In summary, the embodiment of the present application can associate the target comment information with the resource progress node in the multimedia resource, so that the user can replay or watch the position matching the comment information from the multimedia resource through the comment information. In this way, the user can quickly browse the content of interest in the multimedia resource obtained from the comment information, improve the efficiency of the user in watching the multimedia resource, and thus save playback resources.

[0169] Fig.19 The block diagram of a multimedia resource display device based on comments is shown according to an exemplary embodiment. It has the function of implementing the data processing method in the above method embodiment, and the function can be implemented by hardware or by hardware executing corresponding software. Fig.19 , the device includes a display module 1901, an instruction acquisition module 1902, a node determination module 1903 and a playback module 1904: The display module 1901 is configured to display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource; the at least one comment information includes triggerable comment information and non-triggerable comment information; The instruction acquisition module 1902 is configured to execute and acquire a trigger instruction for target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to the playback page of the multimedia resource; The node determination module 1903 is configured to determine the playback progress node of the multimedia resource corresponding to the target comment information, where the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; The playback module 1904 is configured to execute according to the trigger instruction and the playback progress node of the multimedia resource, jump from the comment area to the playback page of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

[0170] In some possible embodiments, the playback module is configured to execute: Determine a target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource; Taking the target frame as a reference, determining the frame with a preset time length before the target frame as the advance frame; The multimedia resource is played starting from the target frame, or the multimedia resource is played starting from the advance frame.

[0171] In some possible embodiments, the device further includes a return display module; the return display module is configured to execute: During the process of playing a multimedia resource starting from a playback progress node of the multimedia resource in the playback page of the multimedia resource, if a return instruction for returning to the comment area on the playback page of the multimedia resource is detected, the comment area is returned from the playback page of the multimedia resource.

[0172] In some possible embodiments, the return display module is configured to execute: Return to the comment area from the multimedia resource playback page and locate the target comment information.

[0173] In some possible embodiments, the playback module is configured to execute: Display resource display floating window in the comment area according to the trigger instruction; In the resource display floating window, the multimedia resource starts playing from the playback progress node of the multimedia resource.

[0174] In some possible embodiments, the apparatus further includes a relationship establishment module; the relationship establishment module is configured to execute: A correspondence between target comment information and a play progress node of a multimedia resource corresponding to the target comment information is established in advance.

[0175] In some possible embodiments, the relationship establishing module is configured to execute: Obtain target comment information, parse feature information in the target comment information, and determine a playback progress node of the multimedia resource corresponding to the feature information in the multimedia resource according to the feature information and global feature information of the multimedia resource; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0176] In some possible embodiments, the relationship establishing module is configured to execute: If the target comment information is picture comment information, the picture feature information of the picture comment information is obtained by parsing; Acquire global feature information of multimedia resources; the global feature information includes picture feature information of each frame in the multimedia resources; The picture feature information of the picture comment information and the global feature information are matched and processed, and a play progress node of the multimedia resource corresponding to the picture feature information of the picture comment information is determined in the multimedia resource.

[0177] In some possible embodiments, the relationship establishing module is configured to execute: If the target comment information is text comment information, semantic analysis is performed on the text comment information to determine semantic feature information of the text comment information; Acquire global feature information of multimedia resources; the global feature information includes semantic feature information of each frame in the multimedia resources; The semantic feature information of the text comment information and the global feature information are matched and processed, and the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information is determined in the multimedia resource.

[0178] In some possible embodiments, the relationship establishing module is configured to execute: Obtaining the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published; A correspondence between target comment information and a playback progress node of a multimedia resource corresponding to the target comment information is established.

[0179] In some possible embodiments, the relationship establishing module is configured to execute: Obtain the playback progress node of the multimedia resource corresponding to the time when the user publishes the target comment information; or, Obtaining the playback progress node of the multimedia resource corresponding to the corresponding screenshot frame when the user captures a frame of the multimedia resource by screenshot and publishes the target comment information; or, Get the playback progress node of the multimedia resource linked by manual linking when the user publishes the target comment information.

[0180] In some possible embodiments, the triggerable comment information is displayed with a triggerable mark.

[0181] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0182] Fig. 20 3000 is a block diagram of an apparatus 3000 for displaying multimedia resources based on comments according to an exemplary embodiment. For example, the apparatus 3000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0183] Reference Fig. 20 , the device 3000 may include one or more of the following components: a processing component 3002 , a memory 3004 , a power component 3006 , a multimedia component 3008 , an audio component 3010 , an input / output (I / O) interface 3012 , a sensor component 3014 , and a communication component 3016 .

[0184] The processing component 3002 generally controls the overall operation of the device 3000, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 3002 may include one or more processors 3020 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 3002 may include one or more modules to facilitate the interaction between the processing component 3002 and other components. For example, the processing component 3002 may include a multimedia module to facilitate the interaction between the multimedia component 3008 and the processing component 3002.

[0185] The memory 3004 is configured to store data of various image types to support operations on the device 3000. Examples of such data include instructions for any application or method operating on the device 3000, contact data, phone book data, messages, pictures, videos, etc. The memory 3004 can be implemented by any image type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0186] The power supply component 3006 provides power to the various components of the device 3000. The power supply component 3006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 3000.

[0187] The multimedia component 3008 includes a screen that provides an output interface between the device 3000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 3008 includes a front camera and / or a rear camera. When the device 3000 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0188] The audio component 3010 is configured to output and / or input audio signals. For example, the audio component 3010 includes a microphone (MIC), and when the device 3000 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 3004 or sent via the communication component 3016. In some embodiments, the audio component 3010 also includes a speaker for outputting audio signals.

[0189] I / O interface 3012 provides an interface between processing component 3002 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0190] The sensor assembly 3014 includes one or more sensors for providing various aspects of status assessment for the device 3000. For example, the sensor assembly 3014 can detect the open / closed state of the device 3000, the relative positioning of components, such as the display and keypad of the device 3000, and the sensor assembly 3014 can also detect changes in the position of the device 3000 or a component of the device 3000, the presence or absence of user contact with the device 3000, the orientation or acceleration / deceleration of the device 3000, and the temperature change of the device 3000. The sensor assembly 3014 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 3014 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 3014 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0191] The communication component 3016 is configured to facilitate wired or wireless communication between the device 3000 and other devices. The device 3000 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 3016 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 3016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0192] In an exemplary embodiment, the apparatus 3000 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0193] An embodiment of the present invention also provides a computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to implementing a comment-based multimedia resource display method. The at least one instruction or the at least one program is loaded and executed by the processor to implement the comment-based multimedia resource display method provided by the above method embodiment.

[0194] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory 3004 including instructions, and the instructions can be executed by the processor 3020 of the device 3000 to complete the above method. Optionally, the storage medium can be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0195] An embodiment of the present invention also provides a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute any method in the first aspect or the second aspect of the embodiment of the present disclosure.

[0196] An embodiment of the present invention further provides a computer program product, which includes a computer program stored in a readable storage medium, and at least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the computer device performs any method of the first aspect or the second aspect of the embodiment of the present disclosure.

[0197] It should be noted that the order of the above embodiments of the present invention is for description only and does not represent the advantages and disadvantages of the embodiments. The above describes specific embodiments of this specification. Other embodiments are within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, comment-based display and parallel processing of multimedia resources are also possible or may be advantageous.

[0198] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0199] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0200] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A multimedia resource display method based on comments, characterized in that: include: Displaying at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource; The at least one comment information includes triggerable comment information and non-triggerable comment information; Acquire a trigger instruction for target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to the playback page of the multimedia resource; Determine a playback progress node of the multimedia resource corresponding to the target comment information, wherein the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; According to the trigger instruction and the playback progress node of the multimedia resource, jump from the comment area to the playback page of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

2. The method for displaying multimedia resources based on comments according to claim 1, characterized in that: The starting to play the multimedia resource from the playback progress node of the multimedia resource includes: Determine a target frame in the multimedia resource corresponding to a playback progress node of the multimedia resource; Taking the target frame as a reference, determining a frame with a preset time length before the target frame as an advance frame; The multimedia resource is played starting from the target frame, or the multimedia resource is played starting from the advance frame.

3. The method for displaying multimedia resources based on comments according to claim 1, characterized in that: The method further comprises: During the process of playing the multimedia resource starting from the playback progress node of the multimedia resource in the playback page of the multimedia resource, if a return instruction for returning to the comment area on the playback page of the multimedia resource is detected, the comment area is returned from the playback page of the multimedia resource.

4. The method for displaying multimedia resources based on comments according to claim 3, characterized in that: The returning the comment area from the playback page of the multimedia resource includes: Return to the comment area from the playback page of the multimedia resource and locate the target comment information.

5. The method for displaying multimedia resources based on comments according to claim 1, characterized in that: The step of jumping from the comment area to the play page of the multimedia resource according to the trigger instruction and the play progress node of the multimedia resource, and starting to play the multimedia resource from the play progress node of the multimedia resource in the play page of the multimedia resource comprises: Displaying a resource display floating window on the comment area according to the trigger instruction; The multimedia resource is played starting from the playback progress node of the multimedia resource in the resource display floating window.

6. The method for displaying multimedia resources based on comments according to claim 1, characterized in that: The method further comprises: A correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information is pre-established.

7. The method for displaying multimedia resources based on comments according to claim 6, characterized in that: The pre-establishing a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information includes: Acquire the target comment information, parse the characteristic information in the target comment information, and determine, in the multimedia resource, a playback progress node of the multimedia resource corresponding to the characteristic information according to the characteristic information and the global characteristic information of the multimedia resource; A correspondence between the target comment information and a playback progress node of the multimedia resource corresponding to the target comment information is established.

8. The method for displaying multimedia resources based on comments according to claim 7, characterized in that: The parsing the characteristic information in the target comment information, and determining, in the multimedia resource, a playback progress node of the multimedia resource corresponding to the characteristic information according to the characteristic information and the global characteristic information of the multimedia resource, comprises: If the target comment information is picture comment information, parsing to obtain picture feature information of the picture comment information; Acquire global feature information of the multimedia resource; the global feature information includes picture feature information of each frame in the multimedia resource; The picture feature information of the picture comment information and the global feature information are matched, and a play progress node of the multimedia resource corresponding to the picture feature information of the picture comment information is determined in the multimedia resource.

9. The method for displaying multimedia resources based on comments according to claim 7, characterized in that: The parsing the characteristic information in the target comment information, and determining, in the multimedia resource, a playback progress node of the multimedia resource corresponding to the characteristic information according to the characteristic information and the global characteristic information of the multimedia resource, comprises: If the target comment information is text comment information, performing semantic analysis on the text comment information to determine semantic feature information of the text comment information; Acquire global feature information of the multimedia resource; the global feature information includes semantic feature information of each frame in the multimedia resource; The semantic feature information of the text comment information and the global feature information are matched, and a play progress node of the multimedia resource corresponding to the semantic feature information of the text comment information is determined in the multimedia resource.

10. The method for displaying multimedia resources based on comments according to claim 6, characterized in that: The pre-establishing a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information includes: Acquire the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is released; A correspondence between the target comment information and a playback progress node of the multimedia resource corresponding to the target comment information is established.

11. The method for displaying multimedia resources based on comments according to claim 10, characterized in that: The acquiring the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published includes: Obtaining the playback progress node of the multimedia resource corresponding to the time when the user publishes the target comment information; or, Obtaining a playback progress node of the multimedia resource corresponding to the corresponding screenshot frame when the user captures a frame of the multimedia resource by means of screenshot and publishes the target comment information; or, The playback progress node of the multimedia resource linked by manual linking when the user publishes the target comment information is obtained.

12. The method for displaying multimedia resources based on comments according to any one of claims 1 to 11, characterized in that: The triggerable comment information is displayed with a triggerable mark.

13. A multimedia resource display device based on comments, characterized in that: include: A display module, configured to display at least one comment information of the multimedia resource in the comment area of ​​the multimedia resource; The at least one comment information includes triggerable comment information and non-triggerable comment information; An instruction acquisition module is configured to execute and acquire a trigger instruction for target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to the playback page of the multimedia resource; A node determination module is configured to determine a playback progress node of the multimedia resource corresponding to the target comment information, wherein the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; The playback module is configured to execute according to the trigger instruction and the playback progress node of the multimedia resource, jump from the comment area to the playback page of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource in the playback page of the multimedia resource.

14. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the comment-based multimedia resource display method according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the multimedia resource display method based on comments as claimed in any one of claims 1 to 12.

16. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a readable storage medium. At least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device executes the comment-based multimedia resource display method according to any one of claims 1 to 12.

Images