A method, apparatus, electronic device, and storage medium for displaying multimedia resources based on comments.
By displaying triggerable comment information in the multimedia resource comment section and jumping to the corresponding playback progress node, the problem of users understanding the comment content is solved, video viewing efficiency is improved, and resources are saved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-12
- Publication Date
- 2026-03-06
AI Technical Summary
When users leave comments after watching a video, they often find it difficult to understand the comments, which forces them to rewatch the video and wastes playback resources.
Display triggerable comment information in the comment section of the multimedia resource, and jump to the playback page of the multimedia resource by obtaining the trigger command, determine the playback progress node corresponding to the comment information, and then start playing the multimedia resource at that node.
By linking comment information with playback progress nodes of multimedia resources, users can quickly browse content of interest, improving viewing efficiency and saving playback resources.
Smart Images

Figure CN119316652B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of Internet technology, and in particular to a method, apparatus, electronic device, and storage medium for displaying multimedia resources based on comments. Background Technology
[0002] With the optimization of the network environment and the popularization of mobile smart devices, mobile terminals have become the main way for people to obtain information. Video can express information more intuitively and clearly, so it is widely disseminated and used as an important communication medium.
[0003] After watching a video, users can usually leave comments on the comment page to share their thoughts and feelings. However, other users may find it difficult to understand the comments because they overlooked the video content corresponding to the comments. This forces them to rewatch the video, resulting in a significant consumption of playback resources. Summary of the Invention
[0004] This disclosure provides a method, apparatus, electronic device, and storage medium for displaying multimedia resources based on comments. The technical solution of this disclosure is as follows:
[0005] According to a first aspect of the present disclosure, a method for displaying multimedia resources based on comments is provided, comprising:
[0006] Display at least one comment on the multimedia resource in the comment section; the at least one comment includes triggerable comment information and non-triggerable comment information;
[0007] Retrieve the trigger command for the target comment information from the triggerable comment information; the trigger command is used to trigger a jump from the comment section to the multimedia resource playback page;
[0008] Determine the playback progress node of the multimedia resource corresponding to the target comment information. The playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource.
[0009] Based on the trigger command and the playback progress node of the multimedia resource, the user is redirected from the comment section to the playback page of the multimedia resource, and the multimedia resource starts playing from the playback progress node on the playback page.
[0010] In some possible embodiments, playing the multimedia resource starting from a playback progress node includes:
[0011] Determine the target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource.
[0012] Based on the target frame, the frames with a preset duration preceding the target frame are determined as the advance frames;
[0013] Playback of multimedia resources can begin from the target frame or from the preceding frame.
[0014] In some possible embodiments, the method further includes:
[0015] If a return command to the comment section is detected on the multimedia resource playback page, and the playback progress node of the multimedia resource is started from the multimedia resource playback page, then the user returns to the comment section from the multimedia resource playback page.
[0016] In some possible embodiments, returning to the comments section from the playback page of the multimedia resource includes:
[0017] Return to the comment section from the multimedia resource playback page and navigate to the target comment information.
[0018] In some possible embodiments, based on a trigger command and a playback progress node of the multimedia resource, the user is redirected from the comment section to the multimedia resource playback page, and playback of the multimedia resource begins from the playback progress node on the multimedia resource playback page, including:
[0019] A resource display pop-up window will be displayed in the comment section based on the trigger command;
[0020] Start playing the multimedia resource from the playback progress node in the resource display floating window.
[0021] In some possible embodiments, the method further includes:
[0022] Establish a pre-defined correspondence between target comment information and the playback progress nodes of the corresponding multimedia resources.
[0023] In some possible embodiments, a correspondence is pre-established between the target comment information and the playback progress nodes of the corresponding multimedia resources, including:
[0024] Obtain target comment information and parse the feature information in the target comment information. Based on the feature information and the global feature information of the multimedia resources, determine the playback progress node of the multimedia resources corresponding to the feature information.
[0025] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0026] In some possible embodiments, feature information in the target comment information is parsed, and based on the feature information and global feature information of the multimedia resources, the playback progress node of the multimedia resource corresponding to the feature information is determined in the multimedia resources, including:
[0027] If the target comment information is an image comment, the image feature information of the image comment information is parsed.
[0028] Obtain global feature information of multimedia resources; global feature information includes image feature information of each frame in the multimedia resources;
[0029] The image feature information and global feature information of the image comment information are matched and processed to determine the playback progress node of the multimedia resource corresponding to the image feature information of the image comment information.
[0030] In some possible embodiments, feature information in the target comment information is parsed, and based on the feature information and global feature information of the multimedia resources, the playback progress node of the multimedia resource corresponding to the feature information is determined in the multimedia resources, including:
[0031] If the target comment information is text comment information, perform semantic parsing on the text comment information to determine the semantic feature information of the text comment information;
[0032] Obtain global feature information of multimedia resources; global feature information includes semantic feature information of each frame in the multimedia resources;
[0033] The semantic features of the text comment information and the global features are matched to determine the playback progress node of the multimedia resource that corresponds to the semantic features of the text comment information.
[0034] In some possible embodiments, a correspondence is pre-established between the target comment information and the playback progress nodes of the corresponding multimedia resources, including:
[0035] Retrieve the playback progress node of the multimedia resource corresponding to the target comment information, which is carried when the target comment information is published;
[0036] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0037] In some possible embodiments, obtaining the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published includes:
[0038] Obtain the playback progress node of the multimedia resource corresponding to the time when the user posted the target comment information;
[0039] or,
[0040] When a user captures a frame from a multimedia resource via screenshot and posts a target comment, the corresponding playback progress node of the multimedia resource is obtained.
[0041] or,
[0042] When obtaining target comment information posted by a user, the playback progress node of the multimedia resource linked manually.
[0043] In some possible implementations, the triggerable comment information displays a triggerable flag.
[0044] According to a second aspect of the present disclosure, a multimedia resource display device based on comments is provided, comprising:
[0045] The display module is configured to display at least one comment message of the multimedia resource in the comment section of the multimedia resource; the at least one comment message includes triggerable comment message and non-triggerable comment message;
[0046] The instruction acquisition module is configured to execute trigger instructions to acquire target comment information from the triggerable comment information; the trigger instructions are used to trigger a jump from the comment section to the multimedia resource playback page;
[0047] The node determination module is configured to determine the playback progress node of the multimedia resource corresponding to the target comment information, where the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource.
[0048] The playback module is configured to jump from the comment section to the multimedia resource playback page based on the trigger command and the playback progress node of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource on the multimedia resource playback page.
[0049] In some possible embodiments, the playback module is configured to perform:
[0050] Determine the target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource.
[0051] Based on the target frame, the frames with a preset duration preceding the target frame are determined as the advance frames;
[0052] Playback of multimedia resources can begin from the target frame or from the preceding frame.
[0053] In some possible embodiments, the apparatus further includes a return display module; the return display module is configured to perform:
[0054] If a return command to the comment section is detected on the multimedia resource playback page, and the playback progress node of the multimedia resource is started from the multimedia resource playback page, then the user returns to the comment section from the multimedia resource playback page.
[0055] In some possible embodiments, the return display module is configured to perform:
[0056] Return to the comment section from the multimedia resource playback page and navigate to the target comment information.
[0057] In some possible embodiments, the playback module is configured to perform:
[0058] A resource display pop-up window will be displayed in the comment section based on the trigger command;
[0059] Start playing the multimedia resource from the playback progress node in the resource display floating window.
[0060] In some possible embodiments, the apparatus further includes a relationship establishment module; the relationship establishment module is configured to perform:
[0061] Establish a pre-defined correspondence between target comment information and the playback progress nodes of the corresponding multimedia resources.
[0062] In some possible embodiments, the relationship-establishing module is configured to perform:
[0063] Obtain target comment information and parse the feature information in the target comment information. Based on the feature information and the global feature information of the multimedia resources, determine the playback progress node of the multimedia resources corresponding to the feature information.
[0064] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0065] In some possible embodiments, the relationship-establishing module is configured to perform:
[0066] If the target comment information is an image comment, the image feature information of the image comment information is parsed.
[0067] Obtain global feature information of multimedia resources; global feature information includes image feature information of each frame in the multimedia resources;
[0068] The image feature information and global feature information of the image comment information are matched and processed to determine the playback progress node of the multimedia resource corresponding to the image feature information of the image comment information.
[0069] In some possible embodiments, the relationship-establishing module is configured to perform:
[0070] If the target comment information is text comment information, perform semantic parsing on the text comment information to determine the semantic feature information of the text comment information;
[0071] Obtain global feature information of multimedia resources; global feature information includes semantic feature information of each frame in the multimedia resources;
[0072] The semantic features of the text comment information and the global features are matched to determine the playback progress node of the multimedia resource that corresponds to the semantic features of the text comment information.
[0073] In some possible embodiments, the relationship-establishing module is configured to perform:
[0074] Retrieve the playback progress node of the multimedia resource corresponding to the target comment information, which is carried when the target comment information is published;
[0075] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0076] In some possible embodiments, the relationship-establishing module is configured to perform:
[0077] Obtain the playback progress node of the multimedia resource corresponding to the time when the user posted the target comment information;
[0078] or,
[0079] When a user captures a frame from a multimedia resource via screenshot and posts a target comment, the corresponding playback progress node of the multimedia resource is obtained.
[0080] or,
[0081] When obtaining target comment information posted by a user, the playback progress node of the multimedia resource linked manually.
[0082] In some possible implementations, the triggerable comment information displays a triggerable flag.
[0083] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the method as described in any of the first aspects above.
[0084] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided such that, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method of any one of the first aspects of the present disclosure.
[0085] According to a fifth aspect of the present disclosure, a computer program product is provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the computer device to perform the method of any one of the first aspects of the present disclosure.
[0086] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects:
[0087] The comment section of a multimedia resource displays at least one comment, including triggerable and non-triggerable comment information. A trigger command is obtained for a target comment within the triggerable comment information. This trigger command is used to initiate a jump from the comment section to the playback page of the multimedia resource. The playback progress node of the multimedia resource corresponding to the target comment is determined. This playback progress node is a frame within the multimedia resource. Based on the trigger command and the playback progress node, the user jumps from the comment section to the playback page of the multimedia resource, and playback begins from the playback progress node on the playback page. This embodiment of the application can associate target comment information with a resource progress node in the multimedia resource, allowing users to rewind or watch content from the multimedia resource at the position matching the comment information. This helps users quickly browse content of interest obtained from the comment information, improving the efficiency of watching multimedia resources and saving playback resources.
[0088] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0089] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0090] Figure 1 This is a schematic diagram illustrating an application environment of a comment-based multimedia resource display method according to an exemplary embodiment;
[0091] Figure 2 This is a flowchart illustrating a comment-based multimedia resource display method according to an exemplary embodiment;
[0092] Figure 3 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 1 ;
[0093] Figure 4 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 2 ;
[0094] Figure 5 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 3 ;
[0095] Figure 6 This is a flowchart illustrating a method for determining playback progress nodes of a multimedia resource according to an exemplary embodiment;
[0096] Figure 7 This is a flowchart illustrating a method for determining playback progress nodes of a multimedia resource according to an exemplary embodiment;
[0097] Figure 8 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 4 ;
[0098] Figure 9 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 5 ;
[0099] Figure 10 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 6 ;
[0100] Figure 11 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 7 ;
[0101] Figure 12 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 8 ;
[0102] Figure 13 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 9 ;
[0103] Figure 14 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 10 ;
[0104] Figure 15 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 10 one;
[0105] Figure 16 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 10 two;
[0106] Figure 17 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 10 three;
[0107] Figure 18 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 10 Four;
[0108] Figure 19 This is a block diagram illustrating a comment-based multimedia resource display device according to an exemplary embodiment;
[0109] Figure 20 This is a block diagram illustrating an electronic device for displaying multimedia resources based on comments, according to an exemplary embodiment. Detailed Implementation
[0110] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0111] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar first objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0112] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.
[0113] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating an application environment for a comment-based multimedia resource display method according to an exemplary embodiment, such as... Figure 1 As shown, the application environment may include server 011 and client 012.
[0114] In some possible embodiments, server 011 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The operating system running on the server may include, but is not limited to, Android, iOS, Linux, Windows, Unix, etc.
[0115] In some possible embodiments, the client 012 described above may include, but is not limited to, image-type clients such as smartphones, desktop computers, tablets, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices. It may also be software running on the client, such as applications or mini-programs. Optionally, the operating system running on the client may include, but is not limited to, Android, iOS, Linux, Windows, and Unix systems.
[0116] In some possible embodiments, client 012 can display at least one comment on the multimedia resource in the comment section of the multimedia resource. This comment includes triggerable and non-triggerable comment information. The client obtains a trigger instruction for a target comment within the triggerable comment information. This trigger instruction is used to initiate a jump from the comment section to the playback page of the multimedia resource. The client determines the playback progress node of the multimedia resource corresponding to the target comment information, which is a frame in the multimedia resource. Based on the trigger instruction and the playback progress node, the client jumps from the comment section to the playback page of the multimedia resource, and playback begins from the playback progress node on the playback page. This embodiment of the application can associate the target comment information with the resource progress node in the multimedia resource, allowing users to rewind or watch from the position in the multimedia resource that matches the comment information. This helps users quickly browse content of interest in the multimedia resource obtained from the comment information, improving the efficiency of watching multimedia resources and saving playback resources.
[0117] In one exemplary implementation, both the client and server databases can be node devices in the blockchain system, capable of sharing acquired and generated information with other node devices within the blockchain system, thus enabling information sharing among multiple node devices. Multiple node devices in the blockchain system can be configured with the same blockchain, which consists of multiple blocks. Adjacent blocks are related, ensuring that any data tampering in any block can be detected by the next block, thereby preventing data tampering and guaranteeing the security and reliability of the data in the blockchain.
[0118] Figure 2 This is a flowchart illustrating a comment-based multimedia resource display method according to an exemplary embodiment. It should be noted that this specification provides the operational steps of the method as described in the embodiments or flowcharts, but based on conventional or non-inventive labor, more or fewer operational steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only execution order. In actual system or product execution, the method can be executed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment) as shown in the embodiments or drawings. Specifically, as... Figure 2 As shown, this flowchart includes at least the following steps S201-S207:
[0119] In step S201, at least one comment message of the multimedia resource is displayed in the comment area of the multimedia resource; the at least one comment message includes triggerable comment message and non-triggerable comment message.
[0120] In this application embodiment, the execution subject of steps S201 to S207 and the embodiments extended from steps S201 to S207 can be a client, and a user account created by a user can exist on the client.
[0121] In this embodiment, before displaying at least one comment on a multimedia resource in the comment section of the multimedia resource, the client may first display the multimedia resource on the resource playback page. Optionally, the resource playback page may be a page on a client corresponding to a certain application, and the application may include instant messaging applications, short video applications, lifestyle service applications, or shopping applications, etc.
[0122] Figure 3 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 1 ,like Figure 3 As shown, it includes a resource playback page 300, and multimedia resources 301, multimedia content information 302, and comment controls 303 on the resource playback page 300.
[0123] Optionally, multimedia resources 301 may include video, audio / video, audio files, text / images, or a collection of images. The following explanation uses video as an example of a multimedia resource; other multimedia resources will not be elaborated upon here.
[0124] Optionally, the multimedia content information 302 is text edited by the publisher of the multimedia resource to describe the multimedia resource. For example, the multimedia content information is a summary of the entire multimedia resource, which may also include relevant topic information, account information to be prompted for viewing, etc. In some possible embodiments, the multimedia content information can be a channel to jump to the comment section. That is, in response to a preset operation on the multimedia content information, the comment section of the multimedia resource can be displayed.
[0125] like Figure 3 As shown, multiple controls can be placed on the right side of the resource playback page 300, which can include, from top to bottom, an account avatar control, a like control, a comment control 303, and a share control.
[0126] The account avatar control can be triggered to display the homepage of the account corresponding to the avatar, which may include multimedia resources published by the publisher of that account. The like control can be triggered to like the multimedia resources playing on the resource playback page. The comment control can be triggered to display the comment section of the multimedia resources playing on the resource playback page, allowing users to comment on the multimedia resources playing on the resource playback page. The share control can be triggered to share the multimedia resources playing on the resource playback page.
[0127] In some other possible embodiments, comment bullet comments can be displayed on the resource playback page 300. Optionally, the displayed comment bullet comments can be comment information from the comment section. Based on this, when the client detects that a preset operation has been performed on the comment bullet comments, such as being double-clicked, the comment section of the multimedia resource can be accessed.
[0128] In this implementation, the client can play multimedia resources on a resource playback page, which includes a comment control. Optionally, the client can respond to a comment display instruction triggered by the comment control, display a comment section for the multimedia resource, and display at least one comment message for the multimedia resource in the comment section.
[0129] In some possible embodiments, the comment section of the multimedia resource may be located on a comment panel, which may be located on the resource playback page. In other possible embodiments, the comment section of the multimedia resource may be located on a comment page, which may be accessed by switching from the resource playback page.
[0130] Figure 4 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 2 ,like Figure 4 As shown, the resource playback page 300 includes the page before and after the comment control 303 is triggered. The resource playback page 300 before and after the comment control 303 is triggered may include multimedia resources 301. The resource playback page 300 before the comment control 303 is triggered may also include multimedia content information 302 and the comment control 303. The resource playback page 300 after the comment control 303 is triggered may also include a comment panel 400 and at least one comment information 401 of the multimedia resources on the comment panel 400.
[0131] The following is combined Figure 4 An alternative embodiment is described, in which the client can play multimedia resources on the resource playback page. When the client detects that a comment control on the resource playback page has been clicked, a comment panel can be displayed on the resource playback page, displaying at least one comment on the multimedia resource.
[0132] like Figure 4 As shown, the comment panel can occupy half or more of the screen. Optionally, the comment panel can be displayed on top of multimedia resources.
[0133] In this embodiment, before the comment control is triggered, the multimedia resource can be displayed in full screen or in the first area of the resource playback page. After the comment control is triggered, it can be displayed in half screen or adjusted from the first area to the second area, and the multimedia resource is displayed in the second area. Optionally, the half screen or the second area can be the upper half of the screen, and the area of the second area is smaller than the area of the first area.
[0134] In this way, when the comment control is triggered, while the comment panel is displayed on the resource playback page, the range and position of the area where the multimedia resource is played can be adjusted to reduce the possibility of the multimedia resource being obscured by the comment area.
[0135] In another alternative embodiment, the client can play multimedia resources on the resource playback page. When the client detects that a comment control on the resource playback page has been clicked, it can pause the playback of the multimedia resources and display a comment panel on the resource playback page, displaying at least one comment message.
[0136] In another alternative embodiment, the client can play multimedia resources on the resource playback page. When the client detects that a comment control on the resource playback page has been clicked, it can jump from the resource playback page to the comment page and display at least one comment on the multimedia resource on the comment page.
[0137] In another optional embodiment, the client can play multimedia resources on the resource playback page. When the client detects that a comment control on the resource playback page has been clicked, it can shrink the first area of the displayed multimedia resource to a second area, move the second area to the upper half of the resource playback page, and display a comment panel on the lower half of the resource playback page, showing at least one comment on the multimedia resource. Optionally, the multimedia resource and the comment panel do not need to obstruct each other.
[0138] Optional, such as Figure 4 As shown, each comment in at least one comment refers to all the content 401 corresponding to each account, including the account avatar, account name, and comment content. For example, the comment content corresponding to the account name "BB" is "The blooming fireworks are so beautiful". In actual application, the dotted box that circles all the content does not exist on the comment panel.
[0139] Optionally, each comment in at least one comment refers to the comment content corresponding to each account, such as the comment corresponding to the name "BB" being "The blooming fireworks are so beautiful".
[0140] In some possible embodiments, the comment content, or comment information, may include text-based comment information, image-based comment information, comment information combining text and images, etc. In this application embodiment, text-based comment information may be referred to as text comment information, image-based comment information may be referred to as image comment information, and comment information combining text and images may be referred to as image-text comment information. In this application embodiment, text comment information, image comment information, and image-text comment information can be collectively referred to as comment information.
[0141] In some possible embodiments, the image comment information may be an image frame from a multimedia resource. The image in the text comment information may be an image frame from a multimedia resource.
[0142] In step S203, a trigger instruction is obtained for the target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to the playback page of the multimedia resource.
[0143] In an optional embodiment, at least one comment information of a multimedia resource may include triggerable comment information and non-triggerable comment information.
[0144] In this embodiment, triggerable comment information refers to comment information that can be triggered to generate a trigger command, while non-triggerable comment information refers to comment information that cannot be triggered to generate a trigger command. The trigger command is used to initiate a jump from the comment section to the multimedia resource playback page.
[0145] In some possible embodiments, the playback page for multimedia resources accessed from the comments section may be as described above. Figure 3-4 The resource playback page shown here has a comment control. This resource playback page can be, for example, the resource playback page corresponding to all multimedia resources in the resource recommendation stream.
[0146] In other possible embodiments, the playback page of the multimedia resource accessed from the comment section can be a newly created playback page specifically for that multimedia resource. Optionally, the newly created playback page can be a resource display floating window displayed on the comment section. That is, when accessing the playback page of a multimedia resource from the comment section of different multimedia resources, different multimedia resources correspond to different playback pages or different resource display floating windows.
[0147] As mentioned above, at least one comment message in a multimedia resource includes text comment messages, image comment messages, and image-text comment messages. Therefore, the comment messages that can be triggered can also include text comment messages, image comment messages, and image-text comment messages.
[0148] In some other possible embodiments, each comment in at least one comment message of a multimedia resource can be triggered.
[0149] In this embodiment of the application, the triggerable comment information is displayed with a triggerable identifier. Figure 5 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 3 ,like Figure 5 As shown, it includes a resource playback page 300, multimedia resources 301 on the resource playback page 300 and a comment panel 400, and triggerable identifiers 501 and 502 on the comment information.
[0150] like Figure 5 As shown, when the triggerable comment information is text comment information, the triggerable identifier can be an underscore 501 under the text comment information, it can be bold text comment information, or it can be text comment information in a preset color. Optionally, the preset color can be red, and the color of text comment information without a triggerable identifier can be black.
[0151] If selected, when the triggerable comment information is an image comment information, the triggerable identifier can be a border 502 surrounding the image comment information. Optionally, the border can be a preset color, such as red.
[0152] In this embodiment of the application, by setting a triggerable identifier, it is possible to clearly identify which comments among at least one comment can be triggered, thereby effectively prompting the user and preventing the user from performing invalid operations on comments that cannot be triggered, thus improving the efficiency of page interaction.
[0153] In this embodiment of the application, the client can obtain a triggering instruction for the target comment information in the triggerable comment information.
[0154] In an optional embodiment, when the user clicks Figure 5 When the client receives an image comment from the triggerable comment information shown, the client can obtain the trigger command for that image comment. The trigger command for the image comment is used to trigger a jump from the comment section to the playback page of the multimedia resource.
[0155] In step S205, the playback progress node of the multimedia resource corresponding to the target comment information is determined, and the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource.
[0156] Optionally, the client can first obtain the trigger instruction for the target comment information among the triggerable comment information, and then determine the playback progress node of the multimedia resource corresponding to the target comment information. Alternatively, the client can first determine the playback progress node of the multimedia resource corresponding to the target comment information, and then obtain the trigger instruction for the target comment information among the triggerable comment information. Alternatively, the client can determine the playback progress node of the multimedia resource corresponding to the target comment information while simultaneously obtaining the trigger instruction for the target comment information among the triggerable comment information.
[0157] Optionally, the playback progress node of the multimedia resource corresponding to the target comment information can be a frame within the multimedia resource. For example, if the multimedia resource is a video resource, then the playback progress node of the multimedia resource corresponding to the target comment information can be an image frame within the video resource.
[0158] In this embodiment of the application, before determining the playback progress node of the multimedia resource corresponding to the target comment information, the client can pre-establish the correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information. Then, when the target comment information in the triggerable comment information is triggered, the client can obtain the playback progress node of the multimedia resource corresponding to the target comment information, which lays the foundation for which node of the multimedia resource to play from in the future.
[0159] In this embodiment, the client can construct a correspondence between the target comment information and the playback progress nodes of the multimedia resource corresponding to the target comment information based on the feature information in the target comment information and the global feature information of the multimedia resource.
[0160] Specifically, the client can obtain target comment information and parse the feature information within it. Based on the feature information and the global feature information of the multimedia resources, the client determines the playback progress node of the multimedia resource corresponding to the feature information. Then, the client can establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource.
[0161] In some possible embodiments, the target comment information is image comment information, and the feature information in the target comment information and the global feature information of the multimedia resource can be related to the image feature information. Figure 6 This is a flowchart illustrating a method for determining playback progress nodes of a multimedia resource according to an exemplary embodiment, including:
[0162] In step S601, if the target comment information is image comment information, the image feature information of the image comment information is parsed and obtained.
[0163] In this embodiment of the application, if the target comment information is image comment information, that is, the target comment information is an image, feature recognition can be performed on the image to obtain the image feature information. Optionally, the image feature information includes at least one of color feature information, texture feature information, shape feature information, and spatial relationship feature information.
[0164] In step S603, global feature information of the multimedia resource is obtained; the global feature information includes the image feature information of each frame in the multimedia resource.
[0165] In this embodiment, assuming the multimedia resource is a video resource, the client can obtain the global feature information of the video resource. The global feature information of the video resource may include the image feature information of each image frame in the multimedia resource. Optionally, the image feature information of each image frame includes at least one of color feature information, texture feature information, shape feature information, and spatial relationship feature information.
[0166] In step S605, the image feature information and global feature information of the image comment information are matched to determine the playback progress node of the multimedia resource corresponding to the image feature information of the image comment information.
[0167] In this embodiment, the client can match the image feature information of the image comment information with the image feature information of each image frame included in the global feature information, and determine the image frame in the multimedia resource that matches the image feature information of the image comment information, such as image frame A, as the playback progress node of the multimedia resource corresponding to the image feature information of the image comment information.
[0168] Next, the client can establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource. Optionally, the matching image frame in the multimedia resource, such as the frame number of image frame A in the multimedia resource (e.g., frame number 1200), can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and a correspondence can be established using frame number 1200 and the target comment information. Optionally, the time point of the matching image frame in the multimedia resource, such as the 10th second, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and a correspondence can be established using the time point 10 seconds and the target comment information.
[0169] In this way, by applying image feature information, the image-based comment information can be linked to the playback progress nodes of multimedia resources, laying the foundation for determining which node of the multimedia resource to play from later.
[0170] In some other possible embodiments, the target comment information is text comment information, and the feature information in the target comment information and the global feature information of the multimedia resource can be related to the semantic feature information. Figure 7 This is a flowchart illustrating a method for determining playback progress nodes of a multimedia resource according to an exemplary embodiment, including:
[0171] In step S701, if the target comment information is text comment information, semantic parsing is performed on the text comment information to determine the semantic feature information of the text comment information.
[0172] In this embodiment of the application, if the target comment information is text comment information, that is, the text comment information is a piece of text, the feature recognition of the piece of text can be performed to obtain the semantic feature information of the text comment information.
[0173] In step S703, global feature information of the multimedia resource is obtained; the global feature information includes the semantic feature information of each frame in the multimedia resource.
[0174] In this embodiment, it is assumed that the multimedia resource is a video resource containing text, and the client can obtain the global feature information of the video resource. The global feature information of the video resource may include the semantic feature information of each segment of text in the multimedia resource.
[0175] In step S705, the semantic feature information and global feature information of the text comment information are matched to determine the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information.
[0176] In this embodiment, the client can match the semantic feature information of the text comment information with the semantic feature information of each segment of text included in the global feature information, and determine the segment of text in the multimedia resource that matches the semantic feature information of each segment of text, such as the 9th segment of text, as the playback progress node of the multimedia resource corresponding to the semantic feature information of the text comment information.
[0177] Next, the client can establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resource. Optionally, the frame number of the first image frame corresponding to the matching text in the multimedia resource, such as the 9th text, for example, frame number 1200, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and a correspondence can be established using frame number 1500 and the target comment information. Optionally, the playback progress node of the multimedia resource corresponding to the matching text, such as the moment the 9th text appears, for example, at 20 seconds, can be determined as the playback progress node of the multimedia resource corresponding to the target comment information, and a correspondence can be established using the 20-second time point.
[0178] In this way, by applying semantic feature information, textual comment information can be linked to the playback progress nodes of multimedia resources, laying the foundation for determining which node of the multimedia resource to play from later.
[0179] In other possible embodiments, the target comment information is a text-image comment, which includes both text and images. The client can then combine the image feature information and semantic feature information corresponding to the text comment information to determine the playback progress node of the multimedia resource corresponding to the feature information. Next, the client can establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource. Specific implementation methods can be found in [reference needed]. Figure 6 and Figure 7 The implementation methods shown will not be described in detail here.
[0180] Thus, the embodiments of this application can establish a relationship between text-based or image-based comment information and the playback progress nodes of multimedia resources by applying different types of feature information, thereby laying the foundation for determining which node of the multimedia resource to play from in the future.
[0181] In this embodiment of the application, the client can construct a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information based on the playback progress node of the multimedia resource corresponding to the target comment information carried when the target comment information is published.
[0182] Specifically, the client can obtain the playback progress node of the multimedia resource corresponding to the target comment information when it is published. Then, the client can establish a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information.
[0183] In an optional embodiment, the client can obtain the playback progress node of the multimedia resource corresponding to the time when the user posts the target comment information, and then establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource. Taking a video resource as an example, assuming the entire video resource is 1 minute long, and assuming the user clicks the comment control and posts the target comment information in the comment section at the 30th second of watching the video resource, then the 30th second of the video resource can be used as the playback progress node of the multimedia resource corresponding to the posted target comment information. Then, the client can use the target comment information and the 30th second of the video resource to establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource.
[0184] In some other possible embodiments, the client can obtain the playback progress node of the multimedia resource corresponding to the screenshot frame when the user captures a frame from the multimedia resource by taking a screenshot and publishes the target comment information. Then, a correspondence between the target comment information and the playback progress node of the multimedia resource corresponding to the target comment information is established.
[0185] In this embodiment, in response to a screenshot operation on a multimedia resource currently being played on a resource playback page, a screenshot and a first comment posting control are displayed. In response to a comment posting instruction triggered by the first comment posting control, the screenshot is posted as the target comment information in the comment section of the multimedia resource, and the image frame corresponding to the screenshot is used as the playback progress node of the multimedia resource corresponding to the target comment information.
[0186] Figure 8 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 4 ,like Figure 8 As shown, the left-hand diagram illustrates multimedia resource 301 playing on resource playback page 300. Assuming a user takes a screenshot of the currently playing multimedia resource 301, the result is... Figure 8 The middle image shows screenshot 800, displaying screenshot 800 and the first comment posting control 801 "One-click comment posting". Screenshot 800 is a screenshot of image frame B from the entire multimedia resource. After screenshot 800 and the first comment posting control 801 are displayed on the resource playback page, if the client detects that the first comment posting control 801 has been triggered, the comment section of the multimedia resource can be displayed, and screenshot 802 can be displayed in the comment section. At this time, screenshot 802 can be displayed as a target comment information in the comment section.
[0187] Optionally, when a user clicks the comment control to post a target comment, assuming the target comment includes image frame B of the screenshot (i.e., screenshot 802 in the diagram on the right), image frame B in the multimedia resource can be used as the playback progress node of the multimedia resource corresponding to the target comment. Then, the client can use the target comment and image frame B in the video resource to establish a correspondence between the target comment and the playback progress node of the corresponding multimedia resource.
[0188] In some possible embodiments, preprocessing can be performed before taking a screenshot of the currently playing multimedia resource 301. Optionally, in response to a screen clearing command triggered by a screen clearing control, text on the screen (e.g., ...) can be cleared. Figure 3The multimedia content information (302) and various controls in the middle are displayed separately for the multimedia resources being played. In this way, a screenshot containing only one image frame of the multimedia resource can be obtained.
[0189] In some other possible embodiments, the screenshot can be processed after it is obtained. Optionally, when the resource playback page displays the screenshot 800 and the first comment posting control 801, the screenshot 800 may also include a screenshot processing control. When the screenshot processing control is triggered, at least one of the following processes can be performed on the screenshot: zooming in, zooming out, cropping, adjusting the screenshot area, adding text emoticons, adjusting the image style, etc.
[0190] In another optional embodiment, the client can obtain the playback progress node of the multimedia resource linked manually when the user posts the target comment information, and then establish a correspondence between the target comment information and the playback progress node of the corresponding multimedia resource.
[0191] In some possible implementations, screenshots from the playback resource page can be combined with manual linking, allowing users to connect to the playback progress nodes of the multimedia resource while posting comments.
[0192] In this embodiment, in response to a screenshot operation on the currently playing multimedia resource on the resource playback page, a screenshot and a second comment posting control are displayed. In response to a comment posting command triggered by the second comment posting control, a link box for the duration of the multimedia video can be displayed. If it is detected that the duration of the multimedia video has been captured in the link box, in response to the comment posting command, the screenshot can be posted as the target comment information in the comment section of the multimedia resource, and the duration of the multimedia resource corresponding to the screenshot can be used as the playback progress node of the multimedia resource corresponding to the target comment information.
[0193] Figure 9 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 5 ,like Figure 9 As shown, the first sub-image represents multimedia resource 301 playing on the resource playback page 300. Assuming a user takes a screenshot of the currently playing multimedia resource 301, the second sub-image will show screenshot 800, along with screenshot 800, the first comment control 801 "One-click comment", the second comment control 900 "One-click comment", and the video link. Specifically, screenshot 800 is a screenshot of image frame B within the entire multimedia resource.
[0194] Optionally, if the client detects that the second post comment control 900 has been triggered, it can proceed as in the third case. Figure 1Similarly, the preset area of the second comment control 900 displays a link box 901 for the duration of the multimedia video. After the user enters the duration in the link box 901, they can respond to the comment posting command and post the screenshot 802 as the target comment information in the comment area of the multimedia resource shown in the fourth sub-image, and use the duration of the multimedia resource corresponding to the screenshot as the playback progress node of the multimedia resource corresponding to the target comment information.
[0195] Taking video resources as an example, let's assume that when a user posts a target comment, the manually linked multimedia resource node in the video's second-count link box 901 is at the 20th second. Then, the 20th second of the multimedia resource can be used as the playback progress node for the corresponding multimedia resource. Next, the client can use the target comment and the 20th second of the video resource to establish a correspondence between the target comment and the playback progress node of the corresponding multimedia resource.
[0196] In other possible embodiments, comment information in the comment section of a multimedia resource can be combined with manual linking, linking the comment information to the playback progress node of the multimedia resource at the same time.
[0197] In this embodiment, the comment area of a multimedia resource may include a comment box. If a preset operation is detected in the comment box, a virtual keyboard can be displayed, on which an input box and a link control can be shown. In response to a link instruction triggered based on the link control, a link box for the duration of the multimedia video can be displayed. If it is detected that the duration of the multimedia video has been obtained from the link box, in response to a comment posting instruction, the input information in the input box can be posted in the comment area of the multimedia resource as the target comment information, and the duration of the multimedia resource corresponding to the input information can be used as the playback progress node of the multimedia resource corresponding to the target comment information.
[0198] Figure 10 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 6 ,like Figure 10 As shown in the first sub-figure, when a client detects that a comment control on the resource playback page has been clicked, a comment panel can be displayed on the resource playback page, showing at least one comment. Optionally, the comment panel may include a comment box. If a preset operation is detected in the comment box, a virtual keyboard can be displayed as shown in the second sub-figure, on which an input box 410 and a link control 411 can be displayed.
[0199] Optionally, after input information is entered into input box 410, in response to a link instruction triggered by the link control 411, a link box 412 showing the seconds of the multimedia video, as shown in the third sub-figure, can be displayed. If it is detected that the seconds in the multimedia video's seconds link box 412 have been obtained, a comment instruction can be issued, as shown in the fourth sub-figure, by publishing the input information 413 in the input box as the target comment information in the comment area of the multimedia resource, and using the seconds of the multimedia resource corresponding to the input information as the playback progress node of the multimedia resource corresponding to the target comment information.
[0200] Taking video resources as an example, let's assume that when a user posts a target comment, the manually linked multimedia resource node in the video's second-count link box 412 is at the 30th second. Then, the 30th second of the multimedia resource can be used as the target comment, i.e., the playback progress node of the multimedia resource corresponding to the input information. Next, the client can use the target comment and the 30th second of the video resource to establish a correspondence between the target comment and the playback progress node of the corresponding multimedia resource.
[0201] As mentioned above Figure 9 The third sub-image and Figure 10 In the third sub-figure, the playback progress of the multimedia resource for the target comment is set by entering the number of seconds in the link box of the multimedia video. However, other implementation methods are also possible, allowing for manual linking.
[0202] Figure 11 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 7 ,like Figure 11 As shown, it includes a link window 420 on the resource playback page and a resource drag bar control 430 in the link window.
[0203] In some possible embodiments, when a virtual keyboard is displayed on the comment panel, the virtual keyboard may include an input field 410 and a link control 411. When input information is entered into the input field 410, in response to a link instruction triggered by the link control 411, the client can display... Figure 11 The link window 420 shown is used to display the multimedia resource, wherein the displayed multimedia resource is not playing. Optionally, the resource drag bar control 430 is used by the user to manually control and drag the multimedia resource to determine which image frame corresponds to the target comment information.
[0204] Optionally, after the user determines the image frame by dragging the resource drag bar control 430, in response to the comment posting instruction, the input information in the input box can be posted in the comment area of the multimedia resource as the target comment information, and the image frame corresponding to the input information can be used as the playback progress node of the multimedia resource corresponding to the target comment information.
[0205] In the embodiments of this application, Figure 11 yes Figure 10 The alternative embodiment of the third subgraph in the diagram can also be utilized in the same way. Figure 11 right Figure 9 The third sub-image in the diagram is replaced, which will not be elaborated here. Thus, this embodiment of the application can determine the playback progress node of the multimedia resource corresponding to the target comment information based on various user operation methods, laying the foundation for constructing the correspondence between the target comment information and the playback progress node of the corresponding multimedia resource, and improving the efficiency of constructing the correspondence.
[0206] In step S207, based on the trigger command and the playback progress node of the multimedia resource, the user jumps from the comment section to the playback page of the multimedia resource, and starts playing the multimedia resource from the playback progress node of the multimedia resource on the playback page.
[0207] In this embodiment of the application, the client can jump from the comment section to the multimedia resource playback page according to the trigger command, and start playing the multimedia resource from the playback progress node of the multimedia resource on the multimedia resource playback page.
[0208] In some possible embodiments, the client can jump from the comment section to the multimedia resource playback page according to the trigger command, determine the target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource, determine the frame with a preset duration before the target frame as the advance frame based on the target frame, and start playing the multimedia resource from the target frame in the multimedia resource playback page, or start playing the multimedia resource from the advance frame in the multimedia resource playback page.
[0209] Figure 12 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 8 ,like Figure 12 As shown, the resource playback page 300 includes both before and after the target comment information is triggered. The resource playback page 300 before and after the target comment information is triggered may include multimedia resources 301. The resource playback page 300 before the target comment information is triggered may also include a comment panel 400 and at least one comment on the comment panel 400. The comment panel 400 on the resource playback page 300 after the target comment information 1100 is triggered has disappeared.
[0210] In some optional embodiments, the multimedia resource can remain in playback mode throughout the entire process, from the moment a user clicks on a comment control on the resource playback page, causing the comment panel to appear, to the moment a user clicks on a triggerable target comment on the comment panel, causing the comment panel to disappear. Based on this, when a user clicks on a target comment (such as the image below the account "DD"), the client can obtain the trigger instruction for that target comment, determine the playback progress node of the multimedia resource corresponding to that target comment, and the client can jump from the comment area to the multimedia resource playback page according to the trigger instruction, and start playing the multimedia resource from the playback progress node on the multimedia resource playback page.
[0211] The following is combined Figure 13 The example shown illustrates the entire process. Figure 13 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 9 ,like Figure 13 As shown in the diagram on the left, multimedia resource 301 is played on resource playback page 300. Assuming the total duration of the multimedia resource is 2 minutes, when the multimedia resource reaches the 1 minute and 5 seconds represented by the progress bar 600, the client detects that the comment control on the resource playback page has been clicked. Figure 13 As shown in the middle image, the client can display a comment panel 400 on the resource playback page, displaying multiple comment messages. While the comment panel is displayed, the multimedia resource continues to play.
[0212] Optionally, when the multimedia resource plays to 1 minute and 20 seconds, the client detects that the image comment information corresponding to the account "DD" on the comment panel has been clicked and triggered. The client can determine that the playback progress node of the multimedia resource corresponding to the image comment information of account "DD" is the image frame corresponding to 35 seconds. At this time, if... Figure 13 As shown in the image on the right, the comment panel disappears from the resource playback page 300, the progress bar 600 returns from 1 minute 20 seconds to 35 seconds, and the multimedia resource starts playing from the image frame corresponding to 35 seconds.
[0213] Alternatively, when the multimedia resource plays to 1 minute and 20 seconds, the client detects that the image comment information corresponding to the account "DD" on the comment panel has been clicked. The client can determine that the playback progress node of the multimedia resource corresponding to the image comment information of account "DD" is the image frame at 35 seconds, and this image frame at 35 seconds is the target frame. Optionally, the client can use the target frame as a reference to determine the frame with a preset duration before the target frame as the advance frame. Optionally, the preset duration is pre-set; assuming the preset duration is 3 seconds, the advance frame is the image frame at 32 seconds. At this time, the comment panel disappears from the resource playback page 300, the progress bar returns from 1 minute and 20 seconds to 32 seconds, and the multimedia resource playback starts from the image frame corresponding to 32 seconds.
[0214] In this way, starting playback from an earlier frame can prevent users from missing out on content they are interested in due to insufficient reaction time. Starting playback from an earlier frame also provides users with a brief recap, deepening their understanding of the content, while ensuring that they do not miss out on content they are interested in.
[0215] Alternatively, when the multimedia resource plays to 1 minute and 20 seconds, the client detects that the image comment information corresponding to the account "DD" on the comment panel has been clicked. The client can determine that the playback progress node of the multimedia resource corresponding to the image comment information of account "DD" is the image frame at 35 seconds, and this image frame at 35 seconds is the target frame. Optionally, the client can use the target frame as a reference to determine the frames a preset number of frames before the target frame as advance frames. Optionally, the preset duration is pre-set. Assuming the preset number of frames is 120 frames, the advance frame is the image frame corresponding to 120 frames before 35 seconds (for example, exactly the image frame corresponding to 31 seconds). At this time, the comment panel disappears from the resource playback page 300, the progress bar returns from 1 minute and 20 seconds to 31 seconds, and the multimedia resource starts playing from the image frame corresponding to 31 seconds.
[0216] In this way, starting playback from an earlier frame can prevent users from missing out on content they are interested in due to insufficient reaction time. Starting playback from an earlier frame also provides users with a brief recap, deepening their understanding of the content, while ensuring that they do not miss out on content they are interested in.
[0217] In this embodiment of the application, when the advance frame does not exist, the first image frame of the multimedia resource can be determined as the advance frame.
[0218] As mentioned above, the preset frame count is 120 frames. Assuming the target frame is the 100th image frame in the multimedia resource, it is clear that the 120 image frames before the target frame do not exist. Therefore, the first image frame of the multimedia resource can be determined as the advance frame.
[0219] As shown above, the preset duration is 3 seconds. The false target frame is the image frame corresponding to the 2nd second in the multimedia resource. Obviously, the image frame 3 seconds before the target frame does not exist. Therefore, the first image frame of the multimedia resource is determined as the advance frame.
[0220] In this embodiment of the application, after the client obtains the trigger instruction for the target comment information and determines the playback progress node of the multimedia resource corresponding to the target comment information, it can display a resource display floating window on the comment area according to the trigger instruction, and start playing the multimedia resource from the playback progress node of the multimedia resource in the resource display floating window.
[0221] Figure 14 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 10 ,like Figure 14 As shown, when a user clicks on the target comment information on the comment panel 400, a trigger command can be generated. This trigger command is used to create a resource display floating window corresponding to the target comment information in the comment area, and to start playing the multimedia resource from the playback progress node in the multimedia resource display floating window.
[0222] Optionally, the resource display window can disappear after the multimedia resource in the display window has finished playing.
[0223] In this embodiment of the application, the subject of execution in step S205, which involves determining the playback progress node of the multimedia resource corresponding to the target comment information, can be either a server or a client.
[0224] In this embodiment of the application, during the playback of a multimedia resource starting from a playback progress node on the multimedia resource playback page, if a return instruction to the comment section is detected on the multimedia resource playback page, the client can return to the comment section from the multimedia resource playback page.
[0225] Figure 15 This is a schematic diagram of a resource playback page during the process of playing a video through comment information, according to an exemplary embodiment. Figure 10 First, such as Figure 15 As shown, Figure 15 As shown in the diagram on the left, the client can display a comment panel 400 on the resource playback page. The comment panel 400 displays multiple comment messages, including the target comment message. When the client detects that the target comment message has been clicked, the client can obtain the trigger instruction for the target comment message and determine the playback progress node of the multimedia resource corresponding to the target comment message. For example... Figure 14As shown in the middle diagram, the client can jump from the comment section to the multimedia resource playback page according to the trigger command, and start playing the multimedia resource from the playback progress node on the multimedia resource playback page.
[0226] In some possible embodiments, when the client navigates from the comment section to the multimedia resource playback page, a "Return to Comment Section" control 1100 may be displayed on the multimedia resource playback page. The client can return to the comment section from the multimedia resource playback page in response to a return command triggered by the "Return to Comment Section" control 1100.
[0227] Specifically, when the client detects that the return to the comment section control 1100 has been clicked, the comment panel can reappear on the multimedia resource playback page, displaying multiple comment messages.
[0228] In this way, the "Return to Comments Section" control displayed on the multimedia resource playback page can quickly help users return to the comment section, reducing the number of interactions and improving interaction efficiency.
[0229] In some possible implementations, when returning to the comment section from the multimedia resource playback page, the client can locate the target comment information. That is, assuming the target comment information is in the middle of the comment section before the client jumps from the comment section to the multimedia resource playback page according to the trigger command, when the client re-displays the comment section according to the return command triggered by the return comment section control, the target comment information will still be in the middle of the comment section; that is, the comment information displayed in the comment section remains unchanged.
[0230] In an optional embodiment, the target comment information is text comment information.
[0231] Figure 16 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 10 Second, such as Figure 16 As shown in the first sub-figure, when a client detects that a comment control on the resource playback page has been clicked, a comment panel can be displayed on the resource playback page, showing at least one comment. Optionally, the comment panel may include a comment box. If a preset operation is detected in the comment box, a virtual keyboard can be displayed as shown in the second sub-figure, which may display input boxes and link controls.
[0232] Optionally, after input information is entered into the input box, in response to the link instruction triggered by the link control 411, the multimedia video's second count link box 412, as shown in the third sub-figure, can be displayed. If it is detected that the second count in the multimedia video's second count link box 412 has been obtained, in response to the comment instruction, as shown in the fourth sub-figure, the input information in the input box can be published in the multimedia resource's comment area as the target comment information, and the second count of the multimedia resource corresponding to the input information can be used as the playback progress node of the multimedia resource corresponding to the target comment information.
[0233] Taking video resources as an example, let's assume that when a user posts a target comment, the manually linked multimedia resource node in the video's second-count link box is at the 30th second. Then, the 30th second of the multimedia resource can be used as the target comment, representing the playback progress node of the multimedia resource corresponding to the input information. Next, the client can use the target comment and the 30th second of the video resource to establish a correspondence between the target comment and the playback progress node of the corresponding multimedia resource. At this point, the target comment is a triggerable comment.
[0234] In some possible embodiments, a trigger control 1400 may be displayed at the end of the target comment information to indicate that the text-based target comment information can be triggered. Optionally, in response to a trigger command triggered based on the trigger control 1400, as shown in the fifth sub-figure, the user can jump from the comment section to the multimedia resource playback page and start playing the multimedia resource from the playback progress node.
[0235] Optionally, the multimedia resource playback page may include a return to the comment section control 1401. The client can return to the comment section from the multimedia resource playback page in response to a return command triggered by the return to the comment section control 1401. Specifically, when the client detects that the return to the comment section control 1401 has been clicked, the comment panel can reappear on the multimedia resource playback page, displaying multiple comment messages.
[0236] Optionally, before the client jumps from the comment section to the multimedia resource playback page according to the trigger instruction, assuming the target comment information is in the middle of the comment section, when the client displays the comment section again according to the return instruction triggered by the return comment section control, the target comment information is still in the first position of the comment section, that is, the comment information displayed in the comment section remains unchanged. As shown in the sixth sub-figure, the words "Return to original comment" 1403 can be displayed. The words "Return to original comment" can disappear after a preset time period.
[0237] In an optional embodiment, the target comment information is image comment information.
[0238] Figure 17 This is an illustration of a resource playback page during a commenting process using screenshots, according to an exemplary embodiment. Figure 10 Third, such as Figure 17 As shown, the first sub-image represents multimedia resources playing on the resource playback page 300. Assuming a user takes a screenshot of the currently playing multimedia resource, the screenshot shown in the second sub-image will be displayed, along with the first and second comment control options ("One-Click Comment") and the video link. This screenshot is a capture of image frame B from the entire multimedia resource.
[0239] Optionally, if the client detects that the second post comment control 900 has been triggered, it can proceed as in the third case. Figure 1 Similarly, the preset area of the second comment control 900 displays a link box 901 for the duration of the multimedia video. After the user enters the duration in the link box 901, they can respond to the comment posting command and post the screenshot as the target comment information in the comment area of the multimedia resource shown in the fourth sub-image, and use the duration of the multimedia resource corresponding to the screenshot as the playback progress node of the multimedia resource corresponding to the target comment information.
[0240] In some possible embodiments, a trigger control 1600 may be displayed at the end of the target comment information to indicate that the image-based target comment information can be triggered. Optionally, in response to a trigger command triggered based on the trigger control 1600, as shown in the fifth sub-figure, the user can jump from the comment section to the multimedia resource playback page and start playing the multimedia resource from the playback progress node.
[0241] Optionally, the multimedia resource playback page may include a return to the comment section control 1601. The client can return to the comment section from the multimedia resource playback page in response to a return command triggered by the return to the comment section control 1601. Specifically, when the client detects that the return to the comment section control 1401 has been clicked, the comment panel can reappear on the multimedia resource playback page, displaying multiple comment messages.
[0242] Optionally, before the client jumps from the comment section to the multimedia resource playback page according to the trigger instruction, assuming the target comment information is in the middle of the comment section, when the client displays the comment section again according to the return instruction triggered by the return comment section control, the target comment information is still in the middle of the comment section, that is, the comment information displayed in the comment section remains unchanged. As shown in the sixth sub-figure, the words "Return to original comment" can be displayed 1603. The words "Return to original comment" can disappear after a preset time period.
[0243] In this embodiment, when the target comment information is a combination of image and text, a trigger command can be generated by the trigger control behind the image, which in turn triggers the multimedia resource playback page to start playing the multimedia resource from the playback progress node. Specific embodiments can be found in the content of the image and text comment information above, and will not be repeated here.
[0244] In this embodiment of the application, the trigger control can be as follows: Figure 16 and Figure 17 The image shown is a simple symbol, but it could also be a control in other forms. Figure 18 This is a schematic diagram of a resource playback page according to an exemplary embodiment. Figure 10 Second, such as Figure 18 As shown, the comment section displayed on the resource playback page can include two triggerable comment messages. Each triggerable comment message can be followed by a trigger control with the words "View the corresponding position of the original video".
[0245] Therefore, by placing a trigger control with the phrase "View the corresponding position in the original video" after the triggerable comment information, the function of the comment information can be more easily understood, thereby improving the interactivity of the page. Similarly, by displaying a "Return to Comments Area" control on the multimedia resource playback page, users can quickly return to the comment section, avoiding the need to start searching for the target comment from the beginning if it is located far back in the comment section, thus reducing the number of interactions and improving interaction efficiency.
[0246] In summary, the embodiments of this application can associate target comment information with resource progress nodes in multimedia resources, allowing users to rewind or watch content from the multimedia resources at the position matching the comment information. This helps users quickly browse content of interest obtained from the comment information, improving the efficiency of watching multimedia resources and saving playback resources.
[0247] Figure 19 This is a block diagram illustrating a comment-based multimedia resource display device according to an exemplary embodiment. It has the functionality to implement the data processing method in the above-described method embodiments; this functionality can be implemented in hardware or by hardware executing corresponding software. (Refer to...) Figure 19 The device includes a display module 1901, an instruction acquisition module 1902, a node determination module 1903, and a playback module 1904.
[0248] Display module 1901 is configured to display at least one comment message of a multimedia resource in the comment section of the multimedia resource; the at least one comment message includes triggerable comment message and non-triggerable comment message;
[0249] The instruction acquisition module 1902 is configured to execute a trigger instruction to acquire target comment information from the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to the playback page of the multimedia resource;
[0250] The node determination module 1903 is configured to determine the playback progress node of the multimedia resource corresponding to the target comment information, wherein the playback progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource.
[0251] Playback module 1904 is configured to jump from the comment section to the multimedia resource playback page based on the trigger command and the playback progress node of the multimedia resource, and start playing the multimedia resource from the playback progress node of the multimedia resource on the multimedia resource playback page.
[0252] In some possible embodiments, the playback module is configured to perform:
[0253] Determine the target frame in the multimedia resource corresponding to the playback progress node of the multimedia resource.
[0254] Based on the target frame, the frames with a preset duration preceding the target frame are determined as the advance frames;
[0255] Playback of multimedia resources can begin from the target frame or from the preceding frame.
[0256] In some possible embodiments, the apparatus further includes a return display module; the return display module is configured to perform:
[0257] If a return command to the comment section is detected on the multimedia resource playback page, and the playback progress node of the multimedia resource is started from the multimedia resource playback page, then the user returns to the comment section from the multimedia resource playback page.
[0258] In some possible embodiments, the return display module is configured to perform:
[0259] Return to the comment section from the multimedia resource playback page and navigate to the target comment information.
[0260] In some possible embodiments, the playback module is configured to perform:
[0261] A resource display pop-up window will be displayed in the comment section based on the trigger command;
[0262] Start playing the multimedia resource from the playback progress node in the resource display floating window.
[0263] In some possible embodiments, the apparatus further includes a relationship establishment module; the relationship establishment module is configured to perform:
[0264] Establish a pre-defined correspondence between target comment information and the playback progress nodes of the corresponding multimedia resources.
[0265] In some possible embodiments, the relationship-establishing module is configured to perform:
[0266] Obtain target comment information and parse the feature information in the target comment information. Based on the feature information and the global feature information of the multimedia resources, determine the playback progress node of the multimedia resources corresponding to the feature information.
[0267] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0268] In some possible embodiments, the relationship-establishing module is configured to perform:
[0269] If the target comment information is an image comment, the image feature information of the image comment information is parsed.
[0270] Obtain global feature information of multimedia resources; global feature information includes image feature information of each frame in the multimedia resources;
[0271] The image feature information and global feature information of the image comment information are matched and processed to determine the playback progress node of the multimedia resource corresponding to the image feature information of the image comment information.
[0272] In some possible embodiments, the relationship-establishing module is configured to perform:
[0273] If the target comment information is text comment information, perform semantic parsing on the text comment information to determine the semantic feature information of the text comment information;
[0274] Obtain global feature information of multimedia resources; global feature information includes semantic feature information of each frame in the multimedia resources;
[0275] The semantic features of the text comment information and the global features are matched to determine the playback progress node of the multimedia resource that corresponds to the semantic features of the text comment information.
[0276] In some possible embodiments, the relationship-establishing module is configured to perform:
[0277] Retrieve the playback progress node of the multimedia resource corresponding to the target comment information, which is carried when the target comment information is published;
[0278] Establish a correspondence between the target comment information and the playback progress nodes of the corresponding multimedia resources.
[0279] In some possible embodiments, the relationship-establishing module is configured to perform:
[0280] Obtain the playback progress node of the multimedia resource corresponding to the time when the user posted the target comment information;
[0281] or,
[0282] When a user captures a frame from a multimedia resource via screenshot and posts a target comment, the corresponding playback progress node of the multimedia resource is obtained.
[0283] or,
[0284] When obtaining target comment information posted by a user, the playback progress node of the multimedia resource linked manually.
[0285] In some possible implementations, the triggerable comment information displays a triggerable flag.
[0286] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.
[0287] Figure 20 This is a block diagram illustrating an apparatus 3000 for displaying comment-based multimedia resources according to an exemplary embodiment. For example, apparatus 3000 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0288] Reference Figure 20 The device 3000 may include one or more of the following components: a processing component 3002, a memory 3004, a power component 3006, a multimedia component 3008, an audio component 3010, an input / output (I / O) interface 3012, a sensor component 3014, and a communication component 3016.
[0289] Processing component 3002 typically controls the overall operation of device 3000, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 3002 may include one or more processors 3020 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 3002 may include one or more modules to facilitate interaction between processing component 3002 and other components. For example, processing component 3002 may include a multimedia module to facilitate interaction between multimedia component 3008 and processing component 3002.
[0290] Memory 3004 is configured to store various image types of data to support operation of device 3000. Examples of this data include instructions for any application or method operating on device 3000, contact data, phonebook data, messages, pictures, videos, etc. Memory 3004 can be implemented by any image type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0291] Power supply component 3006 provides power to various components of device 3000. Power supply component 3006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 3000.
[0292] Multimedia component 3008 includes a screen that provides an output interface between the device 3000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 3008 includes a front-facing camera and / or a rear-facing camera. When the device 3000 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0293] Audio component 3010 is configured to output and / or input audio signals. For example, audio component 3010 includes a microphone (MIC) configured to receive external audio signals when device 3000 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 3004 or transmitted via communication component 3016. In some embodiments, audio component 3010 also includes a speaker for outputting audio signals.
[0294] I / O interface 3012 provides an interface between processing component 3002 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0295] Sensor assembly 3014 includes one or more sensors for providing status assessments of various aspects of device 3000. For example, sensor assembly 3014 may detect the on / off state of device 3000, the relative positioning of components such as the display and keypad of device 3000, changes in the position of device 3000 or a component of device 3000, the presence or absence of user contact with device 3000, the orientation or acceleration / deceleration of device 3000, and temperature changes of device 3000. Sensor assembly 3014 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 3014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 3014 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0296] Communication component 3016 is configured to facilitate wired or wireless communication between device 3000 and other devices. Device 3000 can access wireless networks based on communication standards, such as WiFi, carrier networks (such as 2G, 3G, 4G, or 5G), or combinations thereof. In one exemplary embodiment, communication component 3016 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 3016 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0297] In an exemplary embodiment, the apparatus 3000 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0298] Embodiments of the present invention also provide a computer-readable storage medium, which can be disposed in an electronic device to store at least one instruction or at least one program related to implementing a comment-based multimedia resource display method, wherein the at least one instruction or the at least one program is loaded and executed by the processor to implement the comment-based multimedia resource display method provided in the above-described method embodiments.
[0299] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory 3004 including instructions, which can be executed by a processor 3020 of the device 3000 to perform the above-described method. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.
[0300] Embodiments of the present invention also provide a computer-readable storage medium that, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the method of any one of the first or second aspects of the embodiments of the present disclosure.
[0301] Embodiments of the present invention also provide a computer program product comprising a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the computer device to perform the method of any one of the first or second aspects of the embodiments of the present disclosure.
[0302] It should be noted that the order of the above embodiments of the present invention is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired results. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired results. In some embodiments, comment-based multimedia resource display and parallel processing are also possible or may be advantageous.
[0303] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0304] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0305] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
Claims
1. A method for displaying a multimedia resource based on a comment, characterized by, The method comprises: displaying at least one comment information of the multimedia resource in a comment area of the multimedia resource; the at least one comment information comprises comment information that can be triggered and comment information that cannot be triggered; obtaining a trigger instruction for target comment information in the comment information that can be triggered; the trigger instruction is used to trigger a jump from the comment area to a playing page of the multimedia resource; determining a playing progress node of the multimedia resource corresponding to the target comment information; the playing progress node of the multimedia resource corresponding to the target comment information is a frame in the multimedia resource; according to the trigger instruction and the playing progress node of the multimedia resource, jumping from the comment area to the playing page of the multimedia resource and playing the multimedia resource from the playing progress node of the multimedia resource in the playing page of the multimedia resource; the method further comprises: in response to a screenshot operation on the playing page of the resource, displaying a screenshot and a second comment publishing control; in response to a comment publishing instruction triggered based on the second comment publishing control, a second number link box of the multimedia resource can be displayed; if it is detected that a second number in the second number link box of the multimedia resource has been obtained, the comment publishing instruction can be responded to, the screenshot is published as the target comment information in the comment area of the multimedia resource, and the second number is used as the playing progress node of the multimedia resource corresponding to the target comment information; the second number in the second number link box can be filled in.
2. The comment-based multimedia resource display method of claim 1, wherein, the playing of the multimedia resource from the playing progress node of the multimedia resource comprises: determining a target frame in the multimedia resource corresponding to the playing progress node of the multimedia resource; determining a frame with a preset time length before the target frame as an advance frame based on the target frame; playing the multimedia resource from the target frame as a starting point, or playing the multimedia resource from the advance frame as a starting point.
3. The comment-based multimedia resource display method of claim 1, wherein, the method further comprises: during the playing of the multimedia resource from the playing progress node of the multimedia resource in the playing page of the multimedia resource, if a return instruction for returning to the comment area located on the playing page of the multimedia resource is detected, the comment area is returned from the playing page of the multimedia resource.
4. The comment-based multimedia resource display method of claim 3, wherein, the return of the comment area from the playing page of the multimedia resource comprises: returning the comment area from the playing page of the multimedia resource and positioning to the target comment information.
5. The comment-based multimedia resource display method of claim 1, wherein, the jumping from the comment area to the playing page of the multimedia resource and the playing of the multimedia resource from the playing progress node of the multimedia resource in the playing page of the multimedia resource according to the trigger instruction and the playing progress node of the multimedia resource comprises: displaying a resource display floating window on the comment area according to the trigger instruction; playing the multimedia resource from the playing progress node of the multimedia resource in the resource display floating window.
6. The comment-based multimedia resource display method of claim 1, wherein, the method further comprises: Pre-establishing a corresponding relationship between the target comment information and a playing progress node of the multimedia resource corresponding to the target comment information.
7. The comment-based multimedia resource display method of claim 6, wherein, The pre-establishing of the corresponding relationship between the target comment information and the playing progress node of the multimedia resource corresponding to the target comment information comprises: acquiring the target comment information, and analyzing feature information in the target comment information, and determining, according to the feature information and global feature information of the multimedia resource, a playing progress node of the multimedia resource corresponding to the feature information in the multimedia resource; establishing the corresponding relationship between the target comment information and the playing progress node of the multimedia resource corresponding to the target comment information.
8. The comment-based multimedia resource display method of claim 7, wherein, The analyzing of the feature information in the target comment information, and the determining, according to the feature information and global feature information of the multimedia resource, of the playing progress node of the multimedia resource corresponding to the feature information in the multimedia resource comprises: if the target comment information is picture comment information, analyzing picture feature information of the picture comment information; acquiring global feature information of the multimedia resource; the global feature information comprises picture feature information of each frame in the multimedia resource; performing matching processing on the picture feature information of the picture comment information and the global feature information, and determining the playing progress node of the multimedia resource corresponding to the picture feature information of the picture comment information in the multimedia resource.
9. The comment-based multimedia resource display method of claim 7, wherein, The analyzing of the feature information in the target comment information, and the determining, according to the feature information and global feature information of the multimedia resource, of the playing progress node of the multimedia resource corresponding to the feature information in the multimedia resource comprises: if the target comment information is text comment information, performing semantic analysis on the text comment information to determine semantic feature information of the text comment information; acquiring global feature information of the multimedia resource; the global feature information comprises semantic feature information of each frame in the multimedia resource; performing matching processing on the semantic feature information of the text comment information and the global feature information, and determining the playing progress node of the multimedia resource corresponding to the semantic feature information of the text comment information in the multimedia resource.
10. The comment-based multimedia resource display method of claim 6, wherein, The pre-establishing of the corresponding relationship between the target comment information and the playing progress node of the multimedia resource corresponding to the target comment information comprises: acquiring a playing progress node of the multimedia resource corresponding to the target comment information carried by the target comment information when the target comment information is published; establishing the corresponding relationship between the target comment information and the playing progress node of the multimedia resource corresponding to the target comment information.
11. The comment-based multimedia resource display method of claim 10, wherein, The acquiring of the playing progress node of the multimedia resource corresponding to the target comment information carried by the target comment information when the target comment information is published comprises: acquiring a playing progress node of the multimedia resource corresponding to a time when the target comment information is published by a user; or, acquire a play progress node of the multimedia resource corresponding to a screenshot frame corresponding to a screenshot frame of the multimedia resource taken by a user through screenshot mode when the user publishes the target comment information; Or, acquire a play progress node of the multimedia resource linked through manual linking mode when the user publishes the target comment information.
12. The comment-based multimedia resource display method according to any one of claims 1 to 11, wherein, The triggerable comment information is displayed with a triggerable identifier.
13. A comment-based multimedia resource display apparatus, characterized by comprising: Including: a display module configured to display at least one comment information of a multimedia resource in a comment area of the multimedia resource; The at least one comment information includes triggerable comment information and non-triggerable comment information; an instruction acquisition module configured to acquire a trigger instruction for a target comment information in the triggerable comment information; the trigger instruction is used to trigger a jump from the comment area to a play page of the multimedia resource; a node determination module configured to determine a play progress node of the multimedia resource corresponding to the target comment information, the play progress node of the multimedia resource corresponding to the target comment information being a frame in the multimedia resource; a play module configured to jump from the comment area to the play page of the multimedia resource according to the trigger instruction and the play progress node of the multimedia resource, and play the multimedia resource from the play progress node of the multimedia resource in the play page of the multimedia resource; The device further includes a relationship establishment module configured to: in response to a screenshot operation on the multimedia resource currently being played on the resource play page, display a screenshot and a second comment publishing control; in response to a comment publishing instruction triggered based on the second comment publishing control, a second number link box of the multimedia resource can be displayed; if it is detected that a second number in the second number link box of the multimedia resource has been acquired, the comment publishing instruction can be responded to, the screenshot is published as the target comment information in the comment area of the multimedia resource, and the second number is taken as the play progress node of the multimedia resource corresponding to the target comment information; The second number in the second number link box can be filled.
14. An electronic device, comprising: Including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the comment-based multimedia resource display method of any one of claims 1 to 12.
15. A computer-readable storage medium, characterized in that, When the instructions in the computer readable storage medium are executed by the processor of the electronic device, the electronic device can execute the comment-based multimedia resource display method of any one of claims 1 to 12.
16. A computer program product, characterised in that, The computer program product includes a computer program stored in a readable storage medium, and at least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device executes the comment-based multimedia resource display method of any one of claims 1 to 12.
Citation Information
Patent Citations
Video playing method and device, equipment and medium
CN115221354A