Message sending method and device, equipment and storage medium

Abstract

The present disclosure relates to a message sending method and device, equipment and storage medium, and relates to the technical field of multimedia. The method can call out a message input box through one-key operation, and fill a first image frame currently played into the message input box after taking a screenshot of the first image frame. In this way, the first image frame can be quickly published without manually taking a screenshot of the first image frame by a terminal logged in an object, the operation steps are reduced, and the human-computer interaction efficiency is improved. Furthermore, an editing control of the first image frame is displayed on the message input box, and triggering the editing control can enter an editing interface of the first image frame to edit the first image frame. That is, the message input box also provides an editing function of the first image frame, the first image frame can be quickly edited, the interaction path during editing of the first image frame is shortened, and the human-computer interaction efficiency during publishing of a comment message including an image is further improved.

Description

Technical Field

[0001] This disclosure relates to the field of multimedia technology, and in particular to a message sending method, apparatus, device and storage medium. Background Technology

[0002] In a conversational scenario, if a user downloads an image before entering the conversation interface, the interface will display that image upon entry. The user can then send the image without needing to search for it in the image library. However, the image must be downloaded locally before it can be sent, resulting in low interaction efficiency. Summary of the Invention

[0003] This disclosure provides a message sending method, apparatus, device, and storage medium. The method reduces operational steps and improves human-computer interaction efficiency. The technical solution of this disclosure is as follows.

[0004] According to one aspect of the embodiments of this disclosure, a message sending method is provided, the method comprising:

[0005] In response to a pause operation on the multimedia resource, playback of the multimedia resource is paused, and the first image frame currently being played is displayed on the playback interface.

[0006] In response to the first operation, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed;

[0007] A message input box is displayed based on the screenshot result. The first image frame and an editing control for the first image frame are displayed on the message input box. The message input box is used to post a comment message for the multimedia resource. The editing control is used to display the editing interface of the first image frame when triggered.

[0008] In response to a message posting operation on the message input box, a comment message including the first image frame is posted.

[0009] In some embodiments, the method further includes:

[0010] In response to a second operation on the message input box, the message input box is closed and the multimedia resource continues to play;

[0011] In response to another pause operation on the multimedia resource, playback of the multimedia resource is paused, and the currently playing second image frame is displayed on the playback interface;

[0012] In response to the first operation, the message input box is displayed again, and the first image frame, the second image frame, and their respective editing controls are displayed on the message input box.

[0013] In response to a message posting operation on the message input box, a comment message including the first image frame and the second image frame is posted.

[0014] In some embodiments, the method further includes:

[0015] Display a close control for the first image frame on the message input box;

[0016] In response to the triggering operation of the close control, the first image frame is de-displayed on the message input box.

[0017] In some embodiments, the method further includes:

[0018] A replacement control for the first image frame is displayed on the message input box;

[0019] In response to a trigger operation on the replacement control, a plurality of third image frames are displayed, the plurality of third image frames being image frames extracted from the multimedia resource;

[0020] In response to the selection operation of any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0021] In some embodiments, the method further includes at least one of the following:

[0022] Image frames are extracted from the multimedia resources at preset time intervals to obtain the plurality of third image frames;

[0023] From the multimedia resources, image frames whose interaction count meets the preset conditions are extracted to obtain the plurality of third image frames. The interaction count of each image frame includes at least one of the number of likes, comments, and shares at the playback time of the image frame.

[0024] The multimedia resource is divided into multiple segments, and the image frame with the highest number of publications in each segment is determined as the third image frame.

[0025] In some embodiments, displaying a plurality of third image frames includes:

[0026] The plurality of third image frames are displayed in the playback order of the multimedia resource;

[0027] Alternatively, the plurality of third image frames may be displayed in the order of their interaction counts;

[0028] Alternatively, the plurality of third image frames may be displayed in the order of their publication frequency.

[0029] In some embodiments, the method further includes:

[0030] In response to a pause operation on the multimedia resource, a prompt message is displayed, which prompts the user to perform the first operation.

[0031] In some embodiments, the step of publishing a comment message including the first image frame in response to a message posting operation on the message input box includes:

[0032] In response to a message posting operation on the message input box, obtain the content summary information corresponding to the first image frame;

[0033] A comment message is published that includes the first image frame and the summary information of the content.

[0034] In some embodiments, the step of publishing a comment message including the first image frame in response to a message posting operation on the message input box includes:

[0035] Retrieve the information entered in the message input box;

[0036] In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0037] In some embodiments, the method further includes:

[0038] In response to the first operation, information associated with the first image frame is obtained and the information is displayed on the message input box;

[0039] The response to the message posting operation on the message input box, posting a comment message including the first image frame, includes:

[0040] In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0041] In some embodiments, the playback interface displays a message posting control, and the step of taking a screenshot of the first image frame and displaying the screenshot result of the first image frame in response to the first operation includes at least one of the following:

[0042] In response to a long press operation on the message publishing control, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed;

[0043] In response to a target gesture operation on the playback interface, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed.

[0044] In some embodiments, the method further includes:

[0045] In response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource is displayed, and the first image frame is displayed on the session interface.

[0046] In response to the sending operation of the first image frame, the first image frame is sent to the publisher.

[0047] In some embodiments, the method further includes:

[0048] In response to a fourth operation on the playback interface, a list of objects is displayed;

[0049] In response to a selection operation on any object in the object list, the first image frame is sent to the selected object.

[0050] According to another aspect of the embodiments of this disclosure, a message sending apparatus is provided, the apparatus comprising:

[0051] The pause unit is configured to perform a pause operation in response to a multimedia resource, pause playback of the multimedia resource, and display the currently playing first image frame on the playback interface.

[0052] The display unit is configured to perform a screenshot of the first image frame in response to a first operation and display the screenshot result of the first image frame;

[0053] The display unit is further configured to execute a message input box based on the screenshot result, display the first image frame and an editing control of the first image frame on the message input box, the message input box being used to post a comment message on the multimedia resource, and the editing control being used to display the editing interface of the first image frame after being triggered;

[0054] The publishing unit is configured to perform a message publishing operation in response to the message input box, publishing a comment message including the first image frame.

[0055] In some embodiments, the apparatus further includes:

[0056] The collapse unit is configured to perform a second operation in response to the message input box, collapse the message input box and continue playing the multimedia resource;

[0057] The pause unit is configured to perform a pause operation in response to the multimedia resource, pause the playback of the multimedia resource, and display the currently playing second image frame on the playback interface.

[0058] The display unit is configured to respond to the first operation by displaying the message input box again, and displaying the first image frame, the second image frame and their respective editing controls on the message input box;

[0059] The publishing unit is configured to perform a message publishing operation in response to the message input box, publishing a comment message including the first image frame and the second image frame.

[0060] In some embodiments, the display unit is further configured to perform:

[0061] Display a close control for the first image frame on the message input box;

[0062] In response to the triggering operation of the close control, the first image frame is de-displayed on the message input box.

[0063] In some embodiments, the display unit is further configured to perform:

[0064] A replacement control for the first image frame is displayed on the message input box;

[0065] In response to a trigger operation on the replacement control, a plurality of third image frames are displayed, the plurality of third image frames being image frames extracted from the multimedia resource;

[0066] In response to the selection operation of any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0067] In some embodiments, the display unit is further configured to perform:

[0068] In response to a pause operation on the multimedia resource, a prompt message is displayed, which prompts the user to perform the first operation.

[0069] In some embodiments, the publishing unit is configured to perform:

[0070] In response to a message posting operation on the message input box, obtain the content summary information corresponding to the first image frame;

[0071] A comment message is published that includes the first image frame and the summary information of the content.

[0072] In some embodiments, the publishing unit is configured to perform:

[0073] Retrieve the information entered in the message input box;

[0074] In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0075] In some embodiments, the display unit is further configured to perform:

[0076] In response to the first operation, information associated with the first image frame is obtained and the information is displayed on the message input box;

[0077] The publishing unit is configured to execute:

[0078] In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0079] In some embodiments, the playback interface displays a message posting control, and the display unit is configured to perform at least one of the following:

[0080] In response to a long press operation on the message publishing control, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed;

[0081] In response to a target gesture operation on the playback interface, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed.

[0082] In some embodiments, the display unit is further configured to perform a third operation in response to the playback interface, displaying a session interface between the terminal login object and the publisher of the multimedia resource, and displaying the first image frame on the session interface;

[0083] The apparatus further includes a first transmitting unit configured to perform a transmitting operation on the first image frame by transmitting the first image frame to the publisher.

[0084] In some embodiments, the display unit is further configured to perform a fourth operation in response to the playback interface, displaying a list of objects;

[0085] The apparatus further includes a second transmitting unit configured to perform a selection operation on any object in the object list, transmitting the first image frame to the selected object.

[0086] According to another aspect of the embodiments of this disclosure, an electronic device is provided, the electronic device comprising:

[0087] processor;

[0088] Memory used to store the processor's executable instructions;

[0089] The processor is configured to execute the instructions to implement the message sending method described above.

[0090] According to another aspect of the present disclosure, a computer-readable storage medium is provided that, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the above-described message sending method.

[0091] According to another aspect of the present disclosure, a computer program product is provided, the computer program product including a computer program that, when executed by a processor, implements the above-described message sending method.

[0092] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0093] This disclosure provides a message sending method. When multimedia resource playback is paused, in response to a first operation, the method directly captures a screenshot of the currently playing first image frame and displays it on a message input box. Furthermore, in response to a message publishing operation on the message input box, it directly publishes a comment message including the first image frame. In other words, this method, through a single click, not only brings up the message input box but also captures and fills the message input box with a screenshot of the currently playing first image frame. This eliminates the need for the terminal login object to manually capture the first image frame, quickly publishing it, reducing operation steps, and improving human-computer interaction efficiency. Moreover, an editing control for the first image frame is displayed on the message input box. Triggering this editing control allows access to the editing interface of the first image frame for editing. That is, the message input box also provides editing functionality for the first image frame, allowing for quick editing and shortening the interaction path when editing the first image frame, further improving human-computer interaction efficiency when publishing comment messages including images. Attached Figure Description

[0094] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0095] Figure 1 This is a schematic diagram illustrating an implementation environment according to an exemplary embodiment.

[0096] Figure 2 This is a flowchart illustrating a message sending method according to an exemplary embodiment.

[0097] Figure 3 This is a flowchart illustrating another message sending method according to an exemplary embodiment.

[0098] Figure 4 This is a schematic diagram illustrating a playback interface according to an exemplary embodiment.

[0099] Figure 5 This is a schematic diagram illustrating another playback interface according to an exemplary embodiment.

[0100] Figure 6 This is a schematic diagram illustrating a screenshot result according to an exemplary embodiment.

[0101] Figure 7 This is a schematic diagram illustrating an authorized interface according to an exemplary embodiment.

[0102] Figure 8 This is a schematic diagram illustrating a comment message list according to an exemplary embodiment.

[0103] Figure 9 This is a schematic diagram illustrating a message input box according to an exemplary embodiment.

[0104] Figure 10 This is a flowchart illustrating another message sending method according to an exemplary embodiment.

[0105] Figure 11 This is a schematic diagram illustrating a session interface according to an exemplary embodiment.

[0106] Figure 12 This is a schematic diagram illustrating a list of objects according to an exemplary embodiment.

[0107] Figure 13 This is a block diagram illustrating a message sending apparatus according to an exemplary embodiment.

[0108] Figure 14 This is a block diagram illustrating a terminal according to an exemplary embodiment. Detailed Implementation

[0109] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0110] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0111] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the first image frame, object list, etc. involved in this disclosure were obtained with full authorization.

[0112] The message sending method provided in this disclosure can be executed by an electronic device, which can be at least one of a terminal and a server. Figure 1 This is a schematic diagram of an implementation environment provided in this embodiment of the disclosure. See also: Figure 1 The implementation environment includes: terminal 101 and server 102.

[0113] In this embodiment, a target application is installed on terminal 101, which is used to play multimedia resources. Viewers can post comments on the multimedia resources while watching them. Server 102 serves as the backend server for the target application, providing backend services to it.

[0114] In some embodiments, after pausing multimedia resource playback on terminal 101, the currently playing image frame is displayed. In response to the first operation, a screenshot of the image frame can be taken and displayed in a message input box for posting a comment. Thus, when posting a comment based on the message input box, a comment including the image frame is directly posted. Furthermore, an image frame editing control is displayed in the message input box. Triggering the editing control allows access to the image frame editing interface to edit the current image frame.

[0115] Terminal 101 can be at least one of the following devices: smartphone, smartwatch, desktop computer, laptop, virtual reality terminal, augmented reality terminal, wireless terminal, and laptop computer. Terminal 101 has communication capabilities and can access wired or wireless networks. Terminal 101 can refer to one of multiple terminals; those skilled in the art will understand that the number of terminals can be more or less. Server 102 can be an independent physical server, a server cluster composed of multiple physical servers, or a distributed file system. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, server 102 and terminal 101 are directly or indirectly connected via wired or wireless communication; this disclosure does not limit this. Optionally, the number of servers 102 can be more or less; this disclosure does not limit this. Of course, server 102 can also include other functional servers to provide more comprehensive and diversified services. In this embodiment, server 102 undertakes the main computing work and terminal 101 undertakes the secondary computing work; or, server 102 undertakes the secondary computing work and terminal 101 undertakes the main computing work; or, server 102 or terminal 101 can each undertake computing work independently, and this embodiment does not limit this.

[0116] Figure 2 This is a flowchart illustrating a message sending method according to an exemplary embodiment, such as... Figure 2 As shown, this method is executed by a terminal and includes the following steps.

[0117] In step S201, in response to the pause operation of the multimedia resource, the terminal pauses the playback of the multimedia resource and displays the first image frame currently being played on the playback interface.

[0118] In this embodiment of the disclosure, the terminal plays multimedia resources on a playback interface, and the multimedia resources include at least one of images, text, and videos. Pausing the multimedia resources can be done by clicking on the playback interface or by clicking on a pause control on the playback interface. Optionally, the terminal plays multimedia resources within a target application, and the playback interface is an interface within the target application.

[0119] In step S202, in response to the first operation, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0120] In this embodiment of the disclosure, the first operation can be a trigger operation on a certain control on the playback interface, or a gesture operation on the playback interface.

[0121] In this embodiment of the disclosure, the terminal displays a screenshot of the first image frame on the playback interface. Displaying the screenshot of the first image frame means displaying a thumbnail of the first image frame; or, displaying the screenshot of the first image frame means displaying result text, which indicates that a screenshot of the first image frame has been taken.

[0122] It should be noted that when the terminal pauses the playback of multimedia resources, the playback interface displays not only the first image frame but also interactive controls such as liking and forwarding the multimedia resources. Optionally, the screenshot may include all the content currently displayed on the playback interface; or, the terminal may only capture the first image frame from the playback interface, meaning the screenshot only includes the first image frame and does not include other content on the playback interface. This avoids interference from other content with the first image frame and improves the screenshot quality.

[0123] In step S203, the terminal displays a message input box based on the screenshot result, and displays a first image frame and an editing control for the first image frame on the message input box. The message input box is used to post a comment message for the multimedia resource, and the editing control is used to display the editing interface of the first image frame when triggered.

[0124] The message input box allows users to enter text, images, videos, emoticons, and other information to post comments.

[0125] In some embodiments, the terminal displays a single message input box based on the screenshot result. In response to a trigger operation on the message input box, the terminal displays a virtual keyboard to input information in the message input box. In other embodiments, the terminal displays the virtual keyboard directly while displaying the message input box, i.e., it displays a message input panel including both the message input box and the virtual keyboard. Optionally, the terminal displays a pop-up window on the playback interface, and displays the message input box on the pop-up window.

[0126] Optionally, displaying the first image frame on the message input box means displaying a thumbnail of the first image frame on the message input box. The first image frame can be displayed inside the message input box, or in the adjacent area above or below the message input box.

[0127] In step S204, in response to the message posting operation on the message input box, the terminal posts a comment message including the first image frame.

[0128] In this embodiment of the disclosure, the message publishing operation can be a trigger operation on the send control on the message input box, or it can be a gesture operation on the message input box.

[0129] In this embodiment of the disclosure, a comment message including a first image frame may include only the first image frame, or it may include other information besides the first image frame, such as text, emoticons, etc. Since the message input box displays an editing control for the first image frame, the first image frame included in the comment message may optionally be an unedited first image frame or an edited first image frame.

[0130] In this embodiment of the disclosure, when multimedia resources are paused, the terminal login object brings up a message input box, indicating that the terminal login object is likely to want to post a comment message based on the currently playing first image frame. Therefore, in response to the first operation, the first image frame is directly filled into the message input box while it is brought up, without the terminal login object needing to download or take a screenshot of the first image frame. This reduces the number of operation steps, improves interaction efficiency, and enhances user experience, thus encouraging the terminal login object to post a comment message based on the first image frame.

[0131] This disclosure provides a message sending method. When multimedia resource playback is paused, in response to a first operation, the method directly captures a screenshot of the currently playing first image frame and displays it on a message input box. Furthermore, in response to a message publishing operation on the message input box, it directly publishes a comment message including the first image frame. In other words, this method, through a single click, not only brings up the message input box but also captures and fills the message input box with a screenshot of the currently playing first image frame. This eliminates the need for the terminal login object to manually capture the first image frame, quickly publishing it, reducing operation steps, and improving human-computer interaction efficiency. Moreover, an editing control for the first image frame is displayed on the message input box. Triggering this editing control allows access to the editing interface of the first image frame for editing. That is, the message input box also provides editing functionality for the first image frame, allowing for quick editing and shortening the interaction path when editing the first image frame, further improving human-computer interaction efficiency when publishing comment messages including images.

[0132] The above Figure 2 The diagram shown is merely the basic process of this disclosure. The following section, based on a specific implementation method, further elaborates on the solution provided in this disclosure. See also... Figure 3 , Figure 3 This is a flowchart illustrating another message sending method according to an exemplary embodiment, the method being performed by a terminal, and the method includes the following steps.

[0133] In step S301, in response to the pause operation of the multimedia resource, the terminal pauses the playback of the multimedia resource and displays the currently playing first image frame and prompt information on the playback interface. The prompt information is used to prompt the user to long-press the message publishing control on the playback interface.

[0134] In this embodiment of the disclosure, after the terminal pauses playback of multimedia resources, a pause indicator is also displayed on the playback interface to indicate that the multimedia resources are currently paused. For example, see... Figure 4 , Figure 4 This is a schematic diagram illustrating a playback interface according to an exemplary embodiment. In this interface, multimedia resources are paused, and the currently playing first image frame and a pause indicator are displayed.

[0135] In this embodiment of the disclosure, a message publishing control is displayed on the playback interface. This message publishing control is used to publish comment messages regarding multimedia resources. For example, see [link to previous section]. Figure 4 The playback interface displays a message publishing control 401.

[0136] In this embodiment of the disclosure, the display position of the prompt message on the playback interface can be set as needed. For example, the prompt message can be displayed in an area adjacent to the message publishing control to facilitate visual association between the prompt message and the message publishing control. For example, see... Figure 5 , Figure 5 This is a schematic diagram illustrating a playback interface according to an exemplary embodiment. In this interface, multimedia resources are paused, and the currently playing first image frame and a prompt message 501 are displayed.

[0137] In this embodiment of the disclosure, by displaying prompt information, the transparency of information is improved, which is conducive to promoting terminal login and long-pressing the message publishing control based on the prompt information, thereby promoting interaction.

[0138] In step S302, in response to a long press operation on the message publishing control, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0139] In this embodiment of the disclosure, in response to a long press operation on the message publishing control, the terminal automatically takes a screenshot of the first image frame and displays the screenshot result. Further, the terminal also displays the screenshot process, which refers to the process of displaying the first image frame jumping out of the playback interface and being scaled down to a preset position on the playback interface. This preset position on the playback interface can be set and changed as needed, such as the lower left corner of the playback interface.

[0140] For example, see Figure 6 , Figure 6This is a schematic diagram illustrating a screenshot result according to an exemplary embodiment. A thumbnail 601 of the first image frame is displayed in the lower left corner of the playback interface.

[0141] In some embodiments, authorization from the terminal login object is obtained before the first screenshot is taken within the target application, and the screenshot is taken only after authorization from the terminal login object is granted. For example, see Figure 7 , Figure 7 This is a schematic diagram illustrating an authorization interface according to an exemplary embodiment. In response to a trigger operation on the settings control, the terminal displays a permission settings interface, where the logged-in user authorizes permissions.

[0142] In this embodiment, the first operation is described using a long press on the message publishing control as an example. The original function of the message publishing control is to publish comment messages. In response to a click on the message publishing control, the terminal displays a list of comment messages, and a message input box for publishing comment messages is displayed on the list. In this embodiment, in response to a long press on the message publishing control, a screenshot is taken and the message input box is directly displayed, with the first image frame displayed on it. This directly utilizes the original control on the playback interface for publishing comment messages, without the need to develop a new control, saving resources. Furthermore, triggering the display of the message input box through the original message publishing control is associated with the original function of the message publishing control, making it easier for the terminal login user to understand and facilitating interaction based on the message publishing control.

[0143] In other embodiments, the first operation is a click operation on the message publishing control. Since the prompt information is used to prompt the execution of the first operation, correspondingly, the prompt information is used to prompt the click operation on the message publishing control. Therefore, the process of taking a screenshot of the first image frame in response to the first operation, displaying the screenshot result of the first image frame, and displaying a message input box based on the screenshot result, and displaying the first image frame and its editing control on the message input box, includes the following steps: in response to a click operation on the message publishing control, the terminal takes a screenshot of the first image frame, displays the screenshot result of the first image frame, the terminal displays a comment message list based on the screenshot result, and displays the first image frame and its editing control in the message input area of ​​the comment message list.

[0144] The comment message list includes multiple comment messages posted for multimedia resources. The comment message list can be displayed as a pop-up window on the playback interface, and the message input area can be displayed at the bottom of the comment message list. The message input area is used to enter and post comment messages. Optionally, the message input area displays a message input box. The terminal displays a first image frame in an area adjacent to the message input box, such as displaying the first image frame above the message input box. For example, see... Figure 8 , Figure 8 This is a schematic diagram illustrating a comment message list according to an exemplary embodiment. A message input box 801 is displayed at the bottom of the comment message list, and a first image frame 802 is displayed above the message input box.

[0145] In some embodiments, in response to a trigger operation on a message input box in the comment message list, the terminal cancels the display of the comment message list and displays a message input panel, on which a message input box and a virtual keyboard are displayed to facilitate the input of comment messages. Optionally, the message input panel displays a first image frame and editing controls for the first image frame.

[0146] In other embodiments, the first image frame is not displayed on the comment message list. In response to a trigger operation on the message input box on the comment message list, the terminal cancels the display of the comment message list and displays a message input panel, on which the first image frame and its editing controls are displayed.

[0147] In this embodiment, the message publishing control functions to display a list of comment messages and to publish a comment message. In this particular embodiment, when multimedia resources are paused, triggering the message publishing control to display comment messages also displays the first image frame in the message input area of ​​the comment message list. This allows the logged-in terminal to quickly publish the currently playing first image frame when it normally triggers the message publishing control to publish a comment message, without needing to manually take a screenshot, thus improving human-computer interaction efficiency.

[0148] In other embodiments, the first operation is a target gesture operation on the playback interface, and correspondingly, a prompt message is used to prompt the user to perform the target gesture operation. The process of taking a screenshot of the first image frame in response to the first operation and displaying the screenshot result of the first image frame includes the following steps: in response to the target gesture operation on the playback interface, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0149] The target gesture operation can be set and changed as needed. For example, the target gesture operation can be a long press, a double tap, or a continuous gesture operation, such as a long press plus a swipe.

[0150] The target gesture operation can be a fixed gesture operation, or it can be freely set by the logged-in user. Optionally, the terminal displays a gesture settings interface with multiple gesture options. In response to the selection of any gesture option, the gesture operation corresponding to the selected gesture option is determined as the target gesture operation. Alternatively, the terminal displays a gesture settings interface, and in response to the logged-in user's gesture operation on the gesture settings interface, that gesture operation is determined as the target gesture operation. For example, if the logged-in user performs a long press operation on the gesture settings interface, the long press operation is determined as the target gesture operation.

[0151] In this embodiment, performing a target gesture operation on the playback interface can trigger the capture of the currently playing first image frame and display it in the message input box, without requiring the terminal login object to manually take a screenshot. That is, the target gesture operation can trigger the screenshot and bring up the message input box with one click, reducing operation steps and improving human-computer interaction efficiency.

[0152] In step S303, the terminal displays a message input box based on the screenshot result, and displays a first image frame and an editing control for the first image frame on the message input box. The editing control is used to display the editing interface of the first image frame when triggered.

[0153] In this embodiment of the disclosure, the message input box is displayed based on the screenshot result; that is, after the terminal displays the screenshot result on the playback interface, the message input box is displayed directly. The display position of the first image frame on the message input box can be set as needed. For example, the first image frame is displayed above the message input box.

[0154] In some embodiments, a message input box is displayed on a message input panel, which includes a virtual keyboard for entering comment messages. See, for example. Figure 9 , Figure 9 This is a schematic diagram of a message input panel according to an exemplary embodiment. The message input panel displays a message input box and a virtual keyboard, with a first image frame 901 displayed above the message input box.

[0155] In some embodiments, the terminal also displays a close control for the first image frame on the message input box; in response to a triggering operation on the close control, the terminal cancels the display of the first image frame on the message input box. For example, see [link to previous document]. Figure 9 The message input box also displays a close control 902, which is shown in the upper right corner of the first image frame.

[0156] In this embodiment, by de-displaying the first image frame in the message input box, subsequent comment messages will no longer include the first image frame. By displaying a close control for the first image frame in the message input box, the user can easily cancel the first image frame if they do not wish to publish it or are dissatisfied with it, thus improving the convenience and efficiency of the interaction.

[0157] In step S304, in response to the triggering operation of the editing control, the terminal displays the editing interface of the first image frame, and in response to the editing operation of the first image frame, the edited first image frame is obtained.

[0158] In this embodiment of the disclosure, the display position of the editing control on the message input box can be set as needed. For example, continue participating Figure 9 The message input box displays an editing control 903, which is displayed in the upper left corner of the first image frame.

[0159] The editing interface allows users to edit the size, brightness, and color of the first image frame, and also adds elements such as text and stickers to it (details omitted here). Optionally, the editing interface displays multiple controls, each used for different types of editing of the first image frame. Editing operations on the first image frame include triggering one or more controls to edit the first image frame.

[0160] In this embodiment, by providing an editing control for the first image frame on the message input box, the terminal login object can also edit the first image frame, which improves the convenience of interaction. There is no need to return to the image library to edit the first image frame, which shortens the interaction path and thus improves the interaction efficiency.

[0161] In some embodiments, the first image frame on the message input box can also be replaced. Specifically, the terminal displays a replacement control for the first image frame on the message input box; in response to a trigger operation on the replacement control, multiple third image frames are displayed, the multiple third image frames being image frames extracted from multimedia resources at preset time intervals; in response to a selection operation on any one of the multiple third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0162] In this embodiment of the disclosure, one of a plurality of third image frames can be selected to replace the first image frame, or at least two of a plurality of third image frames can be selected to replace the first image frame. After replacing the first image frame with a third image frame, the first image frame is de-displayed in the message input box, and subsequent published comment messages will include the third image frame.

[0163] In some embodiments, the process of obtaining multiple third image frames includes at least one of the following implementations.

[0164] (1) The terminal extracts image frames from multimedia resources according to a preset time interval to obtain multiple third image frames.

[0165] In this implementation, image frames are extracted from multimedia resources at preset time intervals. These multiple third image frames cover most of the plot content of the multimedia resources, increasing the selectivity of the terminal login object and thus encouraging the terminal login object to select the third image frames for replacement.

[0166] (2) The terminal extracts image frames from multimedia resources that meet the preset conditions for the number of interactions, and obtains multiple third image frames. The number of interactions for each image frame includes at least one of the number of likes, comments and forwards at the playback time of the image frame.

[0167] In this implementation, the preset condition can be reaching a number of interaction thresholds. These thresholds can be the total number of interactions across multiple interaction methods, or they can include the individual number of interaction thresholds for each interaction method. Furthermore, the preset condition refers to the number of interactions of at least one interaction method meeting its number of interaction threshold, or the number of interactions of each interaction method meeting its number of interaction threshold.

[0168] In this implementation, the number of interactions with an image frame meets a preset condition, that is, based on the frequent interaction with the image frame, most viewers have interacted with the image frame, and the image frame is an image frame that the public is accustomed to interacting with. Therefore, the image frame whose number of interactions meets the preset condition is recommended to the terminal login object, which improves the accuracy and quality of the recommendation and helps to encourage the terminal login object to select the third image frame, that is, it helps to promote interaction.

[0169] (3) The terminal divides the multimedia resources into multiple segments and determines the image frame with the highest number of times it is published in each segment as the third image frame.

[0170] Multimedia resources can be divided according to preset time intervals to obtain multiple segments.

[0171] In this implementation, the image frame with the highest number of publications within each segment is obtained, ensuring that the image frames recommended to the terminal login object cover the entire multimedia resource as much as possible. Furthermore, the recommended image frames are those with high publication frequency, which are commonly published by the public. This improves the accuracy and quality of the recommendations, encouraging the terminal login object to select the image frame, thus promoting interaction.

[0172] In some embodiments, the terminal further displays multiple third image frames in a certain order, the process including at least one of the following implementations: the terminal displays multiple third image frames in the playback order of the multiple third image frames in the multimedia resource; or, the terminal displays multiple third image frames in the order of the number of interactions of the multiple third image frames; or, the terminal displays multiple third image frames in the order of the number of times the multiple third image frames are published.

[0173] In this embodiment, the terminal displays multiple third image frames in the playback order, allowing the terminal login object to obtain their playback order based on the displayed image frames, which is beneficial for the terminal login object's understanding and improves information transparency. Displaying multiple third image frames in the order of interaction or publication frequency—that is, displaying image frames with more interactions or publications first—increases the probability of the terminal login object selecting such image frames, minimizing the process of the terminal login object traversing multiple third image frames, improving interaction efficiency, and promoting interaction by the terminal login object.

[0174] In this embodiment, a replacement control for the first image frame is provided on the message input box. This replacement control can provide multiple image frames from the multimedia resource for replacement. In this way, if one is not satisfied with the current first image frame, other image frames from the multimedia resource can be directly selected through the replacement control, without having to return to the playback interface to replay the multimedia resource to obtain other image frames. Obviously, this shortens the interaction path and improves the interaction efficiency.

[0175] In this embodiment of the disclosure, in response to a long press operation on the message publishing control, the screenshot process of the first image frame is first displayed, and then the message input box is displayed based on the screenshot result. This automatic screenshotting before displaying the message input box eliminates the need for manual screenshotting by the logged-in user, significantly improving interaction efficiency. Furthermore, displaying the screenshot process of the first image frame enhances the interface display effect and facilitates the logged-in user's understanding of the interaction process, thereby increasing information transparency.

[0176] In step S305, the terminal obtains the information entered in the message input box.

[0177] In this embodiment of the disclosure, the information includes at least one of text, images, videos, emoticons, etc. A message input box is displayed on a message input panel, which displays a virtual keyboard for inputting text, and also displays shortcut input controls for resource types such as images, videos, and emoticons.

[0178] In step S305, in response to the terminal login object's message input operation in the message input box, the terminal obtains the information entered in the message input box. The example given is the terminal login object manually entering information; in other embodiments, the terminal automatically enters information in the message input box. In response to the first operation, the terminal obtains information associated with the first image frame and displays the information in the message input box.

[0179] The information associated with the first image frame includes text, images, emoticons, etc., that have the same semantic meaning as the first image frame. For example, if the first image frame is a rainy scene, the information associated with the first image frame could be text including "rain." Optionally, the terminal performs artificial intelligence recognition on the first image frame to obtain the information associated with it. Alternatively, the terminal sends the first image frame to a server, which then obtains the information associated with it.

[0180] Accordingly, in response to a message posting operation on the message input box, the terminal posts a message including information associated with the first image frame and a comment message for the first image frame.

[0181] In this embodiment, the terminal automatically obtains the information associated with the first image frame and automatically fills it into the message input box. This eliminates the need for the terminal login user to manually input information, further improving the human-computer interaction efficiency when publishing comment messages that include images. Furthermore, since the information obtained is associated with the first image frame, the accuracy of the information is also guaranteed.

[0182] Furthermore, the logged-in user can also edit the information associated with the first image frame within the message input box. For example, they can delete the information or modify the text within it.

[0183] In step S306, in response to the message posting operation on the message input box, the terminal posts a comment message including information and the edited first image frame.

[0184] In some embodiments, a send control is displayed on the message input box, and the message posting operation on the message input box is also the click operation on the send control. After the terminal posts a comment message, the comment message is displayed on the comment message list of the multimedia resource. Optionally, the terminal sends the comment message to the server, and the server posts the comment message.

[0185] In this embodiment of the disclosure, step S304 is an optional step. When step S304 is executed, the published comment message includes the edited first image frame. When step S304 is not executed, the published comment message includes the unedited first image frame.

[0186] In this embodiment, steps S305-S306 described above implement the process of publishing a comment message including a first image frame in response to a message publishing operation on the message input box. In this embodiment, the first image frame is displayed on the message input box. After information is entered into the message input box, the first image frame and the information in the message input box are published together as a comment message in response to the message publishing operation. This eliminates the need to take a screenshot of the first image frame beforehand and to select it from the message input box, further reducing operation steps and improving interaction efficiency. Furthermore, triggering the editing control allows access to the editing interface of the first image frame for editing. In other words, the message input box also provides an editing function for the first image frame, allowing for quick editing and shortening the interaction path when editing the first image frame, further improving human-computer interaction efficiency.

[0187] In some embodiments, the process of a terminal publishing a comment message including a first image frame in response to a message publishing operation on a message input box further includes the following implementation: in response to a message publishing operation on a message input box, the terminal obtains content summary information corresponding to the first image frame; and publishes a comment message including the first image frame and the content summary information.

[0188] The content summary information refers to a summary of the meaning conveyed by the first image frame. This content summary information can be obtained based on the interpretation of the first image frame, or it can be a hot topic related to the first image frame in the network. Optionally, the terminal extracts multiple elements from the first image frame, summarizes the meaning of the multiple elements, and obtains the content summary information. Alternatively, the terminal extracts multiple elements from the first image frame, matches the multiple elements with current hot topics in the network, and obtains hot topics related to at least one element.

[0189] The summary information can include not only text, but also images, such as trending images on the network that are related to the meaning of the first image frame, so as to express the viewpoint more intuitively through images.

[0190] Optionally, the terminal obtains content summary information through an information recognition model, which is a neural network model that obtains content summary information through image frames.

[0191] In some embodiments, multiple image frames from the multimedia resource can also be quickly sent, that is, after step S303, the following steps are performed: in response to the second operation on the message input box, the terminal closes the message input box and continues playing the multimedia resource; in response to the pause operation on the multimedia resource again, the terminal pauses the playback of the multimedia resource and displays the currently playing second image frame on the playback interface; in response to the first operation, the terminal displays the message input box again, and displays the first image frame, the second image frame and their respective editing controls on the message input box; in response to the message publishing operation on the message input box, the terminal publishes a comment message including the first image frame and the second image frame.

[0192] In some embodiments, a save control is displayed on the message input box, and the second operation refers to triggering the save control. Alternatively, the second operation refers to a first gesture operation on the message input box. The first gesture operation may be an up or down swipe operation. In response to the second operation, the terminal not only closes the message input box and continues playing multimedia resources, but also saves the first image frame so that it can be displayed on the message input box in response to the first operation the next time.

[0193] It should be noted that, in response to the first operation, the process of the terminal displaying the second image frame on the message input box is the same as the process of displaying the first image frame. That is, the process of the terminal displaying the screenshot of the second image frame and displaying the close control, edit control and replace control of the second image frame on the message input box, etc. The detailed process will not be described here.

[0194] In this embodiment of the disclosure, the example of quickly sending two image frames is used for illustration. The terminal can also quickly send more than two image frames. That is, after displaying the first image frame and the second image frame on the message input box, in response to the second operation, the message input box is closed and the multimedia resource continues to play. In response to the next pause operation and the first operation, the first image frame, the second image frame and the third image frame are displayed on the message input box to publish a comment message including these three image frames.

[0195] In this embodiment, in response to the second operation, the message input box can be collapsed and multimedia resources can be played directly without further interaction to end the pause, which obviously improves interaction efficiency. Furthermore, when the message input box is displayed again, it shows not only the currently paused image frame but also the previously paused image frame. This allows for the simultaneous display of multiple image frames without requiring screenshotting or selection operations on these frames. This provides a new interaction method, improves human-computer interaction efficiency, and facilitates interaction.

[0196] In some embodiments, a save control is also displayed on the playback interface. In response to the triggering operation of the save control, the terminal saves the currently played image frame. In response to the first operation, all previously saved image frames of the multimedia resource are displayed on the message input box, thereby enabling the quick publication of comment messages including multiple image frames.

[0197] In this embodiment, the example of quickly publishing a comment message including a first image frame when publishing a comment message on a comment message list is described. In other embodiments, the comment message can be a bullet screen message, that is, when publishing a bullet screen message, a bullet screen message including a first image frame can also be quickly published. Optionally, in response to a long press operation on the bullet screen control on the playback interface, the terminal displays a bullet screen input box, and displays the first image frame and its editing control on the bullet screen input box. The bullet screen control is used to publish bullet screen messages. In response to the bullet screen publishing operation on the bullet screen input box, a bullet screen message including the first image frame is published. The specific process of this embodiment is the same as the process of publishing a comment message including a first image frame, and will not be described again here.

[0198] See Figure 10 , Figure 10 This is a flowchart of a message sending method according to an exemplary embodiment. When multimedia resource playback is paused, a prompt message for long-pressing a message posting control is displayed on the playback interface. In response to the long-press operation on the message posting control, the terminal directly takes a screenshot of a first image frame, displays the screenshot result, and then displays the screenshot of the first image frame on the message input box to post a comment message including the first image frame.

[0199] In this embodiment, the example of quickly publishing an image frame when posting a comment message is illustrated. In other embodiments, an image frame can also be quickly published when sending a session message, including at least one of the following implementations.

[0200] In the first scenario, in response to a third operation on the playback interface, the terminal displays a session interface between the logged-in user and the publisher of the multimedia resource, and displays a first image frame on the session interface; in response to a sending operation of the first image frame, the terminal sends the first image frame to the publisher. Furthermore, editing controls for the first image frame can also be displayed on the session interface.

[0201] The third operation can be either a trigger operation on a control on the playback interface or a gesture operation on the playback interface; no specific limitation is made here. The operation of sending the first image frame can be a click operation on the first image frame or a trigger operation on a send control on the session interface. For example, see... Figure 11 , Figure 11This is a schematic diagram of a conversational interface according to an exemplary embodiment. A first image frame 1101 is displayed in the message input area of ​​the conversational interface, that is, above the message input box.

[0202] In this embodiment of the disclosure, when multimedia resources are paused, the terminal login object brings up the session interface with the publisher, indicating that the terminal login object is likely to want to send a session message to the publisher based on the currently playing first image frame. Therefore, in response to the third operation, the first image frame is directly displayed on the session interface while it is brought up, without the terminal login object needing to download or take a screenshot of the first image frame. This reduces the number of operation steps, improves the interaction efficiency, and enhances the user experience, which is conducive to encouraging the terminal login object to send a session message based on the first image frame.

[0203] In this embodiment of the disclosure, when multimedia resources are paused, in response to the third operation, the currently playing first image frame is directly displayed on the conversation interface with the publisher. In response to the sending operation of the first image frame, the first image frame can be sent to the publisher. That is, with one-click operation, not only is the conversation interface brought up, but the currently playing first image frame is also directly displayed on the conversation interface. Thus, the first image frame can be sent quickly without the terminal login object having to download or take a screenshot of the first image frame in advance. This reduces the operation steps and improves the efficiency of human-computer interaction.

[0204] The second method involves the terminal displaying a list of objects in response to a fourth operation on the playback interface; in response to a selection operation on any object in the list, the terminal sends a first image frame to the selected object.

[0205] The fourth operation can be a trigger operation on a control on the playback interface, or a gesture operation on the playback interface; no specific limitation is made here. Optionally, after any object receives the first image frame, it is displayed on the session interface between that object and the terminal login object.

[0206] In some embodiments, the terminal displays an object list on the playback interface. This object list includes multiple objects, which are friends of the logged-in object on the terminal, such as objects that mutually follow the logged-in object. For example, see... Figure 12 , Figure 12 This is a schematic diagram illustrating an object list according to an exemplary embodiment. The playback interface displays an object list 1201.

[0207] In this embodiment of the disclosure, when multimedia resources are paused, the terminal login object retrieves the object list, indicating that the terminal login object is likely to want to send a session message to other objects based on the currently playing first image frame. Therefore, in response to the fourth operation, when the object list is retrieved, in response to the selection operation of any object, the first image frame is directly sent to that object. The terminal login object does not need to download or take a screenshot of the first image frame, which reduces the operation steps, improves the interaction efficiency, and enhances the user experience, thus facilitating the terminal login object to send session messages based on the first image frame.

[0208] In this embodiment of the disclosure, when multimedia resources are paused, in response to the fourth operation, an object list can be displayed, and in response to the selection operation of any object, the first image frame can be directly sent to the selected object. This eliminates the need to bring up the session interface with any object, allowing the first image frame to be sent quickly. Furthermore, the terminal does not need to download or take a screenshot of the first image frame in advance, thus reducing operation steps and improving human-computer interaction efficiency.

[0209] This disclosure provides a message sending method. When multimedia resource playback is paused, in response to a first operation, the method directly captures a screenshot of the currently playing first image frame and displays it on a message input box. Furthermore, in response to a message publishing operation on the message input box, it directly publishes a comment message including the first image frame. In other words, this method, through a single click, not only brings up the message input box but also captures and fills the message input box with a screenshot of the currently playing first image frame. This eliminates the need for the terminal login object to manually capture the first image frame, quickly publishing it, reducing operation steps, and improving human-computer interaction efficiency. Moreover, an editing control for the first image frame is displayed on the message input box. Triggering this editing control allows access to the editing interface of the first image frame for editing. That is, the message input box also provides editing functionality for the first image frame, allowing for quick editing and shortening the interaction path when editing the first image frame, further improving human-computer interaction efficiency when publishing comment messages including images.

[0210] Figure 13 This is a block diagram illustrating a message sending apparatus according to an exemplary embodiment. (Refer to...) Figure 13 The device includes:

[0211] The pause unit 1301 is configured to perform a pause operation on the multimedia resource, pause the playback of the multimedia resource, and display the first image frame currently being played on the playback interface.

[0212] The display unit 1302 is configured to perform a screenshot of the first image frame in response to the first operation and display the screenshot result of the first image frame;

[0213] The display unit 1302 is also configured to execute a message input box based on the screenshot result, display a first image frame and an editing control of the first image frame on the message input box, the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display the editing interface of the first image frame after being triggered;

[0214] The publishing unit 1303 is configured to perform a message publishing operation in response to a message input box, publishing a comment message including a first image frame.

[0215] In some embodiments, the apparatus further includes:

[0216] The collapse unit is configured to perform a second operation in response to the message input box, collapse the message input box and continue playing the multimedia resource;

[0217] The pause unit is configured to perform a pause operation in response to the multimedia resource, pause the playback of the multimedia resource, and display the currently playing second image frame on the playback interface.

[0218] Display unit 1302 is configured to perform a response to the first operation, display the message input box again, and display the first image frame, the second image frame and their respective editing controls on the message input box;

[0219] The publishing unit 1303 is configured to perform a message publishing operation in response to a message input box, publishing a comment message including a first image frame and a second image frame.

[0220] In some embodiments, the display unit 1302 is further configured to perform:

[0221] Display the close control for the first image frame on the message input box;

[0222] In response to a trigger action on the close control, the first image frame is de-displayed on the message input box.

[0223] In some embodiments, the display unit 1302 is further configured to perform:

[0224] Display a replacement control for the first image frame on the message input box;

[0225] In response to a trigger operation on the replacement control, multiple third image frames are displayed, which are image frames extracted from multimedia resources;

[0226] In response to a selection operation of any third image frame among a plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0227] In some embodiments, the display unit 1302 is further configured to perform:

[0228] In response to pausing a multimedia resource, a prompt message is displayed to prompt the user to perform the first action.

[0229] In some embodiments, the publishing unit 1303 is configured to execute:

[0230] In response to a message posting operation on the message input box, obtain the content summary information corresponding to the first image frame;

[0231] Publish a comment message that includes the first image frame and a summary of the content.

[0232] In some embodiments, the publishing unit 1303 is configured to execute:

[0233] Retrieve the information entered in the message input box;

[0234] In response to a message posting action on the message input box, a comment message including information and a first image frame is posted.

[0235] In some embodiments, the display unit 1302 is further configured to perform:

[0236] In response to the first operation, information associated with the first image frame is obtained and displayed on the message input box;

[0237] Release unit 1303 is configured to execute:

[0238] In response to a message posting action on the message input box, a comment message including information and a first image frame is posted.

[0239] In some embodiments, a message posting control is displayed on the playback interface, and the display unit 1302 is configured to perform at least one of the following:

[0240] In response to a long press on the message posting control, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed;

[0241] In response to a target gesture operation on the playback interface, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed.

[0242] In some embodiments, the display unit 1302 is further configured to perform a third operation in response to the playback interface, displaying a session interface between the terminal login object and the publisher of the multimedia resource, and displaying a first image frame on the session interface.

[0243] The apparatus also includes a first transmitting unit configured to transmit the first image frame to the publisher in response to a transmitting operation of the first image frame.

[0244] In some embodiments, the display unit 1302 is further configured to perform a fourth operation in response to the playback interface, displaying a list of objects;

[0245] The device also includes a second transmitting unit configured to perform a first image frame to the selected object in response to a selection operation on any object in the object list.

[0246] This disclosure provides a message sending device. When multimedia resource playback is paused, in response to a first operation, the device directly captures a screenshot of the currently playing first image frame and displays it on a message input box. Furthermore, in response to a message posting operation on the message input box, it directly posts a comment message including the first image frame. In other words, the device, through a single click, not only brings up the message input box but also captures and fills the message input box with a screenshot of the currently playing first image frame. This eliminates the need for the terminal user to manually capture the first image frame, allowing for quick posting and reducing operation steps, thus improving human-computer interaction efficiency. Moreover, an editing control for the first image frame is displayed on the message input box. Triggering this control allows access to the editing interface of the first image frame for editing. In other words, the message input box also provides editing functionality for the first image frame, enabling quick editing and shortening the interaction path when editing the first image frame, further improving human-computer interaction efficiency when posting comment messages including images.

[0247] Regarding the apparatus in the above embodiments, the specific manner in which each unit performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0248] In some embodiments, the electronic device is provided as a terminal. Figure 14 A structural block diagram of a terminal 1400 provided in an exemplary embodiment of this disclosure is shown. The terminal 1400 may be a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 1400 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or other names.

[0249] Typically, terminal 1400 includes a processor 1401 and a memory 1402.

[0250] Processor 1401 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1401 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1401 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1401 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0251] The memory 1402 may include one or more computer-readable storage media, which may be non-transitory. The memory 1402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1402 are used to store at least one program code, which is executed by the processor 1401 to implement the message sending method provided in the method embodiments of this disclosure.

[0252] In some embodiments, the terminal 1400 may also optionally include a peripheral device interface 1403 and at least one peripheral device. The processor 1401, memory 1402, and peripheral device interface 1403 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1403 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1404, a display screen 1405, a camera assembly 1406, an audio circuit 1407, and a power supply 1408.

[0253] Peripheral interface 1403 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1401 and memory 1402. In some embodiments, processor 1401, memory 1402 and peripheral interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1401, memory 1402 and peripheral interface 1403 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0254] The radio frequency (RF) circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1404 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1404 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1404 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1404 may also include circuitry related to NFC (Near Field Communication), which is not limited in this disclosure.

[0255] Display screen 1405 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1405 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1401 for processing. In this case, display screen 1405 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1405, which serves as the front panel of terminal 1400; in other embodiments, there may be at least two display screens 1405, respectively disposed on different surfaces of terminal 1400 or in a folded design; in still other embodiments, display screen 1405 may be a flexible display screen, disposed on a curved or folded surface of terminal 1400. Furthermore, display screen 1405 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0256] The camera assembly 1406 is used to acquire images or videos. Optionally, the camera assembly 1406 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1406 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0257] The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1401 for processing, or input to the radio frequency circuit 1404 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1400. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0258] Power supply 1408 is used to power the various components in terminal 1400. Power supply 1408 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1408 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0259] Those skilled in the art will understand that Figure 14 The structure shown does not constitute a limitation on terminal 1400 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0260] In an exemplary embodiment, a computer-readable storage medium is also provided, which, when executed by a processor of an electronic device, enables the electronic device to perform the aforementioned message sending method. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device, etc.

[0261] In an exemplary embodiment, a computer program product is also provided, the computer program product including a computer program that, when executed by a processor, implements the above-described message sending method.

[0262] In some embodiments, the computer program product involved in this disclosure may be deployed on an electronic device for execution, or on multiple electronic devices located in one location, or on multiple electronic devices distributed in multiple locations and interconnected through a communication network. The multiple electronic devices distributed in multiple locations and interconnected through a communication network may constitute a blockchain system.

[0263] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims. All the above-described optional technical solutions can be combined in any way to form optional embodiments of this application, and will not be elaborated upon here.

[0264] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A message sending method, characterized in that, The method includes: In response to a pause operation on the multimedia resource, playback of the multimedia resource is paused, and the first image frame currently being played is displayed on the playback interface. In response to a long press operation on the message publishing control on the playback interface, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed. The message publishing control is used to publish a comment message for the multimedia resource. The screenshot result includes the first image frame but does not include other content on the playback interface. A message input box is displayed based on the screenshot result. The first image frame, the editing control of the first image frame, and the replacement control are displayed on the message input box. The message input box is used to post a comment message for the multimedia resource. The editing control is used to display the editing interface of the first image frame when triggered. In response to a message posting operation on the message input box, obtain content summary information corresponding to the first image frame; post a comment message including the first image frame and the content summary information, wherein the content summary information is obtained based on the interpretation of the first image frame or the content summary information is a hot topic related to the first image frame on the network. Alternatively, in response to a trigger operation on the replacement control, the plurality of third image frames are displayed in the playback order of the multimedia resource, the plurality of third image frames being extracted from the multimedia resource; in response to a selection operation on any of the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame; in response to a message publishing operation on the message input box, a comment message including the third image frame is published.

2. The message sending method according to claim 1, characterized in that, The method further includes: In response to a second operation on the message input box, the message input box is closed and the multimedia resource continues to play; In response to another pause operation on the multimedia resource, playback of the multimedia resource is paused, and the currently playing second image frame is displayed on the playback interface; In response to a long press operation on the message posting control, the message input box is displayed again, and the first image frame, the second image frame, and their respective editing controls are displayed on the message input box; In response to a message posting operation on the message input box, a comment message including the first image frame and the second image frame is posted.

3. The message sending method according to claim 1, characterized in that, The method further includes: Display a close control for the first image frame on the message input box; In response to the triggering operation of the close control, the first image frame is de-displayed on the message input box.

4. The message sending method according to claim 1, characterized in that, The method further includes at least one of the following: Image frames are extracted from the multimedia resources at preset time intervals to obtain the plurality of third image frames; From the multimedia resources, image frames whose interaction count meets the preset conditions are extracted to obtain the plurality of third image frames. The interaction count of each image frame includes at least one of the number of likes, comments, and shares at the playback time of the image frame. The multimedia resource is divided into multiple segments, and the image frame with the highest number of publications in each segment is determined as the third image frame.

5. The message sending method according to claim 1, characterized in that, The method further includes: The plurality of third image frames are displayed in the order of their interaction counts; Alternatively, the plurality of third image frames may be displayed in the order of their publication frequency.

6. The message sending method according to claim 1, characterized in that, The method further includes: In response to a pause operation on the multimedia resource, a prompt message is displayed, which prompts the user to perform a long press operation on the message publishing control.

7. The message sending method according to claim 1, characterized in that, The method further includes: In response to a long press operation on the message publishing control, information associated with the first image frame is obtained and the information is displayed on the message input box; The response to the message posting operation on the message input box, posting a comment message including the first image frame, includes: In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

8. The message sending method according to claim 1, characterized in that, The method further includes: In response to a target gesture operation on the playback interface, a screenshot of the first image frame is taken and the screenshot result of the first image frame is displayed.

9. The message sending method according to claim 1, characterized in that, The method further includes: In response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource is displayed, and the first image frame is displayed on the session interface. In response to the sending operation of the first image frame, the first image frame is sent to the publisher.

10. The message sending method according to claim 1, characterized in that, The method further includes: In response to a fourth operation on the playback interface, a list of objects is displayed; In response to a selection operation on any object in the object list, the first image frame is sent to the selected object.

11. A message sending device, characterized in that, The device includes: The pause unit is configured to perform a pause operation in response to a multimedia resource, pause playback of the multimedia resource, and display the currently playing first image frame on the playback interface. The display unit is configured to perform a screenshot of the first image frame in response to a long press operation on the message publishing control on the playback interface, and display the screenshot result of the first image frame. The message publishing control is used to publish a comment message for the multimedia resource. The screenshot result includes the first image frame but does not include other content on the playback interface. The display unit is further configured to execute a message input box based on the screenshot result, display the first image frame, an editing control for the first image frame, and a replacement control on the message input box. The message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display the editing interface of the first image frame when triggered. The publishing unit is configured to, in response to a message publishing operation on the message input box, obtain content summary information corresponding to the first image frame; and publish a comment message including the first image frame and the content summary information, wherein the content summary information is obtained based on the interpretation of the first image frame or the content summary information is a hot topic related to the first image frame on the network. Alternatively, in response to a trigger operation on the replacement control, the plurality of third image frames are displayed in the playback order of the multimedia resource, the plurality of third image frames being extracted from the multimedia resource; in response to a selection operation on any of the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame; in response to a message publishing operation on the message input box, a comment message including the third image frame is published.

12. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the message sending method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the message sending method according to any one of claims 1 to 10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the message sending method according to any one of claims 1 to 10.

Images