Message sending method and device, equipment and storage medium

Abstract

The invention relates to a message sending method and device, equipment and a storage medium, and relates to the technical field of multimedia. According to the method, through one-key operation, the message input box is called out, and the currently played first image frame is subjected to screenshot and then is filled into the message input box, so that the first image frame can be quickly published without performing manual screenshot operation on the first image frame by a terminal login object, the operation steps are reduced, and the user experience is improved. And the man-machine interaction efficiency is improved. Moreover, an editing control of the first image frame is displayed on the message input box, and the editing control is triggered to enter an editing interface of the first image frame to edit the first image frame, that is, an editing function for the first image frame is also provided on the message input box, so that the first image frame can be edited quickly, and the user experience is improved. The interaction path when the first image frame is edited is shortened, and the man-machine interaction efficiency when the comment message including the image is published is further improved.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to a message sending method, device, equipment and storage medium. Background Art

[0002] In the conversation scenario, if the user downloads an image before entering the conversation interface, the user will be prompted with the image after entering the conversation interface. After the user triggers the image, the image can be sent without querying it from the image library. However, the image must be downloaded locally before it can be sent, resulting in low interaction efficiency. Summary of the invention

[0003] The present disclosure provides a message sending method, device, equipment and storage medium, which reduces the operation steps and improves the human-computer interaction efficiency. The technical solution of the present disclosure is as follows.

[0004] According to one aspect of an embodiment of the present disclosure, a message sending method is provided, the method comprising: In response to a pause operation on the multimedia resource, pausing the playing of the multimedia resource, and displaying the first image frame currently played on the playing interface; In response to a first operation, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; Displaying a message input box based on the screenshot result, displaying the first image frame and an editing control of the first image frame on the message input box, wherein the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display an editing interface of the first image frame after being triggered; In response to a message publishing operation on the message input box, a comment message including the first image frame is published.

[0005] In some embodiments, the method further comprises: In response to a second operation on the message input box, closing the message input box and continuing to play the multimedia resource; In response to a second pause operation on the multimedia resource, pausing the playing of the multimedia resource, and displaying a second image frame currently being played on the playing interface; In response to the first operation, displaying the message input box again, and displaying the first image frame, the second image frame and respective editing controls on the message input box; In response to a message publishing operation on the message input box, a comment message including the first image frame and the second image frame is published.

[0006] In some embodiments, the method further comprises: Displaying a close control of the first image frame on the message input box; In response to a triggering operation on the closing control, the first image frame is cancelled from being displayed on the message input box.

[0007] In some embodiments, the method further comprises: Displaying a replacement control of the first image frame on the message input box; In response to a triggering operation on the replacement control, a plurality of third image frames are displayed, wherein the plurality of third image frames are image frames extracted from the multimedia resource; In response to a selection operation on any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0008] In some embodiments, the method further comprises at least one of the following: Extracting image frames from the multimedia resource at a preset time interval to obtain the plurality of third image frames; Extracting image frames whose interaction times meet a preset condition from the multimedia resources to obtain the plurality of third image frames, wherein the interaction times of each image frame includes at least one of the number of likes, the number of comments, and the number of reposts at a playback time point of the image frame; The multimedia resource is divided into a plurality of segments, and the image frame with the highest number of publications in each segment is determined as the third image frame.

[0009] In some embodiments, displaying a plurality of third image frames comprises: Displaying the plurality of third image frames according to the playback order of the plurality of third image frames in the multimedia resource; Alternatively, the plurality of third image frames are displayed in the order of the number of interactions of the plurality of third image frames; Alternatively, the plurality of third image frames are displayed in the order of their number of times of issuance.

[0010] In some embodiments, the method further comprises: In response to the pause operation on the multimedia resource, prompt information is displayed, where the prompt information is used to prompt the execution of the first operation.

[0011] In some embodiments, in response to the message publishing operation on the message input box, publishing a comment message including the first image frame includes: In response to a message publishing operation on the message input box, obtaining content summary information corresponding to the first image frame; A comment message including the first image frame and the content summary information is published.

[0012] In some embodiments, in response to the message publishing operation on the message input box, publishing a comment message including the first image frame includes: Obtaining information entered in the message input box; In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

[0013] In some embodiments, the method further comprises: In response to the first operation, acquiring information associated with the first image frame, and displaying the information on the message input box; The step of publishing a comment message including the first image frame in response to a message publishing operation on the message input box comprises: In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

[0014] In some embodiments, a message publishing control is displayed on the playback interface, and in response to the first operation, taking a screenshot of the first image frame and displaying the screenshot result of the first image frame include at least one of the following: In response to a long press operation on the message publishing control, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; In response to the target gesture operation on the playback interface, a screenshot of the first image frame is taken, and a screenshot result of the first image frame is displayed.

[0015] In some embodiments, the method further comprises: In response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource is displayed, and the first image frame is displayed on the session interface; In response to a sending operation on the first image frame, the first image frame is sent to the publisher.

[0016] In some embodiments, the method further comprises: In response to a fourth operation on the playback interface, displaying an object list; In response to a selection operation on any object in the object list, the first image frame is sent to the selected object.

[0017] According to another aspect of an embodiment of the present disclosure, a message sending device is provided, the device comprising: a pause unit, configured to execute, in response to a pause operation on the multimedia resource, pause playing the multimedia resource, and display the first image frame currently played on the play interface; A display unit is configured to execute, in response to a first operation, a screenshot of the first image frame and display a screenshot result of the first image frame; The display unit is further configured to display a message input box based on the screenshot result, display the first image frame and an editing control of the first image frame on the message input box, the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display an editing interface of the first image frame after being triggered; The publishing unit is configured to execute, in response to a message publishing operation on the message input box, publishing a comment message including the first image frame.

[0018] In some embodiments, the apparatus further comprises: a retracting unit, configured to execute, in response to a second operation on the message input box, retract the message input box and continue playing the multimedia resource; The pause unit is configured to execute, in response to a re-pause operation on the multimedia resource, pause the playing of the multimedia resource, and display the second image frame currently played on the playing interface; The display unit is configured to display the message input box again in response to the first operation, and display the first image frame, the second image frame and respective editing controls on the message input box; The publishing unit is configured to execute a message publishing operation in response to the message input box, and publish a comment message including the first image frame and the second image frame.

[0019] In some embodiments, the display unit is further configured to perform: Displaying a close control of the first image frame on the message input box; In response to a triggering operation on the closing control, the first image frame is cancelled from being displayed on the message input box.

[0020] In some embodiments, the display unit is further configured to perform: Displaying a replacement control of the first image frame on the message input box; In response to a triggering operation on the replacement control, a plurality of third image frames are displayed, wherein the plurality of third image frames are image frames extracted from the multimedia resource; In response to a selection operation on any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0021] In some embodiments, the display unit is further configured to perform: In response to the pause operation on the multimedia resource, prompt information is displayed, where the prompt information is used to prompt the execution of the first operation.

[0022] In some embodiments, the publishing unit is configured to execute: In response to a message publishing operation on the message input box, obtaining content summary information corresponding to the first image frame; A comment message including the first image frame and the content summary information is published.

[0023] In some embodiments, the publishing unit is configured to execute: Obtaining information entered in the message input box; In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

[0024] In some embodiments, the display unit is further configured to perform: In response to the first operation, acquiring information associated with the first image frame, and displaying the information on the message input box; The publishing unit is configured to execute: In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

[0025] In some embodiments, a message publishing control is displayed on the playback interface, and the display unit is configured to perform at least one of the following: In response to a long press operation on the message publishing control, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; In response to the target gesture operation on the playback interface, a screenshot of the first image frame is taken, and a screenshot result of the first image frame is displayed.

[0026] In some embodiments, the display unit is further configured to execute, in response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource, and display the first image frame on the session interface; The device also includes a first sending unit configured to execute, in response to a sending operation on the first image frame, sending the first image frame to the publisher.

[0027] In some embodiments, the display unit is further configured to display an object list in response to a fourth operation on the playback interface; The device also includes a second sending unit configured to send the first image frame to the selected object in response to a selection operation on any object in the object list.

[0028] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the above-mentioned message sending method.

[0029] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above-mentioned message sending method.

[0030] According to another aspect of an embodiment of the present disclosure, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the above-mentioned message sending method is implemented.

[0031] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

[0032] The disclosed embodiment provides a message sending method, which, in the case of pausing the playing of multimedia resources, directly takes a screenshot of the first image frame currently being played and displays it on a message input box in response to a first operation, and directly publishes a comment message including the first image frame in response to a message publishing operation on the message input box, that is, the method not only calls out the message input box through a one-key operation, but also takes a screenshot of the first image frame currently being played and fills it in the message input box, so that the first image frame can be quickly published without the terminal login object manually taking a screenshot of the first image frame, reducing the operation steps and improving the human-computer interaction efficiency. In addition, an editing control of the first image frame is also displayed on the message input box, and triggering the editing control can enter the editing interface of the first image frame to edit the first image frame, that is, the message input box also provides an editing function for the first image frame, which can quickly edit the first image frame, shortening the interaction path when editing the first image frame, and further improving the human-computer interaction efficiency when publishing a comment message including an image. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0034] Figure 1 It is a schematic diagram showing an implementation environment according to an exemplary embodiment.

[0035] Figure 2 The figure is a flowchart of a message sending method according to an exemplary embodiment.

[0036] Figure 3 The figure is a flowchart of another message sending method according to an exemplary embodiment.

[0037] Figure 4 It is a schematic diagram of a playback interface according to an exemplary embodiment.

[0038] Figure 5 is a schematic diagram of another playback interface according to an exemplary embodiment.

[0039] Figure 6 It is a schematic diagram showing a screenshot result according to an exemplary embodiment.

[0040] Figure 7 It is a schematic diagram of an authorization interface according to an exemplary embodiment.

[0041] Figure 8 It is a schematic diagram showing a comment message list according to an exemplary embodiment.

[0042] Fig. 9 It is a schematic diagram of a message input box according to an exemplary embodiment.

[0043] Fig.10 The figure is a flowchart of another message sending method according to an exemplary embodiment.

[0044] Fig.11 The diagram is a schematic diagram of a conversation interface according to an exemplary embodiment.

[0045] Fig.12 The figure is a schematic diagram of an object list according to an exemplary embodiment.

[0046] Fig.13 The invention is a block diagram of a device for sending a message according to an exemplary embodiment.

[0047] Fig.14 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0048] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0049] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0050] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the first image frame, object list, etc. involved in this disclosure are all obtained with full authorization.

[0051] The message sending method provided by the embodiment of the present disclosure can be executed by an electronic device, and the electronic device can be provided as at least one of a terminal and a server. Figure 1 This is a schematic diagram of an implementation environment provided by the embodiment of the present disclosure, see Figure 1 , the implementation environment includes: a terminal 101 and a server 102.

[0052] In the disclosed embodiment, a target application is installed on the terminal 101, and the target application is used to play multimedia resources. When watching multimedia resources, viewers can post comments on the multimedia resources. The server 102 is a background server of the target application, which is used to provide background services for the target application.

[0053] In some embodiments, after pausing the multimedia resource on the terminal 101, the currently played image frame is displayed, and in response to the first operation, the image frame can be screenshotted and displayed in the message input box for posting a comment message, so that when posting a comment message based on the message input box, the comment message including the image frame is directly posted. In addition, an editing control of the image frame is also displayed on the message input box, and after triggering the editing control, the editing interface of the image frame can be entered to edit the current image frame.

[0054] The terminal 101 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop computer. The terminal 101 has a communication function and can access a wired network or a wireless network. The terminal 101 may generally refer to one of a plurality of terminals, and those skilled in the art may know that the number of the above terminals may be more or less. The server 102 may be an independent physical server, or a server cluster or a distributed file system composed of a plurality of physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, the server 102 is directly or indirectly connected to the terminal 101 by wired or wireless communication, which is not limited in the embodiments of the present disclosure. Optionally, the number of the above servers 102 may be more or less, which is not limited in the embodiments of the present disclosure. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services. Among them, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, the server 102 or the terminal 101 can each independently undertake the computing work, which is not limited in the embodiments of the present disclosure.

[0055] Figure 2 is a flow chart of a message sending method according to an exemplary embodiment. Figure 2 As shown, the method is executed by a terminal, and the method includes the following steps.

[0056] In step S201, in response to a pause operation on a multimedia resource, the terminal pauses playing the multimedia resource and displays the first image frame currently being played on the playing interface.

[0057] In an embodiment of the present disclosure, the terminal plays a multimedia resource on a playback interface, and the multimedia resource includes at least one of an image, text, video, etc. The pause operation on the multimedia resource may be a click operation on the playback interface or a click operation on a pause control on the playback interface. Optionally, the terminal plays the multimedia resource in a target application, and the playback interface is an interface in the target application.

[0058] In step S202, in response to the first operation, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0059] In the embodiment of the present disclosure, the first operation may be a trigger operation on a certain control on the playback interface, or may be a certain gesture operation on the playback interface.

[0060] In an embodiment of the present disclosure, the terminal displays the screenshot result of the first image frame on the playback interface. Displaying the screenshot result of the first image frame refers to displaying a thumbnail of the first image frame; or, displaying the screenshot result of the first image frame refers to displaying a result text, and the result text is used to indicate that a screenshot of the first image frame has been taken.

[0061] It should be noted that when the terminal pauses playing a multimedia resource, the playback interface displays not only the first image frame, but also interactive controls such as likes and forwarding of the multimedia resource. Optionally, the image obtained by the screenshot includes all the content currently displayed on the playback interface; or, the terminal only obtains the first image frame on the playback interface, that is, the image obtained by the screenshot includes only the first image frame, and does not include other content on the playback interface. This avoids interference of other content on the first image frame and improves the screenshot quality.

[0062] In step S203, the terminal displays a message input box based on the screenshot result, and displays the first image frame and the editing control of the first image frame on the message input box, the message input box is used to publish comment messages on multimedia resources, and the editing control is used to display the editing interface of the first image frame after being triggered.

[0063] Among them, text, images, videos, emoticons and other information can be entered in the message input box to post comment messages.

[0064] In some embodiments, the terminal displays a single message input box based on the screenshot result, and in response to the triggering operation on the message input box, the terminal displays a virtual keyboard to input information in the message input box through the virtual keyboard. In other embodiments, the terminal directly displays the virtual keyboard while displaying the message input box, that is, displays a message input panel, which includes a message input box and a virtual keyboard. Optionally, the terminal displays a pop-up window on the playback interface, and displays the message input box on the pop-up window.

[0065] Optionally, the terminal displays the first image frame on the message input box, which means displaying a thumbnail of the first image frame on the message input box. The first image frame can be displayed inside the message input box, or in an upper adjacent area or a lower adjacent area of ​​the message input box.

[0066] In step S204, in response to a message publishing operation on the message input box, the terminal publishes a comment message including the first image frame.

[0067] In the embodiment of the present disclosure, the message publishing operation may be a triggering operation of a send control on a message input box, or may be a certain gesture operation on the message input box.

[0068] In the disclosed embodiment, the comment message including the first image frame may include only the first image frame, and may also include other information in addition to the first image frame, such as text, emoticons, etc. Since an edit control for the first image frame is displayed on the message input box, the first image frame included in the comment message may be an unedited first image frame or an edited first image frame.

[0069] In an embodiment of the present disclosure, when the playback of a multimedia resource is paused, the terminal login object calls out a message input box, indicating that the terminal login object is now more likely to want to post a comment message based on the first image frame currently being played, and then in response to the first operation, while calling out the message input box, the first image frame is directly filled into the message input box, and the terminal login object does not need to download or take a screenshot of the first image frame, which reduces the operation steps, improves interaction efficiency, and improves user experience, which is conducive to promoting the terminal login object to post a comment message based on the first image frame.

[0070] The disclosed embodiment provides a message sending method, which, in the case of pausing the playing of multimedia resources, directly takes a screenshot of the first image frame currently being played and displays it on a message input box in response to a first operation, and directly publishes a comment message including the first image frame in response to a message publishing operation on the message input box, that is, the method not only calls out the message input box through a one-key operation, but also takes a screenshot of the first image frame currently being played and fills it in the message input box, so that the first image frame can be quickly published without the terminal login object manually taking a screenshot of the first image frame, reducing the operation steps and improving the human-computer interaction efficiency. In addition, an editing control of the first image frame is also displayed on the message input box, and triggering the editing control can enter the editing interface of the first image frame to edit the first image frame, that is, the message input box also provides an editing function for the first image frame, which can quickly edit the first image frame, shortening the interaction path when editing the first image frame, and further improving the human-computer interaction efficiency when publishing a comment message including an image.

[0071] Above Figure 2 The following is only the basic process of the present disclosure. The solution provided by the present disclosure is further described based on a specific implementation method. Figure 3 , Figure 3 The present invention is a flowchart of another message sending method according to an exemplary embodiment. The method is executed by a terminal and includes the following steps.

[0072] In step S301, in response to a pause operation on a multimedia resource, the terminal pauses playing the multimedia resource and displays the first image frame currently being played and prompt information on the playback interface, where the prompt information is used to prompt a long press operation on a message publishing control on the playback interface.

[0073] In the embodiment of the present disclosure, after the terminal pauses playing the multimedia resource, a pause mark is also displayed on the playing interface to indicate that the multimedia resource is currently in a paused playing state. Figure 4 , Figure 4 The figure is a schematic diagram of a playback interface according to an exemplary embodiment, wherein the multimedia resource is paused, and the first image frame currently played and a pause mark are displayed on the playback interface.

[0074] In the embodiment of the present disclosure, a message publishing control is displayed on the playback interface, and the message publishing control is used to publish a comment message for a multimedia resource. Figure 4 , a message publishing control 401 is displayed on the playback interface.

[0075] In the embodiment of the present disclosure, the display position of the prompt information on the playback interface can be set as needed. For example, the prompt information is displayed in the adjacent area of ​​the message publishing control so as to visually associate the prompt information with the message publishing control. For example, see Figure 5 , Figure 5 5 is a schematic diagram of a playback interface according to an exemplary embodiment, wherein the multimedia resource is paused, and the first image frame currently played and prompt information 501 are displayed on the playback interface.

[0076] In the disclosed embodiment, by displaying prompt information, the transparency of information is improved, which is conducive to promoting terminal login to long press the message release control based on the prompt information, thereby promoting interaction.

[0077] In step S302, in response to a long press operation on the message publishing control, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0078] In an embodiment of the present disclosure, in response to a long press operation on a message publishing control, the terminal automatically takes a screenshot of the first image frame and displays the screenshot result. Furthermore, the terminal also displays a screenshot process, which refers to a process in which the first image frame jumps out of the playback interface and the first image frame is zoomed to a preset position on the playback interface. The position of the preset position on the playback interface can be set and changed as needed, such as the preset position being the lower left corner of the playback interface.

[0079] For example, see Figure 6 , Figure 66 is a schematic diagram showing a screenshot result according to an exemplary embodiment, wherein a thumbnail 601 of the first image frame is displayed at the lower left corner of the play interface.

[0080] In some embodiments, before taking a screenshot for the first time in the target application, the authorization permission of the terminal login object is obtained, and the screenshot is taken only after responding to the authorization permission of the terminal login object. Figure 7 , Figure 7 The diagram is a schematic diagram of an authorization interface according to an exemplary embodiment, wherein in response to a trigger operation on a setting control, the terminal displays a permission setting interface, and the terminal login object performs authorization permission in the permission setting interface.

[0081] In the disclosed embodiment, the first operation is a long press operation on a message publishing control as an example for explanation. The original function of the message publishing control is to publish comment messages. In response to the click operation on the message publishing control, the terminal displays a comment message list, and displays a message input box for publishing comment messages on the comment message list. In this embodiment, in response to the long press operation on the message publishing control, the message input box is directly displayed after the screenshot and the first image frame is displayed on it. In this way, the original control for publishing comment messages on the playback interface is directly utilized, and there is no need to expand new controls, which saves resources. The display of the message input box is triggered by the original message publishing control, which is associated with the original function of the message publishing control, which is convenient for the terminal login object to understand, and is conducive to promoting the terminal login object to interact based on the message publishing control, that is, to promote interaction.

[0082] In other embodiments, the first operation is a click operation on the message publishing control. Since the prompt information is used to prompt the execution of the first operation, the prompt information is correspondingly used to prompt the click operation on the message publishing control. Then, the above process of taking a screenshot of the first image frame in response to the first operation and displaying the screenshot result of the first image frame; displaying the message input box based on the screenshot result, and displaying the first image frame and the editing control of the first image frame on the message input box includes the following steps: in response to the click operation on the message publishing control, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame; the terminal displays a comment message list based on the screenshot result, and displays the first image frame and the editing control of the first image frame in the message input area on the comment message list.

[0083] The comment message list includes multiple comment messages posted on the multimedia resource. The comment message list can be displayed on the playback interface in the form of a pop-up window, and the message input area can be displayed in the bottom area of ​​the comment message list. The message input area is used to enter the comment message for posting. Optionally, the message input area displays a message input box. The terminal displays the first image frame in an area adjacent to the message input box. For example, the first image frame is displayed above the message input box. For example, see Figure 8 , Figure 8 8 is a schematic diagram of a comment message list according to an exemplary embodiment, wherein a message input box 801 is displayed at the bottom of the comment message list, and a first image frame 802 is displayed above the message input box.

[0084] In some embodiments, in response to a triggering operation on a message input box on the comment message list, the terminal cancels displaying the comment message list, displays a message input panel, and displays a message input box and a virtual keyboard on the message input panel to facilitate input of the comment message. Optionally, the message input panel displays a first image frame and an editing control for the first image frame.

[0085] In other embodiments, the first image frame is not displayed on the comment message list. In response to a triggering operation on the message input box on the comment message list, the terminal cancels display of the comment message list, displays the message input panel, and displays the first image frame and the editing control of the first image frame on the message input panel.

[0086] In the disclosed implementation, the functions of the message publishing control include displaying a comment message list and publishing a comment message. In this embodiment, when the multimedia resource is paused, after the message publishing control is triggered to call out the comment message, the first image frame is also displayed in the message input area of ​​the comment message list, so that when the terminal login object normally triggers the message publishing control to publish a comment message, the first image frame currently played can also be quickly published, without the need to manually take a screenshot to quickly publish the first image frame, thereby improving the efficiency of human-computer interaction.

[0087] In other embodiments, the first operation is a target gesture operation on the playback interface, and accordingly, the prompt information is used to prompt the target gesture operation. The above process of taking a screenshot of the first image frame in response to the first operation and displaying the screenshot result of the first image frame includes the following steps: in response to the target gesture operation on the playback interface, the terminal takes a screenshot of the first image frame and displays the screenshot result of the first image frame.

[0088] The target gesture operation can be set and changed as needed, such as a long press operation, a double-click operation, etc., or a continuous gesture operation, such as a long press plus a sliding continuous gesture operation.

[0089] The target gesture operation can be a fixed gesture operation, and the target gesture operation can also be freely set by the terminal login object. Optionally, the terminal displays a gesture setting interface, and multiple gesture options are displayed on the gesture setting interface. In response to the selection operation of any gesture option, the gesture operation corresponding to the selected gesture option is determined as the target gesture operation. Alternatively, the terminal displays a gesture setting interface, and in response to the gesture operation of the terminal login object on the gesture setting interface, the gesture operation is determined as the target gesture operation. For example, if the terminal login object performs a long press operation on the gesture setting interface, the long press operation is determined as the target gesture operation.

[0090] In this embodiment, executing a target gesture operation on the playback interface can trigger the first image frame currently being played to take a screenshot of the current image frame and display it in the message input box, without the need for the terminal login object to manually take a screenshot. That is, the target gesture operation can trigger the screenshot and call up the message input box with one click, reducing the operation steps and improving the efficiency of human-computer interaction.

[0091] In step S303, the terminal displays a message input box based on the screenshot result, and displays the first image frame and an editing control of the first image frame on the message input box, wherein the editing control is used to display an editing interface of the first image frame after being triggered.

[0092] In the embodiment of the present disclosure, the message input box is displayed based on the screenshot result, that is, after the terminal displays the screenshot result on the playback interface, the message input box is directly displayed. The display position of the first image frame on the message input box can be set as needed. For example, the first image frame is displayed above the message input box.

[0093] In some embodiments, the message input box is displayed on the message input panel, and a virtual keyboard is displayed on the message input panel, and the virtual keyboard is used to enter the comment message in the message input box. Fig. 9 , Fig. 9 is a schematic diagram of a message input panel according to an exemplary embodiment, wherein a message input box and a virtual keyboard are displayed on the message input panel, and a first image frame 901 is displayed above the message input box.

[0094] In some embodiments, the terminal further displays a close control of the first image frame on the message input box; in response to a trigger operation on the close control, the terminal cancels display of the first image frame on the message input box. Fig. 9 A close control 902 is also displayed on the message input box, and the close control is displayed in the upper right corner of the first image frame.

[0095] Among them, if the first image frame is canceled from being displayed on the message input box, the subsequent comment message will no longer include the first image frame. In this embodiment, by displaying a close control for the first image frame on the message input box, when the terminal login object does not want to publish the first image frame or is not satisfied with the first image frame, the first image frame can be conveniently canceled through the close control, thereby improving the convenience and efficiency of interaction.

[0096] In step S304, in response to the triggering operation on the editing control, the terminal displays an editing interface for the first image frame, and in response to the editing operation on the first image frame, acquires the edited first image frame.

[0097] In the disclosed embodiment, the display position of the edit control on the message input box can be set as needed. Fig. 9 , an editing control 903 is displayed on the message input box, and the editing control 903 is displayed in the upper left corner of the first image frame.

[0098] Among them, the size, brightness, color, etc. of the first image frame can be edited on the editing interface, and text, stickers, and other elements can also be added to the first image frame, which will not be described one by one here. Optionally, multiple controls are displayed on the editing interface, and the multiple controls are respectively used to perform different types of editing on the first image frame. The editing operation on the first image frame includes triggering any one or more controls to edit the first image frame by triggering these controls.

[0099] In this embodiment, by providing an editing control for the first image frame on the message input box, the terminal login object can also edit the first image frame, thereby improving the convenience of interaction. There is no need to return to the image library to edit the first image frame, shortening the interaction path, and thus improving the interaction efficiency.

[0100] In some embodiments, the first image frame on the message input box can also be replaced. The terminal displays a replacement control for the first image frame on the message input box; in response to a trigger operation on the replacement control, multiple third image frames are displayed, and the multiple third image frames are image frames extracted from multimedia resources at preset time intervals; in response to a selection operation on any third image frame among the multiple third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0101] In the disclosed embodiment, one of the plurality of third image frames may be selected to replace the first image frame, or at least two of the plurality of third image frames may be selected to replace the first image frame. After the first image frame is replaced with the third image frame, the first image frame is cancelled from being displayed in the message input box, and the comment message subsequently published is the comment message including the third image frame.

[0102] In some embodiments, the process of obtaining a plurality of third image frames includes at least one of the following implementations.

[0103] (1) The terminal extracts image frames from the multimedia resource at a preset time interval to obtain a plurality of third image frames.

[0104] In this implementation, image frames are extracted from multimedia resources at preset time intervals, so that these multiple third image frames cover most of the plot content of the multimedia resources, increase the selectivity of the terminal login object, and thus facilitate the terminal login object to select the third image frame for replacement.

[0105] (2) The terminal extracts image frames whose interaction times meet a preset condition from the multimedia resource to obtain a plurality of third image frames, wherein the interaction times of each image frame includes at least one of the number of likes, the number of comments, and the number of reposts at a playback time point of the image frame.

[0106] In this implementation, the preset condition may be reaching a number threshold, which may be the total number of interactions of multiple interaction modes, or may include a number threshold for each interaction mode; further, the preset condition refers to the number of interactions of at least one interaction mode satisfying its number threshold, or the number of interactions of each interaction mode satisfying its number threshold.

[0107] In this implementation, the number of interactions of the image frame meets the preset conditions, that is, based on the frequent interactions of the image frame, most viewers have interacted with the image frame, and the image frame is an image frame that the public is accustomed to interacting with. Therefore, the image frame with the number of interactions that meets the preset conditions is recommended to the terminal login object, thereby improving the accuracy and quality of the recommendation, which is conducive to promoting the terminal login object to select the third image frame, that is, it is conducive to promoting interaction.

[0108] (3) The terminal divides the multimedia resource into multiple segments, and determines the image frame with the highest number of publications in each segment as the third image frame.

[0109] The multimedia resources may be divided according to preset time intervals to obtain multiple segments.

[0110] In this implementation, the image frames with the highest number of publications in each segment are obtained, so that the image frames recommended to the terminal login object cover the entire multimedia resources as much as possible, and the recommended image frames are still image frames with a high number of publications, which are commonly published by the public and are then recommended to the terminal login object, thereby improving the accuracy and quality of the recommendation, which is conducive to promoting the terminal login object to select the image frame, that is, it is conducive to promoting interaction.

[0111] In some embodiments, the terminal also displays multiple third image frames in a certain order, and the process includes at least one of the following implementation methods: the terminal displays multiple third image frames in the order in which the multiple third image frames are played in the multimedia resources; or, the terminal displays multiple third image frames in the order of the number of interactions of the multiple third image frames; or, the terminal displays multiple third image frames in the order of the number of releases of the multiple third image frames.

[0112] In this embodiment, the terminal displays multiple third image frames in the order in which they are played, so that the terminal login object can also obtain the play order based on the displayed multiple image frames, which is conducive to the understanding of the terminal login object, that is, the transparency of information is improved. Multiple third image frames are displayed in the order of the number of interactions or the number of releases, that is, image frames with more interactions or releases are displayed in front, and such image frames are more likely to be selected by the terminal login object, which reduces the process of the terminal login object traversing multiple third image frames as much as possible, improves the interaction efficiency, and is conducive to promoting the interaction of terminal login objects.

[0113] In this embodiment, a replacement control for the first image frame is provided on the message input box, and the replacement control can provide multiple image frames in the multimedia resource for replacement. In this way, if you are not satisfied with the current first image frame, you can directly select other image frames in the multimedia resource through the replacement control, without returning to the playback interface to replay the multimedia resource to obtain other image frames. Obviously, the interaction path is shortened and the interaction efficiency is improved.

[0114] In the disclosed embodiment, in response to a long-press operation on a message publishing control, the screenshot process of the first image frame is first displayed, and then the message input box is displayed based on the screenshot result. In this way, the screenshot is automatically taken before the message input box is displayed, and the terminal login object does not need to take a screenshot manually, which obviously improves the interaction efficiency. In addition, the screenshot process of the first image frame is displayed, which improves the interface display effect, facilitates the terminal login object to understand the interaction process, and improves the transparency of information.

[0115] In step S305, the terminal obtains information input in the message input box.

[0116] In the disclosed embodiment, the information includes at least one of text, image, video, emoticon, etc. The message input box is displayed on the message input panel, a virtual keyboard for inputting text is displayed on the message input panel, and quick input controls of resource types such as image, video, and emoticon are also displayed on the message input panel.

[0117] In response to the message input operation of the terminal login object on the message input box, the terminal obtains the information input on the message input box. In step S305, the terminal login object manually inputs information as an example for description. In other embodiments, the terminal automatically inputs information on the message input box. In response to the first operation, the terminal obtains information associated with the first image frame and displays the information on the message input box.

[0118] The information associated with the first image frame includes text, images, expressions, etc. having the same semantics as the first image frame. For example, if the first image frame is a rainy scene, the information associated with the first image frame may be text including rain. Optionally, the terminal performs artificial intelligence recognition on the first image frame to obtain information associated with the first image frame. Alternatively, the terminal sends the first image frame to a server, and the server obtains the information associated with the first image frame.

[0119] Accordingly, in response to the message publishing operation on the message input box, the terminal publishes a message including information associated with the first image frame and a comment message on the first image frame.

[0120] In this embodiment, the terminal automatically obtains information associated with the first image frame, and automatically fills it in the message input box. This eliminates the need for the terminal login object to manually input information, further improving the efficiency of human-computer interaction when posting comment messages including images. Furthermore, since the information obtained is associated with the first image frame, the accuracy of the information is also guaranteed.

[0121] Furthermore, the terminal login object can also edit the information associated with the first image frame in the message input box, such as deleting the information or modifying the text in the information.

[0122] In step S306, in response to the message publishing operation on the message input box, the terminal publishes a comment message including the information and the edited first image frame.

[0123] In some embodiments, a send control is displayed on the message input box, and the message publishing operation on the message input box is also a click operation on the send control. After the terminal publishes the comment message, the comment message is displayed on the comment message list of the multimedia resource. Optionally, the terminal sends the comment message to the server, and the server publishes the comment message.

[0124] In the disclosed embodiment, step S304 is an optional implementation step. When step S304 is executed, the published comment message includes the edited first image frame. When step S304 is not executed, the published comment message includes the unedited first image frame.

[0125] In the disclosed embodiment, the process of publishing a comment message including the first image frame in response to a message publishing operation on the message input box is implemented through the above steps S305-S306. In this embodiment, the first image frame is displayed on the message input box, and after information is input in the message input box, the first image frame and the information in the message input box can be published together as a comment message in response to the message publishing operation. In this way, when publishing a comment message including the first image frame, there is no need to take a screenshot of the first image frame in advance, and there is no need to select the first image frame on the message input box, which further reduces the operation steps and improves the interaction efficiency. In addition, triggering the editing control can enter the editing interface of the first image frame to edit the first image frame, that is, the message input box also provides an editing function for the first image frame, which can quickly edit the first image frame, shortening the interaction path when editing the first image frame, and further improving the efficiency of human-computer interaction.

[0126] In some embodiments, in response to a message publishing operation on a message input box, the terminal publishes a comment message including a first image frame, and also includes the following implementation method: in response to the message publishing operation on the message input box, the terminal obtains content summary information corresponding to the first image frame; and publishes a comment message including the first image frame and the content summary information.

[0127] The content summary information refers to the summary information of the meaning conveyed by the first image frame, and the content summary information can be obtained based on the interpretation of the first image frame, or can be a hot point of view related to the first image frame in the network. Optionally, the terminal extracts multiple elements in the first image frame, summarizes the meanings of the multiple elements, and obtains the content summary information. Alternatively, the terminal extracts multiple elements in the first image frame, matches the multiple elements with the current hot points of view in the network, and obtains a hot point of view related to at least one element.

[0128] The content summary information may include not only text but also images, such as hot images in the network that are related to the meaning of the first image frame, thereby expressing opinions more intuitively through images.

[0129] Optionally, the terminal obtains the content summary information through an information recognition model, and the information recognition model is a neural network model that obtains the content summary information through image frames.

[0130] In some embodiments, multiple image frames in the multimedia resource can also be sent quickly, that is, after step S303, the following steps are performed: in response to the second operation on the message input box, the terminal closes the message input box and continues to play the multimedia resource; in response to the pause operation on the multimedia resource again, the terminal pauses the playback of the multimedia resource, and displays the second image frame currently played on the playback interface; in response to the first operation, the terminal displays the message input box again, and displays the first image frame, the second image frame and respective editing controls on the message input box; in response to the message publishing operation on the message input box, the terminal publishes a comment message including the first image frame and the second image frame.

[0131] In some embodiments, a save control is displayed on the message input box, and the second operation refers to a trigger operation on the save control. Alternatively, the second operation refers to a first gesture operation on the message input box. The first gesture operation is, for example, a swipe up or swipe down operation. In response to the second operation, the terminal not only collapses the message input box and continues to play the multimedia resource, but also saves the first image frame so that the first image frame can be displayed on the message input box next time in response to the first operation.

[0132] It should be noted that, in response to the first operation, the process of the terminal displaying the second image frame on the message input box is the same as the process of displaying the first image frame, that is, the terminal displays a screenshot of the second image frame and displays a close control, edit control and replacement control of the second image frame on the message input box. The detailed process will not be repeated here.

[0133] In the embodiments of the present disclosure, the quick sending of two image frames is used as an example for explanation. The terminal can also quickly send more than two image frames, that is, after displaying the first image frame and the second image frame on the message input box, in response to the second operation again, the message input box is collapsed and the multimedia resource continues to be played, and in response to the next pause operation and the first operation, the first image frame, the second image frame and the third image frame are displayed on the message input box to publish a comment message including these three image frames.

[0134] In this embodiment, in response to the second operation, not only can the message input box be folded and the multimedia resource can be directly continued to be played, without the need to interact again to end the pause, which obviously improves the interaction efficiency. In addition, when the message input box is displayed next time, not only the image frame currently paused is displayed, but also the image frame last paused is displayed, so that multiple image frames can be released at one time without the need to perform screenshot operations and selection operations on these multiple image frames. This not only provides a new interaction method, but also improves the efficiency of human-computer interaction and is conducive to promoting interaction.

[0135] In some embodiments, a save control is also displayed on the playback interface. In response to a trigger operation on the save control, the terminal saves the currently played image frame. In response to the first operation, all previously saved image frames of the multimedia resource are displayed in the message input box, thereby enabling quick publishing of comment messages including multiple image frames.

[0136] In an embodiment of the present disclosure, an example is taken of quickly publishing a comment message including a first image frame when posting a comment message on a comment message list. In other embodiments, the comment message may be a barrage message, that is, when posting a barrage message, a barrage message including a first image frame may also be quickly posted. Optionally, in response to a long press operation on a barrage control on the playback interface, the terminal displays a barrage input box, and displays the first image frame and its editing control on the barrage input box, and the barrage control is used to post the barrage. In response to the barrage posting operation on the barrage input box, a barrage message including the first image frame is posted. The specific process of this embodiment is the same as the process of posting a comment message including the first image frame, and will not be repeated here.

[0137] See also Fig.10 , Fig.10 The present invention is a flow chart of a message sending method provided according to an exemplary embodiment. In the case of pausing the multimedia resource, a prompt message of long pressing the message publishing control is displayed on the playback interface. In response to the long pressing operation of the message publishing control, the terminal directly screenshots the first image frame, displays the screenshot result, and then displays the screenshot first image frame on the message input box to publish a comment message including the first image frame.

[0138] In the embodiment of the present disclosure, the quick release of image frames when posting a comment message is taken as an example for explanation. In other embodiments, the quick release of image frames when sending a conversation message may also be performed, including at least one of the following implementations.

[0139] In the first method, in response to the third operation on the playback interface, the terminal displays a conversation interface between the terminal login object and the publisher of the multimedia resource, and displays the first image frame on the conversation interface; in response to the sending operation of the first image frame, the terminal sends the first image frame to the publisher. Furthermore, an editing control of the first image frame can also be displayed on the conversation interface.

[0140] The third operation may be a trigger operation on a control on the playback interface, or a gesture operation on the playback interface, which is not specifically limited here. The sending operation on the first image frame may be a click operation on the first image frame, or a trigger operation on the sending control on the session interface. For example, see Fig.11 , Fig.111 is a schematic diagram of a conversation interface according to an exemplary embodiment, wherein the first image frame 1101 is displayed in the message input area on the conversation interface, that is, displayed above the message input box.

[0141] In the embodiment of the present disclosure, when the playback of the multimedia resource is paused, the terminal login object calls out the conversation interface with the publisher, indicating that the terminal login object is now more likely to want to send a conversation message to the publisher based on the first image frame currently played, and then in response to the third operation, while calling out the conversation interface, the first image frame is directly displayed on the conversation interface, and the terminal login object does not need to download or screenshot the first image frame, which reduces the operation steps, improves the interaction efficiency, and improves the user experience, which is conducive to promoting the terminal login object to send a conversation message based on the first image frame.

[0142] In an embodiment of the present disclosure, when the playback of a multimedia resource is paused, in response to a third operation, the first image frame currently being played is directly displayed on the conversation interface with the publisher, and in response to an operation to send the first image frame, the first image frame can be sent to the publisher, that is, through a one-key operation, not only the conversation interface is called up, but also the first image frame currently being played is directly displayed on the conversation interface, and the first image frame can be quickly sent, and the terminal login object does not need to download or screenshot the first image frame in advance, and the first image frame can be quickly sent, thereby reducing the operation steps and improving the efficiency of human-computer interaction.

[0143] Second, in response to the fourth operation on the play interface, the terminal displays an object list; in response to a selection operation on any object in the object list, the terminal sends the first image frame to the selected object.

[0144] The fourth operation may be a trigger operation on a control on the playback interface, or a gesture operation on the playback interface, which is not specifically limited here. Optionally, after any object receives the first image frame, it is displayed on the conversation interface between the object and the terminal login object.

[0145] In some embodiments, the terminal displays an object list on the playback interface, the object list includes multiple objects, and the multiple objects are friends of the terminal login object, such as objects that the terminal login object follows each other. Fig.12 , Fig.12 FIG. 1 is a schematic diagram of an object list according to an exemplary embodiment, wherein an object list 1201 is displayed on the play interface.

[0146] In an embodiment of the present disclosure, when the playback of a multimedia resource is paused, the terminal login object calls out an object list, indicating that the terminal login object now has a high probability of wanting to send a session message to other objects based on the first image frame currently being played, and then in response to the fourth operation, when the object list is called out, in response to a selection operation on any object, the first image frame is directly sent to the object, and the terminal login object does not need to download or take a screenshot of the first image frame, thereby reducing the operation steps, improving interaction efficiency, and improving user experience, which is conducive to promoting the terminal login object to send a session message based on the first image frame.

[0147] In the embodiment of the present disclosure, when the playback of multimedia resources is paused, in response to the fourth operation, a list of objects can be displayed, and in response to the selection operation of any object, the first image frame can be directly sent to the selected object. In this way, the first image frame can be quickly sent without calling up the conversation interface with any object, and the first image frame can be quickly sent without the terminal logging into the object to download or take a screenshot of the first image frame in advance, thereby reducing the operation steps and improving the efficiency of human-computer interaction.

[0148] The disclosed embodiment provides a message sending method, which, in the case of pausing the playing of multimedia resources, directly takes a screenshot of the first image frame currently being played and displays it on a message input box in response to a first operation, and directly publishes a comment message including the first image frame in response to a message publishing operation on the message input box, that is, the method not only calls out the message input box through a one-key operation, but also takes a screenshot of the first image frame currently being played and fills it in the message input box, so that the first image frame can be quickly published without the terminal login object manually taking a screenshot of the first image frame, reducing the operation steps and improving the human-computer interaction efficiency. In addition, an editing control of the first image frame is also displayed on the message input box, and triggering the editing control can enter the editing interface of the first image frame to edit the first image frame, that is, the message input box also provides an editing function for the first image frame, which can quickly edit the first image frame, shortening the interaction path when editing the first image frame, and further improving the human-computer interaction efficiency when publishing a comment message including an image.

[0149] Fig.13 FIG. 1 is a block diagram of a message sending device according to an exemplary embodiment. Fig.13 , the device comprises: The pause unit 1301 is configured to execute a pause operation on the multimedia resource in response to the pause operation on the multimedia resource, pause the playing of the multimedia resource, and display the first image frame currently played on the playing interface; The display unit 1302 is configured to execute a screenshot of the first image frame in response to the first operation, and display the screenshot result of the first image frame; The display unit 1302 is further configured to display a message input box based on the screenshot result, display the first image frame and the editing control of the first image frame on the message input box, the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display the editing interface of the first image frame after being triggered; The publishing unit 1303 is configured to execute, in response to a message publishing operation on the message input box, publishing a comment message including the first image frame.

[0150] In some embodiments, the apparatus further comprises: a folding unit, configured to execute, in response to a second operation on the message input box, fold the message input box and continue playing the multimedia resource; a pause unit configured to execute, in response to a re-pause operation on the multimedia resource, pause the playing of the multimedia resource, and display the second image frame currently played on the playing interface; The display unit 1302 is configured to display the message input box again in response to the first operation, and display the first image frame, the second image frame and respective editing controls on the message input box; The publishing unit 1303 is configured to execute, in response to a message publishing operation on the message input box, publishing a comment message including the first image frame and the second image frame.

[0151] In some embodiments, the display unit 1302 is further configured to perform: Displaying a close control of the first image frame on the message input box; In response to the triggering operation of closing the control, the first image frame is cancelled from being displayed on the message input box.

[0152] In some embodiments, the display unit 1302 is further configured to perform: Displaying a replacement control of the first image frame on the message input box; In response to a triggering operation on the replacement control, a plurality of third image frames are displayed, where the plurality of third image frames are image frames extracted from multimedia resources; In response to a selection operation on any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

[0153] In some embodiments, the display unit 1302 is further configured to perform: In response to the pause operation on the multimedia resource, prompt information is displayed, where the prompt information is used to prompt the execution of a first operation.

[0154] In some embodiments, the publishing unit 1303 is configured to perform: In response to a message publishing operation on the message input box, obtaining content summary information corresponding to the first image frame; A comment message including the first image frame and content summary information is published.

[0155] In some embodiments, the publishing unit 1303 is configured to perform: Get the information entered in the message input box; In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0156] In some embodiments, the display unit 1302 is further configured to perform: In response to the first operation, acquiring information associated with the first image frame, and displaying the information on the message input box; The publishing unit 1303 is configured to execute: In response to a message posting operation on the message input box, a comment message including the information and the first image frame is posted.

[0157] In some embodiments, a message publishing control is displayed on the playback interface, and the display unit 1302 is configured to perform at least one of the following: In response to a long press operation on the message publishing control, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; In response to the target gesture operation on the playback interface, a screenshot is taken of the first image frame, and the screenshot result of the first image frame is displayed.

[0158] In some embodiments, the display unit 1302 is further configured to execute, in response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource, and display the first image frame on the session interface; The device also includes a first sending unit configured to execute a sending operation on the first image frame and send the first image frame to a publisher.

[0159] In some embodiments, the display unit 1302 is further configured to display the object list in response to a fourth operation on the playback interface; The device also includes a second sending unit configured to send the first image frame to the selected object in response to a selection operation on any object in the object list.

[0160] The disclosed embodiment provides a message sending device, which, in the case of pausing the playing of multimedia resources, directly takes a screenshot of the first image frame currently being played and displays it on a message input box in response to a first operation, and directly publishes a comment message including the first image frame in response to a message publishing operation on the message input box, that is, the device not only calls out the message input box through a one-key operation, but also takes a screenshot of the first image frame currently being played and fills it in the message input box, so that the first image frame can be quickly published without the terminal login object manually taking a screenshot of the first image frame, reducing the operation steps and improving the human-computer interaction efficiency. In addition, an editing control of the first image frame is also displayed on the message input box, and triggering the editing control can enter the editing interface of the first image frame to edit the first image frame, that is, the message input box also provides an editing function for the first image frame, which can quickly edit the first image frame, shortening the interaction path when editing the first image frame, and further improving the human-computer interaction efficiency when publishing a comment message including an image.

[0161] Regarding the device in the above embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0162] In some embodiments, the electronic device is provided as a terminal. Fig.14 The structure block diagram of a terminal 1400 provided by an exemplary embodiment of the present disclosure is shown. The terminal 1400 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 1400 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0163] Typically, the terminal 1400 includes a processor 1401 and a memory 1402 .

[0164] The processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1401 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1401 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0165] The memory 1402 may include one or more computer-readable storage media, which may be non-transitory. The memory 1402 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1402 is used to store at least one program code, which is used to be executed by the processor 1401 to implement the message sending method provided in the method embodiment of the present disclosure.

[0166] In some embodiments, the terminal 1400 may further optionally include: a peripheral device interface 1403 and at least one peripheral device. The processor 1401, the memory 1402 and the peripheral device interface 1403 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1403 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1404, a display screen 1405, a camera assembly 1406, an audio circuit 1407 and a power supply 1408.

[0167] The peripheral device interface 1403 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1401 and the memory 1402. In some embodiments, the processor 1401, the memory 1402, and the peripheral device interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1401, the memory 1402, and the peripheral device interface 1403 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0168] The radio frequency circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1404 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1404 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1404 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1404 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0169] The display screen 1405 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1405 is a touch display screen, the display screen 1405 also has the ability to collect touch signals on the surface or above the surface of the display screen 1405. The touch signal can be input as a control signal to the processor 1401 for processing. At this time, the display screen 1405 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1405 can be one, and the front panel of the terminal 1400 is set; in other embodiments, the display screen 1405 can be at least two, which are respectively set on different surfaces of the terminal 1400 or are folded; in some other embodiments, the display screen 1405 can be a flexible display screen, which is set on the curved surface or folded surface of the terminal 1400. Even, the display screen 1405 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0170] The camera component 1406 is used to capture images or videos. Optionally, the camera component 1406 includes a front camera and a rear camera. Usually, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera component 1406 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0171] The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1401 for processing, or input them into the radio frequency circuit 1404 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1400. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0172] The power supply 1408 is used to power various components in the terminal 1400. The power supply 1408 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1408 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0173] Those skilled in the art will understand that Fig.14 The structure shown in the figure does not constitute a limitation on the terminal 1400, and the terminal 1400 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0174] In an exemplary embodiment, a computer-readable storage medium is also provided, and when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the above-mentioned message sending method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0175] In an exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program. When the computer program is executed by a processor, the above-mentioned message sending method is implemented.

[0176] In some embodiments, the computer program product involved in the embodiments of the present disclosure may be deployed and executed on one electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed at multiple locations and interconnected by a communication network. Multiple electronic devices distributed at multiple locations and interconnected by a communication network may constitute a blockchain system.

[0177] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims. All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, which will not be described one by one here.

[0178] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A message sending method, characterized in that: The method comprises: In response to a pause operation on the multimedia resource, pausing the playing of the multimedia resource, and displaying the first image frame currently played on the playing interface; In response to a first operation, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; Displaying a message input box based on the screenshot result, displaying the first image frame and an editing control of the first image frame on the message input box, wherein the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display an editing interface of the first image frame after being triggered; In response to a message publishing operation on the message input box, a comment message including the first image frame is published.

2. The message sending method according to claim 1, characterized in that: The method further comprises: In response to a second operation on the message input box, closing the message input box and continuing to play the multimedia resource; In response to a second pause operation on the multimedia resource, pausing the playing of the multimedia resource, and displaying a second image frame currently being played on the playing interface; In response to the first operation, displaying the message input box again, and displaying the first image frame, the second image frame and respective editing controls on the message input box; In response to a message publishing operation on the message input box, a comment message including the first image frame and the second image frame is published.

3. The message sending method according to claim 1, characterized in that: The method further comprises: Displaying a close control of the first image frame on the message input box; In response to a triggering operation on the closing control, the first image frame is cancelled from being displayed on the message input box.

4. The message sending method according to claim 1, characterized in that: The method further comprises: Displaying a replacement control of the first image frame on the message input box; In response to a triggering operation on the replacement control, a plurality of third image frames are displayed, wherein the plurality of third image frames are image frames extracted from the multimedia resource; In response to a selection operation on any third image frame among the plurality of third image frames, the first image frame on the message input box is replaced with the selected third image frame.

5. The message sending method according to claim 4, characterized in that: The method further comprises at least one of the following: Extracting image frames from the multimedia resource at a preset time interval to obtain the plurality of third image frames; Extracting image frames whose interaction times meet a preset condition from the multimedia resources to obtain the plurality of third image frames, wherein the interaction times of each image frame includes at least one of the number of likes, the number of comments, and the number of reposts at a playback time point of the image frame; The multimedia resource is divided into a plurality of segments, and the image frame with the highest number of publications in each segment is determined as the third image frame.

6. The message sending method according to claim 4, characterized in that: The displaying of a plurality of third image frames comprises: Displaying the plurality of third image frames according to the playback order of the plurality of third image frames in the multimedia resource; Alternatively, the plurality of third image frames are displayed in the order of the number of interactions of the plurality of third image frames; Alternatively, the plurality of third image frames are displayed in the order of their number of times of issuance.

7. The message sending method according to claim 1, characterized in that: The method further comprises: In response to the pause operation on the multimedia resource, prompt information is displayed, where the prompt information is used to prompt the execution of the first operation.

8. The message sending method according to claim 1, characterized in that: The step of publishing a comment message including the first image frame in response to a message publishing operation on the message input box comprises: In response to a message publishing operation on the message input box, obtaining content summary information corresponding to the first image frame; A comment message including the first image frame and the content summary information is published.

9. The message sending method according to claim 1, characterized in that: The step of publishing a comment message including the first image frame in response to a message publishing operation on the message input box comprises: Obtaining information entered in the message input box; In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

10. The message sending method according to claim 1, characterized in that: The method further comprises: In response to the first operation, acquiring information associated with the first image frame, and displaying the information on the message input box; The step of publishing a comment message including the first image frame in response to a message publishing operation on the message input box comprises: In response to a message publishing operation on the message input box, a comment message including the information and the first image frame is published.

11. The message sending method according to claim 1, characterized in that: The playing interface displays a message publishing control, and in response to the first operation, taking a screenshot of the first image frame and displaying a screenshot result of the first image frame include at least one of the following: In response to a long press operation on the message publishing control, taking a screenshot of the first image frame, and displaying a screenshot result of the first image frame; In response to the target gesture operation on the playback interface, a screenshot of the first image frame is taken, and a screenshot result of the first image frame is displayed.

12. The message sending method according to claim 1, characterized in that: The method further comprises: In response to a third operation on the playback interface, a session interface between the terminal login object and the publisher of the multimedia resource is displayed, and the first image frame is displayed on the session interface; In response to a sending operation on the first image frame, the first image frame is sent to the publisher.

13. The message sending method according to claim 1, characterized in that: The method further comprises: In response to a fourth operation on the playback interface, displaying an object list; In response to a selection operation on any object in the object list, the first image frame is sent to the selected object.

14. A message sending device, characterized in that: The device comprises: a pause unit, configured to execute, in response to a pause operation on the multimedia resource, pause playing the multimedia resource, and display the first image frame currently played on the play interface; A display unit is configured to execute, in response to a first operation, a screenshot of the first image frame and display a screenshot result of the first image frame; The display unit is further configured to display a message input box based on the screenshot result, display the first image frame and an editing control of the first image frame on the message input box, the message input box is used to publish a comment message for the multimedia resource, and the editing control is used to display an editing interface of the first image frame after being triggered; The publishing unit is configured to execute, in response to a message publishing operation on the message input box, publishing a comment message including the first image frame.

15. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the message sending method according to any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the message sending method described in any one of claims 1 to 13.

17. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the message sending method according to any one of claims 1 to 13 is implemented.

Images