Session message processing method, apparatus and electronic device
By displaying a reference message editing area and supporting editing operations in the session message processing, the problem of low efficiency in the session message referencing method is solved, thereby improving the efficiency of session communication.
Patent Information
- Application Number
- CN202310457721.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-25
- Publication Date
- 2026-02-10
- Estimated Expiration
- 2043-04-25
AI Technical Summary
The existing method of referencing session messages is not very efficient for session communication.
By responding to input on the target session message, a reference message editing area is displayed, and editing operations such as cropping and splicing of the target session message are supported to generate a session reference message.
It improves the efficiency of conversational communication and highlights the key content of the quoted conversational messages.
Smart Images

Figure CN116471250B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of message processing technology, and in particular to a method, apparatus and electronic device for processing conversational messages. Background Technology
[0002] Currently, when users use communication applications on electronic devices, they can reference conversation messages within the application when replying to messages. Specifically, users can view the desired conversation message in the application's conversation interface, edit the text in the message editing area after confirming the reference, and then send the reply. The user's reply, along with the referenced conversation message, will then appear on the conversation interface. However, this method of referencing conversation messages is not very efficient for communication. Summary of the Invention
[0003] This application provides a method, apparatus, and electronic device for processing conversation messages, which can solve the problem of low efficiency in conversation communication using existing conversation message referencing methods.
[0004] In a first aspect, embodiments of this application provide a session message processing method, the method comprising:
[0005] In response to a first input to at least one target session message of the target session, a reference message editing area corresponding to the at least one target session message is displayed; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message;
[0006] In response to a second input to the reference message editing area, a session reference message corresponding to the at least one target session message is displayed;
[0007] In response to a third input to the session message editing area of the target session, the input message is displayed;
[0008] The input message and the session reference message are sent to the session members participating in the target session.
[0009] Secondly, embodiments of this application provide a session message processing apparatus, the apparatus comprising:
[0010] The first display module is configured to display a reference message editing area corresponding to the at least one target session message in response to a first input to the target session; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message;
[0011] The second display module is configured to display a session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area;
[0012] The third display module is used to display an input message in response to a third input to the session message editing area of the target session;
[0013] The sending module is used to send the input message and the session reference message to the session members participating in the target session.
[0014] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps in the session message processing method as described in the first aspect.
[0015] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps in the session message processing method as described in the first aspect.
[0016] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.
[0017] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.
[0018] In this embodiment, in response to a first input to at least one target session message of a target session, a reference message editing area corresponding to the at least one target session message is displayed; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message; in response to a second input to the reference message editing area, a session reference message corresponding to the at least one target session message is displayed; in response to a third input to the session message editing area of the target session, an input message is displayed; the input message and the session reference message are sent to the session members participating in the target session. That is, when it is necessary to reference at least one target session message of a target session, this application supports displaying a reference message editing area and editing at least one target session message in the reference message editing area to generate a session reference message corresponding to at least one target session message. This can highlight the key content of the referenced session message and improve the efficiency of session communication. Attached Figure Description
[0019] Figure 1 This is a flowchart of a session message processing method provided in an embodiment of this application;
[0020] Figure 2a This is one of the schematic diagrams provided in the embodiments of this application for triggering the reference editing of selected historical session messages;
[0021] Figure 2b This is a second schematic diagram illustrating how to trigger the editing of selected historical session messages, as provided in this application embodiment.
[0022] Figure 3a This is one of the schematic diagrams of a reference message editing area provided in the embodiments of this application;
[0023] Figure 3b This is one of the schematic diagrams provided in the embodiments of this application for pruning historical session messages;
[0024] Figure 4a This is a second schematic diagram of a reference message editing area provided in an embodiment of this application;
[0025] Figure 4b This is the third schematic diagram of a reference message editing area provided in the embodiments of this application;
[0026] Figure 4c This is the fourth schematic diagram of a reference message editing area provided in the embodiments of this application;
[0027] Figure 5a This is a schematic diagram of the input voice message provided in an embodiment of this application;
[0028] Figure 5b This is a schematic diagram of the input video message provided in an embodiment of this application;
[0029] Figure 6a This is one of the schematic diagrams provided in the embodiments of this application for displaying input messages and session reference messages in a target session;
[0030] Figure 6b This is a second schematic diagram illustrating the display of input messages and session reference messages in the target session, provided in an embodiment of this application.
[0031] Figure 7a This is one of the schematic diagrams of video message cropping based on video time range provided in the embodiments of this application;
[0032] Figure 7b This is the second schematic diagram of video message cropping based on video time range provided in the embodiments of this application;
[0033] Figure 8This is a schematic diagram illustrating the referencing of a trimmed message fragment according to an embodiment of this application;
[0034] Figure 9a This is one of the schematic diagrams provided in the embodiments of this application for splicing multiple conversation message fragments located on the same editing page;
[0035] Figure 9b This is the second illustration of splicing multiple conversation message fragments located on the same editing page, provided in the embodiments of this application;
[0036] Figure 9c This is a schematic diagram of the splicing result of multiple message fragments provided in the embodiments of this application;
[0037] Figure 9d This is one of the schematic diagrams provided in the embodiments of this application for triggering the reordering of multiple session messages located on the same editing page;
[0038] Figure 9e This is one of the schematic diagrams illustrating the reordering of dragged session messages provided in the embodiments of this application;
[0039] Figure 9f This is the second illustration provided in the embodiments of this application for triggering the reordering of multiple session messages located on the same editing page;
[0040] Figure 9g This is the second schematic diagram of reordering dragged session messages provided in the embodiments of this application;
[0041] Figure 10a This is one of the schematic diagrams illustrating the addition of voice message segment trimming provided in the embodiments of this application;
[0042] Figure 10b This is the second schematic diagram of the added voice message segment trimming provided in the embodiments of this application;
[0043] Figure 10c This is the third schematic diagram of the added voice message segment trimming provided in the embodiments of this application;
[0044] Figure 10d This is the fourth schematic diagram of the added voice message segment trimming provided in the embodiments of this application;
[0045] Figure 10e This is the fifth schematic diagram of the added voice message segment trimming provided in the embodiments of this application;
[0046] Figure 11a This is one of the schematic diagrams illustrating the addition of video message segment trimming provided in the embodiments of this application;
[0047] Figure 11bThis is the second schematic diagram of adding video message segment trimming provided in the embodiments of this application;
[0048] Figure 11c This is the third schematic diagram of adding video message segment trimming provided in the embodiments of this application;
[0049] Figure 11d This is one of the schematic diagrams showing the switching of the first image preview of a video message segment provided in the embodiments of this application;
[0050] Figure 11e This is the second schematic diagram of the first image preview switching of the video message segment provided in the embodiments of this application;
[0051] Figure 12a This is one of the schematic diagrams illustrating the splicing of multiple voice message segments provided in the embodiments of this application;
[0052] Figure 12b This is the second schematic diagram of splicing multiple voice message segments provided in the embodiments of this application;
[0053] Figure 12c This is a schematic diagram illustrating the splicing of multiple video message segments provided in an embodiment of this application;
[0054] Figure 13a This is one of the schematic diagrams showing multiple voice conversation messages located on different editing pages according to embodiments of this application;
[0055] Figure 13b This is a second illustration of multiple voice conversation messages located on different editing pages, as provided in the embodiments of this application.
[0056] Figure 13c This is the third illustration of multiple voice conversation messages located on different editing pages, as provided in the embodiments of this application;
[0057] Figure 13d This is one of the schematic diagrams showing multiple video session messages located on different editing pages according to embodiments of this application;
[0058] Figure 13e This is a second illustration of multiple video session messages located on different editing pages, as provided in the embodiments of this application.
[0059] Figure 14 This is a schematic diagram showing the complete session message corresponding to the referenced message fragment provided in the embodiments of this application;
[0060] Figure 15 This is a flowchart of a voice message referencing method provided in an embodiment of this application;
[0061] Figure 16 This is a flowchart of a video message referencing method provided in an embodiment of this application;
[0062] Figure 17 This is a schematic diagram of the structure of a session message processing device provided in an embodiment of this application;
[0063] Figure 18 This is one of the structural schematic diagrams of an electronic device provided in the embodiments of this application;
[0064] Figure 19 This is a second schematic diagram of the structure of an electronic device provided in the embodiments of this application. Detailed Implementation
[0065] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0066] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0067] The session message processing method, apparatus, and electronic device provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.
[0068] See Figure 1 , Figure 1 This is a flowchart of a session message processing method provided in an embodiment of this application, such as... Figure 1 As shown, it includes the following steps:
[0069] Step 101: In response to a first input to at least one target session message of the target session, display the reference message editing area corresponding to the at least one target session message; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message.
[0070] The target session can be any session of any communication application. The at least one target session message can be at least one session message selected from the target session.
[0071] Wherein, the aforementioned at least one target session message may all be session messages of the same message type, for example, the aforementioned at least one session message may all be text session messages, voice session messages, image session messages, or video session messages; or, the aforementioned at least one target session message may include session messages of different message types, for example, the aforementioned at least one target session message may include at least two types of session messages among text session messages, voice session messages, image session messages, and video session messages.
[0072] The first input mentioned above may include, but is not limited to, clicking, swiping, or pressing on at least one message of the target session.
[0073] The aforementioned reference message editing area supports editing operations (e.g., cropping, splicing, etc.) on at least one of the target session messages to generate a session reference message.
[0074] For example, upon receiving a first input to at least one target session message on the target session, a reference control can be displayed on the target session; upon receiving touch input to the reference control on the target session, a reference message editing area can be displayed, and at least one target session message can be added to the reference message editing area.
[0075] For example, such as Figure 2a or Figure 2b As shown, after a user selects one or more messages in a target session for citation, a citation mode entry is displayed on the target session to trigger entry into citation mode. The user then touches the citation mode entry (e.g., click, long press, or swipe the citation mode entry) to display the citation message editing area, such as... Figure 3a As shown.
[0076] Step 102: In response to a second input to the reference message editing area, display the session reference message corresponding to the at least one target session message.
[0077] The second input mentioned above may include editing input on at least one target session message displayed in the referenced message editing area, such as cropping input, splicing input, etc. The aforementioned session referenced message may include one or more referenced messages.
[0078] For example, when the number of target session messages is equal to 1, the target session message can be trimmed in the referenced message editing area to obtain at least one message fragment, such as... Figure 3bAs shown, the aforementioned message editing area displays a sequence of audio frames from a voice conversation message, and a clipping box is displayed on this sequence. Users can drag the clipping box to trim the voice conversation message. After the user confirms the trimming control, a 50-second voice conversation message is trimmed into a 39-second audio message segment; or, as... Figures 4a to 4c As shown, the aforementioned reference message editing area displays a sequence of video frames from the video session message, and a cropping box is displayed on this sequence. Users can drag the cropping box on the video frame sequence to crop the video session message. After the user confirms the cropping control, the cropped video message segment is obtained. It should be noted that when multiple message segments are cropped, each segment can be treated as a separate reference message, or the multiple session message segments can be concatenated, and the concatenated result can be used as a single reference message.
[0079] When the number of target session messages is greater than one, at least a portion of the session messages of the at least one target session message can be trimmed in the reference message editing area, and the trimmed message fragments can be used as reference messages; alternatively, at least a portion of the session messages of the at least one target session message can be concatenated, and the concatenated session message can be used as a reference message; or, at least a portion of the session messages of the at least one target session message can be trimmed, and the multiple trimmed message fragments can be concatenated, or the trimmed session message fragments can be concatenated with untrimmed target session messages, and the concatenated session message can be used as a reference message. The concatenation of multiple trimmed message fragments can include concatenating multiple message fragments trimmed from the same session message, or it can include concatenating multiple message fragments trimmed from different session messages.
[0080] It should be noted that for some session messages that do not require trimming or splicing, you can directly confirm the reference to the session message in the message reference editing area, for example, such as Figure 3a As shown, when a user touches the reference control on the reference message editing area, the currently edited voice conversation message can be directly identified as a reference message.
[0081] It should also be noted that when the number of the aforementioned target session messages is greater than 1, the aforementioned at least two target session messages can be located on different editing pages of the aforementioned reference message editing area, and thus the corresponding target session messages can be edited on different editing pages. For example, the first target session message can be edited on the first editing page, the second target session message can be edited on the second editing page, and so on; or, the aforementioned at least two target session messages can both be located on the same editing page of the aforementioned reference message editing area, and thus each target session message can be edited on the same editing page.
[0082] It should also be noted that, in some optional embodiments, when the currently edited conversation message is a voice conversation message or a video conversation message, the currently edited conversation message can also be played in the aforementioned reference message editing area. For example, Figures 4a to 4c As shown, the video session message can be played when the user touches the playback control corresponding to the video session message; for example... Figures 3a to 3b As shown, the voice conversation message can be played when the user touches the playback control corresponding to the voice conversation message.
[0083] Step 103: In response to a third input to the session message editing area of the target session, display the input message.
[0084] In this embodiment, the input message may include at least one of text input message, voice input message, image input message, or video input message.
[0085] For example, after determining the session reference message, the aforementioned session reference message can be brought into the session message editing area. For instance, as shown... Figure 5a As shown, the aforementioned session reference message can be displayed in the session message editing area. Users can select to input voice messages in the session message editing area. After the user completes editing the voice input message, the voice input message and the aforementioned session reference message can be sent together to the session members participating in the target session; or, as... Figure 5b As shown, the aforementioned session reference message can be displayed in the session message editing area. Users can select to input video messages in the session message editing area. After the user completes the editing of the video input message, the video input message and the aforementioned session reference message can be sent together to the session members participating in the target session.
[0086] Step 104: Send the input message and the session reference message to the session members participating in the target session.
[0087] In this embodiment, after the input message and the session reference message are sent to the session members participating in the target session, the input message and the session reference message can be displayed in the target session according to a preset reference format. For example, the session reference message can be displayed below the input message, and the name of the referenced object (i.e., the contact) corresponding to each session reference message can be displayed, for example, such as... Figure 6a and Figure 6b As shown.
[0088] The conversation message processing method provided in this application displays a reference message editing area corresponding to at least one target conversation message in response to a first input to the target conversation message of the target conversation. The at least one target conversation message includes at least one of the following: text conversation message, voice conversation message, image conversation message, and video conversation message. In response to a second input to the reference message editing area, a conversation reference message corresponding to the at least one target conversation message is displayed. In response to a third input to the conversation message editing area of the target conversation, an input message is displayed. The input message and the conversation reference message are sent to the conversation members participating in the target conversation. That is, when it is necessary to reference at least one target conversation message of the target conversation, this application supports displaying a reference message editing area and editing at least one target conversation message in the reference message editing area to generate a conversation reference message corresponding to at least one target conversation message. This can highlight the key content of the referenced conversation message and improve the efficiency of conversation communication.
[0089] Optionally, before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes:
[0090] The at least one target session message is displayed in the reference message editing area;
[0091] Receive a second input to a first session message in the at least one target session message; the first session message is a voice session message or a video session message;
[0092] The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes:
[0093] In response to the second input, a first message fragment of the first session message is displayed;
[0094] The session reference message corresponding to the at least one target session message is displayed according to the first message fragment.
[0095] For example, when the first conversation message is a voice conversation message or a video conversation message, a frame sequence of the first conversation message can be displayed in the referenced message editing area, and a cropping box is displayed on the frame sequence. The first input can be a touch input to the cropping box displayed on the frame sequence, such as swipe input, drag input, etc., and then the first conversation message can be cropped in response to the first input to obtain a first message segment, such as... Figure 3b or Figure 4a As shown; or, the time range of the first session message can be displayed in the above-mentioned reference message editing area, and the first input can be an adjustment input for the above-mentioned time range. Then, the first session message can be trimmed based on the time range adjusted by the first input to obtain a first message fragment, such as... Figures 7a to 7b As shown; or, if the first session message is an image session message, the first input can be a selection box input or a sliding input on the image session message, and the selected area or the area enclosed by the sliding input can be cropped from the image session message.
[0096] It should be noted that after obtaining the first message fragment, it can be referenced, for example, as shown below. Figure 8 As shown; or you can continue to drag the cropping box to crop; or you can initialize and restore the first message fragment obtained by cropping, and after restoration, you can repeat as shown. Figure 3a The operation shown.
[0097] The above-mentioned display of the session reference message corresponding to the at least one target session message based on the first message fragment can be achieved in several ways. For example, the first message fragment can be directly used as the reference message and displayed, or the first message fragment can be concatenated with other session messages or other message fragments, and the concatenation result can be used as the reference message and displayed.
[0098] This application embodiment displays at least one target session message in the reference message editing area, receives a second input on a first session message in the at least one target session message, and in response to the second input, displays a first message fragment of the first session message, and displays a session reference message corresponding to the at least one target session message based on the first message fragment. That is, this application embodiment supports trimming the first session message that needs to be referenced in the reference message editing area, and can generate a reference session message based on the trimmed first message fragment. This helps to simplify the content of the reference message and improve the relevance of the session message reference.
[0099] Optionally, the method further includes:
[0100] When the first message segment is displayed, preview information of the first message segment is displayed, which is voice and text information or video frame information.
[0101] In this embodiment, when the first conversation message is a voice conversation message, the voice and text information of the first message segment can be displayed; when the first conversation message is a video conversation message, the video frame information of the first message segment can be displayed, which makes it easier for users to quickly and accurately cut out the desired message segment.
[0102] For example, such as Figure 4a As shown, before editing the video session message, the reference message editing area displays information such as the video frame sequence of the video session message, the preview image of the first video frame of the video session message, and the video duration of the video session message. Users can drag the cropping box on the video frame sequence to crop the video session message. The duration of the cropped video changes with the range of the cropping box. After confirming the cropping, the reference message editing area displays information such as the video frame sequence of the cropped video message segment, the preview image of the first video frame, and the video duration of the video message segment.
[0103] In some optional embodiments, when the at least one target session message is displayed in the reference message editing area, if preview information of the at least one target session message is also displayed in the reference message editing area, the preview information of the first message fragment can be highlighted when the first message fragment is displayed. Highlighting the preview information of the first message fragment may include, but is not limited to, selecting the preview information of the first message fragment by drawing a box or displaying the preview information of the first message fragment using a different display format than the preview information (e.g., using a different font, a different color, adding a shadow, increasing display brightness, etc.). For example, such as... Figure 3b As shown, during the voice conversation message trimming process, the voice and text information of the trimmed message segments are highlighted.
[0104] Optionally, before displaying the session reference message corresponding to the at least one target session message based on the first message fragment, the method further includes:
[0105] Receive a fourth input to a second session message in the at least one target session message; the second session message has the same message type as the first session message;
[0106] In response to the fourth input, a second message fragment of the second session message is displayed;
[0107] The step of displaying the session reference message corresponding to the at least one target session message according to the first message fragment includes:
[0108] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment.
[0109] The second session message has the same message type as the first session message. For example, if the first session message is a voice session message, then the second session message is also a voice session message; if the first session message is a video session message, then the second session message is also a video session message.
[0110] The above-mentioned display of the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment can be, for example, treating the first message fragment and the second message fragment as separate session reference messages, i.e., directly referencing the first message fragment and the second message fragment; or, concatenating the first message fragment and the second message fragment and using the concatenated result as the reference message, i.e., referencing the concatenated first message fragment and the second message fragment, for example, as... Figures 9a to 9b As shown, the user selects multiple message fragments to be concatenated, and then concatenates the selected message fragments. The concatenated result can be as follows: Figure 9c As shown, the splicing result is used as a reference message.
[0111] This application embodiment supports trimming the first session message and the second session message to obtain the first message fragment and the second message fragment, and can display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment. This not only improves the targeting of session message references, but also improves the efficiency of referencing multiple session messages.
[0112] Optionally, displaying the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment includes:
[0113] Based on the concatenation result of the first message fragment and the second message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0114] In this embodiment, the splicing order of the first message segment and the second message segment can be determined based on user input, or the splicing order of the first message segment and the second message segment can be determined based on their positions in the target session.
[0115] For example, such as Figure 9dAs shown, multiple voice conversation messages and their corresponding voice-text information are all located on the same editing page within the reference message editing area. If a touch input for sorting options is received, the multiple voice conversation messages in the reference message editing area become draggable. In this state, the user can drag the voice conversation messages in the reference message editing area to adjust their order. For example, as... Figure 9e As shown, the voice message segments corresponding to the above multiple voice conversation messages can then be concatenated based on the adjusted order; or, as... Figure 9f As shown, multiple video session messages and the corresponding video frame information for each video session message are all located on the same editing page in the reference message editing area. If a touch input for sorting options is received, the multiple video session messages in the reference message editing area become draggable. In this state, the user can drag the video session messages in the reference message editing area to adjust the order of the multiple video session messages. For example, as... Figure 9g As shown, video message segments corresponding to the above multiple video session messages can then be spliced together based on the adjusted order.
[0116] It should be noted that, as mentioned above, displaying the session reference message corresponding to the at least one target session message based on the concatenation result of the first message fragment and the second message fragment can be achieved by directly using the concatenation result of the first message fragment and the second message fragment as a reference message, or by continuing to concatenate the concatenation result of the first message fragment and the second message fragment with other session messages or message fragments to obtain a reference message.
[0117] In practical applications, due to limitations in session message length, related session messages are often split into multiple session messages for transmission. In this embodiment, the first message fragment and the second message fragment are concatenated, and the concatenated result is used as a reference message. This supports concatenating and referencing message fragments from multiple session messages, which not only further improves the flexibility and relevance of session message referencing but also enhances the completeness and readability of the referenced message.
[0118] Optionally, before displaying the session reference message corresponding to the at least one target session message based on the first message fragment, the method further includes:
[0119] Receive the fifth input to the first session message;
[0120] In response to the fifth input, a third message fragment of the first session message is displayed;
[0121] The step of displaying the session reference message corresponding to the at least one target session message according to the first message fragment includes:
[0122] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment.
[0123] For example, when the first conversation message is a voice conversation message or a video conversation message, the frame sequence of the first conversation message can be displayed in the reference message editing area, and a cropping box is displayed on the frame sequence. The fifth input can be a touch input to the cropping box displayed on the frame sequence, such as a swipe input or a drag input. Alternatively, the time range of the first conversation message can be displayed in the reference message editing area, and the fifth input can be an adjustment input for the time range. Or, when the first conversation message is an image conversation message, the fifth input can be a box selection input or a swipe input on the image conversation message, and the selected area or the area enclosed by the swipe input can be cropped from the image conversation message.
[0124] For example, such as Figures 10a to 10d As shown, when a user clicks the "Add Segment" function and selects a voice message segment that is not within the clipping frame, a clipping frame corresponding to the voice frame sequence of the added voice message segment will appear. The user can then drag the clipping frame to trim the added voice message segment. After confirming the trimming, as shown... Figure 10e As shown, the above-mentioned message editing area can display multiple clipped voice message segments. Users can choose to directly quote or continue dragging the clipping box to trim. If they choose to continue dragging the clipping box to trim, they can repeat the process as shown. Figures 10c to 10d The operation shown; or, as Figures 11a to 11c As shown, when a user clicks the "Add Segment" function and selects a video frame sequence of a video message segment that is not within the cropping frame, a cropping frame corresponding to the added video message segment's video frame sequence will appear. The user can then drag the cropping frame to crop the added video message segment. After confirming the cropping, the aforementioned reference message editing area will display multiple cropped video message segments.
[0125] In some optional embodiments, when a video message segment is cropped, a preview image of the first video frame of that video message segment can be displayed in the aforementioned reference message editing area. Optionally, the preview image of the first video frame of the video message segment displayed in the aforementioned reference message editing area may also include a quick switching entry, such as... Figures 11d to 11e As shown, users can switch between the main image previews of different video message segments through the aforementioned quick switching entry, enabling them to select different video message segments and then crop and reference the selected video message segments.
[0126] The above-mentioned session reference message corresponding to the at least one target session message is displayed based on the first message fragment and the third message fragment. For example, the first message fragment and the third message fragment can be used as reference messages respectively, that is, the first message fragment and the third message fragment can be directly referenced; or, the first message fragment and the third message fragment can be concatenated and the concatenation result can be used as the reference message, that is, the first message fragment and the third message fragment can be concatenated and then referenced.
[0127] This application embodiment supports multiple trimmings of the same session message in at least one target session message to obtain multiple message fragments, and displays the session reference message corresponding to the at least one target session message based on the multiple message fragments obtained from the trimming of the same session message, which can further improve the targeting and flexibility of message reference.
[0128] Optionally, displaying the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment includes:
[0129] Based on the concatenation result of the first message fragment and the third message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0130] The order in which the first message segment and the third message segment are concatenated can be selected by the user, or the order can be determined based on the positions of the first message segment and the third message segment in the first session message.
[0131] It should be noted that, as described above, displaying the session reference message corresponding to the at least one target session message based on the splicing result of the first message fragment and the third message fragment can be achieved by directly using the splicing result of the first message fragment and the third message fragment as a reference message, or by continuing to splice the splicing result of the first message fragment and the third message fragment with other message fragments obtained by trimming the first session message to obtain a reference message.
[0132] For example, such as Figures 12a to 12c As shown, the aforementioned message editing area provides splicing options for combining message fragments. Users can click the splicing option to combine multiple message fragments to obtain a spliced result. Clicking the "reference" option in the message editing area will then confirm the spliced result as a single reference message. Optionally, if the aforementioned message editing area displays preview information for each message fragment, the preview information of the spliced result can be displayed when multiple message fragments are spliced together.
[0133] This embodiment can concatenate multiple message fragments obtained from the same session message as a single reference message, thus ensuring the correspondence between the reference message and the session message and making it convenient for users to view.
[0134] Optionally, if a user needs to reference multiple conversation messages, the user can process each message individually. For example, the user can trim or concatenate each message before confirming the reference. Figures 13a to 13c As shown, or, as Figures 13d to 13e As shown.
[0135] Optionally, the method further includes:
[0136] Receive the sixth input to the first session message;
[0137] In response to the sixth input, a fourth message fragment of the first session message is displayed;
[0138] Receive a seventh input to the back button in the reference message editing area;
[0139] In response to the seventh input, a first message fragment of the first session message is displayed.
[0140] In this embodiment, after displaying the first message segment of the first session message in response to the second input, a sixth input to the first session message is received, and a fourth message segment of the first session message is displayed in response to the sixth input. If a seventh input to the back control (e.g., click input, long press input, or swipe input) is received, the previous operation result can be returned, that is, the first message segment of the first session message is displayed, and the clipping of the fourth message segment is abandoned.
[0141] This embodiment supports rolling back the pruning operation of session messages. This allows users to revert to the previous pruning result if they are not satisfied with the current pruning result, thus improving the flexibility of pruning session messages.
[0142] Optionally, before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes:
[0143] The at least one target session message is displayed in the reference message editing area;
[0144] Receive a second input to a third session message in the at least one target session message; the third session message is a video session message.
[0145] The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes:
[0146] In response to the second input, a fifth message fragment is displayed based on the third session message and the search information corresponding to the second input;
[0147] The session reference message corresponding to the at least one target session message is displayed according to the fifth message fragment.
[0148] The search information corresponding to the second input mentioned above may include, but is not limited to, search terms or search images. For example, if the search information includes search terms, video frames containing the search terms can be found in the third session message based on text information (e.g., subtitles) on each video frame of the third session message; or, video frames containing the object or element indicated by the search terms can be found in the third session message. For example, if the search term is "cat," then video frames containing cat images can be found in the third session message; if the search information includes search images, video frames containing the same object or element as the search image can be found in the third session message. For example, if the search image is a cat image, then video frames containing cat images can be found in the third session message.
[0149] This embodiment supports cropping video message segments from video session messages based on search information, which improves the flexibility of video session message cropping.
[0150] Optionally, before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes:
[0151] The at least one target session message is displayed in the reference message editing area;
[0152] Receive a second input to a fourth session message in the at least one target session message; the fourth session message is an image session message;
[0153] The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes:
[0154] In response to the second input, a sixth message fragment is displayed based on the fourth session message and the image element corresponding to the second input;
[0155] The sixth message fragment displays the session reference message corresponding to the at least one target session message.
[0156] In this embodiment, the aforementioned image elements are used to describe objects or elements in an image, such as people, animals, or scenery in the image. For example, in response to the second input, an image region including the aforementioned image element can be extracted from the fourth session message based on the image element corresponding to the second input. For instance, if the image element is a person, an image region including the person can be extracted from the fourth session message.
[0157] This embodiment supports cropping image regions from image session messages based on image elements, which improves the flexibility of image session message cropping.
[0158] Optionally, after sending the input message and the session reference message to the session members participating in the target session, the method further includes:
[0159] The target session displays the input message, the session reference message, and the preview information corresponding to the session reference message.
[0160] In this embodiment, when the session reference message includes a voice reference message, the preview information corresponding to the voice reference message can be the voice-text information of the voice reference message; when the session reference message includes a video reference message, the preview information corresponding to the video reference message can be the video frame information of the video reference message, for example, the video frame sequence of the video reference message; when the session reference message includes an image reference message, the preview information corresponding to the image reference message can be the text information or preview image of the image reference message, etc.
[0161] This embodiment displays a session reference message and a preview of the corresponding session reference message in the target session, which helps session members participating in the target session to quickly learn the content of the session reference message.
[0162] Optionally, after sending the input message and the session reference message to the session members participating in the target session, the method further includes:
[0163] The input message and the session reference message are displayed in the target session;
[0164] Receive the eighth input for the target reference message in the session reference message;
[0165] In response to the eighth input, a fifth session message in the at least one target session message is displayed, wherein the target reference message includes a message fragment from the fifth session message.
[0166] In this embodiment, the target reference message can be any reference message that includes a session message fragment. The fifth session message can include one or more session messages. For example, if the target reference message is a message fragment of session message a, then the fifth session message is session message a; if the target reference message is obtained by concatenating a message fragment of session message a and a message fragment of session message b, then the fifth session message includes session message a and session message b.
[0167] For example, such as Figure 6a or Figure 6b As shown, the target session displays input messages and session reference messages. Upon receiving a click input on a specific reference message (e.g., a 39-second audio clip) within the session reference message, the original session message corresponding to that reference message can be displayed, such as... Figure 14 The original audio is displayed. Optionally, preview information corresponding to the original conversation message can also be displayed, such as... Figure 14 As shown, the text information of the original speech is displayed.
[0168] This application embodiment allows users to further view the original session message corresponding to the referenced session message fragment based on the referenced session message fragment, which can improve the readability of the referenced message and make it easier for users to understand.
[0169] Optionally, the input message includes at least one of the following: text input message, voice input message, image input message, and video input message.
[0170] The input messages in this embodiment may include at least one of text input messages, voice input messages, image input messages, and video input messages. This can increase the types of conversation messages that can be replied to when quoting conversation messages, thereby improving the flexibility of message replies when quoting conversation messages.
[0171] The embodiments of this application are illustrated below with examples:
[0172] Example 1: Voice message citation.
[0173] like Figure 15 As shown, the voice message referencing method provided in this application embodiment may include the following steps:
[0174] Step 1501: Receive the instruction to reference voice conversation messages in the historical chat history.
[0175] Users can swipe through the chat history interface and select voice messages. The command to select a voice message for quoting can be triggered by the user, including long presses, swipes to the left, and similar actions. Once selected, an entry point for the voice message quotation mode appears. Optional features include... Figure 2a As shown, users can also select multiple voice conversation messages to reference.
[0176] Step 1502: In response to the instruction, enter the voice message referencing mode, and in this voice message referencing mode, extract segments for referencing, splice segments for referencing, or batch referencing voice conversation messages.
[0177] In this step, after entering the voice message referencing mode, as follows: Figure 3a As shown, users can listen to selected voice conversation messages and view the audio-text information of those messages. Users can directly quote the voice conversation messages or crop them by dragging the cropping box. Figure 3b As shown, during the voice message trimming process, users can see the length of the trimmed voice segment and the original voice message length. Simultaneously, while dragging the trimming box, users can see the changes in the corresponding voice-to-text information. Users can cancel trimming or confirm and save the trimming. After the user selects to confirm trimming, as shown... Figure 8 As shown, users can reference the cropped voice message segments, continue to drag the cropping box to crop, and also initialize and restore the cropped voice message segments.
[0178] Optionally, the above-mentioned reference message editing area may also support the addition of fragment clipping. For specific implementation details, please refer to the relevant descriptions in the foregoing embodiments, which will not be repeated here.
[0179] Optionally, the aforementioned quoted message editing area can also support deleting clipping segments. When a user has multiple clipped segments of the same voice conversation message (i.e., multiple voice message segments), they can delete a specific voice message segment by clicking the delete segment option and selecting a clipping segment. The aforementioned quoted message editing area can also have a restore option. Clicking the restore option will restore the clipped voice message segment to the original voice conversation message and invalidate any unconfirmed or unsaved clipping actions.
[0180] Optionally, when multiple voice message segments are obtained by trimming, the aforementioned message editing area can also provide an option to splice the voice segments. Users can click the splicing option to combine multiple voice message segments into a single voice message for citation. The corresponding voice-to-text information preview will also change from multiple text information segments to a single text message, such as... Figures 12a to 12b As shown.
[0181] Optionally, if a user needs to reference multiple voice conversation messages, the user can process each message individually. For example, the user can trim or splice each message before confirming the reference. Figures 13a to 13c As shown, or as Figures 13d to 13e As shown.
[0182] Optional, such as Figures 9d to 9e As shown, users can also drag and drop multiple voice conversation messages to sort them. Multiple voice conversation messages can also be displayed on the same editing page in the above-mentioned reference message editing area. Users can add or remove segments for each voice conversation message, and can also drag the order of voice messages across messages.
[0183] Optional, such as Figures 9a to 9c As shown, users can also splice multiple voice conversation messages or voice message segments. After clicking the splice option, they can select the voice message segment or the entire voice conversation message to be spliced. Once the selection is completed, the splicing will begin immediately, and the spliced voice message and corresponding voice-text information will be displayed in the above-mentioned reference message editing area.
[0184] Step 1503: Include the voice message confirming the reference in the newly edited reply message, and send the reply message and the voice message confirming the reference.
[0185] In this step, users can directly edit new messages in the input box. The referenced voice messages or voice message segments (i.e., the referenced voice messages mentioned above) are displayed below the input box. Users can also reference multiple voice conversation messages or multiple voice message segments. Multiple referenced voice messages should be displayed one by one in the order of reference and can be combined with the newly edited message into a single message for unified sending. Optionally, users can delete any referenced voice message or voice segment below the input box. If all referenced voice messages are deleted, the user's referencing operation is considered invalid, and the new message being edited does not reference any voice conversation messages.
[0186] It should be noted that all message recipients will receive a notification in the communication-related referencing program, and can view the latest referencing reply upon entering the target session interface. For example... Figure 6a and Figure 6b As shown, after the message sender sends a reply message, the message receiver will receive a message reception notification. The received reply message is displayed on the target session interface. Depending on the number of referenced voice messages, one or more referenced voice messages will be displayed below the reply message by default.
[0187] It should also be noted that the above method of referencing voice messages can be used not only in one-on-one chat scenarios but also in group chat scenarios. Furthermore, in a one-on-one chat scenario, both parties or all members in a group chat can click on the referenced voice message to listen to the corresponding audio content. If a voice message segment is clicked, the audio content of that segment can be listened to, as well as the audio content of the corresponding voice conversation message.
[0188] Example 2: Video message citation.
[0189] like Figure 16 As shown, the voice message referencing method provided in this application embodiment may include the following steps:
[0190] Step 1601: Receive the instruction to reference video session messages in the historical chat history.
[0191] Users can swipe through the chat history interface and select video conversation messages. The command to select a video message for quoting can be triggered by the user, including long presses, swipes to the left, and similar actions. Once selected, an entry point for the video message quotation mode appears. Optional features include... Figure 2b As shown, users can also select multiple video session messages to reference.
[0192] Step 1602: In response to the instruction, enter the video message referencing mode, and in this video message referencing mode, perform segmented reference, spliced segment reference, or batch reference of video session messages.
[0193] In this step, after entering the video message referencing mode, as follows: Figures 4a to 4c As shown, the reference message editing area displays a preview of the video session message, a video cropping frame, and the video duration. Users can directly reference the video session message or drag the cropping frame to crop it. The cropped video duration changes according to the cropping frame's range. After confirming the cropping, a preview of the cropped video message segment and the corresponding cropping frame will appear in the reference message editing area. Users can also initialize and restore the cropped video message segment. Or, as shown... Figures 7a to 7b As shown, the maximum time range of the video session message is displayed in the above-mentioned reference message editing area. Users can adjust the value of the video time selection box. The video message segment corresponding to the final time range after adjustment is the cropped video message segment, which users can reference.
[0194] Optional, such as Figures 11a to 11c As shown, the aforementioned message editing area also supports adding clipping. When a user clicks the "Add Clipping" function and selects a video message clip not within the clipping frame, a corresponding video clipping frame will appear, and the user can drag it again to clip. Users can switch between clipping frames to crop different video ranges. Alternatively, clicking the "Add Clipping" function will bring up a new video time range selection box, allowing the user to manually enter the video time range not included in the clipped video message clip.
[0195] Optionally, the aforementioned message editing area can also support deletion and cropping. When a user has cropped multiple video message segments from the same video session, they can delete a specific video message segment by clicking the delete cropping option and selecting a cropping box. Alternatively, the user can click the delete cropping function and select a time range box to delete the video message segment corresponding to that time range box.
[0196] Optionally, after confirming the cropping, the aforementioned reference message editing area can display multiple cropped video message segments. Users can choose to directly reference them or continue dragging the cropping box to crop. Optionally, the first preview image of the video message segment displayed in the aforementioned reference message editing area (i.e., the preview image of the first video frame) can also have a quick switching entry, such as... Figures 11d to 11e As shown, users can switch between the main image previews of different video message segments through the aforementioned quick switching entry, enabling them to select different video message segments and then crop and reference the selected video message segments. The referenced video messages can include one or more video message segments from the same video session.
[0197] Optionally, the multiple video message segments obtained from the cropping process also support a splicing function. After clicking the splicing option, multiple video message segments can be spliced into a single video message with a duration equal to that of the spliced video message. The aforementioned quoted message editing area can also include a restore option. Clicking the restore option will restore the video message segment to its original form as a video session message.
[0198] Optionally, if a user needs to reference multiple video session messages, the user can process each video session message one by one. For example, the user can trim or splice each video session message one by one, and then confirm the reference one by one.
[0199] Optionally, users can also drag and drop multiple video conversation messages from other users to sort them. Multiple video conversation messages can be displayed on the same editing page in the above-mentioned reference message editing area. Users can add, remove, or restore segments for each video conversation message, and can also drag the order of video conversation messages up and down across messages.
[0200] Optionally, users can also splice multiple video session messages or video message segments. After clicking the splice option, users can select the video message segments or video session messages to be spliced. Once the selection is completed, the splicing will begin immediately, and the spliced video message and its corresponding duration will be displayed in the above-mentioned reference message editing area. The spliced video message can be directly referenced.
[0201] Step 1603: Include the video message confirming the reference in the newly edited reply message, and send the reply message and the video message confirming the reference.
[0202] In this step, users can directly edit new messages in the input box. Referenced video conversation messages and video message clips are displayed below the input box. If multiple video conversation messages or video message clips are concatenated, the concatenation results are displayed sequentially, and the video duration is displayed in the reference box. Users can also batch reference multiple video conversation messages or multiple video message clips. Selected video conversation messages should be displayed one by one in the reference order and can be combined with reply messages into a single message for unified sending. Optionally, users can delete any referenced video message below the input box. If all referenced video messages are deleted, the user's referencing operation is considered invalid, and the new message being edited does not reference any video conversation messages.
[0203] Optional, such as Figure 5b As shown, in addition to editing text messages in the input box, users can also choose to enter new video messages, and can upload one or more videos as a new reply message being edited.
[0204] It should be noted that all message recipients will receive a notification in the communication-related referencing application, and can view the latest referencing reply upon entering the target session interface. The referencing content can either display only a text description of the referenced video message, or it can display the entire referenced video message and support playback preview.
[0205] It should also be noted that the above method of referencing video messages can be used not only in one-on-one chat scenarios but also in group chat scenarios. In group chat scenarios, the target session interface will display the name of the specific referenced object and the corresponding applied video message.
[0206] The session message processing method provided in this application can be executed by a session message processing device. This application uses an example of a session message processing device executing the session message processing method to illustrate the session message processing device provided in this application.
[0207] See Figure 17 , Figure 17 This is a schematic diagram of the structure of a session message processing device provided in an embodiment of this application, as shown below. Figure 17 As shown, the session message processing device 1700 includes:
[0208] The first display module 1701 is configured to display a reference message editing area corresponding to the at least one target session message in response to a first input to the target session message; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message;
[0209] The second display module 1702 is configured to display a session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area.
[0210] The third display module 1703 is used to display an input message in response to a third input to the session message editing area of the target session;
[0211] The sending module 1704 is used to send the input message and the session reference message to the session members participating in the target session.
[0212] Optionally, the device further includes:
[0213] The fourth display module is used to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0214] A first receiving module is configured to receive a second input to a first session message in the at least one target session message; the first session message is a voice session message or a video session message.
[0215] The second display module is specifically used for:
[0216] In response to the second input, a first message fragment of the first session message is displayed;
[0217] The session reference message corresponding to the at least one target session message is displayed according to the first message fragment.
[0218] Optionally, the device further includes:
[0219] The fifth display module is used to display preview information of the first message segment when the first message segment is displayed, wherein the preview information is voice and text information or video frame information.
[0220] Optionally, the device further includes:
[0221] The second receiving module is configured to receive a fourth input to a second session message in the at least one target session message before displaying the session reference message corresponding to the at least one target session message according to the first message fragment; the second session message has the same message type as the first session message;
[0222] The sixth display module is configured to display a second message fragment of the second session message in response to the fourth input;
[0223] The second display module is specifically used for:
[0224] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment.
[0225] Optionally, the second display module is specifically used for:
[0226] Based on the concatenation result of the first message fragment and the second message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0227] Optionally, the device further includes:
[0228] The third receiving module is used to receive a fifth input to the first session message before displaying the session reference message corresponding to the at least one target session message according to the first message fragment;
[0229] The seventh display module is used to display a third message fragment of the first session message in response to the fifth input;
[0230] The second display module is specifically used for:
[0231] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment.
[0232] Optionally, the second display module is specifically used for:
[0233] Based on the concatenation result of the first message fragment and the third message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0234] Optionally, the device further includes:
[0235] The fourth receiving module is used to receive a sixth input to the first session message;
[0236] The eighth display module is configured to display a fourth message fragment of the first session message in response to the sixth input;
[0237] The fifth receiving module is used to receive the seventh input to the back button in the reference message editing area;
[0238] The ninth display module is used to display a first message fragment of the first session message in response to the seventh input.
[0239] Optionally, the device further includes:
[0240] The tenth display module is used to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0241] The sixth receiving module is configured to receive a second input to a third session message in the at least one target session message; the third session message is a video session message.
[0242] The second display module is specifically used for:
[0243] In response to the second input, a fifth message fragment is displayed based on the third session message and the search information corresponding to the second input;
[0244] The session reference message corresponding to the at least one target session message is displayed according to the fifth message fragment.
[0245] Optionally, the device further includes:
[0246] The eleventh display module is used to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0247] The seventh receiving module is configured to receive a second input to the fourth session message in the at least one target session message; the fourth session message is an image session message;
[0248] The second display module is specifically used for:
[0249] In response to the second input, a sixth message fragment is displayed based on the fourth session message and the image element corresponding to the second input;
[0250] The sixth message fragment displays the session reference message corresponding to the at least one target session message.
[0251] Optionally, the device further includes:
[0252] The twelfth display module is used to display the input message, the session reference message, and the preview information corresponding to the session reference message in the target session after sending the input message and the session reference message to the session members participating in the target session.
[0253] Optionally, the device further includes:
[0254] The thirteenth display module is used to display the input message and the session reference message in the target session after sending the input message and the session reference message to the session members participating in the target session;
[0255] The eighth receiving module is used to receive the eighth input to the target reference message in the session reference message;
[0256] The fourteenth display module is configured to display a fifth session message in the at least one target session message in response to the eighth input, wherein the target reference message includes a message fragment in the fifth session message.
[0257] Optionally, the input message includes at least one of the following: text input message, voice input message, image input message, and video input message.
[0258] The session message processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.
[0259] The session message processing device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0260] The session message processing device provided in this application embodiment can achieve... Figure 1 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.
[0261] Optionally, such as Figure 18 As shown, this application embodiment also provides an electronic device 1800, including a processor 1801 and a memory 1802. The memory 1802 stores a program or instructions that can run on the processor 1801. When the program or instructions are executed by the processor 1801, they implement the various steps of the above-described session message processing method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0262] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.
[0263] Figure 19 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.
[0264] The electronic device 1900 includes, but is not limited to, components such as: radio frequency unit 1901, network module 1902, audio output unit 1903, input unit 1904, sensor 1905, display unit 1906, user input unit 1907, interface unit 1908, memory 1909, and processor 1910.
[0265] Those skilled in the art will understand that the electronic device 1900 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1910 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 19 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0266] The display unit 1906 is configured to, in response to a first input to at least one target session message of the target session, display a reference message editing area corresponding to the at least one target session message; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message; in response to a second input to the reference message editing area, display a session reference message corresponding to the at least one target session message; and in response to a third input to the session message editing area of the target session, display an input message.
[0267] Radio frequency unit 1901 is used to send the input message and the session reference message to the session members participating in the target session.
[0268] In embodiments of this application, when it is necessary to reference at least one target session message of a target session, a reference message editing area can be displayed, and at least one target session message can be edited in the reference message editing area to generate a session reference message corresponding to at least one target session message. This can highlight the key content of the referenced session message and improve the efficiency of session communication.
[0269] Optionally, the display unit 1906 is further configured to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0270] User input unit 1907 is configured to receive a second input to a first session message in the at least one target session message; the first session message is a voice session message or a video session message.
[0271] The display unit 1906 is specifically used for:
[0272] In response to the second input, a first message fragment of the first session message is displayed;
[0273] The session reference message corresponding to the at least one target session message is displayed according to the first message fragment.
[0274] Optionally, the display unit 1906 is further configured to display preview information of the first message segment when displaying the first message segment, wherein the preview information is voice and text information or video frame information.
[0275] Optionally, the user input unit 1907 is further configured to receive a fourth input on a second session message in the at least one target session message before displaying the session reference message corresponding to the at least one target session message according to the first message fragment; the second session message has the same message type as the first session message;
[0276] The display unit 1906 is also configured to display a second message segment of the second session message in response to the fourth input;
[0277] The display unit 1906 is specifically used for:
[0278] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment.
[0279] Optionally, the display unit 1906 is specifically used for:
[0280] Based on the concatenation result of the first message fragment and the second message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0281] Optionally, the user input unit 1907 is further configured to receive a fifth input to the first session message before displaying the session reference message corresponding to the at least one target session message according to the first message fragment;
[0282] The display unit 1906 is also configured to display a third message segment of the first session message in response to the fifth input;
[0283] The display unit 1906 is specifically used for:
[0284] Display the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment.
[0285] Optionally, the display unit 1906 is specifically used for:
[0286] Based on the concatenation result of the first message fragment and the third message fragment, the session reference message corresponding to the at least one target session message is displayed.
[0287] Optionally, the user input unit 1907 is further configured to receive a sixth input to the first session message;
[0288] The display unit 1906 is also configured to display a fourth message segment of the first session message in response to the sixth input;
[0289] The user input unit 1907 is also configured to receive a seventh input to the back control in the reference message editing area;
[0290] The display unit 1906 is also configured to display a first message segment of the first session message in response to the seventh input.
[0291] Optionally, the display unit 1906 is further configured to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0292] The user input unit 1907 is further configured to receive a second input to a third session message in the at least one target session message; the third session message is a video session message.
[0293] The display unit 1906 is specifically used for:
[0294] In response to the second input, a fifth message fragment is displayed based on the third session message and the search information corresponding to the second input;
[0295] The session reference message corresponding to the at least one target session message is displayed according to the fifth message fragment.
[0296] Optionally, the display unit 1906 is further configured to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area;
[0297] The user input unit 1907 is further configured to receive a second input to a fourth session message in the at least one target session message; the fourth session message is an image session message.
[0298] The display unit 1906 is specifically used for:
[0299] In response to the second input, a sixth message fragment is displayed based on the fourth session message and the image element corresponding to the second input;
[0300] The sixth message fragment displays the session reference message corresponding to the at least one target session message.
[0301] Optionally, the display unit 1906 is further configured to display the input message, the session reference message, and preview information corresponding to the session reference message in the target session after the input message and the session reference message are sent to the session members participating in the target session.
[0302] Optionally, the display unit 1906 is further configured to display the input message and the session reference message in the target session after the input message and the session reference message are sent to the session members participating in the target session;
[0303] The user input unit 1907 is also configured to receive an eighth input regarding the target reference message in the session reference message;
[0304] The display unit 1906 is further configured to display a fifth session message in the at least one target session message in response to the eighth input, wherein the target reference message includes a message fragment in the fifth session message.
[0305] Optionally, the input message includes at least one of the following: text input message, voice input message, image input message, and video input message.
[0306] It should be understood that, in this embodiment, the input unit 1904 may include a graphics processing unit (GPU) 19041 and a microphone 19042. The GPU 19041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1906 may include a display panel 19061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1907 includes at least one of a touch panel 19071 and other input devices 19072. The touch panel 19071 is also called a touch screen. The touch panel 19071 may include a touch detection device and a touch controller. Other input devices 19072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0307] The memory 1909 can be used to store software programs and various data. The memory 1909 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1909 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1909 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.
[0308] Processor 1910 may include one or more processing units; optionally, processor 1910 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1910.
[0309] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described session message processing method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0310] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0311] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described session message processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0312] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0313] This application provides a computer program product that is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described session message processing method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0314] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0315] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0316] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A method for processing session messages, characterized in that, The method includes: In response to a first input to at least one target session message of the target session, a reference message editing area corresponding to the at least one target session message is displayed; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message; In response to a second input to the reference message editing area, a session reference message corresponding to the at least one target session message is displayed; In response to a third input to the session message editing area of the target session, the input message is displayed; The input message and the session reference message are sent to the session members participating in the target session; Before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes: The at least one target session message is displayed in the reference message editing area; Receive a second input to a first session message in the at least one target session message; the first session message is a voice session message or a video session message; The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes: In response to the second input, a first message fragment of the first session message is displayed; Display the session reference message corresponding to the at least one target session message according to the first message fragment; Before displaying the session reference message corresponding to the at least one target session message according to the first message fragment, the method further includes: Receive a fourth input to a second session message in the at least one target session message; the second session message has the same message type as the first session message; In response to the fourth input, a second message fragment of the second session message is displayed; The step of displaying the session reference message corresponding to the at least one target session message according to the first message fragment includes: Display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment; The step of displaying the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment includes: Based on the concatenation result of the first message fragment and the second message fragment, the session reference message corresponding to the at least one target session message is displayed.
2. The method according to claim 1, characterized in that, The method further includes: When the first message segment is displayed, preview information of the first message segment is displayed, which is voice and text information or video frame information.
3. The method according to claim 1, characterized in that, Before displaying the session reference message corresponding to the at least one target session message according to the first message fragment, the method further includes: Receive the fifth input to the first session message; In response to the fifth input, a third message fragment of the first session message is displayed; The step of displaying the session reference message corresponding to the at least one target session message according to the first message fragment includes: Display the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment.
4. The method according to claim 3, characterized in that, The step of displaying the session reference message corresponding to the at least one target session message based on the first message fragment and the third message fragment includes: Based on the concatenation result of the first message fragment and the third message fragment, the session reference message corresponding to the at least one target session message is displayed.
5. The method according to claim 1, characterized in that, The method further includes: Receive the sixth input to the first session message; In response to the sixth input, a fourth message fragment of the first session message is displayed; Receive a seventh input to the back button in the reference message editing area; In response to the seventh input, a first message fragment of the first session message is displayed.
6. The method according to claim 1, characterized in that, Before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes: The at least one target session message is displayed in the reference message editing area; Receive a second input to a third session message in the at least one target session message; the third session message is a video session message. The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes: In response to the second input, a fifth message fragment is displayed based on the third session message and the search information corresponding to the second input; The session reference message corresponding to the at least one target session message is displayed according to the fifth message fragment.
7. The method according to claim 1, characterized in that, Before displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area, the method further includes: The at least one target session message is displayed in the reference message editing area; Receive a second input to a fourth session message in the at least one target session message; the fourth session message is an image session message; The step of displaying the session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area includes: In response to the second input, a sixth message fragment is displayed based on the fourth session message and the image element corresponding to the second input; The sixth message fragment displays the session reference message corresponding to the at least one target session message.
8. The method according to any one of claims 1 to 7, characterized in that, After sending the input message and the session reference message to the session members participating in the target session, the method further includes: The target session displays the input message, the session reference message, and the preview information corresponding to the session reference message.
9. The method according to any one of claims 1 to 7, characterized in that, After sending the input message and the session reference message to the session members participating in the target session, the method further includes: The input message and the session reference message are displayed in the target session; Receive the eighth input for the target reference message in the session reference message; In response to the eighth input, a fifth session message in the at least one target session message is displayed, wherein the target reference message includes a message fragment from the fifth session message.
10. The method according to any one of claims 1 to 7, characterized in that, The input message includes at least one of the following: text input message, voice input message, image input message, and video input message.
11. A session message processing apparatus, characterized in that, The device includes: The first display module is configured to display a reference message editing area corresponding to the at least one target session message in response to a first input to the target session; the at least one target session message includes at least one of the following: text session message, voice session message, image session message, and video session message; The second display module is configured to display a session reference message corresponding to the at least one target session message in response to a second input to the reference message editing area; The third display module is used to display an input message in response to a third input to the session message editing area of the target session; The sending module is used to send the input message and the session reference message to the session members participating in the target session; The device further includes: The fourth display module is used to display the at least one target session message in the reference message editing area before displaying the session reference message corresponding to the at least one target session message in response to the second input to the reference message editing area; A first receiving module is configured to receive a second input to a first session message in the at least one target session message; the first session message is a voice session message or a video session message. The second display module is specifically used for: In response to the second input, a first message fragment of the first session message is displayed; Display the session reference message corresponding to the at least one target session message according to the first message fragment; The device further includes: The second receiving module is configured to receive a fourth input to a second session message in the at least one target session message before displaying the session reference message corresponding to the at least one target session message according to the first message fragment; the second session message has the same message type as the first session message; The sixth display module is configured to display a second message fragment of the second session message in response to the fourth input; The second display module is specifically used for: Display the session reference message corresponding to the at least one target session message based on the first message fragment and the second message fragment; The second display module is specifically used for: Based on the concatenation result of the first message fragment and the second message fragment, the session reference message corresponding to the at least one target session message is displayed.
12. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the session message processing method as described in any one of claims 1 to 10.
13. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the session message processing method as described in any one of claims 1 to 10.
Citation Information
Patent Citations
Message reply method and apparatus
CN106020595A
Video message generation method and device, electronic equipment and storage medium
CN113163230A
Video processing method and device, electronic equipment and storage medium
CN113645482A
Message processing method and device, electronic equipment and readable storage medium
CN115002056A
Message reference method and device, electronic equipment and storage medium
CN115378899A