Information display method, device, electronic device and readable storage medium

By determining the display order based on the elements of text themes and multimedia content in the electronic device, the problem of disordered order during transmission of multimedia messages and text messages is solved, and the readability of information and user understanding is improved.

CN112949270BActive Publication Date: 2025-01-10VIVO MOBILE COMM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110112414.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-27
Publication Date
2025-01-10
Estimated Expiration
2041-01-27

AI Technical Summary

Technical Problem

In electronic devices, multimedia messages and text messages are displayed in a disordered order due to different transmission times, which affects users' reading and understanding.

Method used

When obtaining the message content, the display order is determined based on the elements of the text theme and multimedia content, ensuring that the messages are displayed in the intention and layout order of the sender to prevent confusion.

Benefits of technology

It effectively avoids the inconsistency of information display, improves the readability of messages and user understanding, and ensures that the information is displayed in the expected order.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112949270B_ABST
    Figure CN112949270B_ABST
Patent Text Reader

Abstract

The present application discloses an information display method, device, electronic device and readable storage medium, which can solve the problem of disordered message display. The method includes: obtaining N message contents, N≥2; displaying the N message contents in a first order of the N message contents; wherein the N message contents include at least one multimedia content and at least one text; the first order is determined based on the text theme of at least one text and the content element of the multimedia file indicated by at least one multimedia content; the content element is used to describe the main content contained in the multimedia file.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular, to an information display method, device, electronic device, and readable storage medium. Background Art

[0002] With the development of electronic device technology, users are using electronic devices to chat more and more frequently.

[0003] In the related art, in order to express richer emotions, users usually insert different types of information during chats, such as pictures, texts, videos, emoticons, etc. Moreover, for frequent chat partners or group chats, multiple paragraphs of text and multiple pictures are often received in succession.

[0004] However, since electronic devices usually display the received information in the order of reception after receiving the above information, the order of information display may be disordered due to the fact that the sender does not format the information and different types of information have different transmission times, which greatly affects the reading and understanding of the information content by the receiving user. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an information display method, device, electronic device and readable storage medium, which can solve the problem of disordered message display.

[0006] In order to solve the above technical problems, this application is implemented as follows:

[0007] In a first aspect, an embodiment of the present application provides an information display method, the method comprising: obtaining N message contents, N≥2; displaying the N message contents in a first order of the N message contents; wherein the N message contents include at least one multimedia content and at least one text; the first order is determined based on a text subject of at least one text and a content element of a multimedia file indicated by at least one multimedia content; the content element is used to describe the main content contained in the multimedia file.

[0008] In a second aspect, an embodiment of the present application also provides an information display device, which includes: an acquisition module and a display module; the acquisition module is used to acquire N message contents, N≥2; the display module is used to display the N message contents according to the first order of the N message contents acquired by the acquisition module; wherein the N message contents include at least one multimedia content and at least one text; the first order is determined based on the text subject of at least one text and the content elements of the multimedia file indicated by at least one multimedia content; the content elements are used to describe the main content contained in the multimedia file.

[0009] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the information display method described in the first aspect.

[0010] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0011] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0012] In an embodiment of the present application, after obtaining N message contents, the above-mentioned N message contents are displayed according to a first order determined based on the text subject of at least one text in the N message contents and the content elements of the multimedia file indicated by at least one multimedia content, so that the electronic device can display the messages edited by the user according to the user's true intentions, prevent message confusion, and facilitate other users to understand. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a schematic diagram of an information display method interface provided by an embodiment of the present application;

[0014] Figure 2 is a structural schematic diagram of an information display system provided in an embodiment of the present application;

[0015] Figure 3 It is a flowchart of an information display method provided by an embodiment of the present application;

[0016] Figure 4 is a schematic diagram of an interface applied by an information display method provided in an embodiment of the present application;

[0017] Figure 5 It is a flowchart of another information display method provided in an embodiment of the present application;

[0018] Figure 6 is a schematic diagram of the structure of an information display device provided in an embodiment of the present application;

[0019] Figure 7 is a schematic diagram of the structure of another information display device provided in an embodiment of the present application;

[0020] Figure 8 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0022] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0023] The information display method provided in the embodiment of the present application can be applied in a chat scenario.

[0024] For example, in the chat scenario, in the related art, when the sender sends multiple multimedia messages and text messages, due to the different transmission times of the multimedia messages and text messages, it is easy to cause the display order of the multimedia messages and text messages on the receiving end to be different from the sending order of the sending end, which in turn causes the message display to be chaotic, affecting the user's reading. Figure 1 As shown in (A), the content sent by the sending user, each image is accompanied by explanatory text. However, when the receiving user receives the above content, he may Figure 1 The order shown in (B) shows the above contents. Due to the disorder of the order, the receiving end user may not be able to understand the correct meaning that the sending end user wants to express.

[0025] To address this problem, in the technical solution provided in the embodiments of the present application, the user at the sending end can edit the message in the editing box, and then the sending end sends the message edited by the user and the typeset order of the message to the server, so that after the receiving end receives the above message, it can display it in the typeset order of the message at the sending end, or, after receiving a message that may be out of order, the receiving end can reorder the received message according to the subject of the text and the content elements of the multimedia message to prevent message confusion and improve the readability of the message.

[0026] The information display method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0027] Exemplarily, the execution subject of the information display method as described in the first aspect of the present application may be a first electronic device. When the execution subject is the first electronic device, the above-mentioned acquisition of N message contents specifically includes: receiving N message contents sent by the server.

[0028] like Figure 2 As shown, an information display system provided in an embodiment of the present application includes: a first electronic device 201, a second electronic device 202 and a server 203; wherein the first electronic device 201 and the second electronic device 202 receive and send messages through the server 203.

[0029] The second electronic device 202 receives the third input of the user in the content editing area. After that, the second electronic device 202 sends a target message to the server. The target message includes at least one text and at least one multimedia file in the content editing area; the target message is used to instruct the server to send at least one text and at least one multimedia content to the first electronic device in a second order; one multimedia content indicates one multimedia file, and the second order is the layout order of the at least one text and at least one multimedia file in the content editing area, and the layout order is determined based on the text theme of the at least one text and the content element of the at least one multimedia file.

[0030] Exemplarily, if the layout order of the at least one text and the at least one multimedia file in the content editing area is not determined based on the text subject of the at least one text and the content elements of the at least one multimedia file, the second electronic device may layout the N message contents based on the text subject of the at least one text and the content elements of the at least one multimedia file before sending the N message contents.

[0031] In the case where the N message contents acquired by the first electronic device 201 are the message contents sent by the server 203, after receiving the second message sent by the second electronic device 202, the server 203 sends a first message containing the N message contents to the first electronic device 201. The N message contents include at least one multimedia content and at least one text. The at least one multimedia content is used to indicate at least one multimedia file sent by the second electronic device 202, and one multimedia content indicates one multimedia file. The at least one text is at least one text sent by the second electronic device 202.

[0032] The first electronic device 201 receives N message contents sent by the server, where N≥2. The first electronic device 201 stacks and displays the N message contents in a first order of the N message contents. The first order is determined based on a text theme of at least one text and a content element of a multimedia file indicated by at least one multimedia content. Specifically, the first order may be the same as the second order.

[0033] Exemplarily, while receiving N message contents sent by the server 203, the first electronic device 201 also receives sequence information sent by the server 203, where the sequence information is used to instruct the first electronic device 201 to stack and display the N message contents in the order indicated by the sequence information.

[0034] Exemplarily, the first electronic device may have the function of the second electronic device, that is, the steps performed by the second electronic device may also be performed on the first electronic device. Similarly, the steps performed by the first electronic device may also be performed on the second electronic device.

[0035] In this way, after the second user of the second electronic device edits the content to be sent in the content editing area of ​​the second electronic device, the second electronic device sends the edited content to the server. After receiving the content sent by the second electronic device, the server sends N message contents containing the content to the first electronic device. After receiving the above N message contents, the first electronic device displays the above N message contents in a first order determined based on the text subject of at least one text in the above N message contents and the content elements of the multimedia file indicated by at least one multimedia content. This avoids the situation where the order of chat information is disordered due to different transmission times during the transmission process.

[0036] like Figure 3 As shown, an information display method applied to a first electronic device provided in an embodiment of the present application may include the following steps 301 and 302:

[0037] Step 301: The information display device obtains N message contents.

[0038] Among them, N≥2.

[0039] Exemplarily, the N message contents acquired by the information display device may be sent by a server, or may be manually edited by a user on the first electronic device.

[0040] Step 302: The information display device displays the N message contents according to the first order of the N message contents.

[0041] Among them, the above-mentioned N message contents include at least one multimedia content and at least one text, and the above-mentioned first order is determined based on the text subject of at least one text and the content element of the multimedia file indicated by at least one multimedia content, and the content element is used to describe the main content contained in the multimedia file.

[0042] Optionally, in the embodiment of the present application, in order to facilitate user viewing, the information display device may integrate messages with content relevance. Specifically, the information display device may stack and display the above N message contents.

[0043] It should be noted that, in the case where the above-mentioned N message contents are manually edited by the user on the first electronic device, after the user completes the editing and clicks the send button, the information display device can display the above-mentioned N message contents in the first order. In this application, for the convenience of understanding, the above-mentioned acquisition of N message contents can be understood as receiving the N message contents sent by the server.

[0044] Exemplarily, the multimedia file may include at least one of the following: an image, a sound, and a video.

[0045] For example, since different types of messages have different transmission times during transmission, the sending end may send messages in the order of multimedia files and texts, and the receiving end may display messages in the order of texts and multimedia files. In the case of a large number of multimedia files and text messages, it is easy to cause message confusion, affect user reading, and be difficult to understand. Therefore, the above N message contents include at least one multimedia content and at least one text.

[0046] For example, in order to save traffic, usually, when receiving a multimedia message, the information display device does not directly receive the multimedia file, but displays it in the form of multimedia content (e.g., a preview image). When the information display device receives a user's touch input of the multimedia content, the information display device downloads the multimedia file indicated by the multimedia content from the server.

[0047] Optionally, in an embodiment of the present application, the information display device may determine the display order of the above N message contents, i.e., the above first order, according to whether sequence information is received from the server. The sequence information is used to instruct the information display device to display the above N message contents in the order indicated by the sequence information.

[0048] Case 1:

[0049] In the case where the information display device receives the sequence information sent by the server, the first sequence may be: the preset display sequence of the N message contents, the preset display sequence being the sequence determined by the server. That is, the preset display sequence is the sequence indicated by the sequence information. That is, the first sequence is determined by the server.

[0050] Case 2:

[0051] In the case where the information display device does not receive the sequence information sent by the server, the first sequence may be determined by the information display device according to the content relevance of the N message contents. That is, the first sequence is determined by the information display device.

[0052] Exemplarily, the information display device may perform semantic recognition on at least one received text to obtain the subject of the text, wherein one text corresponds to at least one subject. The information display device may also identify the content element of the media file corresponding to the received multimedia content, and then match the content element with the subject of the at least one text, and sort the N message contents according to the matching result. Specifically, the multimedia content and text that match the content element and subject may be adjusted to adjacent positions.

[0053] Exemplarily, after the information display device determines the first order of the N message contents, the information display device displays the N message contents in the first order. That is, the information display device stacks and displays messages with related contents in the same area to avoid mixing with other irrelevant messages, making it easier for users to view.

[0054] For example, Figure 4 As shown in (A), it is the order of 4 messages with content association sent by the sender, such as Figure 4 As shown in (B), after receiving the above four messages, the receiving end stacks the above four messages with content correlation.

[0055] In this way, after the information display device receives N message contents sent by the server, the above N message contents are stacked and displayed in a first order determined based on the content relevance of the N message contents, so that the first electronic device can display the received messages in the order edited by the sending user, or sort the received messages according to the content relevance to prevent message confusion and facilitate user understanding.

[0056] Optionally, in an embodiment of the present application, in order to facilitate users to understand large passages of text received by the information display device, the information display device may perform semantic analysis on the received text. When the semantic analysis result indicates that the text has at least two topics, the information display device segments the text to facilitate user reading and understanding.

[0057] Exemplarily, when the at least one text includes a first text and the first text is a text containing at least two topics, the information display device performs semantic analysis on the first text, and then performs text segmentation on the first text according to the semantic analysis result. After that, the information display device reorders the N message contents after the text segmentation.

[0058] Exemplarily, after the above step 301, the information display method provided in the embodiment of the present application may further include the following step 301a:

[0059] Step 301a: When the at least one text includes a first text, and the first text is a text containing at least two topics, the information display device performs text segmentation on the first text to generate M third texts.

[0060] Among them, one third text corresponds to one topic.

[0061] Exemplarily, the information display device divides a first text having at least two topics into a plurality of third texts according to the number of topics of the first text. Specifically, the information display device can extract text features of the first text through a temporal deep model such as a transfomer, and perform text segmentation on the first text according to the text features.

[0062] Exemplarily, before the above step 302, the information display method provided in the embodiment of the present application may further include the following steps 301b1 and 301b2:

[0063] Step 301b1: The information display device matches the content elements of the multimedia file indicated by each multimedia content with the subject of each third text.

[0064] Step 301b2: The information display device sorts the at least one multimedia content and the M third texts according to the matching result.

[0065] Exemplarily, after segmenting the first text, the information display device further needs to reorder the N message contents for the convenience of user understanding, and then display the N message contents.

[0066] It should be noted that, when the multimedia file is an audio or video file, the information display device may also segment the multimedia file according to the content elements of the multimedia file, and re-sort the N message contents.

[0067] In this way, the information display device can segment the received large text, and then match and re-order the segmented text and other multimedia content to facilitate user reading and message query.

[0068] Optionally, in an embodiment of the present application, referring to the above-mentioned situation 2, when the information display device does not receive the sequence information sent by the server, in order to prevent the situation in which the user's reading and understanding are affected due to the disorder of the information sequence, after receiving the multimedia content, the information display device is triggered to search for text that matches the content elements of the multimedia file indicated by the multimedia content, and re-sort the text to facilitate the user's reading and understanding.

[0069] Exemplarily, the N message contents include a second text, the subject of which matches a content element of a multimedia file indicated by any multimedia content. The information display device sorts the N message contents based on the text subject of the second text and the content element of a multimedia file indicated by at least one multimedia content.

[0070] Exemplarily, after the above step 301, the information display method provided in the embodiment of the present application may further include the following step 301c:

[0071] Step 301c: When the information display device obtains the target multimedia content, if the theme of the fourth text matches the content element of the multimedia file indicated by the target multimedia content, the fourth text is determined as the second text.

[0072] The fourth text is a text obtained within a first time before the target multimedia content is obtained and within a second time after the target multimedia content is obtained. The target multimedia content is one of the at least one multimedia content.

[0073] Exemplarily, the information display device uses whether multimedia content is acquired as a trigger condition. When the multimedia content is acquired, the information display device is triggered to search for text matching the multimedia content, and reorders the target multimedia content and the second text according to the matching result.

[0074] In this way, for message contents received without a server-specified order, the information display device can be triggered to reorder the received messages according to content relevance after receiving the multimedia content, so as to facilitate user reading and understanding.

[0075] Optionally, in an embodiment of the present application, after the information display device displays the above-mentioned N message contents, the user can browse among the above-mentioned N message contents through a sliding gesture.

[0076] Exemplarily, after the above step 302, the information display method provided in the embodiment of the present application may further include the following steps 302a1 and 302a2:

[0077] Step 302a1: The information display device receives a first input from a user on a target area.

[0078] Among them, the above-mentioned target area is the area where the above-mentioned N message contents are displayed.

[0079] Exemplarily, the first input may be a sliding input of the user on the target area.

[0080] Step 302a2: In response to the first input, the information display device adjusts the display content of the target area based on the display order of the N message contents.

[0081] Exemplarily, when adjusting the display content of the target area, the information display device switches the display content of the target area according to the display order of the N message contents (ie, the first order mentioned above).

[0082] In this way, the user can browse the N messages with content relevance in the target area without scrolling up and down in the chat window.

[0083] Further optionally, in the embodiment of the present application, in order to save traffic, the above multimedia content is only used as a preview of the multimedia file, and the multimedia file is still stored in the server. Therefore, when the user wants to view the multimedia file, the information display device can download and play the multimedia file from the server after receiving the user's browsing input.

[0084] Exemplarily, the above browsing input may be a click input of the user on the multimedia content.

[0085] Exemplarily, after the above step 302, the information display method provided in the embodiment of the present application may further include the following steps 302b1 and 302b2:

[0086] Step 302b1: When the information display device displays the multimedia content in the target area, the information display device receives a second input of the user on the multimedia content.

[0087] Step 302b2: The information display device loads the multimedia file indicated by the multimedia content in response to the second input.

[0088] Exemplarily, the multimedia content is one of the N message contents. The loading process includes a process in which the information display device downloads and plays the multimedia file from the server.

[0089] In this way, the information display device can download the multimedia file from the server when the user needs to browse the content of the multimedia file, thereby reducing the consumption of traffic.

[0090] The information display method provided in the embodiment of the present application, after acquiring N message contents, displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the N message contents and the content elements of the multimedia file indicated by at least one multimedia content, so as to facilitate the user to read and understand the above-mentioned N messages displayed by the information display device and avoid the occurrence of message confusion due to the different transmission times of different types of messages.

[0091] In the case where the N message contents acquired by the first electronic device are the N message contents sent by the server, Figure 5 As shown, another information display method applied to a second electronic device provided in an embodiment of the present application may include the following steps 401 and 402:

[0092] Step 401: The information display device receives a third input from a user in a content editing area.

[0093] Exemplarily, the third input may be an editing input of a user in the content editing area, for example, an input of inserting an image, video, voice or text.

[0094] Step 402: The information display device sends a target message to the server.

[0095] The target message includes at least one text and at least one multimedia file in the content editing area. The target message is used to instruct the server to send sequence information to the first electronic device when sending at least one text and at least one multimedia content to the first electronic device. The sequence information is used to instruct the first electronic device to display the at least one text and at least one multimedia content in a second sequence. One multimedia content indicates one multimedia file, and the second sequence is the layout sequence of the at least one text and the at least one multimedia file in the content editing area, and the layout sequence is determined based on the text theme of the at least one text and the content element of the at least one multimedia file.

[0096] Exemplarily, the information display device sends at least one text and at least one multimedia file in the content editing area and the typeset order of the at least one text and at least one multimedia file to the server. After the server receives the at least one text and at least one multimedia file, in order to save the traffic of the first electronic device, the server does not directly send the at least one multimedia file to the first electronic device, but sends the multimedia content used to indicate the multimedia file to the first electronic device, for example, a preview image for previewing the multimedia file.

[0097] Exemplarily, after receiving the sequence information sent by the server, the first electronic device displays the at least one text and the at least one multimedia content in accordance with the second sequence.

[0098] Exemplarily, the above-mentioned first order may be the same as the above-mentioned second order.

[0099] In this way, the user at the sending end can layout the content to be sent on the sending end, and then the information display device sends the layout content and the layout order to the server, so that the receiving end can display the above content according to the display order preset by the user.

[0100] Optionally, in an embodiment of the present application, if the user enters a long paragraph of text in the content editing area, in order to facilitate the receiving user to read and understand, the information display device will split the long paragraph of text and re-sort it according to content relevance before sending the second message.

[0101] Exemplarily, before the above step 402, the information display method provided in the embodiment of the present application may further include the following steps 401a1 to 401a3:

[0102] Step 401a1: When the at least one text includes a fifth text, the information display device performs text segmentation on the fifth text to generate K sixth texts.

[0103] Among them, K≥2, the fifth text is a text containing at least two topics in the at least one text, and one sixth text corresponds to one topic.

[0104] Step 401a2: The information display device matches the content elements of each multimedia file with the theme of each sixth text.

[0105] Step 401a3: The information display device sorts the at least one multimedia file and the at least one text according to the matching result.

[0106] Illustratively, the above matching and reordering method has been described in detail in the above embodiments, and will not be described again here to avoid repetition.

[0107] In this way, after receiving the message content processed by the sending end, the receiving end does not need to perform any processing, and the user can read it directly, which is convenient and fast.

[0108] In the information display method provided by the embodiment of the present application, the second user of the second electronic device edits the content to be sent in the content editing area of ​​the second electronic device, and then sends the edited content to the server. After receiving the content sent by the second electronic device, the server sends N message contents containing the content to the first electronic device. After receiving the above-mentioned N message contents, the first electronic device displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the above-mentioned N message contents and the content elements of the multimedia file indicated by at least one multimedia content. This avoids the situation in which the order of information is disordered due to different transmission times during the transmission of chat information.

[0109] It should be noted that the information display method provided in the embodiment of the present application can be executed by an information display device or a control module in the information display device for executing the information display method. In the embodiment of the present application, the information display device provided in the embodiment of the present application is described by taking the information display device executing the information display method as an example.

[0110] It should be noted that in the embodiments of the present application, the information display methods shown in the above-mentioned method drawings are all exemplarily described in combination with one of the drawings in the embodiments of the present application. In specific implementation, the information display methods shown in the above-mentioned method drawings can also be implemented in combination with any other drawings that can be combined as shown in the above-mentioned embodiments, which will not be repeated here.

[0111] Figure 6 A possible structural diagram of an information display device provided in an embodiment of the present application is as follows: Figure 6 As shown, the information display device 600 includes: an acquisition module 601 and a display module 602, wherein: the acquisition module is used to acquire N message contents, N≥2; the display module is used to display the N message contents according to the first order of the N message contents received by the acquisition module; wherein the N message contents include at least one multimedia content and at least one text; the first order is determined based on the text subject of at least one text and the content elements of the multimedia file indicated by at least one multimedia content; the content elements are used to describe the main content contained in the multimedia file.

[0112] Optionally, in the embodiment of the present application, the display module 602 is specifically used to stack and display the above N message contents.

[0113] Optionally, in an embodiment of the present application, the information display device 600 also includes: a segmentation module 603, a matching module 604 and a sorting module 605; the segmentation module 603 is used to perform text segmentation on the first text to generate M third texts when at least one text includes a first text and the first text is a text containing at least two topics; one third text corresponds to one topic; the matching module 604 is used to match the content elements of the multimedia file indicated by each multimedia content with the topic of each third text generated by the segmentation module 603; the sorting module 605 is used to sort at least one multimedia content and the M third texts according to the matching results of the matching module 604.

[0114] Optionally, in an embodiment of the present application, N message contents include a second text, and the subject of the second text matches the content element of the multimedia file indicated by any multimedia content; the information display device 600 also includes: a determination module 606; the determination module 606 is used to determine the fourth text as the second text if the subject of the fourth text matches the content element of the multimedia file indicated by the target multimedia content when the target multimedia content is acquired; wherein the fourth text is: text acquired within a first time before the target multimedia content is acquired, and within a second time after the target multimedia content is acquired, and the target multimedia content is one of at least one multimedia content.

[0115] Optionally, in an embodiment of the present application, the information display device 600 also includes: a user input module 607; the user input module 607 is used to receive a first input from a user to a target area; the target area is an area for displaying N message contents; the display module 602 is also used to adjust the display content of the target area based on the display order of the N message contents in response to the first input received by the user input module 607.

[0116] Optionally, in an embodiment of the present application, the user input module 607 is also used to receive a second input from the user on the multimedia content when the multimedia content is displayed in the target area; the display module 602 is also used to load the multimedia file indicated by the multimedia content in response to the second input received by the user input module 607.

[0117] The information display device provided in the embodiment of the present application, after acquiring N message contents, displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the N message contents and the content elements of the multimedia file indicated by at least one multimedia content, so as to facilitate the user to read and understand the above-mentioned N messages displayed by the information display device and avoid the occurrence of message confusion due to the different transmission times of different types of messages.

[0118] Figure 7A possible structural diagram of another information display device provided in an embodiment of the present application is as follows: Figure 7 As shown, the information display device 700 includes: a user input module 701 and a sending module 702; the user input module 701 is used to receive a third input from a user in the content editing area; the sending module 702 is used to send a target message to the server, and the target message includes at least one text and at least one multimedia file in the content editing area; wherein the target message is used to instruct the server to send at least one text and at least one multimedia content to the first electronic device in a second order; one multimedia content indicates one multimedia file, and the second order is the layout order of at least one text and at least one multimedia file in the content editing area, and the layout order is determined based on the text theme of the above-mentioned at least one text and the content elements of the at least one multimedia file.

[0119] Optionally, the information display device 700 also includes: a segmentation module 703, a matching module 704 and a sorting module 705; the segmentation module 703 is used to perform text segmentation on the fifth text when the fifth text is included in at least one text, so as to generate K sixth texts; one sixth text corresponds to one topic; the matching module 704 is used to match the content elements of each multimedia file with the topic of each sixth text generated by the segmentation module 703; the sorting module 705 is used to sort at least one multimedia file and at least one text according to the matching results of the matching module 704; wherein the fifth text is a text in at least one text that contains at least two topics.

[0120] The information display device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0121] The information display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0122] The information display device provided in the embodiment of the present application can achieve Figures 2 to 5 To avoid repetition, the various processes implemented by the information display device in the method embodiment will not be described here.

[0123] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0124] In the information display device provided by the embodiment of the present application, the second user of the second electronic device edits the content to be sent in the content editing area of ​​the second electronic device, and then sends the edited content to the server. After receiving the content sent by the second electronic device, the server sends N message contents containing the content to the first electronic device. After receiving the above-mentioned N message contents, the first electronic device displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the above-mentioned N message contents and the content elements of the multimedia file indicated by at least one multimedia content. This avoids the situation in which the order of information is disordered due to different transmission times during the transmission of chat information.

[0125] Optionally, an embodiment of the present application also provides an electronic device, including a processor 110, a memory 109, and a program or instruction stored in the memory 109 and executable on the processor 110. When the program or instruction is executed by the processor 110, each process of the above-mentioned information display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0126] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0127] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present application.

[0128] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0129] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0130] Wherein, when the electronic device 100 is a first electronic device, the radio frequency unit 101 is used to obtain N message contents, N≥2; the display unit 106 is used to stack and display the N message contents according to the first order of the N message contents received by the radio frequency unit 101; wherein the N message contents include at least one multimedia content and at least one text; the first order is determined based on the text subject of at least one text and the content element of the multimedia file indicated by at least one multimedia content; the content element is used to describe the main content contained in the multimedia file.

[0131] Optionally, the display unit 106 is specifically configured to display the above N message contents in a stacked manner.

[0132] Optionally, the processor 110 is used to perform text segmentation on the first text to generate M third texts when at least one text includes a first text and the first text is a text containing at least two topics; one third text corresponds to one topic; the processor 110 is used to match the content elements of the multimedia file indicated by each multimedia content with the topic of each third text generated by the processor 110; the processor 110 is used to sort at least one multimedia content and the M third texts according to the matching results of the processor 110.

[0133] Optionally, the N message contents include a second text, and the subject of the second text matches the content element of the multimedia file indicated by any multimedia content; the processor 110 is used to, when the target multimedia content is acquired, determine the fourth text as the second text if the subject of the fourth text matches the content element of the multimedia file indicated by the target multimedia content; wherein the fourth text is: text acquired within a first time before the target multimedia content is acquired, and within a second time after the target multimedia content is acquired, and the target multimedia content is one of at least one multimedia content.

[0134] Optionally, the user input unit 107 is used to receive a first input from a user to a target area; the target area is an area for displaying N message contents; the display unit 106 is also used to adjust the display content of the target area based on the display order of the N message contents in response to the first input received by the user input unit 107.

[0135] Optionally, the user input unit 107 is further used to receive a second input of the user on the multimedia content when the multimedia content is displayed in the target area; the display unit 106 is further used to load the multimedia file indicated by the multimedia content in response to the second input received by the user input unit 107.

[0136] The first electronic device provided in the embodiment of the present application, after acquiring N message contents, displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the N message contents and the content elements of the multimedia file indicated by at least one multimedia content, so as to facilitate the user to read and understand the above-mentioned N messages displayed by the information display device and avoid the occurrence of message confusion due to the different transmission times of different types of messages.

[0137] When the electronic device 100 is a second electronic device, a user input unit 107 and a radio frequency unit 101; the user input unit 107 is used to receive a third input from a user in the content editing area; the radio frequency unit 101 is used to send a target message to a server, and the target message includes at least one text and at least one multimedia file in the content editing area; wherein the target message is used to instruct the server to send at least one text and at least one multimedia content to the first electronic device in a second order; one multimedia content indicates one multimedia file, and the second order is the layout order of at least one text and at least one multimedia file in the content editing area, and the layout order is determined based on the text theme of the at least one text and the content elements of the at least one multimedia file.

[0138] Optionally, the processor 110 is used to perform text segmentation on the fifth text to generate K sixth texts when the fifth text is included in at least one text; one sixth text corresponds to one topic; the processor 110 is used to match the content elements of each multimedia file with the topic of each sixth text generated by the processor 110; the processor 110 is used to sort at least one multimedia file and at least one text according to the matching results of the processor 110; wherein the fifth text is a text in at least one text that contains at least two topics.

[0139] In the second electronic device provided in the embodiment of the present application, the second user of the second electronic device edits the content to be sent in the content editing area of ​​the second electronic device, and then sends the edited content to the server. After receiving the content sent by the second electronic device, the server sends N message contents containing the content to the first electronic device. After receiving the above-mentioned N message contents, the first electronic device displays the above-mentioned N message contents in a first order determined based on the text subject of at least one text in the above-mentioned N message contents and the content elements of the multimedia file indicated by at least one multimedia content. This avoids the situation in which the order of the chat information is disordered due to different transmission times during the transmission process.

[0140] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 109 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 110 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0141] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0142] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0143] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0144] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0145] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0146] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling an electronic device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0147] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An information display method, characterized in that: The method comprises: Get N message contents, N ≥ 2; Upon receiving the sequence information of the display sequence of the N message contents sent by the server, displaying the N message contents according to the display sequence of the N message contents; or, In the case where the sequence information of the display sequence of the N message contents sent by the server is not received, determining a first sequence of the N message contents, and displaying the N message contents according to the first sequence; The N message contents include at least one multimedia content and at least one text; the first order is determined based on a text subject of the at least one text and a content element of a multimedia file indicated by the at least one multimedia content; the content element is used to describe the main content contained in the multimedia file; After obtaining N message contents, the method further includes: In a case where the at least one text includes a first text, and the first text is a text containing at least two topics, performing text segmentation on the first text to generate M third texts, where one third text corresponds to one topic; The determining a first order of the N message contents comprises: matching content elements of the multimedia file of each multimedia content indication with the subject of each third text; The at least one multimedia content and the M third texts are sorted according to the matching result.

2. The method according to claim 1, characterized in that The displaying of the N message contents includes: The N message contents are displayed in a stacked manner.

3. The method according to claim 1, characterized in that The N message contents include a second text, the subject of which matches a content element of a multimedia file indicated by any multimedia content; After obtaining N message contents, the method further includes: In the case of acquiring the target multimedia content, if the subject of the fourth text matches the content element of the multimedia file indicated by the target multimedia content, determining the fourth text as the second text; The fourth text is: text acquired within a first time before acquiring the target multimedia content, and within a second time after acquiring the target multimedia content; the target multimedia content is one of the at least one multimedia content.

4. The method according to any one of claims 1 to 3, characterized in that After displaying the N message contents in the first order, the method further includes: receiving a first input from a user on a target area, where the target area is an area where the N message contents are displayed; In response to the first input, the display content of the target area is adjusted based on the display order of the N message contents.

5. The method according to claim 4, characterized in that After displaying the N message contents in the first order, the method further includes: In a case where the target area displays the multimedia content, receiving a second input of the multimedia content by the user; In response to the second input, a multimedia file indicated by the multimedia content is loaded.

6. An information display device, characterized in that: The device comprises: an acquisition module and a display module; The acquisition module is used to acquire N message contents, where N≥2; The display module is configured to display the N message contents according to the display order of the N message contents acquired by the acquisition module when receiving the order information of the display order of the N message contents sent by the server; or, In the case where the sequence information of the display sequence of the N message contents sent by the server is not received, determining a first sequence of the N message contents, and displaying the N message contents according to the first sequence; The N message contents include at least one multimedia content and at least one text; the first order is determined based on a text subject of the at least one text and a content element of a multimedia file indicated by the at least one multimedia content; the content element is used to describe the main content contained in the multimedia file; The device also includes: a segmentation module, a matching module and a sorting module; The segmentation module is used for performing text segmentation on the first text to generate M third texts when the at least one text includes a first text and the first text is a text containing at least two topics; one third text corresponds to one topic; The matching module is used to match the content elements of the multimedia file indicated by each multimedia content with the subject of each third text generated by the segmentation module; The sorting module is used to sort the at least one multimedia content and the M third texts according to the matching result of the matching module.

7. The device according to claim 6, characterized in that The display module is specifically used to stack and display the N message contents.

8. The device according to claim 6, characterized in that The N message contents include a second text, the subject of which matches a content element of a multimedia file indicated by any multimedia content; the device further includes: a determination module; The determination module is configured to, when the target multimedia content is acquired, determine the fourth text as the second text if the subject of the fourth text matches the content element of the multimedia file indicated by the target multimedia content; The fourth text is: text acquired within a first time before acquiring the target multimedia content, and within a second time after acquiring the target multimedia content, and the target multimedia content is one of the at least one multimedia content.

9. The device according to any one of claims 6 to 8, characterized in that The device further comprises: a user input module; The user input module is used to receive a first input from a user to a target area; the target area is an area where the N message contents are displayed in a stacked manner; The display module is further configured to adjust the display content of the target area based on the display order of the N message contents in response to the first input received by the user input module.

10. The device according to claim 9, characterized in that The user input module is further configured to receive a second input of the multimedia content from the user when the multimedia content is displayed in the target area; The display module is further configured to load the multimedia file indicated by the multimedia content in response to a second input received by the user input module.

11. An electronic device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the information display method according to any one of claims 1 to 5.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the information display method according to any one of claims 1 to 5 are implemented.

Citation Information

Patent Citations

  • Information interaction method and device

    CN108173747A

  • Icon sorting method and device and electronic equipment

    CN111459350A