Multimedia resource displaying method, apparatus, device, and storage medium
By displaying reading progress instructions on the text display interface and recommending relevant multimedia resources when the progress has not changed, the problem that the object needs to exit the interface to search resources is solved, and efficient and accurate resource recommendations are achieved.
Patent Information
- Application Number
- PCT/CN2024/119379
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-07
- Filing Date
- 2024-09-18
- Publication Date
- 2025-07-24
AI Technical Summary
When reading text, the object may be interested in a certain content in the text but needs to exit the interface to search for related multimedia resources, resulting in inefficient and inaccurate resource display.
Display reading progress instructions on the text display interface. If the progress does not change and exceed the preset time, display resource recommendation information, recommend multimedia resources associated with text content, search and display through the terminal or server.
It improves the recommendation accuracy and interaction efficiency of multimedia resources, and objects can obtain relevant resources without switching interfaces.
Smart Images

Figure CN2024119379_24072025_PF_FP_ABST
Abstract
Description
Multimedia resource display method, device, equipment and storage medium
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on December 7, 2023, application number 202311690410.9, and application name “Method, device, equipment and storage medium for displaying multimedia resources”, all contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of Internet technology, and in particular to multimedia resource display technology. Background Art
[0003] When a subject is reading a text on a terminal, he or she may be interested in a certain content in the text. At this time, the subject is likely to exit the text display interface and enter other interfaces to search for multimedia resources related to the content of interest, which makes it impossible to display the related multimedia resources efficiently.
[0004] In related technologies, a portion of text is typically highlighted to indicate to the user that it is a hyperlink, allowing for a secondary search and subsequent search for related content directly within the text display interface. However, different users may be interested in different content, meaning that the secondary search content may not be what the user is interested in, forcing the user to exit the text display interface and enter another interface to search. Therefore, a method for displaying multimedia resources is needed to improve interaction efficiency.
[0005] Summary of the Invention
[0006] The embodiments of the present application provide a method, apparatus, device, and storage medium for displaying multimedia resources, which improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations. The technical solution is as follows:
[0007] In one aspect, a method for displaying multimedia resources is provided, the method being executed by a terminal and comprising:
[0008] Displaying the text content of the text to be read on the text display interface, and displaying a reading progress indicator on the text display interface, wherein the reading progress indicator is used to indicate the text reading progress corresponding to the text content;
[0009] If the text reading progress indicated by the reading progress indicator does not change within a preset time period, displaying resource recommendation information, wherein the resource recommendation information is used to indicate multimedia resources, and the multimedia resources are multimedia resources associated with the displayed text content;
[0010] In response to a resource display operation on the text display interface, the multimedia resource indicated by the resource recommendation information is displayed.
[0011] In another aspect, a method for displaying multimedia resources is provided, the method being executed by a server and comprising:
[0012] receiving first content sent by a terminal, the first content being text content in a text to be read displayed on a text display interface of the terminal, the text display interface displaying a reading progress indicator for indicating a text reading progress corresponding to the displayed text content, the terminal being configured to send the first content if the text reading progress indicated by the reading progress indicator does not change within a preset time period;
[0013] Searching based on the first content to obtain multimedia resources associated with the first content;
[0014] The multimedia resource is sent to a terminal, and the terminal is configured to display resource recommendation information indicating the multimedia resource.
[0015] In another aspect, a multimedia resource display device is provided, the device being deployed on a terminal and comprising:
[0016] A content display module, configured to display the text content of a text to be read on a text display interface, wherein a reading progress indicator is displayed on the text display interface, wherein the reading progress indicator is used to indicate the text reading progress corresponding to the text content;
[0017] an information display module, configured to display resource recommendation information if the text reading progress indicated by the reading progress indicator does not change within a preset time period, wherein the resource recommendation information is used to indicate multimedia resources, and the multimedia resources are multimedia resources associated with the displayed text content;
[0018] The resource display module is configured to display the multimedia resources indicated by the resource recommendation information in response to a resource display operation on the text display interface.
[0019] In another aspect, a multimedia resource display device is provided, the device being deployed on a server and comprising:
[0020] a receiving module, configured to receive first content sent by a terminal, wherein the first content is text content in a text to be read displayed on a text display interface of the terminal, wherein a reading progress indicator is displayed on the text display interface, indicating a text reading progress corresponding to the displayed text content, and the terminal is configured to send the first content if the text reading progress indicated by the reading progress indicator does not change within a preset time period;
[0021] a search module, configured to search based on the first content to obtain multimedia resources associated with the first content;
[0022] The sending module is used to send the multimedia resource to the terminal, and the terminal is used to display resource recommendation information indicating the multimedia resource.
[0023] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory is used to store at least one program, and the at least one program is loaded and executed by the processor to implement the multimedia resource display method in the embodiment of the present application.
[0024] On the other hand, a computer-readable storage medium is provided, in which at least one program is stored. The at least one program is loaded and executed by a processor to implement the multimedia resource display method in the embodiment of the present application.
[0025] On the other hand, a computer program product is provided, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium. The processor of a computer device reads the at least one program segment from the computer-readable storage medium, and the processor executes the at least one program segment, so that the computer device executes the multimedia resource display method or the multimedia resource display method described in any of the above-mentioned implementation methods.
[0026] The present application provides a method for displaying multimedia resources. The method displays the text content of the text to be read on a text display interface while a subject is reading a text. The text display interface also displays a reading progress indicator, which indicates the text reading progress corresponding to the displayed text content. That is, if the text reading progress indicated by the reading progress indicator remains unchanged, it means that the text content being read by the subject has not changed. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, it means that the subject has been viewing the currently displayed text content, that is, the subject is interested in the currently displayed text content. At this time, resource recommendation information is displayed to remind the subject that multimedia resources associated with the currently displayed text content are recommended. After the subject performs an interactive operation, the subject can view the recommended multimedia resources without having to switch to other interfaces to search for related multimedia resources, thereby improving interaction efficiency. In addition, the method determines the content of interest to the subject based on the subject's reading behavior, so that the determined content of interest is accurate, and then recommends multimedia resources related to the content of interest to the subject, thereby improving the accuracy of multimedia resource recommendations. This method improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0028] FIG1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;
[0029] FIG2 is a flowchart of a method for displaying multimedia resources provided in an embodiment of the present application;
[0030] FIG3 is a flowchart of another method for displaying multimedia resources provided in an embodiment of the present application;
[0031] FIG4 is a flowchart of another method for displaying multimedia resources provided in an embodiment of the present application;
[0032] FIG5 is a schematic diagram of a text display interface provided in an embodiment of the present application;
[0033] FIG6 is a schematic diagram of another text display interface provided in an embodiment of the present application;
[0034] FIG7 is a schematic diagram of an interface for displaying multimedia resources provided in an embodiment of the present application;
[0035] FIG8 is a schematic diagram of another interface for displaying multimedia resources provided in an embodiment of the present application;
[0036] FIG9 is a schematic diagram of another interface for displaying multimedia resources provided in an embodiment of the present application;
[0037] FIG10 is an interface flow chart of an interactive process of a navigation bar provided in an embodiment of the present application;
[0038] FIG11 is a flowchart of another method for displaying multimedia resources provided in an embodiment of the present application;
[0039] FIG12 is a flowchart of another method for displaying multimedia resources provided in an embodiment of the present application;
[0040] FIG13 is a flowchart of another method for displaying multimedia resources provided in an embodiment of the present application;
[0041] FIG14 is a block diagram of a multimedia resource display device provided in an embodiment of the present application;
[0042] FIG15 is a block diagram of a multimedia resource display device provided in an embodiment of the present application;
[0043] FIG16 is a block diagram of a terminal provided in an embodiment of the present application;
[0044] Figure 17 is a block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0045] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.
[0046] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor is there any limitation on the quantity and execution order.
[0047] In the present application, the term "at least one" means one or more, and the term "plurality" means two or more.
[0048] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the subject's line of sight, historical reading information, reading preference information, etc. involved in this application are all obtained with full authorization.
[0049] The following is an introduction to the implementation environment involved in this application:
[0050] The multimedia resource display method provided in the embodiment of the present application can be executed by a computer device, which can be provided as a server or a terminal. The following is a schematic diagram of the implementation environment of the multimedia resource display method provided in the embodiment of the present application.
[0051] Refer to Figure 1, which is a schematic diagram of the implementation environment of a multimedia resource display method provided in an embodiment of the present application, and the implementation environment includes a terminal 101 and a server 102. The terminal 101 and the server 102 can be directly or indirectly connected through wired or wireless communication, and the present application does not limit this. In some embodiments, the terminal 101 is used to display a text display interface and perform text display on the text display interface; further, the terminal 101 is also used to display multimedia resources associated with the displayed text content on the text display interface. The server 102 is used to provide background services for the terminal 101 to display text and multimedia resources. In some embodiments, a search application is installed on the terminal 101, and the text display interface is an interface in the search application. The server 102 is a background server of the search application, which is used to provide background services for the search application, so that based on the powerful search capabilities of the search application, rich and accurate multimedia resources can be provided to the terminal 101.
[0052] In some embodiments, a reading application for text reading is installed on the terminal 101. For example, the reading application is a book reader, a novel reader, an e-book reader, etc. Furthermore, these readers also have a reading progress indication function. For example, during the use of these readers, a reading progress indication is displayed on the text display interface, and the reading progress indication is used to indicate the current reading progress of the text. Furthermore, the reading application also has a search function for multimedia resources, so that during the process of the reading application performing text reading, multimedia resources related to the text content are recommended through the search function. Alternatively, the reading application is communicated with the search application, so that during the process of the reading application performing text reading, multimedia resources related to the text content are recommended to the reading application through the search application.
[0053] In some embodiments, the terminal 101 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc., but is not limited thereto. In some embodiments, the server 102 is an independent server or a server cluster or distributed system composed of multiple servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, the server 102 is primarily responsible for computing tasks, and the terminal 101 is responsible for secondary computing tasks; alternatively, the server 102 is responsible for secondary computing services, and the terminal 101 is responsible for primary computing tasks; alternatively, the server 102 and the terminal 101 use a distributed computing architecture for collaborative computing.
[0054] Refer to Figure 2, which is a flowchart of a method for displaying multimedia resources provided in an embodiment of the present application. The method is executed by a terminal and includes the following steps.
[0055] 201. The terminal displays the text content of the text to be read on the text display interface, and a reading progress indicator is displayed on the text display interface, where the reading progress indicator is used to indicate the text reading progress corresponding to the text content.
[0056] The text to be read is the text that the object needs to read. The text to be read can be very long or very short. When the text to be read is very long, the text content displayed on the text display interface can be part of the text to be read; when the text to be read is very short, the text content displayed on the text display interface can be the entire content of the text to be read. The embodiment of the present application will mainly be described by taking the example of the text content displayed on the text display interface being part of the text to be read.
[0057] To prevent the reading progress indicator from obscuring the displayed text content, the reading progress indicator is displayed in the border area of the text display interface. Furthermore, the display position of the reading progress indicator on the text display interface changes as the text reading progress changes. For example, the reading progress indicator is displayed in the right border area of the text display interface. The closer the text reading progress is, the higher the display position of the reading progress indicator is, and the later the text reading progress is, the lower the display position of the reading progress indicator is.
[0058] In the embodiment of the present application, the reading progress indication may be text information or a navigation bar, and the display position of the navigation bar is used to indicate the text reading progress corresponding to the displayed content.
[0059] In this embodiment, the reading progress indicator is a navigation bar as an example for description. The navigation bar is displayed in the border area of the text display interface. Further, the navigation bar is displayed on the left side or the right side of the border area.
[0060] In an embodiment of the present application, when the text to be read is very long, the text display interface displays only part of the text to be read. In this case, the text display interface can switch the content of the displayed text based on a content switching operation. The content switching operation can be an upward swipe operation, a downward swipe operation, a left swipe operation, a right swipe operation, or a click operation. In this embodiment, the content switching operation is described as an upward swipe operation or a downward swipe operation.
[0061] In an embodiment of the present application, the closer the text content currently displayed on the text display interface is to the front of the text to be read, the higher the navigation bar is displayed on the text display interface. The navigation bar's display position changes in response to content switching operations. For example, in response to an upward swipe operation on the text display interface, the navigation bar's display position moves upward; in response to a downward swipe operation on the text display interface, the navigation bar's display position moves downward.
[0062] 202. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, the terminal displays resource recommendation information, where the resource recommendation information is used to indicate multimedia resources, which are multimedia resources associated with the displayed text content.
[0063] In an embodiment of the present application, in response to the terminal not detecting a content switching operation on the text display interface within a preset time period, it is determined that the text reading progress indicated by the reading progress indicator has not changed. When the text to be read is very long and a portion of the text to be read is displayed on the text display interface, the terminal does not detect a content switching operation on the text display interface within the preset time period, which means that the text content displayed on the text display interface has not changed.
[0064] In some embodiments, the display position of the reading progress indicator changes as the text reading progress changes. Accordingly, whether the text reading progress has changed can be determined based on whether the display position of the reading progress indicator has changed. For example, if the reading progress indicator is a navigation bar, then if the text reading progress indicated by the reading progress indicator has not changed, the display position of the navigation bar has not changed.
[0065] If the reading progress indicator is text information, such as 50%, then the fact that the text reading progress indicated by the reading progress indicator has not changed means that the text information of the reading progress indicator has not changed.
[0066] In other embodiments, the reading progress indicator is a navigation bar, and text indicating the text reading progress is displayed on the navigation bar.
[0067] In an embodiment of the present application, the multimedia resource is obtained by searching based on the text content. For example, the multimedia resource is obtained by searching based on the text content through a search application.
[0068] In an embodiment of the present application, the terminal displays resource recommendation information to prompt the text display interface to recommend multimedia resources associated with the currently displayed content.
[0069] In a possible implementation, the resource recommendation information may be displayed on the reading progress indicator, thereby reducing the extra space occupied by the resource recommendation information and avoiding obstruction of the displayed text content.
[0070] 203. In response to the resource display operation on the text display interface, the terminal displays the multimedia resources indicated by the resource recommendation information.
[0071] In the embodiment of the present application, the terminal can display multimedia resources on the text display interface, or can display multimedia resources after jumping to other interfaces. In this embodiment, the example of displaying multimedia resources on the text display interface is used for explanation.
[0072] The present application provides a method for displaying multimedia resources. The method displays the text content of the text to be read on a text display interface while a subject is reading a text. The text display interface also displays a reading progress indicator, which indicates the text reading progress corresponding to the displayed text content. That is, if the text reading progress indicated by the reading progress indicator remains unchanged, it means that the text content being read by the subject has not changed. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, it means that the subject has been viewing the currently displayed text content, that is, the subject is interested in the currently displayed text content. At this time, resource recommendation information is displayed to remind the subject that multimedia resources associated with the currently displayed text content are recommended. After the subject performs an interactive operation, the subject can view the recommended multimedia resources without having to switch to other interfaces to search for related multimedia resources, thereby improving interaction efficiency. In addition, the method determines the content of interest to the subject based on the subject's reading behavior, so that the determined content of interest is accurate, and then recommends multimedia resources related to the content of interest to the subject, thereby improving the accuracy of multimedia resource recommendations. This method improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations.
[0073] In an embodiment of the present application, the terminal obtains the content read by the object on the terminal (that is, the text content displayed on the text display interface) after obtaining the object's authorization. Among them, the authorization interface is displayed on the terminal used by the object, and the authorization interface displays prompt information, an agreement control, and a disagreement control. The prompt information is used to indicate that the object has obtained the content read on the terminal. The agreement control is used to indicate that the object agrees that the terminal obtains the content it reads on the terminal. In response to the triggering operation of the agreement control, the terminal obtains the content read by the object on the terminal.
[0074] The above embodiment based on Figure 2 describes the process of displaying multimedia resources using a terminal as the execution entity. The following embodiment describes the process of displaying multimedia resources using a server as the execution entity. Referring to Figure 3, Figure 3 is a flowchart of a method for displaying multimedia resources provided in an embodiment of the present application. The method is executed by the server and includes the following steps.
[0075] 301. The server receives first content sent by the terminal. The first content is text content in the text to be read displayed on the text display interface of the terminal. A reading progress indicator is displayed on the text display interface to indicate the text reading progress corresponding to the displayed text content. The terminal is configured to send the first content when the text reading progress indicated by the reading progress indicator does not change within a preset time period.
[0076] In the embodiment of the present application, the text display interface, reading progress indicator, etc. in step 301 are the same as those in step 201 and will not be repeated here.
[0077] 302. The server searches based on the first content to obtain multimedia resources associated with the first content.
[0078] In an embodiment of the present application, the server may perform a search based on a search server. The relevance between the multimedia resource and the first content is greater than a relevance threshold.
[0079] 303. The server sends the multimedia resource to the terminal, and the terminal is used to display resource recommendation information indicating the multimedia resource.
[0080] In the embodiment of the present application, the process of displaying multimedia resources by the terminal is the same as the above steps 202-203, which will not be repeated here.
[0081] The present application provides a method for displaying multimedia resources. The method displays the text content of the text to be read on a text display interface while a subject is reading a text. The text display interface also displays a reading progress indicator, which indicates the text reading progress corresponding to the displayed text content. That is, if the text reading progress indicated by the reading progress indicator remains unchanged, it means that the text content being read by the subject has not changed. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, it means that the subject has been viewing the currently displayed text content, that is, the subject is interested in the content of the currently displayed text content. At this time, the subject sends the text content of interest, that is, first content, to a server, so that the server searches based on the first content to obtain relevant multimedia resources, and then returns them to the terminal for display. This method eliminates the need for the subject to switch to other interfaces to search for relevant multimedia resources, thereby improving interaction efficiency. In addition, the method determines the content of interest to the subject based on the subject's reading behavior, so that the determined content of interest is accurate, and then recommends multimedia resources related to the content of interest to the subject, thereby improving the accuracy of multimedia resource recommendations. This method improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations.
[0082] The above embodiments of Figures 2 and 3 briefly introduce the method for displaying multimedia resources. The following embodiment of Figure 4 further explains the method for displaying multimedia resources in detail. Referring to Figure 4, Figure 4 shows a method for displaying multimedia resources provided by an embodiment of the present application. The method is described using the interaction between a terminal and a server as an example. The method includes the following steps.
[0083] 401. The terminal displays the text content of the text to be read on the text display interface, and a reading progress indicator is displayed on the text display interface, where the reading progress indicator is used to indicate the text reading progress corresponding to the text content.
[0084] In some embodiments, in response to an entry operation on a text display interface, the terminal enters the text display interface. The entry operation on the text display interface can be set and modified as needed. For example, the terminal displays an entry control for a text display interface. In response to a triggering operation on the text display interface, the terminal displays the text display interface. For another example, the terminal displays a text cover with text. In response to a triggering operation on the text cover, the terminal displays the text display interface.
[0085] In this embodiment, the reading progress indicator is a navigation bar as an example for description. The shape and size of the navigation bar can be set and changed as needed. The navigation bar is a strip structure, and its length and width can be set and changed as needed.
[0086] For example, see Figure 5, which is a schematic diagram of a text display interface provided by an embodiment of the present application. In which, a navigation bar 501 is displayed on the right side of the text display interface.
[0087] 402. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, the terminal determines a first content from the text content.
[0088] In some embodiments, the display position of the reading progress indicator changes as the text reading progress changes. In this embodiment, the reading progress indicator is described as a navigation bar. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, the text reading progress indicated by the navigation bar does not change within the preset time period.
[0089] In the embodiment of the present application, the preset duration can be set and changed as needed. For example, the preset duration is 1 second.
[0090] In an embodiment of the present application, the process of the terminal determining to send the first content to the server based on the text content includes at least one of the following three implementation methods.
[0091] In one implementation, the terminal determines the displayed text content as the first content. In this implementation, directly determining the text content as the first content, that is, further determining the multimedia resource based on all the content displayed on the text display interface, can improve the richness and diversity of the multimedia resources.
[0092] In another implementation, the terminal determines the content corresponding to the display position of the reading progress indicator in the text content as the first content. In this implementation, if a reading progress indicator is provided on the text display interface, the content the subject is reading is generally the content corresponding to the display position of the reading progress indicator. This text content is then used as the first content to determine the multimedia resource, thereby making the multimedia resource recommendations for the subject more accurate.
[0093] In another implementation, the terminal determines the content corresponding to the object's line of sight based on line of sight detection. If the content corresponding to the object's line of sight belongs to the content corresponding to the display position of the reading progress indicator, the content corresponding to the object's line of sight is determined as the first content.
[0094] If the content corresponding to the subject's line of sight does not correspond to the content corresponding to the display position of the reading progress indicator, the content corresponding to the display position of the reading progress indicator in the text content is determined as the first content. Optionally, the terminal performs line of sight detection using a front camera.
[0095] In this implementation, the content read by the object is further determined based on the object's line of sight, which further improves the accuracy of the first content, and thus the multimedia resources recommended to the object are more accurate.
[0096] In an embodiment of the present application, the content corresponding to the display position of the reading progress indication is determined by the following steps: the terminal determines the target area corresponding to the display position of the reading progress indication, and uses the content in the target area as the content corresponding to the display position of the reading progress indication.
[0097] The terminal determines the positions of the two vertices of the reading progress indicator, and uses the two vertices as starting points to delay a line toward the other boundary of the text display interface opposite the display position of the reading progress indicator until it reaches the other boundary, thereby obtaining two parallel straight lines. The area between the two straight lines is defined as the target area. The other two boundaries of the target area are the boundaries of the text.
[0098] In some embodiments, the terminal further performs eye gaze detection. If it is determined through eye gaze detection that the subject's eye gaze remains on the text display interface, and the text reading progress indicated by the reading progress indicator has not changed within a preset time period, the terminal determines the first content from the text content. Accordingly, if the text reading progress indicated by the reading progress indicator has not changed within a preset time period, the terminal displays resource recommendation information on the reading progress indicator, including the following steps: if it is determined through eye gaze detection that the subject's eye gaze remains on the text display interface, and the text reading progress indicated by the reading progress indicator has not changed within a preset time period, the terminal displays the resource recommendation information.
[0099] In this embodiment, when the object's gaze stays on the text display interface, it means that the object is indeed reading the content displayed on the text display interface at this time. In this way, when the object's gaze stays on the text display interface for a long time, multimedia resources are recommended to the object, which further improves the accuracy of recommending multimedia resources to the object and avoids waste of resources.
[0100] 403. The terminal sends the first content to the server.
[0101] In an embodiment of the present application, the terminal may compress the first content and send it to the server. The server is configured to determine multimedia resources based on the first content.
[0102] 404. The server receives the first content sent by the terminal.
[0103] In the embodiment of the present application, the server is configured to search for multimedia resources based on the first content.
[0104] 405. The server determines a type tag of the to-be-read text based on the first content and extracts key information from the first content.
[0105] The type tag of the text to be read is used to indicate the genre of the text to be read, such as indicating that the text to be read is a news report, an expository article, an argumentative article, etc. Alternatively, the type tag of the text to be read is used to indicate the field to be read, such as indicating that the text to be read is a scientific article. Furthermore, the type tag of the text to be read can indicate both of the above, and is not specifically limited here.
[0106] In an embodiment of the present application, the first content may be a paragraph, a sentence, or a word. Optionally, if the first content is a word, the word is used as key information. If the first content is a sentence, the sentence is split, and the multiple words obtained by splitting are used as key information respectively. If the first content is a paragraph, the paragraph is split, and the multiple sentences obtained are used as key information respectively, and the multiple sentences are split, and the multiple words obtained are used as key information respectively.
[0107] In some embodiments, the server further screens the split sentences and words, selecting sentences or words that meet a target condition as key information. For example, the target condition can be the subject's preferred content as indicated by the subject's reading preference information, or the number of searches for a sentence or word reaching a search threshold, or a combination of the two, which is not specifically limited here.
[0108] In other embodiments, the terminal itself determines the type label of the text to be read based on the first content and extracts key information from the first content, and sends the type label and key information to the server.
[0109] In other embodiments, the server obtains the entire content of the text to be read, and then determines the type tag of the text to be read based on the entire content of the text to be read. Furthermore, the terminal sends the location of the first content to the server, and the server determines the first content based on the obtained text and location.
[0110] 406. The server searches based on the type tag and key information to obtain multimedia resources associated with the first content.
[0111] In an embodiment of the present application, the server can use the type tag and key information as search conditions to search separately, obtaining multimedia resources corresponding to the type tag and key information respectively. Alternatively, the server can also use the type tag and key information as a comprehensive search condition to search, obtaining multimedia resources corresponding to both the type tag and key information. For example, the comprehensive search condition C1 can be C1 = tag + A01, A02, A03..., where A01, A02, and A03 each represent a type of key information.
[0112] In another implementation, if there are multiple key information, the server combines each key information with a type tag to obtain multiple search conditions; or, alternatively, combines at least two of the multiple key information and type tags to obtain multiple search conditions. The server then searches based on the multiple search conditions to obtain multimedia resources corresponding to the multiple search conditions.
[0113] In some embodiments, the server searches based on the type tag and key information to obtain multimedia resources associated with the first content, including the following steps: the server searches based on the type tag and key information to obtain candidate multimedia resources. The server determines the multimedia resources based on the candidate multimedia resources in the following implementations.
[0114] In one implementation, the server determines the relevance between a candidate multimedia resource and the first content. If the relevance between the candidate multimedia resource and the first content exceeds a first relevance threshold, the server identifies the candidate multimedia resource as a multimedia resource associated with the first content. In this implementation, multimedia resources with a greater content relevance to the content of interest to the subject are identified as relevant resources, thereby improving the accuracy of the multimedia resources.
[0115] In another implementation, the server determines the type tag corresponding to the candidate multimedia resource and extracts key information from the candidate multimedia resource. If the correlation between the type tag and key information corresponding to the candidate multimedia resource and the type tag and key information corresponding to the first content exceeds a second correlation threshold, the candidate multimedia resource is identified as a multimedia resource associated with the first content. In this implementation, multimedia resources with a greater correlation between the type tag and key information and the content of interest are identified as related resources, thereby improving the accuracy of the multimedia resources.
[0116] In another implementation, if the correlation between the candidate multimedia resource and the first content is greater than a first correlation threshold, and if the correlation between the type label and key information corresponding to the candidate multimedia resource and the type label and key information corresponding to the first content is greater than a second correlation threshold, the candidate multimedia resource is treated as a multimedia resource associated with the first content.
[0117] In this embodiment, there may be multiple candidate multimedia resources. Based on the above steps, the multiple candidate multimedia resources are judged separately to determine whether they are multimedia resources associated with the first content.
[0118] In the embodiment of the present application, the first correlation threshold and the second correlation threshold are the same or different. In this embodiment, the first correlation threshold and the second correlation threshold are the same as an example for description, such as both are 90%.
[0119] In some embodiments, the process in which the server searches based on type tags and key information to obtain multimedia resources associated with the first content includes the following steps: the server searches based on type tags and key information to obtain multiple candidate multimedia resources; the server obtains the number of interactions of each of the multiple candidate multimedia resources; the server determines the multimedia resource associated with the first content from the multiple candidate multimedia resources based on the number of interactions of each of the multiple candidate multimedia resources.
[0120] Among them, the number of interactions of the candidate multimedia resources refers to the number of times the object corresponds to at least one type of interaction with the candidate multimedia resources, and multiple interaction types include searching, browsing, sharing, liking and commenting; accordingly, the number of interactions includes at least one of the number of searches, browsing, sharing, likes and comments of the candidate multimedia resources.
[0121] Optionally, the server selects a candidate multimedia resource ranked in a front preset position in the order of the number of interactions among the multiple candidate multimedia resources as the multimedia resource associated with the first content. Alternatively, the server selects a candidate multimedia resource with an interaction number exceeding a threshold among the multiple candidate multimedia resources as the multimedia resource associated with the first content.
[0122] Optionally, multiple interaction types have priorities, such as search count > view count > share count > like count > comment count. If data for a certain interaction type of a candidate multimedia resource is missing, the server sorts the candidate multimedia resources according to the above priorities to screen the multimedia resources.
[0123] In this embodiment, a large number of interactions with a multimedia resource indicates that the multimedia resource is a hot topic. Therefore, recommending such a multimedia resource to the subject can increase the subject's interest, meet the subject's needs, and thus improve the user experience.
[0124] In some embodiments, the server determines multimedia resources by combining the two aforementioned embodiments. Alternatively, the server first determines multiple multimedia resources from a plurality of candidate multimedia resources based on the number of interactions. Then, based on the relevance corresponding to each of the plurality of target multimedia resources, the server determines the multimedia resources associated with the first content. Alternatively, the server first selects the multimedia resources based on the relevance, then selects the multimedia resources based on the number of interactions.
[0125] In this embodiment of the present application, steps 405-406 are used to perform a search based on the first content and obtain multimedia resources associated with the first content. In this embodiment, information is extracted from the first content to obtain text type and key information, thereby making the search more accurate, avoiding interference from invalid information, and improving search efficiency by reducing the amount of information.
[0126] It should be noted that the above steps 405-406 are only one optional implementation method of the process, and the process can also be implemented through other optional implementation methods, such as directly searching based on the first content, which will not be repeated here.
[0127] 407. The server sends the multimedia resource to the terminal.
[0128] In some embodiments, the server further determines resource recommendation information based on the quantity and type of multimedia resources, and sends the resource recommendation information and the multimedia resources to the terminal, thereby facilitating the terminal to display the resource recommendation information.
[0129] In some embodiments, the server only sends resource recommendation information to the terminal. In response to a resource display operation on the resource recommendation information, the terminal obtains the multimedia resource indicated by the resource recommendation information from the server.
[0130] 408. The terminal receives the multimedia resource returned by the server, and displays resource recommendation information indicating the received multimedia resource on the reading progress indicator.
[0131] In some embodiments, the resource recommendation information includes the type of multimedia resource and the number of multimedia resources of each type. Further, the resource recommendation information also indicates the first content, such as the resource recommendation information includes "recommendation result of **".
[0132] The type of multimedia resource includes at least one of video, image, text and audio. The type of multimedia resource included in the resource recommendation information is a type name, or an icon element (icon) corresponding to the type.
[0133] In an embodiment of the present application, the terminal determines resource recommendation information based on the quantity and type of multimedia resources.
[0134] In some embodiments, the process of displaying resource recommendation information on the reading progress indicator by the terminal includes at least one of the following implementation methods.
[0135] In one implementation, the terminal displays a modified reading progress indicator, and displays resource recommendation information on the modified reading progress indicator. The modified style includes at least one of color, size, and shape. In this implementation, by modifying the reading progress indicator's style and providing a visual reminder of the difference, the user is informed that a new multimedia resource has been recommended. This modified reading progress indicator attracts the user's attention and serves as an effective reminder.
[0136] In another implementation, the terminal displays a resource component in an area adjacent to the reading progress indicator, and displays resource recommendation information on the resource component. In this implementation, by displaying the resource component and displaying the resource recommendation information on the resource component, the resource recommendation information avoids blocking the reading progress indicator, making the interface display more neat.
[0137] The resource component may be a user interface (UI) bubble, which includes a bottom UI and resource recommendation information. The adjacent area may be the upper, lower, left, and right areas of the reading progress indicator, which is not specifically limited here.
[0138] In some embodiments, at least one of the following implementations is also included.
[0139] In one implementation, the terminal highlights the first content. The highlighting method includes at least one of highlighting the first content, framing the first content, bolding text within the first content, underlining the first content, and adding a shading to the first content, which is not specifically limited herein. In this implementation, highlighting the first content facilitates further confirmation by the subject, allowing the subject to further understand the content indicated by the resource recommendation information, thereby increasing the richness of the information output and thereby improving the user experience.
[0140] In another implementation, the terminal displays a connecting line on the text display interface, with the ends of the connecting line pointing to the first content and the reading progress indicator, respectively. In this implementation, by displaying the connecting line, a visual association is achieved between the first content and the reading progress indicator, improving the visual display effect and promoting the viewing of multimedia resources.
[0141] In an embodiment of the present application, the terminal may execute at least one of the above implementations on the first content after determining the first content, or may execute at least one of the above implementations when the terminal displays resource recommendation information.
[0142] For example, see Figure 6, which is a schematic diagram of a text display interface provided by an embodiment of the present application. Here, the reading progress indicator is illustrated as a navigation bar. A navigation bar 601 is displayed on the text display interface, and the style of the navigation bar changes. The text display interface also displays a resource component, which displays resource recommendation information 602. The text display interface also displays a highlight box 603 for the first content and a connecting line 604.
[0143] In an embodiment of the present application, resource recommendation information is displayed on the navigation bar to inform the subject that there is more relevant content to view. This method undoubtedly increases the subject's motivation to continue watching. The side navigation bar can aggregate and display more recommended content on the navigation bar in real time based on the subject's reading content.
[0144] In this embodiment of the present application, steps 402-408 are used to implement the process of displaying resource recommendation information on the reading progress indicator. In this embodiment, the content currently being read by the subject is sent to the server, which then determines the relevant multimedia resources. This reduces the service pressure on the terminal, and because the server has strong service capabilities, it is able to obtain sufficiently rich and accurate multimedia resources.
[0145] It should be noted that the above steps 402-408 are only an optional implementation method for implementing the process, and the process can also be implemented through other optional implementation methods. For example, the terminal itself performs a search based on the first content.
[0146] 409. In response to the resource display operation on the text display interface, the terminal displays the multimedia resources indicated by the resource recommendation information.
[0147] In the embodiment of the present application, the process of the terminal displaying the multimedia resources indicated by the resource recommendation information in response to the resource display operation on the text display interface includes at least one of the following implementation methods.
[0148] In one implementation, in response to a triggering operation on resource recommendation information, the terminal displays multimedia resources. In this implementation, triggering resource recommendation information and then displaying the multimedia resources indicated by the resource recommendation information ensures the continuity of interaction and improves user experience.
[0149] In another implementation, in response to a sliding operation in a preset direction, the terminal displays multimedia resources. The preset direction can be set and modified as needed. In this embodiment, the preset direction is leftward. In this implementation, displaying multimedia resources through a sliding operation improves the convenience of interaction.
[0150] In some embodiments, the terminal displays a resource pop-up window on the text display interface, and displays multimedia resources on the resource pop-up window. Optionally, the resource pop-up window is displayed on a floating layer of the text display interface. In other embodiments, the terminal displays multimedia resources directly on the floating layer of the text display interface. In other embodiments, the terminal switches from the text display interface to the resource display interface, and displays multimedia resources on the resource display interface. Optionally, the resource display interface is a resource display interface displayed in response to a search operation, and information such as the source of the multimedia resources can also be displayed on the resource display interface.
[0151] For example, referring to Figure 7, Figure 7 is a schematic diagram of an interface for displaying multimedia resources provided by an embodiment of the present application. In response to a left swipe operation on the text display interface, the terminal displays the multimedia resources on a resource pop-up window.
[0152] In some embodiments, if there are multiple multimedia resources indicated by the resource recommendation information, in response to the resource display operation on the text display interface, the terminal displays a resource list, and the resource list includes resource covers of multiple multimedia resources; in response to the triggering operation on any resource cover, the terminal displays the multimedia resource corresponding to any resource cover.
[0153] It should be noted that if the multimedia resource is a video, the video playback interface will be displayed in response to the triggering operation on the resource cover. If the multimedia resource is text, the text details interface will be displayed in response to the triggering operation on the resource cover. If the multimedia resource is an image, the image details interface will be displayed in response to the triggering operation on the resource cover.
[0154] Optionally, in response to the resource display operation, the terminal displays a list pop-up window, and displays the resource list on the list pop-up window. Further, the list pop-up window is displayed on a floating layer of the text display interface. Alternatively, the terminal directly displays the resource list on the floating layer of the text display interface.
[0155] Optionally, in response to a triggering operation on the resource cover, the terminal displays a details pop-up window on the text display interface, displaying the multimedia resource in the details pop-up window. Optionally, the details pop-up window pops up from the bottom of the screen. Furthermore, the details pop-up window is displayed on a floating layer on the text display interface. The details pop-up window or floating layer also displays a return control, which is used to return to the resource pop-up window; alternatively, the return control is used to return to the text display interface to continue displaying the text content.
[0156] The multiple multimedia resources are arranged in a preset order on the resource list. Optionally, the multiple multimedia resources are arranged according to type priority, such as video > image > text > audio. Alternatively, if the multiple multimedia resources are determined based on relevance, the multimedia resource with a greater relevance is ranked higher. If the multiple multimedia resources are determined based on the number of interactions, the multimedia resource with a greater number of interactions is ranked higher.
[0157] In some embodiments, if the number of the multimedia resources is large and the resource covers of the multiple multimedia resources cannot be displayed simultaneously, the resource covers of the multiple multimedia resources are displayed in response to an up and down sliding operation on the resource list.
[0158] For example, referring to Figure 8, Figure 8 is a flow chart of displaying multimedia resources provided by an embodiment of the present application. Among them, resource recommendation information is displayed on the text display interface, such as the first picture from bottom to top in Figure 8. In response to the resource display operation, the terminal displays a list pop-up window on the text display interface, and displays the resource covers of multiple multimedia resources on the list pop-up window, such as the cover of video 1 and the cover of video 2 in the second picture from bottom to top in Figure 8. In response to the triggering operation of the video cover of a video in the multimedia resources, the terminal displays a details pop-up window and plays the video on the details pop-up window, such as the third picture from bottom to top in Figure 8. In response to the triggering operation of the video cover of an image in the multimedia resources, the terminal displays a details pop-up window and displays the detailed content of the image on the details pop-up window, such as the fourth picture from bottom to top in Figure 8.
[0159] It should be noted that if there is only one multimedia resource, the terminal directly displays the multimedia resource in response to the resource display operation on the text display interface. Alternatively, the terminal displays the resource cover of the multimedia resource and displays the multimedia resource in response to the trigger operation on the resource cover.
[0160] In the embodiment of the present application, the process of displaying multimedia resources is realized through the above steps 401-409. In some embodiments, after the terminal closes the displayed multimedia resources, it continues to display text, which is realized through the following step 410.
[0161] 410. In response to the resource closing operation on the text display interface, the terminal closes the resource pop-up window, continues to display the text content on the text display interface, and displays the multimedia resources on the resource pop-up window.
[0162] In some embodiments, the process of closing a resource pop-up window by the terminal in response to a resource closing operation on the text display interface includes the following steps: in response to the resource closing operation on the text display interface, the terminal displays a closing animation of the resource pop-up window, where the closing animation indicates the process of the resource pop-up window shrinking to the reading progress indicator. In this embodiment, by displaying a transition animation during the closing of the resource pop-up window, the interface display effect is improved.
[0163] Optionally, after the resource pop-up window is closed, the resource recommendation information continues to be displayed on the reading progress indicator, and then in response to the resource display operation again, the multimedia resource can be displayed again.
[0164] In some embodiments, the resource closing operation is a sliding operation in a target direction. In this embodiment, the target direction is upward as an example for illustration. In other embodiments, a close control is displayed on the resource pop-up window, and in response to a triggering operation on the close control, the terminal closes the resource pop-up window.
[0165] For example, refer to Figure 9, which is a flow chart of displaying multimedia resources provided by an embodiment of the present application. Among them, the reading progress indication is taken as an example for explanation. The terminal displays the text content of the text on the text display interface, such as the first picture from left to right in the three pictures in the first row of Figure 9. In response to the display position of the navigation bar not changing within the preset time length, resource recommendation information is displayed on the navigation bar, such as the second picture from left to right in the three pictures in the first row of Figure 9. In response to the left swipe operation, the video is played, and the left swipe operation is shown in the third picture from left to right in the three pictures in the first row of Figure 9, and the interface for playing the video is shown in the first picture from right to left in the three pictures in the second row of Figure 9. In response to the swipe-up operation, the video is closed and the text content of the text continues to be displayed on the text display interface. The swipe-up operation is shown in the second picture from right to left in the three pictures in the second row of Figure 9. The text content of the text continues to be displayed on the text display interface, as shown in the third picture from right to left in the three pictures in the second row of Figure 9.
[0166] For example, see Figure 10, which is an interface flow chart of an interactive process of a navigation bar provided by an embodiment of the present application. The navigation bar has different states in different situations, namely, normal state, recommended resource state, resource expanded state, and resource collapsed state.
[0167] The embodiment of FIG4 above describes a process for recommending multimedia resources to an object when the text reading progress indicated by the reading progress indicator does not change within a preset time period. The following embodiment based on FIG11 describes a process for recommending multimedia resources to an object based on the object's reading preferences. Referring to FIG11 , FIG11 is a method for displaying multimedia resources provided by an embodiment of the present application. The method is described using the interaction between a terminal and a server as an example, and the method includes the following steps.
[0168] 1101. In response to an entry operation on a text display interface, the terminal enters the text display interface, displays the text content of the text to be read on the text display interface, and displays a reading progress indicator on the text display interface, which is used to indicate the text reading progress corresponding to the text content.
[0169] In the embodiments of the present application, the entry operation for the text display interface can be set and modified as needed. For example, the terminal displays an entry control for the text display interface. In response to a triggering operation on the text display interface, the terminal displays the text display interface. For another example, the terminal displays a text cover with text. In response to a triggering operation on the text cover, the terminal displays the text display interface.
[0170] 1102. The terminal sends the text to be read to the server.
[0171] In the embodiment of the present application, after the terminal enters the text display interface and performs text display, the text to be read, that is, the entire content of the text to be read, is sent to the server.
[0172] 1103. The server receives the text to be read sent by the terminal, and determines the second content in the text to be read that matches the reading preference information of the object.
[0173] In this embodiment of the present application, the subject's reading preference information is derived based on the subject's historical reading information. The subject's reading preference information indicates the text content the subject prefers to read, such as the subject's preferred city, gender, content preferences, and reading habits. Content preferences may include preferred genres, fields, and so on.
[0174] In an embodiment of the present application, the terminal obtains the object's historical reading information after obtaining the object's authorization. In this case, an authorization interface is displayed on the terminal used by the object, and the authorization interface displays prompt information, an agreement control, and a disagreement control. The prompt information is used to indicate the acquisition of the object's historical reading information. The agreement control is used to indicate that the object agrees that the terminal agrees to obtain its historical reading information. In response to the triggering operation of the agreement control, the terminal obtains the object's historical reading information and sends it to the server. The server determines the reading preference information based on the historical reading information. Alternatively, after the terminal obtains the historical reading information, it determines the reading preference information based on the historical reading information and sends the reading preference information to the server.
[0175] 1104. The server searches based on the second content and obtains multimedia resources associated with the second content.
[0176] In the embodiment of the present application, the second content may be a paragraph, a sentence or a word. The process of the server searching based on the second content is similar to the process of searching based on the type tag and key information in step 406, and will not be repeated here.
[0177] 1105. The server determines the position of the second content in the text to be read, and sends the second content and the position of the second content to the terminal.
[0178] In the embodiment of the present application, based on the position of the second content in the text to be read, it can be determined whether the second content is located at a position corresponding to the display position of the reading progress indicator.
[0179] In other embodiments, the server sends the second content to the terminal, and the terminal determines the position of the second content in the to-be-read text based on the second content. Alternatively, the server sends the position of the second content to the terminal, and the terminal determines the second content based on the position of the second content.
[0180] 1106. If the text content displayed on the text display interface includes the second content, and the text content corresponding to the display position of the reading progress indicator includes the second content, the terminal sends a resource request to the server.
[0181] The resource request is used to request to obtain multimedia resources associated with the second content.
[0182] In this embodiment, if a reading progress indicator is set on the text display interface, the content read by the object is generally the text content corresponding to the display position of the reading progress indicator. Therefore, when the text content corresponding to the display position of the reading progress indicator includes the second content, the object is generally reading the second content at this time, and then the resource request is triggered at this time. At this time, multimedia resources can be recommended to the object, which matches the object's reading behavior of reading the second content, thereby ensuring the timing accuracy of resource recommendation.
[0183] In other embodiments, if the text content displayed on the text display interface includes the second content, the terminal sends a resource request to the server. In this embodiment, since the text content displayed on the text display interface includes the second content, the subject may be reading the second content at this time, thereby triggering the resource request. At this time, multimedia resources can be recommended to the subject, matching the subject's reading behavior of the second content, ensuring the timing and accuracy of the resource recommendation.
[0184] 1107. The server receives the resource request sent by the terminal, and returns multimedia resources associated with the second content to the terminal.
[0185] Optionally, the resource request carries a content identifier of the second content. The server obtains multimedia resources associated with the second content based on the content identifier and returns the multimedia resources to the terminal.
[0186] 1108. The terminal receives the multimedia resource returned by the server, and displays resource recommendation information indicating the received multimedia resource on the reading progress indicator.
[0187] In some embodiments, the terminal further performs at least one of the following implementations on the second content. After the terminal obtains the second content, the second content is highlighted. The terminal displays a connecting line on the text display interface, with the two ends of the connecting line pointing to the second content and the reading progress indicator, respectively. In an embodiment of the present application, the terminal may perform at least one of the above implementations on the second content after determining it, or may perform at least one of the above implementations when the terminal displays resource recommendation information.
[0188] 1109. In response to the resource display operation on the text display interface, the terminal displays the multimedia resources indicated by the resource recommendation information.
[0189] 1110. In response to the resource closing operation on the text display interface, the terminal closes the resource pop-up window, continues to display the text content on the text display interface, and displays the multimedia resources on the resource pop-up window.
[0190] In the embodiment of the present application, steps 1108-1110 are similar to steps 408-410 and are not described again here.
[0191] It should be noted that the above description uses the example of sending the entire text to the server in advance, and then having the server search for multimedia resources related to the content in the text. In this embodiment, the server pre-determines the second content in the entire text that matches the subject's reading preference information, and then pre-determines the multimedia resources associated with the second content. When the subject reads the second content, the terminal directly obtains the multimedia resources from the server without further searching, thereby improving the efficiency of obtaining multimedia resources, and thus improving the efficiency of displaying multimedia resources and improving timeliness.
[0192] In other embodiments, in response to a content switching operation on a text display interface, the terminal displays the text content of the text and sends the text content to a server. The server determines a third content in the text content that matches the reading preference information of the subject, and then determines a multimedia resource associated with the third content. The third content and its location are sent to the terminal. The terminal obtains the multimedia resource from the server in response to the position corresponding to the display position of the reading progress indicator including the location of the third content. In this embodiment, the server only needs to determine the multimedia resource based on the content that matches the reading preference information in the content displayed on the text display interface, and does not need to determine the multimedia resource based on the content that matches the reading preference information in the entire text. Since the subject may not read the entire content of the text, that is, the terminal may not display the entire content of the text, only the displayed content is processed, which can save resources.
[0193] It should be noted that the embodiment of FIG. 4 and the embodiment of FIG. 11 may be implemented in combination, thereby providing richer multimedia resources.
[0194] For example, see Figure 12, which is a logical flow chart for displaying multimedia resources provided by an embodiment of the present application. This flow is illustrated using a navigation bar as an example of a reading progress indicator. This logical flow involves interactions between the object, product, and server. On the object side, the object opens the text display interface using a gesture. The object can maintain its current browsing state, then detect the navigation bar's state and obtain resource recommendations to continue viewing recommended multimedia resources. On the product side, the terminal recognizes the gesture and detects whether the navigation bar remains in the current browsing state for greater than or equal to 1 second. This results in a navigation bar display position detection result. If this is greater than or equal to 1 second, meaning the object maintains its current browsing state, the terminal analyzes the currently displayed content and issues a search task to the server. The server then searches based on the current content and, further, searches based on the object's reading preferences. The terminal then displays the multimedia resources. If the server finds the multimedia resource, meaning the multimedia resource is successfully generated, the navigation bar with a modified style and the type and quantity of the multimedia resource are displayed. If generation fails, the navigation bar with a modified style and resource recommendations are not displayed. On the server side, the server is responsible for content extraction and multimedia resource generation. The server extracts the current content and then searches for related content. It then performs analysis and generation to obtain a generated result. The generated result is then matched for relevance. If the relevance is met, the generation is considered successful, and if not, the generation fails.
[0195] For example, see Figure 13, which is a logic flow chart for displaying multimedia resources provided by an embodiment of the present application. Here, the reading progress indicator is a navigation bar as an example for explanation. The logic process includes two parts: the object side and the product side. On the object side, the object browses the content, detects the position of the navigation bar, and continues to watch new recommended resources. On the product side, the viewing duration of the object is identified or the content corresponding to the display position of the navigation bar is determined based on historical reading information, and a real-time prompt of "more content" is given.
[0196] The method provided in the embodiments of the present application can be applied to the image-text reading scenario of a search application. By linking a side navigation bar with the text content, where the navigation bar can correspond to an entire paragraph, multiple lines of content, etc., information is linked and recommended. This navigation bar + text linkage display method creates a seamless experience mode for continuous consumption while reading. In this case, the terminal detects the length of time the subject stays on the text display interface to determine whether a certain paragraph or keyword in the text can stimulate the subject's interest to a certain extent. In addition, based on the subject's historical reading information, the subject's reading preferences, such as categories of interest and preferences, are obtained. If the first two conditions are met, the navigation bar displays information in an overlay, and the subject can interact by swiping sideways to view related resources. The embodiments of the present application use a comprehensive experience method of gaze detection + subject preference analysis + navigation bar interaction + more content recommendation to timely recommend and display more relevant content that the subject is interested in, thereby quickly reducing the subject's cost of obtaining information, greatly improving the matching accuracy of recommendation words, improving the effective access efficiency of the search application's existing information, improving the efficiency of resource acquisition, and significantly improving user experience and user stickiness.
[0197] The method provided by the embodiment of the present application improves the timeliness, accuracy and interactivity of the interaction of recommended content from the following aspects. In terms of the matching degree of more content, backed by the massive content of the search application, it focuses on the current real-time recommendation demands of the object, and displays recommended content to the user more quickly, with high quality and accuracy based on the content that the object may like. In terms of interactive experience, the product is designed in a sliding-to-experience way. When the side navigation bar displays the aggregated information component (tips), the object can expand the current recommended resources by swiping left, and continue to swipe up to display the recommended resources. After reading, the navigation bar can be seamlessly retracted to continue to display the previous text, and the reading habit will be more coherent and natural. In the user's mind, the cost of obtaining more relevant resources can be greatly reduced, so that the application can meet the psychological expectations generated by the object in real time, and greatly enhance the pleasure of the resource experience process. Moreover, through this method, the average usage time of the product can be greatly improved, and the user's usage stickiness can be greatly improved. This approach focuses on interactive recommendations and the consumer experience for text reading within search apps. By understanding the user's viewing time and historical reading history, it aggregates "More Content" in a side navigation bar in real time. Through gesture interaction, the user can complete an immersive consumption experience of recommended content. Based on a "understanding-recommendation-interactive consumption" content recommendation approach, this approach achieves a new form of content interaction in terms of content matching and interactive experience, allowing users to seamlessly and continuously consume content of interest, significantly enhancing the product content consumption experience.
[0198] The method provided in the embodiment of the present application can be summarized into three stages: timing determination, interest anchoring, and data analysis. Timing determination includes: determining the text position of the navigation bar in real time, and determining the object's residence time in the current content (including: paragraphs, sentences, keywords, etc.) in real time. If it is greater than or equal to 1 second, it is determined that the object is relatively interested in this content, which can be used as the best time to extract key information. Interest anchoring includes: the server will analyze the reading preference information of the object, including: gender, city, hobbies, content preferences, consumption habits, etc., and obtain this information after analyzing historical reading information. Interest can be used as an important judgment criterion. When the object clicks into the text display interface, the interest keywords of the article will be scanned and compared with the reading preference information. When the content overlaps, a recommendation prompt will be displayed on the navigation bar. Data analysis includes: combining the previous two interactions and information acquisition to derive the corresponding content search conditions, and analyze and store them, and recommend and display them when the interaction node is reached.
[0199] The method provided in the embodiment of this application uses insights into the length of time a user spends viewing content, combined with sliding behavior and the status of the navigation bar, to display more content recommendations in the navigation bar. This creates an "understanding-recommendation-display" content recommendation method. This solution achieves a new form of content interaction in terms of the interactive experience of the navigation bar and the matching of recommendation results, allowing users to "seamlessly" continue to watch content they are interested in, significantly improving the product content consumption experience, and achieving beneficial effects including but not limited to several aspects.
[0200] First, new recommendations better align with the user's viewing expectations. In terms of content matching accuracy, search apps boast a vast amount of content. Focusing on the user's current, real-time needs, they can present more relevant recommendations more quickly, accurately, and with high quality, based on the content they might enjoy. Second, word-of-mouth (WMO) will be significantly improved. Regarding the interactive experience, product design will utilize a "sensory unification" approach. When a user's gaze remains on a piece of content for more than one second without swiping up, but engages in gaze, new recommendations will be seamlessly presented during the interaction. This will create a more consistent and natural reading experience, significantly reducing the user's cost of acquiring relevant information, fulfilling the platform and user's expectations of "real-time generation," and significantly increasing the user's enjoyment of the information experience. Third, product usage time will be significantly increased. In terms of product reputation and market feedback, this will significantly enhance product reputation, increase average usage time per user, and significantly improve user stickiness. Fourthly, the status of the navigation bar is updated in real time, and the attributes and quantity of related information are displayed in a timely manner, which makes it easier for the subject to form continuous cognition and thus form a mindset of continuous viewing. Whenever a change is seen, an expectation of clicking will be generated, which can greatly increase the length of time the subject continues to watch.
[0201] FIG14 is a block diagram of a multimedia resource display device according to an embodiment of the present application. Referring to FIG14 , the device includes:
[0202] The content display module 1401 is used to display the text content of the text to be read on the text display interface, and the text display interface displays a reading progress indicator, which is used to indicate the text reading progress corresponding to the text content;
[0203] The information display module 1402 is configured to display resource recommendation information if the text reading progress indicated by the reading progress indicator does not change within a preset time period, where the resource recommendation information indicates multimedia resources associated with the displayed text content.
[0204] The resource display module 1403 is configured to display the multimedia resources indicated by the resource recommendation information in response to a resource display operation on the text display interface.
[0205] In some embodiments, the information display module 1402 is used to:
[0206] Display resource recommendations on the reading progress indicator.
[0207] In some embodiments, the information display module 1402 is used to:
[0208] determining a first content from the text content;
[0209] Sending the first content to a server, where the server is configured to determine a multimedia resource based on the first content;
[0210] The multimedia resource returned by the server is received, and resource recommendation information indicating the received multimedia resource is displayed.
[0211] In some embodiments, the information display module 1402 is configured to perform at least one of the following:
[0212] Determine the text content as the first content;
[0213] Determining the content corresponding to the display position of the reading progress indicator in the text content as the first content;
[0214] The content corresponding to the object's gaze is determined based on the gaze detection. If the content corresponding to the object's gaze belongs to the content corresponding to the display position of the reading progress indicator, the content corresponding to the object's gaze is determined as the first content.
[0215] In some embodiments, the content display module is further configured to perform at least one of the following:
[0216] Highlight the first content;
[0217] A connecting line is displayed on the text display interface, with both ends of the connecting line pointing to the first content and the reading progress indicator respectively.
[0218] In some embodiments, the information display module 1402 is used to:
[0219] If it is determined through gaze detection that the subject's gaze remains on the text display interface, and the text reading progress indicated by the reading progress indicator does not change within a preset time period, resource recommendation information is displayed.
[0220] In some embodiments, the resource display module 1403 is used to:
[0221] If there are multiple multimedia resources indicated by the resource recommendation information, in response to a resource display operation on the text display interface, a resource list is displayed, the resource list including resource covers of the multiple multimedia resources;
[0222] In response to a triggering operation on any resource cover, the multimedia resource corresponding to any resource cover is displayed.
[0223] In some embodiments, the apparatus further comprises a determination module for determining second content in the text to be read, the second content being content in the text to be read that matches the reading preference information of the subject;
[0224] The information display module 1402 is also used to display resource recommendation information based on the second content if the text content displayed on the text display interface includes the second content, and the resource recommendation information is used to indicate multimedia resources associated with the second content; or, if the text content displayed on the text display interface includes the second content, and the text content corresponding to the display position of the reading progress indication includes the second content, display resource recommendation information based on the second content.
[0225] In some embodiments, the resource recommendation information includes the type of multimedia resources and the number of multimedia resources of each type.
[0226] In some embodiments, the resource display module 1403 is used to:
[0227] In response to a triggering operation on the resource recommendation information, displaying the multimedia resource;
[0228] Alternatively, in response to a sliding operation in a preset direction, multimedia resources are displayed.
[0229] In some embodiments, the multimedia resource is displayed on a resource pop-up window, and the apparatus further includes:
[0230] The closing module is used to respond to the resource closing operation on the text display interface, close the resource pop-up window, and continue to display the text content on the text display interface.
[0231] In some embodiments, the shutdown module is configured to:
[0232] In response to a resource closing operation on the text display interface, a closing animation of the resource pop-up window is displayed, where the closing animation is used to indicate a process of shrinking the resource pop-up window to a reading progress indicator.
[0233] In some embodiments, the information display module 1402 is configured to perform at least one of the following:
[0234] Displaying a changed style of the reading progress indicator, and displaying resource recommendation information on the changed reading progress indicator, where the style includes at least one of color, size, and shape;
[0235] A resource component is displayed in an area adjacent to the reading progress indicator, and resource recommendation information is displayed on the resource component.
[0236] The present invention provides a multimedia resource display device that displays the text content of the text to be read on a text display interface while a subject is reading a text. The text display interface also displays a reading progress indicator, which indicates the text reading progress corresponding to the displayed text content. That is, if the text reading progress indicated by the reading progress indicator remains unchanged, it means that the text content being read by the subject has not changed. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, it means that the subject has been viewing the currently displayed text content, that is, the subject is interested in the currently displayed text content. At this time, resource recommendation information is displayed to remind the subject that multimedia resources associated with the currently displayed text content are recommended. After the subject performs an interactive operation, the subject can view the recommended multimedia resources without having to switch to other interfaces to search for related multimedia resources, thereby improving interaction efficiency. In addition, the method determines the content of interest to the subject based on the subject's reading behavior, ensures that the determined content of interest is accurate, and then recommends multimedia resources related to the content of interest to the subject, thereby improving the accuracy of multimedia resource recommendations. This method improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations.
[0237] FIG15 is a block diagram of a multimedia resource display device according to an embodiment of the present application. Referring to FIG15 , the device includes:
[0238] Receiving module 1501, configured to receive first content sent by a terminal, where the first content is text content in a text to be read displayed on a text display interface of the terminal, where a reading progress indicator is displayed on the text display interface, indicating a text reading progress corresponding to the displayed text content, and the terminal is configured to send the first content if the text reading progress indicated by the reading progress indicator does not change within a preset time period;
[0239] A search module 1502 is configured to search based on the first content to obtain multimedia resources associated with the first content;
[0240] The sending module 1503 is configured to send the multimedia resource to the terminal, and the terminal is configured to display resource recommendation information indicating the multimedia resource.
[0241] In some embodiments, the search module 1502 is configured to:
[0242] determining a type label of the to-be-read text based on the first content and extracting key information from the first content;
[0243] A search is performed based on the type tag and the key information to obtain multimedia resources associated with the first content.
[0244] In some embodiments, the search module 1502 is configured to:
[0245] Search based on type tags and key information to obtain candidate multimedia resources;
[0246] determining a relevance between the candidate multimedia resource and the first content, and if the relevance between the candidate multimedia resource and the first content is greater than a first relevance threshold, treating the candidate multimedia resource as a multimedia resource associated with the first content;
[0247] Alternatively, determine the type tag corresponding to the candidate multimedia resource and extract the key information in the candidate multimedia resource; if the correlation between the type tag and key information corresponding to the candidate multimedia resource and the type tag and key information corresponding to the first content is greater than a second correlation threshold, the candidate multimedia resource is treated as a multimedia resource associated with the first content.
[0248] In some embodiments, the search module 1502 is configured to:
[0249] Search based on type tags and key information to obtain multiple candidate multimedia resources;
[0250] Obtaining the number of interactions of each of the plurality of candidate multimedia resources;
[0251] Based on the number of interactions of each of the multiple candidate multimedia resources, a multimedia resource associated with the first content is determined from the multiple candidate multimedia resources.
[0252] In some embodiments, the receiving module 1501 is further configured to receive a text to be read;
[0253] The apparatus further includes a determination module for determining second content in the to-be-read text that matches the reading preference information of the subject;
[0254] The search module 1502 is further configured to search based on the second content to obtain multimedia resources associated with the second content;
[0255] The determination module is further configured to determine a position of the second content in the text to be read, and to send the second content and the position of the second content to the terminal, wherein the terminal is configured to send a resource request if the position corresponding to the display position of the reading progress indicator includes the position of the second content;
[0256] The receiving module 1501 is further configured to receive a resource request sent by a terminal, and return multimedia resources associated with the second content to the terminal, so that the terminal displays the multimedia resources associated with the second content.
[0257] An embodiment of the present application provides a device for displaying multimedia resources. The device displays the text content of the text to be read on a text display interface while a subject is reading a text. The text display interface also displays a reading progress indicator, which indicates the text reading progress corresponding to the displayed text content. That is, if the text reading progress indicated by the reading progress indicator remains unchanged, it indicates that the text content being read by the subject has not changed. If the text reading progress indicated by the reading progress indicator does not change within a preset time period, it indicates that the subject has been viewing the currently displayed text content, i.e., the subject is interested in the content of the currently displayed text content. At this time, the subject sends the text content of interest, i.e., first content, to a server. The server searches for the first content based on the first content, obtains relevant multimedia resources, and then returns them to a terminal for display. This method eliminates the need for the subject to switch to other interfaces to search for relevant multimedia resources, thereby improving interaction efficiency. Furthermore, the method determines the content of interest to the subject based on the subject's reading behavior, ensuring that the determined content of interest is accurate, and thus recommends multimedia resources related to the content of interest to the subject, thereby improving the accuracy of multimedia resource recommendations. This method improves interaction efficiency while ensuring the accuracy of multimedia resource recommendations.
[0258] In the embodiments of the present application, the computer device may be a terminal or a server. When the computer device is a terminal, the terminal serves as the execution subject to implement the technical solution provided in the embodiments of the present application; when the computer device is a server, the server serves as the execution subject to implement the technical solution provided in the embodiments of the present application; or, the technical solution provided in the present application may be implemented through interaction between the terminal and the server, which is not limited in the embodiments of the present application.
[0259] FIG16 is a structural block diagram of a terminal 1600 provided by an exemplary embodiment of the present application.
[0260] Typically, the terminal 1600 includes a processor 1601 and a memory 1602 .
[0261] The processor 1601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0262] Memory 1602 may include one or more computer-readable storage media, which may be non-transitory. Memory 1602 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in memory 1602 is used to store at least one program code, which is executed by processor 1601 to implement the multimedia resource display method provided in the method embodiment of the present application.
[0263] In some embodiments, terminal 1600 may optionally include a peripheral device interface 1603 and at least one peripheral device. Processor 1601, memory 1602, and peripheral device interface 1603 may be connected via a bus or signal lines. Each peripheral device may be connected to peripheral device interface 1603 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 1604, a display screen 1605, a camera assembly 1606, an audio circuit 1607, and a power supply 1608.
[0264] In some embodiments, the terminal 1600 further includes one or more sensors 1609 , including but not limited to: an acceleration sensor 1610 , a gyroscope sensor 1611 , a pressure sensor 1612 , an optical sensor 1613 , and a proximity sensor 1614 .
[0265] Those skilled in the art will understand that the structure shown in FIG16 does not constitute a limitation on the terminal 1600 , and the terminal 1600 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.
[0266] FIG17 is a schematic diagram of the structure of a server provided according to an embodiment of the present application. The server 1700 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 1701 and one or more memories 1702, wherein the memories 1702 are used to store executable program codes, and the processors 1701 are configured to execute the above-mentioned executable program codes to implement the multimedia resource display methods provided by the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input / output interface for input and output. The server may also include other components for implementing device functions, which will not be described in detail here.
[0267] The present application also provides a computer-readable storage medium storing at least one program, which is loaded and executed by a processor to implement the multimedia resource display method of any of the above-mentioned implementations. All of the above-mentioned optional technical solutions provided in the present application can be combined in any manner to form optional embodiments of the present application, and are not described in detail here.
[0268] An embodiment of the present application also provides a computer program product, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium. The processor of the computer device reads the at least one program segment from the computer-readable storage medium, and the processor executes the at least one program segment, so that the computer device executes the multimedia resource display method of any of the above-mentioned implementation methods.
[0269] In some embodiments, the computer program product involved in the embodiments of the present application can be deployed and executed on a computer device, or on multiple computer devices located at one location, or on multiple computer devices distributed at multiple locations and interconnected through a communication network. Multiple computer devices distributed at multiple locations and interconnected through a communication network can constitute a blockchain system.
[0270] All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described in detail here. The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.
Claims
1. A method for displaying multimedia resources, which is executed by a terminal, and the method includes: Displaying the text content of the text to be read on a text display interface, and a reading progress indicator is displayed on the text display interface, and the reading progress indicator is used to indicate the text reading progress corresponding to the text content; If the text reading progress indicated by the reading progress indicator does not change within a preset duration, displaying resource recommendation information, where the resource recommendation information is used to indicate multimedia resources, and the multimedia resources are multimedia resources associated with the displayed text content; In response to a resource display operation on the text display interface, displaying the multimedia resources indicated by the resource recommendation information.
2. The method according to claim 1, where the displaying resource recommendation information includes: Displaying the resource recommendation information on the reading progress indicator.
3. The method according to claim 1 or 2, where the displaying resource recommendation information includes: Determining a first content from the text content; Sending the first content to a server, and the server is used to determine the multimedia resources based on the first content; Receiving the multimedia resources returned by the server, and displaying resource recommendation information for indicating the received multimedia resources.
4. The method according to claim 3, where the determining a first content from the text content includes at least one of the following: Determining the text content as the first content; Determining the content corresponding to the display position of the reading progress indicator in the text content as the first content; Based on gaze detection, determining the content corresponding to the gaze of an object, and if the content corresponding to the gaze of the object belongs to the content corresponding to the display position of the reading progress indicator, determining the content corresponding to the gaze of the object as the first content.
5. The method according to claim 3 or 4, and the method further includes at least one of the following: Highlighting the first content; Displaying a connection line on the text display interface, and the two ends of the connection line respectively point to the first content and the reading progress indicator.
6. The method according to any one of claims 1-5, where the if the text reading progress indicated by the reading progress indicator does not change within a preset duration, displaying resource recommendation information includes: If it is determined through gaze detection that the gaze of an object stays on the text display interface, and the text reading progress indicated by the reading progress indicator does not change within a preset duration, displaying resource recommendation information.
7. The method according to any one of claims 1-6, where the in response to a resource display operation on the text display interface, displaying the multimedia resources indicated by the resource recommendation information includes: If the multimedia resources indicated by the resource recommendation information are multiple, in response to a resource display operation on the text display interface, displaying a resource list, and the resource list includes resource covers of multiple multimedia resources; In response to a trigger operation on any one of the resource covers, displaying the multimedia resource corresponding to the any one of the resource covers.
8. The method according to any one of claims 1-7, and the method further includes: Determine the second content in the text to be read, where the second content is the content in the text to be read that matches the reading preference information of the object; If the text content displayed on the text display interface includes the second content, display the resource recommendation information based on the second content, where the resource recommendation information is used to indicate the multimedia resources associated with the second content; Or, if the text content displayed on the text display interface includes the second content, and the text content corresponding to the display position indicated by the reading progress indicator includes the second content, display the resource recommendation information based on the second content.
9. The method according to any one of claims 1-8, where the resource recommendation information includes the types of multimedia resources and the quantity of multimedia resources of each type.
10. The method according to any one of claims 1-9, where the displaying of the multimedia resources indicated by the resource recommendation information in response to a resource display operation on the text display interface includes: Display the multimedia resources in response to a trigger operation on the resource recommendation information; Or, display the multimedia resources in response to a sliding operation in a preset direction.
11. The method according to any one of claims 1-10, where the multimedia resources are displayed on a resource pop-up window, and the method further includes: In response to a resource closing operation on the text display interface, close the resource pop-up window and continue to display the text content on the text display interface.
12. The method according to claim 11, where the closing of the resource pop-up window in response to a resource closing operation on the text display interface includes: In response to a resource closing operation on the text display interface, display a closing animation of the resource pop-up window, where the closing animation is used to indicate the process of the resource pop-up window shrinking to the reading progress indicator.
13. The method according to any one of claims 2-12, where the displaying of the resource recommendation information on the reading progress indicator includes at least one of the following: Display the changed style of the reading progress indicator, and display the resource recommendation information on the reading progress indicator with the changed style, where the style includes at least one of color, size, and shape; Display a resource component in the adjacent area of the reading progress indicator, and display the resource recommendation information on the resource component.
14. A method for displaying multimedia resources, where the method is executed by a server, and the method includes: Receive the first content sent by the terminal, where the first content is the text content in the text to be read displayed on the text display interface of the terminal, and a reading progress indicator for indicating the text reading progress corresponding to the displayed text content is displayed on the text display interface, and the terminal is used to send the first content when the text reading progress indicated by the reading progress indicator does not change within a preset duration; Search based on the first content to obtain multimedia resources associated with the first content; Send the multimedia resources to the terminal, and the terminal is used to display the resource recommendation information indicating the multimedia resources.
15. The method according to claim 14, wherein the searching based on the first content to obtain multimedia resources associated with the first content includes: determining a type tag of the text to be read based on the first content and extracting key information from the first content; searching based on the type tag and the key information to obtain multimedia resources associated with the first content.
16. The method according to claim 15, wherein the searching based on the type tag and the key information to obtain multimedia resources associated with the first content includes: searching based on the type tag and the key information to obtain candidate multimedia resources; determining the degree of association between the candidate multimedia resources and the first content, and if the degree of association between the candidate multimedia resources and the first content is greater than a first association degree threshold, using the candidate multimedia resources as the multimedia resources associated with the first content; alternatively, determining a type tag corresponding to the candidate multimedia resources and extracting key information from the candidate multimedia resources; if the degree of association between the type tag and the key information corresponding to the candidate multimedia resources and the type tag and the key information corresponding to the first content is greater than a second association degree threshold, using the candidate multimedia resources as the multimedia resources associated with the first content.
17. The method according to claim 15, wherein the searching based on the type tag and the key information to obtain multimedia resources associated with the first content includes: searching based on the type tag and the key information to obtain a plurality of candidate multimedia resources; obtaining the respective interaction times of the plurality of candidate multimedia resources; determining, based on the respective interaction times of the plurality of candidate multimedia resources, the multimedia resources associated with the first content from the plurality of candidate multimedia resources.
18. The method according to any one of claims 14-17, further comprising: receiving the text to be read; determining a second content in the text to be read that matches the reading preference information of the object; searching based on the second content to obtain multimedia resources associated with the second content; determining the position of the second content in the text to be read, and sending the second content and the position of the second content to the terminal, where the terminal is configured to send a resource request when the display position indicated by the reading progress includes the position of the second content; receiving the resource request sent by the terminal, and returning to the terminal the multimedia resources associated with the second content, where the terminal is configured to display the multimedia resources associated with the second content.
19. A multimedia resource display device, where the device is deployed on a terminal, and the device includes: a content display module, configured to display the text content of the text to be read on a text display interface, and a reading progress indicator is displayed on the text display interface, where the reading progress indicator is used to indicate the text reading progress corresponding to the text content; An information display module, configured to display resource recommendation information if the text reading progress indicated by the reading progress indicator has not changed within a preset duration, where the resource recommendation information is used to indicate multimedia resources, and the multimedia resources are multimedia resources associated with the displayed text content; A resource display module, configured to display the multimedia resources indicated by the resource recommendation information in response to a resource display operation on the text display interface.
20. A display device for multimedia resources, where the device is deployed on a server, and the device includes: A receiving module, configured to receive first content sent by a terminal, where the first content is the text content in the text to be read displayed on the text display interface of the terminal, and a reading progress indicator for indicating the text reading progress corresponding to the displayed text content is displayed on the text display interface, and the terminal is configured to send the first content when the text reading progress indicated by the reading progress indicator has not changed within a preset duration; A search module, configured to search based on the first content to obtain multimedia resources associated with the first content; A sending module, configured to send the multimedia resources to the terminal, and the terminal is configured to display resource recommendation information indicating the multimedia resources.
21. A computer device, where the computer device includes a processor and a memory, and the memory is configured to store at least one program, and the at least one program is loaded and executed by the processor to perform the multimedia resource display method according to any one of claims 1-13 or the multimedia resource display method according to any one of claims 14-18.
22. A computer-readable storage medium, configured to store at least one program, and the at least one program is used to perform the multimedia resource display method according to any one of claims 1-13 or the multimedia resource display method according to any one of claims 14-18.
23. A computer program product, where the computer program product includes at least one program, the at least one program is stored in a computer-readable storage medium, a processor of a computer device reads the at least one program from the computer-readable storage medium, and the processor executes the at least one program, so that the computer device performs the multimedia resource display method according to any one of claims 1-13 or the multimedia resource display method according to any one of claims 14-18.