Page display method and related device

Abstract

The present disclosure provides a page display method and a related device. The method comprises: displaying a first page of first content; in response to a first instruction to pause playback of the first content, pausing playback of the first content and displaying a first control; and in response to a trigger instruction for the first control, displaying a second page related to the first content, the second page comprising recommendation information acquired on the basis of a current frame of the first content.

Description

Page display method and related device

[0001] Cross-reference to Related Applications

[0002] The present application claims priority to the Chinese patent application No. 202411388922.4, filed on September 30, 2024, and entitled “Page display method and related device”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] The present disclosure relates to the field of computer technology, and in particular, to a page display method and related device. BACKGROUND

[0004] With the development of computer science and technology, various application programs (APPs) have emerged. These application programs provide people with all-round convenience in life and also provide people with rich choices for leisure and entertainment.

[0005] In some scenarios, an application program can display multimedia content. SUMMARY

[0006] Therefore, the purpose of the present disclosure is to provide a page display method and related device.

[0007] In a first aspect, the present disclosure provides a page display method, comprising:

[0008] displaying a first page of first content; and

[0009] in response to a first instruction to pause playing the first content, pausing playing the first content and displaying a first control;

[0010] in response to a triggering instruction for the first control, displaying a second page related to the first content, the second page comprising recommendation information obtained based on a current frame of the first content.

[0011] In a second aspect, the present disclosure provides a page display apparatus, comprising:

[0012] a first display module configured to display a first page of first content, and in response to a first instruction to pause playing the first content, pause playing the first content and display a first control;

[0013] a second display module configured to, in response to a triggering instruction for the first control, display a second page related to the first content, the second page comprising recommendation information obtained based on a current frame of the first content.

[0014] In a third aspect, the present disclosure provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor implements the method according to the first aspect when executing the program.

[0015] In a fourth aspect, the present disclosure provides a non-transitory computer readable storage medium storing computer instructions for causing a computer to execute the method according to the first aspect.

[0016] In a fifth aspect, the present disclosure provides a computer program product comprising computer program instructions for causing a computer to execute the method according to the first aspect when the computer program instructions run on the computer. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present disclosure or the related art, the drawings needed to be used in the embodiments or the related art description will be briefly introduced. Obviously, the drawings in the following description are only embodiments of the present disclosure, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0018] FIG. 1 shows a schematic diagram of an exemplary system according to an embodiment of the present disclosure.

[0019] FIG. 2A shows a schematic diagram of an exemplary page according to an embodiment of the present disclosure.

[0020] FIG. 2B shows a schematic diagram of another exemplary page according to an embodiment of the present disclosure.

[0021] FIG. 2C shows a schematic diagram of another exemplary page according to an embodiment of the present disclosure.

[0022] FIG. 2D shows a schematic diagram of another exemplary page according to an embodiment of the present disclosure.

[0023] FIG. 2E shows a schematic diagram of another exemplary page according to an embodiment of the present disclosure.

[0024] FIG. 2F shows a schematic diagram of another exemplary page according to an embodiment of the present disclosure.

[0025] FIG. 3 shows a schematic diagram of an exemplary page according to an embodiment of the present disclosure.

[0026] FIG. 4 shows a schematic diagram of an exemplary page according to an embodiment of the present disclosure.

[0027] FIG. 5 shows a flowchart of an exemplary method according to an embodiment of the present disclosure.

[0028] FIG. 6 shows a structural schematic diagram of an exemplary device provided by an embodiment of the present disclosure.

[0029] FIG. 7 shows a hardware structural schematic diagram of an exemplary electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] For the purposes of the present disclosure, technical solutions and advantages, the following will be further described in detail with specific embodiments and with reference to the accompanying drawings.

[0031] It should be noted that, unless otherwise defined, technical terms or scientific terms used in the embodiments of the present disclosure should be understood as their common meanings to those skilled in the art to which the present disclosure pertains. The terms "first", "second", and similar terms used in the embodiments of the present disclosure do not denote any order, quantity, or importance, but are merely used to distinguish different components. The terms "include", "contain", and similar terms mean that the elements or objects before the terms encompass the elements or objects listed after the terms and their equivalents, without excluding other elements or objects. The terms "connect" or "connected" and similar terms do not mean only physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms "upper", "lower", "left", "right", and the like are merely used to indicate relative positional relationships, and when the absolute positions of the described objects are changed, the relative positional relationships can also be changed accordingly.

[0032] It can be understood that, before using the technical solutions of the various embodiments of the present disclosure, the user will be informed of the type of personal information involved, the scope of use, the use scenario, and the like in an appropriate manner, and the user's authorization will be obtained.

[0033] For example, in response to receiving the user's active request, the user is sent prompt information to explicitly prompt the user that the operation requested to be performed will require the acquisition and use of the user's personal information. Thus, the user can voluntarily choose whether to provide personal information to the electronic device, application program, server, or storage medium, and the like software or hardware that performs the operation of the technical solutions of the present disclosure, according to the prompt information.

[0034] As an optional but non-limiting implementation manner, in response to accepting the user's active request, the manner of sending prompt information to the user may, for example, be a pop-up window manner, in which the prompt information can be presented in the form of text. In addition, the pop-up window can also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0035] It can be understood that the above notification and user authorization obtaining process is only illustrative, and does not limit the implementation of the present disclosure, and other ways that meet relevant laws and regulations can also be applied to the implementation of the present disclosure.

[0036] The inventor of the present disclosure finds that the recommendation information based on multimedia content is artificially added, and the effect is poor.

[0037] FIG. 1 shows a schematic diagram of an exemplary system 100 according to an embodiment of the present disclosure. The system 100 can be a system for implementing page display.

[0038] As shown in FIG. 1, the system 100 can include a terminal device 102, a server 104, and a database server 106. The terminal device 102 and the server 104 are connected through a network, such as a wired or wireless network connection, etc. Optionally, the apparatus for implementing page display can be integrated in the terminal device 102. The database server 106 and the server 104 are connected through a network, such as a wired or wireless network connection, etc. The database server 106 can store various data related to the execution of the page display method, for example, multimedia content (video, audio, picture, etc.).

[0039] Various application programs (APPs) can be installed on the terminal device 102, such as video application programs, image processing application programs, video conference application programs, life service application programs, reading application programs, social application programs, payment application programs, web browsers, and instant messaging tools, etc., which can all be used to display pages.

[0040] The terminal device 102 here can be hardware or software. When the terminal device 102 is hardware, it can be various electronic devices with display screens, including but not limited to smart phones, tablet computers, e-book readers, MP3 players, laptop computers (Laptops), and desktop computers (PCs), etc. When the terminal device 102 is software, it can be installed in the above-mentioned electronic devices. It can be implemented as multiple software or software modules (for example, to provide distributed services), or as a single software or software module. No specific limitation is made here.

[0041] The server 104 can be a server that provides various services. For example, a background server that provides support for various application programs displayed on the terminal device 102. The database server 106 can also be a database server that provides various services. It can be understood that in the case that the server 104 can implement the related functions of the database server 106, the database server 106 can not be provided in the system 100.

[0042] The server 104 and the database server 106 herein can also be hardware or software. When they are hardware, they can be implemented as a distributed server cluster composed of multiple servers or as a single server. When they are software, they can be implemented as multiple software or software modules (for example, for providing distributed services) or as a single software or software module. No specific limitation is made herein.

[0043] It should be noted that the page display method provided by the embodiments of the present disclosure can be executed by the system 100. Specifically, it can be executed by the interaction between the terminal device 102, the server 104 and the database server 106. It can be understood that, in the case where the terminal device 102 is provided with the functions required by the server 104 and the database server 106 in executing the page display method, it can also be executed by the terminal device 102 alone. It should be understood that the number of the terminal device 102, the server 104, the database server 106 and the user 108 in FIG. 1 is merely illustrative. According to actual needs, there can be any number of terminal devices, users, servers and database servers.

[0044] In an exemplary application scenario, the user 108 can use any application program through the terminal device 102 to watch multimedia content. However, the inventors of the present disclosure find that the recommendation information based on the multimedia content is triggered from the perspective of the creator, and the recommended effect is poor because the recommended anchor points and links are added manually by the creator. The embodiments of the present disclosure aim to solve or at least partially solve this problem.

[0045] FIG. 2A shows a schematic diagram of an exemplary page 200 according to an embodiment of the present disclosure.

[0046] As shown in FIG. 2A, the page 200 can be the home page of a content providing application program. The user 108 can open the application in the terminal device 102, and then the page 200 corresponding to the application can be displayed on the terminal device 102. It can be understood that there are many ways to enter the page 200, and the possible entering ways are described herein only for the purpose of making the description clearer.

[0047] As shown in FIG. 2A, for example, a plurality of thumbnails 202 of contents can be displayed in the page 200, and the thumbnail 202 can be a picture of a key frame of the content. The user 108 can click any thumbnail 202, and the page 200 can play the content corresponding to the thumbnail, as shown in FIG. 2B.

[0048] For example, assuming that the user 108 clicks the first thumbnail 202 in FIG. 2A, the page 210 shown in FIG. 2B can be displayed, and the content 212 corresponding to the first thumbnail 202 in FIG. 2A can be played in the page 210, as shown in FIG. 2B. The content 212 can be multimedia content, such as a video, an audio, a picture, or the like. In some embodiments, the content 212 can be a medium or long video, such as a video with a length greater than 10 minutes.

[0049] In some embodiments, as shown in FIG. 2B, the page 210 can further include a control 214, and the terminal device 102 can display at least one recommended content 222 related to the content 212 in response to a triggering instruction (e.g., clicking the control 214) for the control 214, as shown in FIG. 2C. Optionally, the recommended content 222 can be obtained according to information of the content 212, for example, by searching for content similar to the content 212. In this way, by recommending other content related to the current content 212 to the user, the richness of the recommended content is expanded.

[0050] Returning to FIG. 2B, in some embodiments, in response to a first instruction for pausing the playing of the content 212 (e.g., clicking the screen in the state of FIG. 2B), the terminal device 102 can pause the playing of the content 212 and display a control 216A in the page 210, as shown in FIG. 2D. When the control 216A is triggered, recommended information obtained based on a current frame of the content 212 can be displayed.

[0051] Meanwhile, in some embodiments, in response to the first instruction for pausing the playing of the content 212, the terminal device 102 can determine a current frame of the content 212 (i.e., the frame of the picture displayed when the playing is currently paused), obtain multi-modal data related to the current frame, and then obtain the recommended information corresponding to the content 212 based on the multi-modal data. In this way, by using the multi-modal data related to the current frame of the content 212 to obtain the recommended information, the recommended information related to the current frame can be better recommended, and the user experience is improved.

[0052] Optionally, the multi-modal data includes at least one of the following:

[0053] scene information corresponding to the current frame;

[0054] image information of the current frame;

[0055] text information identified from the current frame, for example, by using a known model to identify the text information appearing in the current frame;

[0056] audio information of the content 212 corresponding to the current frame.

[0057] The scene information can be context information describing the current frame, and can include information about people, events, objects, background, and environment in the current frame. In some embodiments, the scene information can be generated by using a known model. For example, the scene information can be generated by using a known model based on the image information of the current frame, so as to better reflect the context of the current frame.

[0058] Optionally, the audio information of the content 212 corresponding to the current frame can be background music adopted by the content 212 corresponding to the video time node of the current frame, because the background music at this time is more consistent with the content of the current frame, and is conducive to reflecting the relevant information of the current frame.

[0059] In some embodiments, the terminal device 102 can obtain first recommended information related to the scene information of the current frame based on the scene information of the current frame. The first recommended information can be presented to the user later, so that the recommended content is more abundant. Optionally, the information matching the scene information in the system 100 can be found by using the scene information as the first recommended information, so that the first recommended information is more consistent with the context expressed by the scene information.

[0060] In some embodiments, the terminal device 102 can also identify object information (e.g., people, objects, etc.) in the image information of the current frame, and then obtain second recommended information related to the object information.

[0061] In some embodiments, in response to the text information of the current frame including foreign language, the terminal device 102 can obtain translation information of the foreign language as third recommended information. In this way, when the foreign language appears in the current frame, the corresponding translation information can be provided for the user, further expanding the range of recommended content.

[0062] It can be understood that the step of obtaining recommended information based on the current frame can be triggered immediately after the terminal device 102 receives the first instruction to pause playing the content 212, so that the recommended information can be obtained in time. In this way, when the recommended information needs to be displayed, it can be displayed more quickly, and the response speed is faster.

[0063] As an optional embodiment, as shown in FIG. 2D, the page 210 can also include a play control 216B and a screen clearing control 216C. When the play control 216B is triggered, the playing speed of the content 212 can be adjusted, which is convenient for user operation. When the screen clearing control 216C is triggered, other content in the page 210 except the content 212 can be cleared, so as to achieve the effect of immersive viewing.

[0064] In some embodiments, in response to the triggering instruction for the first control, the terminal device 102 can display a page 230 related to the content 212, as shown in FIG. 2E. Optionally, the page 230 can include recommendation information obtained based on the current frame of the content 212. In this way, the recommendation information is obtained and displayed based on the current frame, which widens the range of recommended content and improves user experience.

[0065] As mentioned above, the recommendation information can include first recommendation information obtained based on scene information of the current frame, second recommendation information obtained based on image information of the current frame, and third recommendation information obtained based on text information identified from the current frame. As shown in FIG. 2E, the page 230 can further include a first label 232A corresponding to the first recommendation information, a second label 232B corresponding to the second recommendation information, and a third label 232C corresponding to the third recommendation information. In this way, the user can switch the display of the first recommendation information, the second recommendation information, or the third recommendation information in the page 230 by clicking the labels.

[0066] For example, when entering the page 230, the first recommendation information 234 can be displayed in the page 230 by default. Optionally, the first label 232A is highlighted, indicating that the currently displayed recommendation information is the recommendation information corresponding to the first label 232A.

[0067] In some embodiments, in response to a viewing instruction (e.g., clicking the first recommendation information 234 in FIG. 2E) for the first recommendation information, the terminal device 102 can display detailed information 236 of the first recommendation information 234 in the page 230, as shown in FIG. 2F. In this way, the user can understand the first recommendation information 234 more specifically and obtain more information by viewing the detailed information 236 of the first recommendation information 234.

[0068] In some embodiments, in response to a long-press triggering operation (e.g., pressing any position in the area where the detailed information 236 is located and keeping for a predetermined time) for the detailed information 236, at least one operation control (e.g., operation controls 238A, 238B, and 238C) for the detailed information 236 can be further displayed. In this way, the user can further operate the detailed information 236 based on the operation controls, which expands the operation range of the user.

[0069] Optionally, the control 238A can be used to add the detail information 236 of the first recommended information 234 to an abstract, which can be saved in the account of the user 108 (e.g., the user homepage), and the user 108 can open the homepage at any time to view the abstract, which facilitates the user to view the detail information 236 of the first recommended information 234 at any time. Optionally, the control 238B can be used to share the detail information 236 of the first recommended information 234 with others, and the control 238C can be used to feed back the error of the detail information 236 of the first recommended information 234 to the platform.

[0070] Returning to FIG. 2E, in some embodiments, the first recommended information obtained based on the scene information of the current frame can be many and can include many types of recommended information, such as service information, question and answer information, and video information related to the content 212 (or the current frame), etc. Among them, the service information can be information of a service (e.g., a cruise service) provided to the user, the question and answer information can be information based on the scene information to ask and answer, and the video information can be a video recommended to the user according to the scene information.

[0071] Optionally, as shown in FIG. 2E, the page 230 can further include a control 240, which can be used for the user 108 to generate an abstract based on the first recommended information and save it in the user's homepage.

[0072] In some embodiments, in response to a triggering instruction (e.g., clicking the control 240) for the control 240, the terminal device 102 can display a page 300 for selecting the first recommended information, as shown in FIG. 3. Optionally, a check box is provided in front of each first recommended information of the page 300, and the first recommended information corresponding to the check box selected by the user is selected as the target recommended information.

[0073] Exemplarily, as shown in FIG. 3, in response to a selection instruction for the target recommended information (e.g., the first recommended information 302A, 302B, 302C) in the first recommended information, the terminal device 102 can display a control 304 for generating a target content (e.g., an abstract).

[0074] Further, in response to a triggering instruction (e.g., clicking the control 304) for the control 304, the terminal device 102 can generate a target content (e.g., an abstract) based on the target recommended information.

[0075] In this way, by selecting recommended information to generate an abstract, the user can save the information of interest in the form of an abstract. Optionally, the abstract can be stored in an abstract folder of the user's homepage, which can facilitate the user to view, modify, share, etc. at any time.

[0076] Back to FIG. 2E, in some embodiments, in response to a triggering instruction (e.g., clicking the second tab 232B) for the second tab 232B, the first recommended information can be switched to display the second recommended information, and the second tab 232B can be highlighted. At this time, the page 230 can display the image information of the current frame to find the related second recommended information (e.g., shopping information, other videos of people wearing the floral dress, etc.), so that the user can find the information recommended based on another dimension of information, thereby widening the range of recommended content.

[0077] In some embodiments, in response to a triggering instruction (e.g., clicking the third tab 232C) for the third tab 232C, the first recommended information can be switched to display the third recommended information, and the third tab 232C can be highlighted. At this time, the page 230 can display the text information of the current frame to find the related third recommended information (e.g., translation information in foreign languages, etc.), so that the user can find the information recommended based on another dimension of information, thereby widening the range of recommended content.

[0078] In some embodiments, as shown in FIG. 2E, the page 230 further includes a control 242; in response to a triggering instruction (e.g., clicking the control 242) for the control 242, the terminal device 102 can display the current frame in a page 400, as shown in FIG. 4.

[0079] Further, in response to a selection instruction (e.g., selecting a region by drawing a circle with a gesture) for a target region of the current frame 402, the terminal device 102 can identify the image information in the target region, obtain fourth recommended information based on the identification result of the image information in the target region, and display the fourth recommended information. For example, the user 108 selects the region where the middle person is located, and the clothes worn by the middle person can be obtained through image recognition, and then the same kind of goods based on the clothes can be found as the fourth recommended information to be fed back to the user, thereby widening the range of recommended content.

[0080] In some embodiments, as shown in FIG. 2E, the page 230 further includes a control 244. In response to a triggering instruction (for example, clicking the control 244) for the control 244, the terminal device 102 can display a control (for example, a text input box or a voice input special effect icon) for inputting question information. In response to receiving question information (for example, what interesting places are there in XX country) input based on the control (for example, a text input box or a voice input special effect icon) for inputting question information, the terminal device 102 can obtain fifth recommended information (for example, a recommended answer to the question information) corresponding to the question information, and display the fifth recommended information. In this way, the question and answer tool is used to realize the question and answer of the user in the current recommended scene, and the user experience is improved. The question and answer tool can be a question and answer model based on a machine learning model.

[0081] As can be seen from the above embodiments, at least part of the embodiments of the present disclosure use the semantic understanding capability of the model to analyze the current frame, mine potential points of the video, and match the video points with the content and services, connect people with people, people with content, and people with things, thereby improving the user experience.

[0082] At least part of the embodiments of the present disclosure can use the AI content understanding capability to mine potential recommended content. At least part of the embodiments of the present disclosure use the excerpt function to help the user record the content of interest, and facilitate viewing at any time.

[0083] It should be noted that the method of the embodiments of the present disclosure can be executed by a single device, such as a computer or a server. The method of the embodiments of the present disclosure can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only execute one or more steps in the method of the embodiments of the present disclosure, and the multiple devices can interact with each other to complete the method.

[0084] It should be noted that some embodiments of the present disclosure have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than the order described above and still achieve desirable results. In addition, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous.

[0085] Based on the same basic inventive concept, the embodiments of the present disclosure also provide a page display method.

[0086] FIG. 5 shows a flowchart of an example method 500 provided by embodiments of the present disclosure. The method 500 can be implemented by the terminal device 102 of FIG. 1, or by the system 100 of FIG. 1, and can be used to display a page of an application. The method 500 can further include the following steps.

[0087] At step 502, a first page (e.g., page 210 of FIG. 2B) of first content (e.g., content 212 of FIG. 2B) is displayed.

[0088] At step 504, in response to a first instruction to pause playing the first content, playing of the first content is paused, and a first control (e.g., control 216A of FIG. 2D) is displayed.

[0089] At step 506, in response to a triggering instruction for the first control, a second page (e.g., page 230 of FIG. 2E) related to the first content is displayed, the second page including recommendation information (e.g., first recommendation information 234 of FIG. 2E) obtained based on a current frame of the first content.

[0090] As can be seen from the above, the page display method provided by the present disclosure improves information acquisition efficiency and enhances user experience by obtaining and displaying recommendation information based on a current frame in a paused playing state.

[0091] In some embodiments, the method further includes:

[0092] In response to a first instruction to pause playing the first content, the current frame of the first content is determined.

[0093] Multimodal data related to the current frame is obtained.

[0094] Based on the multimodal data, the recommendation information corresponding to the first content is obtained.

[0095] In this way, by using multimodal data related to the current frame of the first content to obtain recommendation information, recommendation information related to the current frame can be better recommended, and user experience is improved.

[0096] In some embodiments, the multimodal data includes at least one of the following:

[0097] scene information corresponding to the current frame;

[0098] image information of the current frame;

[0099] text information identified from the current frame;

[0100] audio information corresponding to the current frame.

[0101] The scene information can be context information describing the current frame, and can include fusion information of people, events, objects, backgrounds and environment information in the current frame. In some embodiments, the scene information can be generated by using a known model. For example, a model can be used to generate corresponding scene information based on image information of the current frame, so as to better reflect the context of the current frame.

[0102] Optionally, the audio information of the first content corresponding to the current frame can be background music adopted by the first content corresponding to the video time node corresponding to the current frame, because the background music at this time is more consistent with the content of the current frame, and is conducive to reflecting the relevant information of the current frame.

[0103] In some embodiments, based on the multi-modal data, the recommended information corresponding to the first content is obtained, including: according to the scene information corresponding to the current frame, obtaining first recommended information related to the scene information, which can be presented to the user subsequently, so that the recommended content is more abundant. Optionally, the scene information can be used to find information matching the scene information in the system 100 as the first recommended information, so that the first recommended information is more consistent with the context expressed by the scene information.

[0104] In some embodiments, the method further includes: in response to a viewing instruction for the first recommended information, displaying detail information (for example, detail information 236 of FIG. 2F) of the first recommended information. In this way, the user can understand the first recommended information more specifically by viewing the detail information of the first recommended information, and obtain more information.

[0105] In some embodiments, the method further includes: in response to a long-press trigger operation for the detail information, displaying at least one operation control (for example, operation controls 238A-238C of FIG. 2F) for the detail information. In this way, the user can further operate the detail information based on the operation control, thereby expanding the operation range of the user.

[0106] In some embodiments, the first recommended information includes service information, question and answer information and video information related to the first content; and the second page further includes a second control (for example, control 240 of FIG. 2E);

[0107] The method further includes:

[0108] In response to a trigger instruction for the second control, a third page (for example, page 300 of FIG. 3) for selecting the first recommended information is displayed;

[0109] In response to a selection instruction for target recommendation information (e.g., the first recommendation information 302A, 302B, 302C of FIG. 3) in the first recommendation information, a third control (e.g., the control 304 of FIG. 3) for generating target content is displayed;

[0110] In response to a trigger instruction for the third control, target content is generated based on the target recommendation information.

[0111] In this way, by selecting recommendation information to generate an excerpt, the user can save information of interest to himself in the form of an excerpt. Alternatively, the excerpt can be stored in an excerpt folder on the user's home page, which can facilitate the user to view, modify, share, etc. at any time.

[0112] In some embodiments, the recommendation information further includes second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further includes a first label (e.g., the first label 232A of FIG. 2E) corresponding to the first recommendation information, a second label (e.g., the second label 232B of FIG. 2E) corresponding to the second recommendation information, and a third label (e.g., the third label 232C of FIG. 2E) corresponding to the third recommendation information.

[0113] Displaying a second page related to the first content further includes displaying the first recommendation information in the second page, and the first label is highlighted to indicate that the currently displayed recommendation information is the recommendation information corresponding to the first label.

[0114] In some embodiments, the method further includes, in response to a trigger instruction for the second label or the third label, switching the first recommendation information to display the second recommendation information or the third recommendation information, and the second label or the third label is highlighted, so that the user can find information recommended based on another dimension of information, thereby widening the range of recommended content.

[0115] In some embodiments, based on the multi-modal data, the recommendation information corresponding to the first content is obtained, including: identifying object information in the image information of the current frame; and obtaining second recommendation information related to the object information. In this way, image recognition results are used for recommendation, thereby widening the range of recommended content.

[0116] In some embodiments, based on the multi-modal data, the recommendation information corresponding to the first content is obtained, including: in response to the text information of the current frame including foreign language, obtaining translation information of the foreign language as the third recommendation information. In this way, when foreign language appears in the current frame, corresponding translation information can be provided for the user, thereby further widening the range of recommended content.

[0117] In some embodiments, the second page further includes a fourth control (for example, control 242 of FIG. 2E);

[0118] The method further includes:

[0119] In response to a triggering instruction for the fourth control, displaying the current frame (for example, current frame 402 of FIG. 4);

[0120] In response to a selection instruction for a target region of the current frame, identifying image information in the target region;

[0121] Based on the identification result of the image information in the target region, obtaining fourth recommended information;

[0122] Displaying the fourth recommended information.

[0123] For example, the user selects the region where the middle person in FIG. 4 is located, and the clothes worn by the person can be obtained through image recognition, and then the same kind of goods based on the clothes is found as the fourth recommended information to feed back to the user, thereby expanding the range of recommended content.

[0124] In some embodiments, the second page further includes a fifth control (for example, control 244 of FIG. 2E);

[0125] The method further includes:

[0126] In response to a triggering instruction for the fifth control, displaying a sixth control for inputting question information;

[0127] In response to receiving question information input based on the sixth control, obtaining fifth recommended information corresponding to the question information;

[0128] Displaying the fifth recommended information.

[0129] In this way, the question and answer tool is used to realize the question and answer of the user in the current recommended scene, and the user experience is improved.

[0130] In some embodiments, the first page further includes a seventh control;

[0131] The method further includes:

[0132] In response to a triggering instruction for the seventh control, displaying at least one recommended content related to the first content.

[0133] In this way, by recommending other content related to the current content to the user, the richness of the recommended content is expanded.

[0134] It should be noted that the method of the embodiments of the present disclosure can be executed by a single device, such as a computer or a server, etc. The method of the embodiments can also be applied to a distributed scenario, and be completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only execute one or more steps in the method of the embodiments of the present disclosure, and the multiple devices can interact with each other to complete the method.

[0135] It should be noted that some embodiments of the present disclosure have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous.

[0136] Based on the same basic inventive concept, the present disclosure also provides a page display apparatus corresponding to any of the above-mentioned embodiment methods. FIG. 6 shows a structural schematic diagram of an exemplary apparatus 600 provided by the embodiments of the present disclosure.

[0137] Referring to FIG. 6, the page display apparatus 600 can include:

[0138] The first display module 602 is configured to display a first page of a first content, and in response to a first instruction to pause playing the first content, pause playing the first content and display a first control.

[0139] The second display module 604 is configured to, in response to a triggering instruction for the first control, display a second page related to the first content, the second page including recommendation information obtained based on a current frame of the first content.

[0140] In some embodiments, the first display module 602 is configured to:

[0141] In response to the first instruction to pause playing the first content, determine the current frame of the first content.

[0142] Obtain multi-modal data related to the current frame.

[0143] Based on the multi-modal data, obtain the recommendation information corresponding to the first content.

[0144] In some embodiments, the multi-modal data includes at least one of the following:

[0145] Scene information corresponding to the current frame.

[0146] image information of the current frame;

[0147] text information identified from the current frame;

[0148] audio information corresponding to the current frame.

[0149] In some embodiments, the first display module 602 is configured to:

[0150] obtain first recommendation information related to the scene information according to the scene information corresponding to the current frame.

[0151] In some embodiments, the second display module 604 is configured to: in response to a viewing instruction for the first recommendation information, display detail information of the first recommendation information.

[0152] In some embodiments, the second display module 604 is configured to: in response to a long-press trigger operation for the detail information, display at least one operation control for the detail information.

[0153] In some embodiments, the first recommendation information includes service information, question and answer information, and video information related to the first content; and the second page further includes a second control.

[0154] The second display module 604 is configured to:

[0155] in response to a trigger instruction for the second control, display a third page for selecting the first recommendation information;

[0156] in response to a selection instruction for target recommendation information in the first recommendation information, display a third control for generating target content;

[0157] in response to a trigger instruction for the third control, generate target content based on the target recommendation information.

[0158] In some embodiments, the recommendation information further includes second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further includes a first label corresponding to the first recommendation information, a second label corresponding to the second recommendation information, and a third label corresponding to the third recommendation information.

[0159] The second display module 604 is configured to: display the first recommendation information in the second page, and the first label is highlighted.

[0160] In some embodiments, the second display module 604 is configured to, in response to a trigger instruction for the second label or the third label, switch display of the first recommendation information to the second recommendation information or the third recommendation information, the second label or the third label being highlighted.

[0161] In some embodiments, based on the multi-modal data, the recommendation information corresponding to the first content is obtained, including:

[0162] Identifying object information in image information of the current frame;

[0163] Obtaining second recommendation information related to the object information.

[0164] In some embodiments, the first display module 602 is configured to:

[0165] In response to the text information of the current frame including foreign language, obtaining translation information of the foreign language as the third recommendation information.

[0166] In some embodiments, the second page further includes a fourth control;

[0167] The second display module 604 is configured to:

[0168] In response to a trigger instruction for the fourth control, display the current frame;

[0169] In response to a selection instruction for a target region of the current frame, identify image information in the target region;

[0170] Based on the identification result of the image information in the target region, obtain fourth recommendation information;

[0171] Display the fourth recommendation information.

[0172] In some embodiments, the second page further includes a fifth control;

[0173] The second display module 604 is configured to:

[0174] In response to a trigger instruction for the fifth control, display a sixth control for inputting question information;

[0175] In response to receiving question information input based on the sixth control, obtain fifth recommendation information corresponding to the question information;

[0176] Display the fifth recommendation information.

[0177] In some embodiments, the first page further includes a seventh control;

[0178] The first display module 602 is configured to:

[0179] In response to the triggering instruction for the seventh control, display at least one recommended content related to the first content.

[0180] For ease of description, the above apparatus is described in various modules in terms of functions. Of course, the functions of the modules can be implemented in one or more software and / or hardware in implementing the present disclosure.

[0181] The apparatus of the above embodiments is used to implement the corresponding method 500 in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described here again.

[0182] Based on the substantially same inventive concept, the embodiments of the present disclosure also provide a computer device for implementing the above method 500. FIG. 7 shows a hardware structure schematic diagram of an exemplary computer device 700 provided by the embodiments of the present disclosure. The computer device 700 can be used to implement the terminal device 102 in FIG. 1. In some scenarios, the computer device 700 can also be used to implement the server 104, the database server 106 in FIG. 1.

[0183] As shown in FIG. 7, the computer device 700 can include a processor 702, a memory 704, a network module 706, a peripheral interface 708, and a bus 710. Among them, the processor 702, the memory 704, the network module 706, and the peripheral interface 708 are connected to each other through the bus 710 for internal communication connection in the computer device 700.

[0184] The processor 702 can be a central processing unit (CPU), an image processor, a neural network processor (NPU), a microcontroller unit (MCU), a programmable logic device, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or one or more integrated circuits. The processor 702 can be used to perform functions related to the techniques described in the present disclosure. In some embodiments, the processor 702 can also include multiple processors integrated as a single logical component. For example, as shown in FIG. 7, the processor 702 can include multiple processors 702a, 702b, and 702c.

[0185] The memory 704 can be configured to store data (e.g., instructions, computer code, etc.). As shown in FIG. 7, the memory 704 stores data including program instructions (e.g., program instructions for implementing the method 500 of the embodiments of the present disclosure) and data to be processed (e.g., the memory can store configuration files of other modules, etc.). The processor 702 can also access the program instructions and data stored in the memory 704 and execute the program instructions to operate on the data to be processed. The memory 704 can include volatile storage or non-volatile storage. In some embodiments, the memory 704 can include random access memory (RAM), read-only memory (ROM), optical disc, magnetic disc, hard disc, solid state disc (SSD), flash memory, memory stick, etc.

[0186] The network interface 706 can be configured to provide communication with other external devices to the computer device 700 via a network. The network can be any wired or wireless network capable of transmitting and receiving data. For example, the network can be a wired network, a local wireless network (e.g., Bluetooth, WiFi, near field communication (NFC), etc.), a cellular network, the Internet, or a combination thereof. It can be understood that the type of network is not limited to the specific examples described above.

[0187] The peripheral interface 708 can be configured to connect the computer device 700 with one or more peripheral devices to achieve information input and output. For example, the peripheral devices can include input devices such as a keyboard, a mouse, a touchpad, a touch screen, a microphone, various sensors, etc. and output devices such as a display, a speaker, a vibrator, an indicator light, etc.

[0188] The bus 710 can be configured to transmit information between various components (e.g., the processor 702, the memory 704, the network interface 706, and the peripheral interface 708) of the computer device 700, such as an internal bus (e.g., a processor-memory bus), an external bus (a USB port, a PCI-E bus), etc.

[0189] It should be noted that although the architecture of the computer device 700 described above only shows the processor 702, the memory 704, the network interface 706, the peripheral interface 708, and the bus 710, in the specific implementation process, the architecture of the computer device 700 can also include other components necessary for normal operation. In addition, those skilled in the art can understand that the architecture of the computer device 700 described above can also only include components necessary for implementing the embodiments of the present disclosure, and does not necessarily include all the components shown in the figure.

[0190] Based on the same inventive concept, the disclosure also provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method 500 of any of the above embodiments.

[0191] The computer-readable medium of the embodiments can include permanent and non-permanent, removable and non-removable media, which can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device.

[0192] The computer instructions stored in the storage medium of the above embodiments are used to cause the computer to perform the method 500 of any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which are not repeated here.

[0193] Based on the same inventive concept, the disclosure also provides a computer program product including a computer program. In some embodiments, the computer program is executable by one or more processors to cause the processors to perform the method 500. Corresponding to the execution subject of each step in each embodiment of the method 500, the processor performing the corresponding step can belong to the corresponding execution subject.

[0194] The computer program product of the above embodiments is used to cause the processor to perform the method 500 of any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which are not repeated here.

[0195] Those skilled in the art should understand that the above discussion of any of the embodiments is only exemplary and is not intended to imply that the scope of the disclosure (including claims) is limited to these examples; the above embodiments or technical features between different embodiments can also be combined, the steps can be implemented in any order, and there are many other changes to the aspects of the embodiments of the disclosure as described above. In order to be brief, they are not provided in detail.

[0196] Additionally, to simplify the description and discussion, and so as not to obscure the embodiments of the disclosure with details that are well known to those skilled in the art, some conventional attributes of integrated circuit (IC) chips and other components can or can not be shown in the drawings or discussed below. Furthermore, devices can be shown in block diagram form in order to avoid obscuring the embodiments of the disclosure, and this also acknowledges the fact that the details in regard to how such block devices are implemented are highly dependent on the platform within which an embodiment of the disclosure is being implemented (i.e., such details should be completely evident to those skilled in the art). Where specific details are set forth in order to describe an illustrative embodiment of the disclosure, it will be apparent to one skilled in the art that the embodiment of the disclosure can be practiced without, or with variations of, these specific details. Thus, the description is to be considered as illustrative and not restrictive, and the scope of the disclosure is to be determined not with the assistance of the foregoing description alone.

[0197] While the disclosure has been described in connection with specific embodiments thereof, many alternatives, modifications and variations will be apparent to those skilled in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) can use the embodiments discussed.

[0198] Embodiments of the disclosure are intended to cover all such alternatives, modifications and variations as falling within the scope of the appended claims. Accordingly, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the disclosure should be included in the protection scope of the disclosure.

Claims

1. A page display method, comprising: displaying a first page of a first content; in response to a first instruction of pausing playing the first content, pausing playing the first content and displaying a first control; in response to a triggering instruction for the first control, displaying a second page related to the first content, the second page comprising recommendation information obtained based on a current frame of the first content.

2. The method of claim 1, further comprising: in response to the first instruction of pausing playing the first content, determining the current frame of the first content; obtaining multi-modal data related to the current frame; based on the multi-modal data, obtaining the recommendation information corresponding to the first content.

3. The method of claim 2, wherein, The multi-modal data comprises at least one of: scene information corresponding to the current frame; image information of the current frame; text information identified from the current frame; audio information corresponding to the current frame.

4. The method of claim 3, wherein, Based on the multi-modal data, obtaining the recommendation information corresponding to the first content comprises: based on the scene information corresponding to the current frame, obtaining first recommendation information related to the scene information.

5. The method of claim 4, further comprising: in response to a viewing instruction for the first recommendation information, displaying detail information of the first recommendation information.

6. The method of claim 5, further comprising: in response to a long-press triggering operation for the detail information, displaying at least one operation control for the detail information.

7. The method of claim 4, wherein, The first recommendation information comprises service information, question and answer information, and video information related to the first content; and the second page further comprises a second control; The method further comprises: in response to a triggering instruction for the second control, displaying a third page for selecting the first recommendation information; in response to a selection instruction for target recommendation information in the first recommendation information, displaying a third control for generating target content; in response to a triggering instruction for the third control, generating target content based on the target recommendation information.

8. The method of claim 4, wherein, The recommendation information further comprises second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further comprises a first label corresponding to the first recommendation information, a second label corresponding to the second recommendation information, and a third label corresponding to the third recommendation information; Displaying the second page related to the first content further comprises: displaying the first recommendation information in the second page, and the first label is highlighted.

9. The method of claim 8, further comprising: in response to a triggering instruction for the second label or the third label, switching the first recommendation information to be displayed as the second recommendation information or the third recommendation information, and the second label or the third label is highlighted.

10. The method of claim 8, wherein, Based on the multi-modal data, obtaining the recommendation information corresponding to the first content comprises: identifying object information in the image information of the current frame; obtaining second recommendation information related to the object information.

11. The method of claim 10, wherein, The second page further comprises a fourth control; The method further comprises: display the current frame in response to a triggering instruction for the fourth control; identify image information in a target region of the current frame in response to a selection instruction for the target region; obtain fourth recommendation information based on the identification result of the image information in the target region; display the fourth recommendation information.

12. The method of claim 1, wherein, The second page further includes a fifth control; The method further includes: displaying a sixth control for inputting question information in response to a triggering instruction for the fifth control; obtaining fifth recommendation information corresponding to the question information in response to receiving the question information input based on the sixth control; display the fifth recommendation information.

13. The method of claim 1, wherein, The first page further includes a seventh control; The method further includes: displaying at least one recommended content related to the first content in response to a triggering instruction for the seventh control.

14. A page display apparatus, comprising: a first display module configured to display a first page of first content; and, in response to a first instruction to pause playing the first content, pause playing the first content and display a first control; a second display module configured to display a second page related to the first content in response to a triggering instruction for the first control, the second page including recommendation information obtained based on a current frame of the first content.

15. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, The processor implements the method of any one of claims 1 to 13 when executing the program.

16. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to make the computer execute the method of any one of claims 1 to 13.

17. A computer program product, wherein, The computer program instructions, when running on the computer, make the computer execute the method of any one of claims 1 to 13.

Images