Page display method and related equipment

Abstract

The invention provides a page display method and related equipment. The method comprises the following steps: displaying a first page of first content; in response to a first instruction for pausing playing of the first content, pausing playing of the first content, and displaying a first control; in response to a trigger instruction for the first control, a second page related to the first content is displayed, and the second page comprises recommendation information obtained based on a current frame of the first content.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a page display method and related equipment. Background Art

[0002] With the development of computer science and technology, various applications (APPs) have emerged. These applications provide convenience in all aspects of life for people, and some also provide rich choices for people's leisure and entertainment.

[0003] In some scenarios, applications can display multimedia content.

[0004] However, the inventors of the present disclosure have found that the manual addition of recommendation information based on multimedia content has poor results. Summary of the invention

[0005] In view of this, the purpose of the present disclosure is to provide a page display method and related devices to solve or partially solve the above technical problems.

[0006] In a first aspect of the present disclosure, a page display method is provided, comprising:

[0007] Displaying a first page of first content;

[0008] In response to a first instruction to pause playing of the first content, pausing playing of the first content and displaying a first control;

[0009] In response to a trigger instruction for the first control, a second page related to the first content is displayed, wherein the second page includes recommendation information obtained based on a current frame of the first content.

[0010] A second aspect of the present disclosure provides a page display device, comprising:

[0011] A first display module is configured to: display a first page of a first content; and, in response to a first instruction to pause playing of the first content, pause playing of the first content and display a first control;

[0012] The second display module is configured to: in response to a trigger instruction for the first control, display a second page related to the first content, wherein the second page includes recommendation information obtained based on a current frame of the first content.

[0013] In a third aspect of the present disclosure, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the program.

[0014] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the first aspect.

[0015] In a fifth aspect of the present disclosure, a computer program product is provided, comprising computer program instructions, which, when executed on a computer, cause the computer to execute the method described in the first aspect.

[0016] It can be seen from the above that the page display method and related devices provided by the present disclosure obtain and display recommended information based on the current frame in the paused playback state, thereby improving the efficiency of information acquisition and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 A schematic diagram of an exemplary system according to an embodiment of the present disclosure is shown.

[0019] Figure 2A A schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0020] Figure 2B A schematic diagram showing another exemplary page according to an embodiment of the present disclosure is shown.

[0021] Figure 2C A schematic diagram showing another exemplary page according to an embodiment of the present disclosure is shown.

[0022] Figure 2D A schematic diagram showing another exemplary page according to an embodiment of the present disclosure is shown.

[0023] Figure 2E A schematic diagram showing another exemplary page according to an embodiment of the present disclosure is shown.

[0024] Figure 2F A schematic diagram showing another exemplary page according to an embodiment of the present disclosure is shown.

[0025] Figure 3 A schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0026] Figure 4 A schematic diagram of an exemplary page according to an embodiment of the present disclosure is shown.

[0027] Figure 5 A flowchart of an exemplary method provided by an embodiment of the present disclosure is shown.

[0028] Figure 6 A schematic diagram of the structure of an exemplary device provided by an embodiment of the present disclosure is shown.

[0029] Figure 7 A schematic diagram of the hardware structure of an exemplary electronic device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0030] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0031] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0032] It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] Figure 1 FIG. 1 is a schematic diagram of an exemplary system 100 according to an embodiment of the present disclosure. The system 100 may be a system for implementing page display.

[0037] like Figure 1 As shown, the system 100 may include a terminal device 102, a server 104, and a database server 106. The terminal device 102 and the server 104 are connected via a network, such as a wired or wireless network connection. Optionally, the device for implementing page display may be integrated in the terminal device 102. The database server 106 and the server 104 are connected via a network, such as a wired or wireless network connection. The database server 106 may store various data related to the execution of the page display method, such as multimedia content (video, audio, pictures, etc.).

[0038] Various applications (Application, APP, Chinese abbreviation: application) can be installed on the terminal device 102, such as video applications, image processing applications, video conferencing applications, life service applications, reading applications, social applications, payment applications, web browsers and instant messaging tools, etc. These applications can all be used to display pages.

[0039] The terminal device 102 here can be hardware or software. When the terminal device 102 is hardware, it can be various electronic devices with a display screen, including but not limited to smart phones, tablet computers, e-book readers, MP3 players, laptop computers (Laptops) and desktop computers (PCs), etc. When the terminal device 102 is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, to provide distributed services), or it can be implemented as a single software or software module. It is not specifically limited here.

[0040] The server 104 may be a server that provides various services. For example, it may be a background server that provides support for various applications displayed on the terminal device 102. The database server 106 may also be a database server that provides various services. It is understood that if the server 104 can implement the relevant functions of the database server 106, the database server 106 may not be provided in the system 100.

[0041] Here, the server 104 and the database server 106 can also be hardware or software. When they are hardware, they can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When they are software, they can be implemented as multiple software or software modules (for example, to provide distributed services), or as a single software or software module. No specific limitation is made here.

[0042] It should be noted that the page display method provided in the embodiment of the present disclosure can be executed by the system 100. Specifically, it can be interactively executed by the terminal device 102, the server 104 and the database server 106. It is understood that in the case where the terminal device 102 has the functions required by the server 104 and the database server 106 to execute the page display method, the terminal device 102 can also execute it alone. It should be understood that Figure 1 The number of terminal devices 102, servers 104, database servers 106 and users 108 in the figure is only for illustration. According to actual needs, there may be any number of terminal devices, users, servers and database servers.

[0043] In an exemplary application scenario, user 108 can use any application to watch multimedia content through terminal device 102. However, the inventors of the present disclosure have found that the recommendation information based on multimedia content is triggered from the perspective of the creator, and the creator manually adds recommendation anchors and links, and the recommendation effect is poor. The embodiments of the present disclosure are intended to solve or at least partially solve this problem.

[0044] Figure 2A A schematic diagram of an exemplary page 200 according to an embodiment of the present disclosure is shown.

[0045] like Figure 2A As shown, page 200 may be the homepage of a content providing application. User 108 may open the application in terminal device 102, and then page 200 corresponding to the application may be displayed on terminal device 102. It is understood that there are many ways to enter page 200, and the possible ways of entering are described here only for the purpose of illustrating more clearly.

[0046] like Figure 2AAs shown, for example, a plurality of content thumbnails 202 may be displayed in the page 200, and the thumbnails 202 may be images of key frames of the content. When the user 108 clicks on any thumbnail 202, the page 200 may play the content corresponding to the thumbnail, such as Figure 2B shown.

[0047] For example, assume that user 108 clicks Figure 2A The first thumbnail 202 can be displayed Figure 2B The page 210 shown in FIG. 210 can be played Figure 2A The content 212 corresponding to the first thumbnail 202 in Figure 2B The content 212 may be multimedia content, such as video, audio, picture, etc. In some embodiments, the content 212 may be a medium-length video, such as a video with a duration greater than 10 minutes.

[0048] In some embodiments, Figure 2B As shown, the page 210 may further include a control 214. In response to a trigger instruction for the control 214 (eg, clicking the control 214), the terminal device 102 may display at least one recommended content 222 related to the content 212, such as Figure 2C Optionally, the recommended content 222 may be obtained based on information of the content 212, for example, by searching for content similar to the content 212. In this way, by recommending other content related to the current content 212 to the user, the richness of the recommended content is expanded.

[0049] Back to Figure 2B In some embodiments, in response to a first instruction to pause playing content 212 (e.g., Figure 2B The terminal device 102 can pause playing the content 212 and display the control 216A on the page 210, such as Figure 2D When the control 216A is triggered, the recommended information obtained based on the current frame of the content 212 can be displayed.

[0050] At the same time, in some embodiments, in response to the first instruction to pause the playing of the content 212, the terminal device 102 can determine the current frame of the content 212 (i.e., the frame displayed when the playing is currently paused), and obtain multimodal data related to the current frame, and then obtain the recommendation information corresponding to the content 212 based on the multimodal data. In this way, by using the multimodal data related to the current frame of the content 212 to obtain the recommendation information, the recommendation information related to the current frame can be better recommended, thereby improving the user experience.

[0051] Optionally, the multimodal data includes at least one of the following:

[0052] The scene information corresponding to the current frame;

[0053] The image information of the current frame;

[0054] recognizing text information from the current frame, for example, using a known model to recognize text information appearing in the current frame;

[0055] The audio information of the content 212 corresponding to the current frame.

[0056] The scene information may be a description of the context of the current frame, including fusion information of people, things, objects, and background and environmental information in the current frame. In some embodiments, the scene information may be generated using a known model. For example, using a known model to generate corresponding scene information based on the image information of the current frame may better reflect the context of the current frame.

[0057] Optionally, the audio information of the content 212 corresponding to the current frame may be the background music used for the content 212 corresponding to the video time node corresponding to the current frame, because the background music at this time is more consistent with the content of the current frame and is conducive to reflecting the relevant information of the current frame.

[0058] In some embodiments, the terminal device 102 can obtain first recommendation information related to the scene information according to the scene information of the current frame, and the first recommendation information can be subsequently presented to the user to enrich the recommended content. Optionally, the scene information can be used to find information matching the scene information in the system 100 as the first recommendation information, so that the first recommendation information is more consistent with the context expressed by the scene information.

[0059] In some embodiments, the terminal device 102 may also identify object information (eg, a person, an object, etc.) in the image information of the current frame, and then obtain second recommendation information related to the object information.

[0060] In some embodiments, in response to the text information of the current frame including foreign language, the terminal device 102 can obtain translation information of the foreign language as the third recommendation information. In this way, when the current frame contains foreign language, the corresponding translation information can be provided to the user, further broadening the scope of the recommended content.

[0061] It is understandable that the step of obtaining recommended information based on the current frame can be triggered immediately after the terminal device 102 receives the first instruction to pause playing the content 212, so that the recommended information can be obtained in time. In this way, when the recommended information needs to be displayed, it can be displayed faster and the response speed is faster.

[0062] As an optional embodiment, Figure 2DAs shown, the page 210 may also include a play control 216B and a clear screen control 216C, wherein when the play control 216B is triggered, the play speed of the content 212 may be adjusted to facilitate user operation. When the clear screen control 216C is triggered, other contents except the content 212 in the page 210 may be cleared to achieve an immersive viewing effect.

[0063] In some embodiments, in response to the trigger instruction for the first control, the terminal device 102 may display a page 230 related to the content 212, such as Figure 2E Optionally, the page 230 may include recommendation information acquired based on the current frame of the content 212. In this way, acquiring and displaying recommendation information based on the current frame broadens the scope of recommended content and improves user experience.

[0064] As mentioned above, the recommendation information may include first recommendation information obtained based on the scene information of the current frame, second recommendation information obtained based on the image information of the current frame, and third recommendation information obtained based on the text information recognized from the current frame. Figure 2E As shown, optionally, page 230 may further include a first tag 232A corresponding to the first recommended information, a second tag 232B corresponding to the second recommended information, and a third tag 232C corresponding to the third recommended information. In this way, the user can switch to display the first recommended information, the second recommended information, or the third recommended information in page 230 by clicking on each tag.

[0065] Exemplarily, when entering the page 230, the first recommended information 234 may be displayed by default in the page 230. Optionally, the first tag 232A is highlighted, indicating that the currently displayed recommended information is the recommended information corresponding to the first tag 232A.

[0066] In some embodiments, in response to a viewing instruction for the first recommendation information (e.g., clicking Figure 2E The terminal device 102 may display detailed information 236 of the first recommended information 234 on the page 230, such as Figure 2F In this way, the user can learn more about the first recommended information 234 and obtain more information by viewing the detailed information 236 of the first recommended information 234.

[0067] In some embodiments, in response to a long press trigger operation on the detailed information 236 (for example, pressing and holding any position in the area where the detailed information 236 is located for a predetermined period of time), at least one operation control for the detailed information 236 may be further displayed, for example, operation controls 238A, 238B, and 238C. In this way, the user can further operate the detailed information 236 based on the operation control, thereby expanding the user's operation range.

[0068] Optionally, the control 238A can be used to add the detailed information 236 of the first recommended information 234 to the excerpt, and the excerpt can be saved in the account of the user 108 (for example, the user's homepage), and the user 108 can open the homepage at any time to view the excerpt, so as to conveniently view the detailed information 236 of the first recommended information 234 at any time. Optionally, the control 238B can be used to share the detailed information 236 of the first recommended information 234 with others, and the control 238C can feedback the errors of the detailed information 236 of the first recommended information 234 to the platform.

[0069] Back to Figure 2E In some embodiments, the first recommendation information obtained based on the scene information of the current frame may be numerous and may include many types of recommendation information, such as service information, question-and-answer information, and video information related to the content 212 (or the current frame), etc. Among them, the service information may be information providing services (e.g., cruise services) for users, the question-and-answer information may be information for question-and-answer based on the scene information, and the video information may be videos recommended to users based on the scene information.

[0070] Alternatively, if Figure 2E As shown, the page 230 may further include a control 240, which may be used for the user 108 to generate an excerpt based on the first recommendation information and save it on his own homepage.

[0071] In some embodiments, in response to a trigger instruction for the control 240 (eg, clicking the control 240), the terminal device 102 may display a page 300 for selecting the first recommended information, such as Figure 3 Optionally, a check box is set in front of each first recommended information on page 300, and when the user selects the check box, the first recommended information corresponding to the check box is selected as the target recommended information.

[0072] For example, Figure 3 As shown, in response to a selection instruction for target recommendation information (eg, first recommendation information 302A, 302B, 302C) in the first recommendation information, the terminal device 102 may display a control 304 for generating target content (eg, an excerpt).

[0073] Furthermore, in response to a trigger instruction for the control 304 (eg, clicking the control 304 ), the terminal device 102 may generate target content (eg, an excerpt) based on the target recommendation information.

[0074] In this way, by selecting recommended information to generate an excerpt, the user can save the information he is interested in in the form of an excerpt. Optionally, the excerpt can be stored in an excerpt folder on the user's homepage, which can be convenient for the user to view, modify, share, etc. at any time.

[0075] Back to Figure 2E In some embodiments, in response to a trigger instruction for the second label 232B (e.g., clicking the second label 232B), the first recommended information can be switched to the second recommended information, and the second label 232B can be highlighted. At this time, the page 230 can display the image information of the current frame to find the relevant second recommended information (e.g., shopping information, other videos of people wearing floral dresses, etc.), so that the user can find the recommended information based on another dimension of information, thereby broadening the scope of recommended content.

[0076] In some embodiments, in response to a trigger instruction for the third label 232C (e.g., clicking the third label 232C), the first recommended information is switched to the third recommended information, and the third label 232C may be highlighted. At this time, the page 230 may display the text information of the current frame to find the relevant third recommended information (e.g., foreign language translation information, etc.), so that the user can find the information recommended based on another dimension of information, thereby broadening the scope of recommended content.

[0077] In some embodiments, Figure 2E As shown, page 230 also includes a control 242; in response to a trigger instruction for control 242 (eg, clicking control 242), terminal device 102 may display the current frame in page 400, as shown in FIG. Figure 4 shown.

[0078] Furthermore, the terminal device 102 responds to the selection instruction for the target area of ​​the current frame 402 (for example, using a gesture to draw a circle to select an area), identifies the image information in the target area, obtains the fourth recommendation information based on the recognition result of the image information in the target area, and displays the fourth recommendation information. For example, if the user 108 selects the area where the person in the middle is located, the clothes worn by the person can be obtained through image recognition, and then similar products based on the clothes are found as the fourth recommendation information to be fed back to the user, thereby broadening the scope of the recommended content.

[0079] In some embodiments, Figure 2EAs shown, page 230 also includes a control 244. In response to a trigger instruction for control 244 (e.g., clicking control 244), terminal device 102 can display a control for inputting question information (e.g., a text input bar or a voice input special effect icon); in response to receiving question information (e.g., what other fun places are there in XX country) input based on the control for inputting question information (e.g., a text input bar or a voice input special effect icon), terminal device 102 can obtain fifth recommendation information corresponding to the question information (e.g., a recommended answer to the question information) and display the fifth recommendation information. In this way, the question and answer tool is used to implement the user's question and answer in the current recommendation scenario, thereby improving the user experience. The question and answer tool can be a question and answer model based on a machine learning model.

[0080] It can be seen from the above embodiments that at least some embodiments of the present disclosure utilize the semantic understanding ability of the model to analyze the current frame, explore potential key points of the video, and match the video key points with content and services, connecting people with people, people with content, and people with things, thereby enhancing the user experience.

[0081] At least some embodiments of the present disclosure can use AI content understanding capabilities to mine potential recommended content. At least some embodiments of the present disclosure use the excerpt function to help users record content of interest for easy viewing at any time.

[0082] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the present embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.

[0083] It should be noted that the above describes some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0084] Based on basically the same inventive concept, the embodiment of the present disclosure also provides a page display method.

[0085] Figure 5 FIG. 5 is a flow chart of an exemplary method 500 provided by an embodiment of the present disclosure. The method 500 may be Figure 1The terminal device 102 can also be implemented by Figure 1 The method 500 can be implemented by the system 100, and the method 500 can be used to display a page of an application. The method 500 can further include the following steps.

[0086] In step 502, the first content (eg, Figure 2B The first page of content 212) (e.g., Figure 2B Page 210);

[0087] In step 504, in response to a first instruction to pause playing of the first content, playing of the first content is paused, and a first control (eg, Figure 2D Control 216A);

[0088] In step 506, in response to the trigger instruction for the first control, a second page (eg, Figure 2E The second page includes recommendation information obtained based on the current frame of the first content (for example, Figure 2E first recommendation information 234).

[0089] It can be seen from the above that the page display method provided by the present disclosure obtains and displays recommended information based on the current frame in a paused playback state, thereby improving information acquisition efficiency and enhancing user experience.

[0090] In some embodiments, the method further comprises:

[0091] In response to a first instruction to pause playing of the first content, determining the current frame of the first content;

[0092] Acquire multimodal data related to the current frame;

[0093] Based on the multimodal data, the recommendation information corresponding to the first content is obtained.

[0094] In this way, by using the multimodal data related to the current frame of the first content to obtain the recommended information, the recommended information related to the current frame can be better recommended, thereby improving the user experience.

[0095] In some embodiments, the multimodal data includes at least one of the following:

[0096] The scene information corresponding to the current frame;

[0097] The image information of the current frame;

[0098] Text information recognized from the current frame;

[0099] The audio information corresponding to the current frame.

[0100] The scene information may be a description of the context of the current frame, including fusion information of people, things, objects, and background and environmental information in the current frame. In some embodiments, the scene information may be generated using a known model. For example, using a model to generate corresponding scene information based on the image information of the current frame may better reflect the context of the current frame.

[0101] Optionally, the audio information of the first content corresponding to the current frame may be the background music used for the first content corresponding to the video time node corresponding to the current frame, because the background music at this time is more consistent with the content of the current frame and is conducive to reflecting the relevant information of the current frame.

[0102] In some embodiments, based on the multimodal data, obtaining the recommendation information corresponding to the first content includes: according to the scene information corresponding to the current frame, obtaining first recommendation information related to the scene information, and the first recommendation information can be subsequently presented to the user to enrich the recommended content. Optionally, the scene information can be used to find information matching the scene information in the system 100 as the first recommendation information, so that the first recommendation information is more consistent with the context expressed by the scene information.

[0103] In some embodiments, the method further includes: in response to a viewing instruction for the first recommended information, displaying detailed information of the first recommended information (for example, Figure 2F In this way, the user can learn more about the first recommended information and obtain more information by viewing the detailed information of the first recommended information.

[0104] In some embodiments, the method further includes: in response to a long press trigger operation on the detail information, displaying at least one operation control (for example, Figure 2F In this way, the user can further operate the detailed information based on the operation control, thereby expanding the user's operation range.

[0105] In some embodiments, the first recommendation information includes service information, question-and-answer information, and video information related to the first content; the second page also includes a second control (e.g., Figure 2E Controls 240);

[0106] The method further comprises:

[0107] In response to the trigger instruction for the second control, a third page (eg, Figure 3 Page 300);

[0108] In response to the target recommendation information in the first recommendation information (for example, Figure 3 The selection instruction of the first recommendation information 302A, 302B, 302C) is displayed, and a third control (for example, Figure 3 Control 304);

[0109] In response to a trigger instruction for the third control, target content is generated based on the target recommendation information.

[0110] In this way, by selecting recommended information to generate an excerpt, the user can save the information he is interested in in the form of an excerpt. Optionally, the excerpt can be stored in an excerpt folder on the user's homepage, which can be convenient for the user to view, modify, share, etc. at any time.

[0111] In some embodiments, the recommendation information further includes second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further includes a first tag corresponding to the first recommendation information (for example, Figure 2E a first tag 232A corresponding to the second recommendation information, and a second tag (eg, Figure 2E The second tag 232B) and the third tag corresponding to the third recommendation information (for example, Figure 2E A third tag 232C);

[0112] Displaying a second page related to the first content further includes: displaying the first recommended information in the second page, with the first tag being highlighted, indicating that the currently displayed recommended information is the recommended information corresponding to the first tag.

[0113] In some embodiments, the method further includes: in response to a trigger instruction for the second tag or the third tag, switching the first recommended information to the second recommended information or the third recommended information, and the second tag or the third tag is highlighted so that the user can find information recommended based on another dimension of information, thereby broadening the scope of recommended content.

[0114] In some embodiments, based on the multimodal data, obtaining the recommendation information corresponding to the first content includes: identifying object information in the image information of the current frame; and obtaining second recommendation information related to the object information. In this way, the image recognition result is used for recommendation, which broadens the scope of recommended content.

[0115] In some embodiments, based on the multimodal data, obtaining the recommendation information corresponding to the first content includes: in response to the text information of the current frame including a foreign language, obtaining translation information of the foreign language as the third recommendation information. In this way, when a foreign language appears in the current frame, corresponding translation information can be provided to the user, further broadening the scope of the recommended content.

[0116] In some embodiments, the second page further includes a fourth control (eg, Figure 2E Controls 242);

[0117] The method further comprises:

[0118] In response to the trigger instruction for the fourth control, the current frame (for example, Figure 4 The current frame 402);

[0119] In response to a selection instruction for a target area of ​​the current frame, identifying image information within the target area;

[0120] Based on the recognition result of the image information in the target area, obtaining fourth recommendation information;

[0121] The fourth recommendation information is displayed.

[0122] For example, if the user selects Figure 4 The area where the person is located in the middle can be obtained through image recognition, and the clothes he is wearing can then be found based on the clothes as the fourth recommendation information and fed back to the user, thereby broadening the scope of the recommended content.

[0123] In some embodiments, the second page further includes a fifth control (eg, Figure 2E Controls 244);

[0124] The method further comprises:

[0125] In response to a trigger instruction for the fifth control, displaying a sixth control for inputting question information;

[0126] In response to receiving question information input based on the sixth control, acquiring fifth recommendation information corresponding to the question information;

[0127] The fifth recommendation information is displayed.

[0128] In this way, the question-and-answer tool enables users to ask and answer questions in the current recommendation scenario, thereby improving the user experience.

[0129] In some embodiments, the first page further includes a seventh control;

[0130] The method further comprises:

[0131] In response to a trigger instruction for the seventh control, at least one recommended content related to the first content is displayed.

[0132] In this way, by recommending other content related to the current content to the user, the richness of the recommended content is expanded.

[0133] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the present embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.

[0134] It should be noted that the above describes some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0135] Based on basically the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure further provides a page display device. Figure 6 A schematic structural diagram of an exemplary device 600 provided in an embodiment of the present disclosure is shown.

[0136] refer to Figure 6 , the page display device 600 may include:

[0137] The first display module 602 is configured to: display a first page of a first content; and, in response to a first instruction to pause playing of the first content, pause playing of the first content and display a first control;

[0138] The second display module 604 is configured to: in response to a trigger instruction for the first control, display a second page related to the first content, where the second page includes recommendation information obtained based on a current frame of the first content.

[0139] In some embodiments, the first display module 602 is configured as follows:

[0140] In response to a first instruction to pause playing of the first content, determining the current frame of the first content;

[0141] Acquire multimodal data related to the current frame;

[0142] Based on the multimodal data, the recommendation information corresponding to the first content is obtained.

[0143] In some embodiments, the multimodal data includes at least one of the following:

[0144] The scene information corresponding to the current frame;

[0145] The image information of the current frame;

[0146] Text information recognized from the current frame;

[0147] The audio information corresponding to the current frame.

[0148] In some embodiments, the first display module 602 is configured as follows:

[0149] According to the scene information corresponding to the current frame, first recommendation information related to the scene information is obtained.

[0150] In some embodiments, the second display module 604 is configured to: in response to a viewing instruction for the first recommended information, display detailed information of the first recommended information.

[0151] In some embodiments, the second display module 604 is configured to: in response to a long press trigger operation on the detail information, display at least one operation control for the detail information.

[0152] In some embodiments, the first recommendation information includes service information, question and answer information, and video information related to the first content; the second page also includes a second control;

[0153] The second display module 604 is configured as follows:

[0154] In response to a trigger instruction for the second control, displaying a third page for selecting the first recommended information;

[0155] In response to a selection instruction for target recommendation information in the first recommendation information, displaying a third control for generating target content;

[0156] In response to a trigger instruction for the third control, target content is generated based on the target recommendation information.

[0157] In some embodiments, the recommendation information further includes second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further includes a first tag corresponding to the first recommendation information, a second tag corresponding to the second recommendation information, and a third tag corresponding to the third recommendation information;

[0158] The second display module 604 is configured to: display the first recommendation information on the second page, with the first tag being highlighted.

[0159] In some embodiments, the second display module 604 is configured to: in response to a trigger instruction for the second tag or the third tag, switch the first recommended information to the second recommended information or the third recommended information, and the second tag or the third tag is highlighted.

[0160] In some embodiments, obtaining the recommendation information corresponding to the first content based on the multimodal data includes:

[0161] Identifying object information in the image information of the current frame;

[0162] Acquire second recommendation information related to the object information.

[0163] In some embodiments, the first display module 602 is configured as follows:

[0164] In response to the text information of the current frame including a foreign language, translation information of the foreign language is obtained as the third recommendation information.

[0165] In some embodiments, the second page further includes a fourth control;

[0166] The second display module 604 is configured as follows:

[0167] In response to a trigger instruction for the fourth control, display the current frame;

[0168] In response to a selection instruction for a target area of ​​the current frame, identifying image information within the target area;

[0169] Based on the recognition result of the image information in the target area, obtaining fourth recommendation information;

[0170] The fourth recommendation information is displayed.

[0171] In some embodiments, the second page further includes a fifth control;

[0172] The second display module 604 is configured as follows:

[0173] In response to a trigger instruction for the fifth control, displaying a sixth control for inputting question information;

[0174] In response to receiving question information input based on the sixth control, acquiring fifth recommendation information corresponding to the question information;

[0175] The fifth recommendation information is displayed.

[0176] In some embodiments, the first page further includes a seventh control;

[0177] The first display module 602 is configured as follows:

[0178] In response to a trigger instruction for the seventh control, at least one recommended content related to the first content is displayed.

[0179] For the convenience of description, the above device is described by dividing it into various modules according to its functions. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0180] The device of the above embodiment is used to implement the corresponding method 500 in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0181] Based on basically the same inventive concept, the embodiment of the present disclosure further provides a computer device for implementing the above method 500 . Figure 7 FIG. 7 is a schematic diagram showing the hardware structure of an exemplary computer device 700 provided in an embodiment of the present disclosure. The computer device 700 can be used to implement Figure 1 In some scenarios, the computer device 700 can also be used to implement Figure 1 Server 104 and database server 106.

[0182] like Figure 7 As shown, the computer device 700 may include: a processor 702, a memory 704, a network module 706, a peripheral interface 708 and a bus 710. The processor 702, the memory 704, the network module 706 and the peripheral interface 708 are connected to each other in communication within the computer device 700 through the bus 710.

[0183] Processor 702 may be a central processing unit (CPU), an image processor, a neural network processor (NPU), a microcontroller (MCU), a programmable logic device, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or one or more integrated circuits. Processor 702 may be used to perform functions related to the technology described in the present disclosure. In some embodiments, processor 702 may also include multiple processors integrated into a single logical component. For example, Figure 7As shown, processor 702 may include a plurality of processors 702a, 702b, and 702c.

[0184] The memory 704 may be configured to store data (eg, instructions, computer code, etc.). Figure 7 As shown, the data stored in the memory 704 may include program instructions (e.g., program instructions for implementing the method 500 of the embodiment of the present disclosure) and data to be processed (e.g., the memory may store configuration files of other modules, etc.). The processor 702 may also access the program instructions and data stored in the memory 704, and execute the program instructions to operate on the data to be processed. The memory 704 may include a volatile storage device or a non-volatile storage device. In some embodiments, the memory 704 may include a random access memory (RAM), a read-only memory (ROM), an optical disk, a magnetic disk, a hard disk, a solid-state drive (SSD), a flash memory, a memory stick, etc.

[0185] The network interface 706 can be configured to provide the computer device 700 with communication with other external devices via a network. The network can be any wired or wireless network capable of transmitting and receiving data. For example, the network can be a wired network, a local wireless network (e.g., Bluetooth, WiFi, near field communication (NFC)), a cellular network, the Internet, or a combination thereof. It is understood that the type of network is not limited to the above specific examples.

[0186] The peripheral interface 708 can be configured to connect the computer device 700 to one or more peripheral devices to achieve information input and output. For example, the peripheral devices can include input devices such as a keyboard, a mouse, a touch pad, a touch screen, a microphone, and various sensors, and output devices such as a display, a speaker, a vibrator, and an indicator light.

[0187] The bus 710 may be configured to transmit information between various components of the computer device 700 (e.g., the processor 702, the memory 704, the network interface 706, and the peripheral interface 708), such as an internal bus (e.g., a processor-memory bus), an external bus (USB port, PCI-E bus), etc.

[0188] It should be noted that, although the architecture of the computer device 700 only shows the processor 702, the memory 704, the network interface 706, the peripheral interface 708 and the bus 710, in the specific implementation process, the architecture of the computer device 700 may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the architecture of the computer device 700 may also only include components necessary for implementing the embodiments of the present disclosure, and does not necessarily include all the components shown in the figure.

[0189] Based on basically the same inventive concept, corresponding to any of the above-mentioned embodiments, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute method 500 described in any of the above embodiments.

[0190] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0191] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the method 500 described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0192] Based on the same inventive concept, corresponding to the method 500 in any of the above embodiments, the present disclosure further provides a computer program product, which includes a computer program. In some embodiments, the computer program is executable by one or more processors so that the processors execute the method 500. Corresponding to the execution subject corresponding to each step in each embodiment of the method 500, the processor that executes the corresponding step may belong to the corresponding execution subject.

[0193] The computer program product of the above embodiment is used to enable the processor to execute the method 500 described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0194] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Based on the concept of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0195] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present disclosure difficult to understand, the known power / ground connections to the integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present disclosure difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that the embodiments of the present disclosure can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0196] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0197] The embodiments of the present disclosure are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A page display method, comprising: Displaying a first page of first content; In response to a first instruction to pause playing of the first content, pausing playing of the first content and displaying a first control; In response to a trigger instruction for the first control, a second page related to the first content is displayed, wherein the second page includes recommendation information obtained based on a current frame of the first content.

2. The method of claim 1, further comprising: In response to a first instruction to pause playing of the first content, determining the current frame of the first content; Acquire multimodal data related to the current frame; Based on the multimodal data, the recommendation information corresponding to the first content is obtained.

3. The method of claim 2, wherein: The multimodal data includes at least one of the following: The scene information corresponding to the current frame; The image information of the current frame; Text information recognized from the current frame; The audio information corresponding to the current frame.

4. The method of claim 3, wherein: Acquiring the recommendation information corresponding to the first content based on the multimodal data includes: According to the scene information corresponding to the current frame, first recommendation information related to the scene information is obtained.

5. The method of claim 4, further comprising: In response to a viewing instruction for the first recommended information, detailed information of the first recommended information is displayed.

6. The method of claim 5, further comprising: In response to a long press trigger operation on the detail information, at least one operation control for the detail information is displayed.

7. The method of claim 4, wherein: The first recommendation information includes service information, question and answer information and video information related to the first content; the second page also includes a second control; The method further comprises: In response to a trigger instruction for the second control, displaying a third page for selecting the first recommended information; In response to a selection instruction for target recommendation information in the first recommendation information, displaying a third control for generating target content; In response to a trigger instruction for the third control, target content is generated based on the target recommendation information.

8. The method of claim 4, wherein: The recommendation information further includes second recommendation information obtained based on the image information and third recommendation information obtained based on the text information, and the second page further includes a first tag corresponding to the first recommendation information, a second tag corresponding to the second recommendation information, and a third tag corresponding to the third recommendation information; Displaying a second page related to the first content further includes: The first recommendation information is displayed on the second page, and the first tag is highlighted.

9. The method of claim 8, further comprising: In response to a trigger instruction for the second tag or the third tag, the first recommended information is switched to be displayed as the second recommended information or the third recommended information, and the second tag or the third tag is highlighted.

10. The method of claim 8, wherein: Acquiring the recommendation information corresponding to the first content based on the multimodal data includes: Identifying object information in the image information of the current frame; Acquire second recommendation information related to the object information.

11. The method of claim 10, wherein: The second page also includes a fourth control; The method further comprises: In response to a trigger instruction for the fourth control, display the current frame; In response to a selection instruction for a target area of ​​the current frame, identifying image information within the target area; Based on the recognition result of the image information in the target area, obtaining fourth recommendation information; The fourth recommendation information is displayed.

12. The method of claim 1, wherein: The second page also includes a fifth control; The method further comprises: In response to a trigger instruction for the fifth control, displaying a sixth control for inputting question information; In response to receiving question information input based on the sixth control, acquiring fifth recommendation information corresponding to the question information; The fifth recommendation information is displayed.

13. The method of claim 1, wherein: The first page also includes a seventh control; The method further comprises: In response to a trigger instruction for the seventh control, at least one recommended content related to the first content is displayed.

14. A page display device, comprising: A first display module is configured to: display a first page of a first content; and, in response to a first instruction to pause playing of the first content, pausing playing of the first content and displaying a first control; The second display module is configured to: in response to a trigger instruction for the first control, display a second page related to the first content, wherein the second page includes recommendation information obtained based on a current frame of the first content.

15. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the method according to any one of claims 1 to 13 is implemented.

16. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 13.

17. A computer program product, wherein: The method comprises computer program instructions, which, when executed on a computer, cause the computer to execute the method according to any one of claims 1 to 13.

Images