Methods, apparatuses, devices, and products for displaying components

Abstract

This disclosure relates to methods, apparatus, devices, and products for displaying components. The method includes displaying a first component, published by a first user, on a first interface, the first component being generated based on first media content. The method also includes displaying a second component, generated based on the user input and the first component, in response to user input from a second user, and the second component being associated with the first media content. Furthermore, the method includes publishing the second component as the work of a second user in response to a first operation.

Description

Technical Field

[0001] This article relates to the field of human-computer interaction, and more specifically to methods, apparatuses, devices and products for display components. Background Technology

[0002] With the widespread dissemination of video, audio, and other forms of media content, users need to quickly grasp the core information when watching such content, such as the sequence of events, relationships between characters, operational steps, key knowledge points, or conclusions. Some platforms offer AI-based dialogue functions, allowing users to input questions while watching media content, and large language models to generate corresponding text answers or summaries based on the content, assisting users in understanding and reviewing the media material. Summary of the Invention

[0003] In a first aspect of the examples in this paper, a method for displaying components is provided. The method includes displaying a first component, published by a first user and generated based on first media content, on a first interface. The method also includes displaying a second component, generated based on the user input and the first component, in response to user input from a second user, and associated with the first media content. Furthermore, the method includes publishing the second component as a work of the second user in response to a first action. In this way, the second user can generate a second component associated with the original media content based on a component already published by the first user, through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, facilitating user creative intent, simplifying the creative process, reducing the difficulty of creation, and improving the user experience.

[0004] In a second aspect of the examples presented herein, an apparatus for displaying components is provided. The apparatus includes a first component display module configured to display a first component published by a first user on a first interface, the first component being generated based on first media content. The apparatus also includes a second component display module configured to display a second component in response to user input from a second user, the second component being generated based on the user input and the first component, and associated with the first media content. Furthermore, the apparatus includes a second component publishing module configured to publish the second component as a work of the second user in response to a first operation. In this way, the second user can generate a second component associated with the original media content based on a component already published by the first user, through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, facilitating the user's creative intent, simplifying the creative process, reducing the difficulty of creation, and improving the user experience.

[0005] In a third aspect of the examples presented herein, an electronic device is provided. The electronic device includes one or more processors; and a storage device for storing one or more programs, which, when executed by the one or more processors, cause the one or more processors to implement a method for displaying a component. The method includes displaying a first component published by a first user on a first interface, the first component being generated based on first media content. The method also includes displaying a second component, generated based on the user input and the first component, in response to user input from a second user, the second component being associated with the first media content. Furthermore, the method includes publishing the second component as a work of the second user in response to a first operation. In this way, the second user can generate a second component associated with the original media content based on a component already published by the first user, through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, facilitating the user's creative intent, simplifying the steps of the creative process, reducing the difficulty of creation, and improving the user experience.

[0006] In a fourth aspect of the examples herein, a computer program product is provided. This computer program product is tangibly stored on a non-transitory computer-readable medium and includes machine-executable instructions that, when executed, cause a machine to implement a method for displaying a component. The method includes displaying a first component published by a first user on a first interface, the first component being generated based on first media content. The method also includes displaying a second component, generated based on the user input and the first component, in response to user input from a second user, and associated with the first media content. Furthermore, the method includes publishing the second component as a work of the second user in response to a first operation. In this way, the second user can generate a second component associated with the original media content based on a component already published by the first user, through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, facilitating the user's creative intent, simplifying the steps of the creative process, reducing the difficulty of creation, and improving the user experience. Attached Figure Description

[0007] The above and other features, advantages, and aspects of the examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0008] Figure 1 A schematic diagram is shown illustrating the example environment in which several examples in this article can be implemented;

[0009] Figure 2 A flowchart illustrating methods for displaying components, based on some examples in this article, is shown;

[0010] Figure 3 A schematic diagram of an example system for generating and publishing interactive components is shown, based on some examples in this article;

[0011] Figure 4 A flowchart illustrating an example process for generating interactive components, based on some examples in this article, is shown;

[0012] Figure 5 A flowchart is shown illustrating an example process of creating derivative works based on generated interactive components, using some examples from this article.

[0013] Figures 6A to 6G A schematic diagram illustrating examples of generating interactive relationship graphs based on media content, using some examples from this paper;

[0014] Figures 7A to 7C The illustration shows examples of derivative creations based on generated interactive relationship graphs, using some examples from this article;

[0015] Figure 8 A block diagram of a device for displaying components, according to some examples in this document, is shown;

[0016] Figure 9 A block diagram of a device that can implement several of the examples in this paper is shown.

[0017] In all the accompanying figures, the same or similar reference numerals denote the same or similar elements. Detailed Implementation

[0018] It is understood that all user-related data involved in this technical solution should be obtained and used only after authorization from the user. This means that if it is necessary to use a user's personal information in this technical solution, the user's explicit consent and authorization are required before obtaining this data; otherwise, no related data collection and use will be carried out. It should also be understood that when implementing this technical solution, relevant laws and regulations should be strictly followed in the process of data collection, use, and storage, and necessary technical measures should be taken to protect user data security and ensure the secure use of data.

[0019] It is understandable that before using the technical solutions disclosed in the examples in this article, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this article in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained.

[0020] For example, upon receiving a user's proactive request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware such as electronic devices, applications, servers, or storage media performing the operations described herein, based on the prompt message.

[0021] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0022] It is understood that the above notification and user authorization process is merely illustrative and does not limit the implementation method described in this article. Other methods that comply with relevant laws and regulations may also be applied to the implementation method described in this article.

[0023] The examples herein will now be described in more detail with reference to the accompanying drawings. While some examples of this document are shown in the drawings, it should be understood that this document can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these examples are provided to provide a more thorough and complete understanding of this document. It should be understood that the accompanying drawings and examples are for illustrative purposes only and are not intended to limit the scope of this document.

[0024] In the description of the examples in this document, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The terms "first", "second", etc., may refer to different or the same objects unless explicitly stated otherwise. Other explicit and implicit definitions may also be included below.

[0025] As mentioned above, with the widespread dissemination of video, audio, and other forms of media content, users need to quickly grasp the core information involved when watching such content. This includes, for example, the sequence of events, relationships between characters, operational steps, key knowledge points, or conclusions. Some platforms offer AI-based dialogue functions, allowing users to input questions while watching media content. Large language models then generate corresponding text answers or summaries based on the media content to assist users in understanding and reviewing the material.

[0026] However, in these related technologies, AI-generated results are typically only presented as output during the current user's conversation, making it difficult for other users to generate new content versions based on the existing content. Even if other users wish to adjust the existing results, they often need to initiate a new conversation based on the original media content and regenerate their own content, making it difficult to easily reuse high-quality user-generated content. Furthermore, these related technologies lack a mechanism for publishing new content generated based on existing content as user-created works.

[0027] To this end, this paper provides a scheme for displaying components. In this scheme, a terminal device can display a first component published by a first user on a first interface. The first component is generated based on the first media content. In response to user input from a second user, the terminal device can display a second component, which is generated based on the user input and the first component and is associated with the first media content. Then, in response to the first operation, the terminal device can publish the second component as the second user's work. In this way, the second user can use the component already published by the first user as a basis to generate a second component associated with the original media content through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, promoting users' creative intentions, simplifying the steps of creation, reducing the difficulty of creation, and improving the user experience.

[0028] Figure 1 A schematic diagram of an example environment 100 in which several examples of this article can be implemented is shown. For example... Figure 1 As shown, environment 100 includes terminal device 102. Terminal device 102 can be any device with processing capabilities. For example, terminal device 102 can include smartphones, tablets, laptops, desktop computers, workstations, or smart wearable devices. In environment 100, terminal device 102 can be a client device, and terminal device 102 can run application 104. Users can interact with application 104 through terminal device 102. For example, application 104 can be a content publishing platform, content creation platform, content editing platform, social platform, video platform, music platform, etc. In environment 100, terminal device 102 can be associated with a second user 122. For example, the account of the second user 122 can be logged in on terminal device 102.

[0029] In environment 100, terminal device 102 can display a first component 110 published by first user 120 on a first interface 106. The first component 110 is generated based on media content 112 (also referred to herein as first media content). For example, terminal device 102 can display the first interface 106. The first interface 106 is configured to display works published by users. For example, the first interface 106 may include a work details interface, a work preview interface, a media content playback interface, or a comment area on the media content playback interface. For example, a first work 108 published by first user 120 can be displayed on the first interface 106, and the first work 108 may include the first component 110, wherein the first work 108 may be an independent work or a comment on media content 112. First user 120 can generate the first component 110 associated with media content 112 through AI dialogue. The first component 110 may include interactive or non-interactive content. For example, if the first component 110 includes interactive content, the first component 110 may include a relationship graph, checklist, planner, comparison table, or timeline. For example, in an example where media content 112 includes video or audio related to a TV series, the first user 120 can generate a character relationship diagram from the TV series through AI dialogue. In an example where media content 112 includes video or audio related to a cooking tutorial for a particular dish, the first user 120 can generate a list of cooking steps through AI dialogue, which may include multiple cooking steps for the dish. The first user 120 can then publish the generated first component 110 as a first work 108, allowing other users to view the first work 108 while browsing the list of works or media content 112.

[0030] In environment 100, in response to user input 114 from second user 122, terminal device 102 can display a second component 116. The second component 116 is generated based on user input 114 and the first component 110, and is associated with media content 112. For example, while viewing the first component 110, the second user 122 can perform corresponding operations to generate a new component that meets their requirements based on the first component 110. User input 114 can include natural language instructions, such as, "Modify the cooking steps to a version suitable for children." Furthermore, terminal device 102 can also receive user input 114 by receiving operations on an editable component; for example, the second user 122 can generate a new list of cooking steps by operating an editable component configured to adjust the number of people. In example 100, the second component 116 is associated with media content 112. For example, the server can modify the first component 110 associated with media content 112 to generate the second component 116 associated with media content 112. For example, when generating the second component 116, the server can input the media content 112, the first component 110, and the user input 114 into the large language model to generate the second component 116.

[0031] In environment 100, in response to the first operation, terminal device 102 can publish the second component 116 as the second work 118 of the second user 122. For example, the first operation may include triggering the publication of the component and corresponding operations to be performed during the publication process (e.g., setting the publication method or parameters, or setting viewing permissions for other users). For example, when displaying the generated second component 116, terminal device 102 can display the publication component on the interface. In response to an operation on the publication component, terminal device 102 can publish the second component 116 as the second work 118. The second work 118 can be an independent work. In other words, other users can see the second work 118 displayed as an independent work when browsing the list of works. Then, other users can view or use the second component 116 by viewing the second work 118.

[0032] In this way, the second user 122 can use the first component 110 published by the first user 120 as a basis to generate a second component 116 associated with the media content 112 through user input 114, and publish the second component 116 as an independent second work 118. This allows the second user 122 to reuse and inherit the high-quality dialogue results published by other users, promote the creative intentions of the second user 122, simplify the steps of the creation operation, reduce the difficulty of creation, and improve the user experience.

[0033] Figure 2A flowchart of a method 200 for displaying components, according to some examples in this document, is shown. Method 200 can be executed by a terminal device. For example, method 200 can be performed by... Figure 1 The terminal device 102 performs the operation. The terminal device may include, for example, a smartphone, tablet computer, laptop computer, desktop computer, workstation, or smart wearable device.

[0034] like Figure 2 As shown in box 202, the terminal device can display a first component published by a first user on a first interface. This first component is generated based on first media content. For example, in... Figure 1 In the illustrated environment 100, terminal device 102 can display a first component 110 published by a first user 120 on a first interface 106. The first component 110 is generated based on media content 112. For example, terminal device 102 can display the first interface 106. The first interface 106 is configured to display works published by users. For example, a first work 108 published by the first user 120 can be displayed on the first interface 106, and the first work 108 may include the first component 110, wherein the first work 108 may be an independent work or a comment on the media content 112. The first user 120 can generate the first component 110 associated with the media content 112 through AI dialogue. The first component 110 may include interactive or non-interactive content. The first user 120 can publish the generated first component 110 as the first work 108 for other users to view when browsing the list of works or media content 112.

[0035] In box 204, in response to user input from a second user, the terminal device can display a second component, which is generated based on the user input and the first component, and is associated with the first media content. For example, in... Figure 1 In the illustrated environment 100, in response to user input 114 from a second user 122, terminal device 102 can display a second component 116. The second component 116 is generated based on user input 114 and a first component 110, and is associated with media content 112. For example, while viewing the first component 110, the second user 122 can perform corresponding operations to generate a new component that meets their requirements based on the first component 110. In example 100, the second component 116 is associated with media content 112. For example, the server can modify the first component 110 associated with media content 112 to generate the second component 116 associated with media content 112. As another example, when generating the second component 116, the server can input media content 112, the first component 110, and user input 114 into a large language model to generate the second component 116.

[0036] In box 206, in response to the first operation, the terminal device can publish a second component as the work of a second user. For example, in... Figure 1 In the illustrated environment 100, in response to the first operation, terminal device 102 can publish a second component 116 as a second work 118 of a second user 122. For example, when displaying the generated second component 116, terminal device 102 can display the published component on the interface. In response to an operation on the published component, terminal device 102 can publish the second component 116 as a second work 118. The second work 118 can be a standalone work. In other words, other users can see the second work 118 displayed as a standalone work when browsing the list of works. Then, other users can view or use the second component 116 by viewing the second work 118.

[0037] In this way, a second user can use the components already published by the first user as a basis to generate a second component associated with the original media content through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, promoting users' creative intentions, simplifying the steps of creation, reducing the difficulty of creation, and improving the user experience.

[0038] Figure 3 A schematic diagram of a sample system 300 for generating and publishing interactive components, based on some examples in this document, is shown. Figure 3 As shown, system 300 may include a context engine 302, an AI dialogue module 304, a skill router 306, a content generator 308, a rendering and distribution module 310, and a derivative creation engine 312. The context engine 302 can acquire information related to the primary media content (e.g., Figure 1 The context engine 302 can provide the AI ​​dialogue module 304 with contextual information associated with the media content 112. For example, this contextual information may include the transcribed text of the first media content, title, tags, category information, creator information, or comment information.

[0039] The AI ​​dialogue module 304 can receive user input and determine the user's intent based on the contextual information of the user input and the first media content. In some cases, the terminal device can display a third component (also referred to herein as a derivative creation component) on the first interface. In response to an operation on the third component, the terminal device can display a first input component. The terminal device can then receive user input through the first input component, and this user input includes natural language text. In this way, users can describe their derivative creation needs with lower operational difficulty. Furthermore, natural language instructions can include richer modification methods, which can improve the flexibility of derivative creation of the component. In some cases, the first component and the second component can be interactive components, and interactive components can include interactive content. In some cases, the first component includes first interactive content, and in response to an operation on the first interactive content, the terminal device can display second interactive content on the first component. In this way, the component can support on-demand expansion and layered exploration, avoiding the display of too much information at once on the initial interface and improving interaction efficiency.

[0040] The AI ​​dialogue module 304 can send user intents to the skill router 306 and the content generator 308. The skill router 306 can determine a first component type for generating components based on the user intent, the content characteristics of the first media content, or a combination of both. For example, the first component type may include at least one of a relationship graph, checklist, planner, timeline, or comparison component. The skill router 306 can provide the content generator 308 with generation rules, data patterns, or display rules corresponding to the first component type. Furthermore, the content generator 308 can also provide feedback on the generation results to the skill router 306 to adjust the first component type, generation parameters, or display configuration.

[0041] Content generator 308 can generate structured component data based on user input, contextual information of the first media content, and the first component type. For example, structured component data may include attributes of entries or nodes, relationships between nodes, interactive fields, clickable actions, and interface display configurations. The structured component data generated by content generator 308 can be provided to rendering and distribution module 310, which renders the structured component data into an interactive component and displays it in the client's dialog interface, the media content's comment area, the user's homepage, or the content stream interface. Rendering and distribution module 310 can also, in response to a user's publishing operation, store and distribute the interactive component as a user's work.

[0042] In some examples, the derivative creation engine 312 can respond to derivative creation operations on published components by acquiring the structured component data of the published component, the contextual information of the media content associated with the component, and new user input. Based on the structured component data of the published component, the contextual information of the media content, and the new user input, it can generate new interactive components. The new interactive components generated by the derivative creation engine 312 can be published as a second user's work through the rendering and distribution module 310, establishing a version association or derivative association with the original interactive component. Thus, the system 300 can support users in generating interactive components around media content and allows other users to adapt, publish, and disseminate these components using natural language commands.

[0043] Figure 4 A flowchart of an example process 400 for generating interactive components, based on some examples in this document, is shown. Process 400 can be executed by a server. Figure 4 As shown in box 402, the server can construct contextual information for the primary media content. The primary media content can include video, audio, live stream replays, or other media content. This contextual information can include the transcribed text of the primary media content, its title, tags, category information, creator information, or comment information, etc.

[0044] In box 404, in response to user input, the server can use an intent recognition model to determine the skill type corresponding to that user input. User input may include natural language text entered by the user while watching the primary media content. For example, skill types may include relationship graphs, checklists, planners, timelines, or comparison components. The server can also determine the skill type based on the content characteristics of the primary media content. For example, if the primary media content is a cooking tutorial video, the server will determine the corresponding skill type as a checklist; if the primary media content is a film or television commentary video, the server may determine the corresponding skill type as a relationship graph or timeline, etc.

[0045] In box 406, the server can generate structured data for the first interactive component based on the contextual information of the first media content, the determined skill type, and user input. For example, the server can use the contextual information of the first media content, a data pattern corresponding to the determined skill type, and a large language model of the user input to output structured data conforming to that data pattern. This structured data may include attributes of items or nodes, relationships between nodes, interactive fields that allow user operation, processing rules corresponding to the interactive operation, and display configurations for displaying the first interactive component. For example, if the first interactive component includes a relationship graph, the structured data may include multiple nodes and the relationships between them. If the first interactive component includes a checklist, the structured data may include multiple items, the order of the items, the relationships between the items, and a video timestamp corresponding to each item.

[0046] In box 408, the server can send structured data of the first interactive component to the terminal device (e.g., a client). The terminal device can then display the first interactive component in a dialog interface, media content playback interface, media content comment area, or other interfaces based on this structured data and rendering rules corresponding to the skill type. Users can view and interact with the interactive content within the first interactive component. In some examples, in response to a publishing operation, the terminal device can publish the first interactive component as a work associated with the first media content for other users to view, use, or generate derivative interactive components based on new user input.

[0047] Figure 5 A flowchart of an example process 500 for derivative creation based on generated interactive components, based on some examples in this paper, is shown. Process 500 can be generated by a terminal device (e.g., such as...). Figure 1 The terminal device 102 shown executes this. For example... Figure 5 As shown in box 502, the terminal device can render the first interactive component based on the structured data of the first interactive component. The first interactive component can be associated with the first media content. The first interactive component may include a relationship graph, checklist, planner, timeline, or comparison component, etc. The terminal device can render the structured data into interface content that can be browsed and operated by the user based on the component type and display configuration of the first interactive component.

[0048] In box 504, in response to an operation on the published component, the terminal device can publish the first interactive component as the first user's first work. For example, the first user can trigger a publish operation after previewing the first interactive component to publish the first interactive component to the comment section corresponding to the first media content, the first user's profile page, portfolio interface, or content stream. The terminal device can also store the first work in association with the first media content, the first user, and the component type of the first interactive component.

[0049] In box 506, the terminal device can display a content stream, which may include multiple works, including a first work and first media content. In some examples, the multiple works may include a first work published by a first user and works published by other users that are associated with the first media content. The terminal device may display interface elements in the content stream that represent the first work and display information associated with the first interactive component to enable other users to discover and interact with the first interactive component.

[0050] In box 508, in response to user input from a second user, the terminal device can display a second interactive component. The second interactive component can be generated based on the user input and the first interactive component, and is associated with the first media content. For example, the second user can input natural language text such as "change the itinerary to a three-day, two-night family version" or "change the character relationship diagram to a modern workplace style" while browsing the first work. The terminal device can send the structured data of the first interactive component, the contextual information of the first media content, and the user input to the server to generate the structured data of the second interactive component. After receiving the structured data of the second interactive component, the terminal device can display the second interactive component based on this structured data. In this way, the second user can reuse the first interactive component and create derivative works without having to extract and reorganize information from the first media content.

[0051] In box 510, in response to a publish operation, the terminal device can publish a second interactive component as a second work by a second user. The second work can establish a derivative relationship or version association with the first work to indicate that the second work is created based on the first work. In some examples, the terminal device can also display the source information of the first work, the information of the first user, or a derivative creation identifier in the interface elements corresponding to the second work, thereby supporting users to further create derivative works from the second work and trace back to the original work.

[0052] In some cases, the first interactive content includes a first relationship graph, which is associated with the first media content. The first relationship graph includes a first set of nodes and the relationships between those nodes. This approach allows the relationships between people, events, or concepts within the media content to be presented in a structured and interactive manner, facilitating user understanding of complex content and improving the user experience.

[0053] In some cases, in response to an operation on a first node in the first group of nodes, second interactive content is displayed. This second interactive content includes a second relationship graph, which includes at least some of the nodes in the first group of nodes and the relationships between them. In this way, when a user clicks on a node in the relationship graph, a second relationship graph containing related nodes and relationships is displayed, allowing the user to explore relationships around that node and improving the efficiency of retrieving and focusing relationship information.

[0054] In some scenarios, the terminal device can display the first media content and a fourth component (e.g., a prompt component) on a third interface (e.g., a media content playback interface). In response to an action on the fourth component, the terminal device can trigger the generation of the first component. This allows users to directly enter the generation process of interactive components from the media content playback context, reducing context switching and associating the generated result with the media content.

[0055] In some cases, in response to an operation on the fourth component, the terminal device can display a second prompt indicating that the generation process of the first component includes summarizing media content and constructing an interactive interface. This allows the user to understand that the system generates interactive components based on media content, increasing the user's predictability of the generated results.

[0056] In some cases, the terminal device can display a fifth component (e.g., a "post a work" component) in association with the first component. In response to an operation on the fifth component, the terminal device can publish the first component as the first user's work. In this way, the generated interactive component can be transformed from an individual's creation into a content base accessible to other users and used for derivative creation, thereby increasing the user's creative motivation and improving the user experience.

[0057] In some cases, the terminal device can display a sixth component (e.g., a comment component) in association with the first component. In response to an operation on the sixth component, the terminal device can post a first comment on the first media content, the first comment including the first content associated with the first component. In this way, the generated component can be embedded within the comment context of the media content, thereby facilitating the component's dissemination, increasing the chances for other users to discover the component and engage in secondary creation, and enhancing the user's creative enthusiasm.

[0058] Figures 6A to 6G A schematic diagram of example 600, based on media content, is shown, illustrating the generation of an interactive relationship graph according to some examples in this paper. For example... Figure 6A As shown, Example 600 includes a media content playback interface 602, which is configured to play media content 604 (e.g., Figure 1 Media content 604 (112) can be, for example, video or audio. In example 600, media content 604 is also referred to as work A. When media content 604 is audio, information associated with the audio can be displayed on media playback interface 602, such as the cover art, author, or subtitles corresponding to the audio. Author information 606 of media content 604 can also be displayed on media content playback interface 602, which can be, for example, the name or avatar of the author of media content 604. In example 600, a prompt component 608 (e.g., a fourth component) can be displayed on media content playback interface 602. Prompt information associated with media content 604 can be displayed on prompt component 608 to prompt the user to display information associated with media content 604 by triggering prompt component 608. For example, when media content 604 is a film and television commentary video published by user A, the prompt component 608 can display the prompt message "Character Relationship Network of Work A" to prompt the user to obtain information related to the character relationship network in this video by clicking the prompt component 608.

[0059] like Figure 6B As shown in Example 600, in response to an operation on Prompt component 608, the terminal device can display Dialogue component 610 on media content playback interface 602. Dialogue component 610 is configured to engage in dialogue with an AI object (e.g., a large language model), and this dialogue is associated with media content 604. In other words, in the dialogue corresponding to dialogue component 610, the context of the dialogue includes information from media content 604.

[0060] In Example 600, in response to an operation on Prompt Component 608, the terminal device can also acquire a prompt word 612 corresponding to Prompt Component 608. Prompt word 612 is associated with media content 604, and prompt word 612 can prompt the AI ​​object to generate content associated with media content 604. Prompt word 612 can be associated with prompt information on Prompt Component 608. For example, prompt word 612 could be "Sorting out the character relationship network of work A into a relationship graph." In some cases, in response to an operation on Prompt Component 608, the terminal device can display prompt word 612 in Dialogue Component 610 and send prompt word 612 to the AI ​​object without user interaction. In some cases, in response to an operation on Prompt Component 608, the terminal device can display prompt word 612 in Dialogue Component 610, and the user can modify prompt word 612. In response to a sending operation of the modified prompt word, the terminal device can send the modified prompt word to the AI ​​object.

[0061] like Figure 6C As shown, in response to the prompt 612 being sent to the AI ​​object, the terminal device can display progress information 618 on the dialogue component 610 regarding the generation task of the interactive component. In example 600, the progress information 618 may indicate that the generation task of the interactive component includes the following steps: summarizing video information, constructing a relationship graph and injecting visual styles, and refining the text descriptions in the relationship graph. Furthermore, information 620 may also be displayed on the dialogue component 610, indicating the thought process of the large language model during the generation of the interactive component.

[0062] like Figure 6D As shown, when the task of generating the interactive component is completed, the generated interactive component 622 can be displayed on the dialogue component 610 (e.g., Figure 1 The first component 110 in the example. In example 600, interactive component 622 includes a relationship graph 634 generated based on media content 604. For example, relationship graph 634 can indicate a character relationship diagram in media content 604. Relationship graph 634 includes multiple nodes (e.g., represented by circles) corresponding to multiple characters and the relationships between these multiple nodes (e.g., character relationships, represented by line segments between circles). For example, relationship graph 634 can include node 626 corresponding to character A in media content 604 and node 628 corresponding to character B in media content 604. Furthermore, relationship graph 634 also includes the relationship between character A and character B in media content 604.

[0063] In Example 600, a question component 630 may also be displayed on the dialogue component 610. The user can input natural language commands for the relationship graph 634 through the question component 630. In response to the sending of the natural language command, the terminal device can display a modified relationship graph on the dialogue component 610, which is generated based on the relationship graph 634 and the natural language command. In Example 600, a publication component 632 may also be displayed on the dialogue component 610. In response to an operation on the publication component 632, the terminal device can publish an independent first work (e.g., Figure 1 The first work (108) includes an interactive component 622. After the first work is published, it can be included in the content stream sent to other users (e.g., a second user) along with media content 604, so that the first work and media content 604 can be displayed in the other user's recommended content.

[0064] In example 600, a relationship graph 634 can be displayed on the interactive component 622. This graph is centered on node 626 (e.g., the character A corresponding to node 626 could be one of the main characters in work A) and includes the relationships between node 626 and other nodes. In response to an operation on a first node in the relationship graph 634 other than node 626, another relationship graph can be displayed on the interactive component 622. This other relationship graph can be centered on the first node and include the relationships between the first node and other nodes. For example, in response to an operation on node 628, a graph such as... can be displayed on the interactive component 622. Figure 6E The relationship diagram shown is 636.

[0065] like Figure 6E As shown, relationship graph 636 is centered on node 628 and includes the relationships between node 628 and other nodes. In example 600, relationship graphs 634 and 636 can correspond to two states of interactive component 622. Relationship graphs 634 and 636 can have the same number of nodes, but present different relationships between nodes centered on different nodes. This functionality can be provided by interactive component 622, therefore, there is no need to regenerate interactive component 622.

[0066] In response to an operation on the published work component 632, the terminal device can publish the interactive component 622 as the first work (e.g., Figure 1 The first published work (108). The first published work can be added to a pool of works, from which multiple works can be selected to form a content stream for the current user or other users, which can then be displayed on the terminal devices of the current user or other users. For example... Figure 6FAs shown, a content stream interface 640 can be displayed on the second user's terminal device. The content stream interface 640 can display a content stream, which may include works 642, 644, 646, and 648, etc. In example 600, work 642 may be a first work including an interactive component 622. A preview image of work 642 can be displayed on the content stream interface 640, and the preview image may include content associated with the interactive component 622. Furthermore, information 650 and 652 associated with work 642 can also be displayed on the content stream interface 640. Information 650 may include, for example, the title or content description of the interactive component 622. Information 652 may include, for example, the identifier of the author of work 642 (e.g., avatar and name). Additionally, information 652 may indicate that work 642 was generated by user B using an AI model, which can reduce other users' expectations of the difficulty of derivative creation and encourage other users to use AI for derivative creation.

[0067] like Figure 6G As shown, in response to an operation on work 642, the terminal device can display work details interface 654 (e.g., Figure 1 The first interface 106 in the process. The interactive component 622 and the derivative creation component 656 can be displayed on the work details interface 654. In response to the operation on the derivative creation component 656, the terminal device can display the derivative creation interface, allowing the user to generate new interactive components based on the interactive component 622.

[0068] In some cases, the terminal device can display a first prompt message on the first interface. This first prompt message is associated with the third component and includes an example of the user's input. This approach can inspire users to create derivative works, reduce the difficulty of creating derivative works, and improve the user experience.

[0069] In some cases, in response to the release of the second component, the terminal device can display at least a portion of multiple works on a second interface (e.g., a content stream interface), said multiple works including the first work and the second work. This allows the first and second works to be viewed together, facilitating the formation of a collection of works centered around the same media content.

[0070] In some cases, the terminal device can display a first interface element corresponding to the second work on the second interface. This first interface element includes first information associated with the second component. In this way, users can identify derivative works corresponding to the second component in the list of works and quickly learn about the content or attributes of those works.

[0071] In some cases, the first interface element also includes second information indicating that the second work was generated by the second user using a model. This approach reduces users' expectations of the difficulty of derivative creation and encourages them to use AI for derivative works.

[0072] In some cases, the first interactive content has a first style, and the user input indicates the generation of interactive content with a second style, which is different from the first style. In this way, users can create derivative works in terms of expression while retaining the content carried by the original component, adapting to different usage scenarios.

[0073] In some cases, the second interactive content includes a second set of nodes, where the nodes in the second set correspond to the nodes in the first set, and the relationships between the nodes in the second set are the same as those between the nodes in the first set. This allows derivative creation components to retain the core semantic structure of the original relationship graph, reducing relationship distortion or content deviation during the derivative creation process.

[0074] Figures 7A to 7C A schematic diagram of example 700, based on a generated interactive relationship graph, is shown, illustrating derivative creations using some examples from this paper. For example... Figure 7A As shown, example 700 includes a work details interface 702. Interactive components 704 (e.g., ...) can be displayed on the work details interface 702. Figure 6D Interactive component 622). Interactive component 704 may include a relationship graph indicating the character relationships in work A, and the relationship graph may include a node 710 corresponding to character A and a node 712 corresponding to character B. In example 700, a derivative creation component 706 and a prompt message 708 (e.g., a first prompt message) may be displayed on the work details interface 702. The prompt message 708 is displayed in association with the derivative creation component 706, and the prompt message 708 may include an example of user input, such as, “Try generating a modern version of the job hierarchy network.”

[0075] like Figure 7BAs shown, in response to an operation on the derivative creation component 706, the terminal device can display the input component 714. The terminal device can receive user input 716 through the input component 714, which may include natural language text describing the requirements for the derivative creation. In some cases, in response to an operation on the derivative creation component 706, the terminal device can acquire user input associated with the derivative creation component 706 and automatically fill that user input into the input component 714, allowing the user to make further modifications based on the user input, thereby reducing the difficulty for the user in creating derivative works. In Example 700, the interactive component 704 may have a first style (e.g., an ancient style), and the user input 716 may instruct the generation of a second style (e.g., a modern rank style). In response to an operation on the sending component 718, the terminal device can display as shown... Figure 7C The derivative creation interface shown is 702.

[0076] like Figure 7C As shown, a dialogue component 720 can be displayed on the derivative creation interface 702. An interactive component 722 generated based on the interactive component 704 (e.g., ...) can be displayed on the dialogue component 720. Figure 1 The second component 116 in the interactive component 722 includes a relationship graph 728, which has a different style from the relationship graph in the interactive component 704. The nodes in the relationship graph 728 correspond to the nodes in the interactive component 704, and the relationships between the nodes in the relationship graph 728 are the same as the relationships between the nodes in the relationship graph of the interactive component 704. For example, the relationship graph 728 includes a node 724 corresponding to role A and a node 726 corresponding to role B. The images of nodes 724 and 726 are changed to images associated with modern job titles (e.g., chairman, or general manager), and nodes 724 and 726 may include text descriptions associated with the modern job titles.

[0077] A question component 732 can be displayed on the derivative creation interface 702. In response to new user input obtained through the question component 732, the terminal device can display a new interactive component generated based on the interactive component 722 and the new user input. Furthermore, a publish component 730 can also be displayed on the derivative creation interface 702. In response to an operation on the publish component 730, the terminal device can publish the interactive component 722 as a second work (e.g., Figure 1 The second work (118) in the work pool. Works including interactive component 704 and works including interactive component 722 can be included in the work pool for determining multiple works from the work pool to form a content stream for the current user or other users, which can be displayed on the terminal device of the current user or other users.

[0078] Figure 8 A block diagram of a device 800 for displaying components, according to some examples herein, is shown. Figure 8 As shown, device 800 includes a first component display module 802, configured to display a first component published by a first user on a first interface, the first component being generated based on first media content. Device 800 also includes a second component display module 804, configured to display a second component in response to user input from a second user, the second component being generated based on the user input and the first component, and associated with the first media content. Furthermore, device 800 includes a second component publishing module 806, configured to publish the second component as a work of the second user in response to a first operation. In this way, the second user can use a component already published by the first user as a basis to generate a second component associated with the original media content through new user input, and publish the second component as an independent work. This allows for the reuse and inheritance of high-quality dialogue results already published by other users, promoting the user's creative intent, simplifying the creative process, reducing the difficulty of creation, and improving the user experience.

[0079] In some cases, device 800 further includes: a third component display module configured to display a third component on the first interface; a first input component display module configured to display a first input component in response to an operation on the third component; and a user input receiving module configured to receive user input via the first input component, the user input including natural language text. In this way, users can describe their creative needs with lower operational difficulty. Furthermore, natural language instructions can include richer modification methods, improving the flexibility of component-based creative work.

[0080] In some cases, device 800 further includes a first prompt information display module, configured to display first prompt information on the first interface, the first prompt information being associated with the third component, and the first prompt information including an example of the user input. In this way, users can be encouraged to engage in derivative creation, reducing the operational difficulty of derivative creation and improving the user experience.

[0081] In some cases, the first media content corresponds to a first work, the second component corresponds to a second work, and the device 800 further includes a first work display module configured to display at least a portion of a plurality of works on a second interface in response to the publication of the second component, the plurality of works including the first work and the second work. In this way, the first work and the second work can be viewed together, facilitating the formation of a collection of works centered around the same media content.

[0082] In some cases, the first work display module includes a first interface element display module, configured to display a first interface element corresponding to the second work on the second interface. The first interface element includes first information associated with the second component. In this way, users can identify derivative works corresponding to the second component in the work list and quickly learn about the content or attributes of those works.

[0083] In some cases, the first interface element also includes second information indicating that the second work was generated by the second user using a model. This reduces users' expectations of the difficulty of derivative creation and encourages them to use AI for derivative creation.

[0084] In some cases, the first component includes first interactive content, and the device 800 further includes a second interactive content display module configured to display second interactive content on the first component in response to an operation on the first interactive content. This allows the component to support on-demand expansion and layered exploration, avoiding the display of too much information at once in the initial interface and improving interaction efficiency.

[0085] In some cases, the first interactive content includes a first relationship graph associated with the first media content, comprising a first set of nodes and the relationships between those nodes. This allows the relationships between characters, events, or concepts within the media content to be presented in a structured and interactive manner, facilitating user understanding of complex content and improving the user experience.

[0086] In some cases, the second interactive content display module includes a second relationship graph display module, configured to display the second interactive content in response to an operation on a first node in the first group of nodes. The second interactive content includes a second relationship graph, which includes at least some nodes in the first group of nodes and the relationships between those nodes. In this way, when a user clicks on a node in the relationship graph, a second relationship graph containing related nodes and relationships can be displayed, thereby enabling the search and focusing of relationship information around that node and improving the efficiency of relationship information retrieval and focus.

[0087] In some cases, the first interactive content has a first style, and the user input instructs the generation of interactive content with a second style, which differs from the first style. This allows users to create derivative works in terms of expression while retaining the content carried by the original component, adapting to different usage scenarios.

[0088] In some cases, the second interactive content includes a second set of nodes, where the nodes in the second set correspond to the nodes in the first set, and the relationships between the nodes in the second set are the same as those between the nodes in the first set. This allows derivative creation components to retain the core semantic structure of the original relationship graph, reducing relationship distortion or content deviation during the derivative creation process.

[0089] In some cases, device 800 further includes: a fourth component display module configured to display the first media content and the fourth component on a third interface; and a first component generation module configured to trigger the generation of the first component in response to an operation on the fourth component. In this way, users can directly enter the generation process of interactive components from the playback scenario of the media content, reducing context switching and associating the generation result with the media content.

[0090] In some cases, device 800 further includes a second prompt information display module, configured to display a second prompt information in response to an operation on the fourth component, the second prompt information indicating that the generation process of the first component includes summarizing media content and constructing an interactive interface. In this way, the user can understand that the system generates interactive components based on media content, improving the user's predictability of the generation result.

[0091] In some cases, device 800 further includes: a fifth component display module configured to display a fifth component in association with the first component; and a first work publishing module configured to publish the first component as the first user's work in response to an operation on the fifth component. In this way, the generated interactive component can be transformed from a personal creation into a content base accessible to other users and used for derivative creation, thereby increasing the user's creative enthusiasm and improving the user experience.

[0092] In some cases, device 800 further includes: a sixth component display module configured to display a sixth component in association with the first component; and a first comment publishing module configured to publish a first comment on the first media content in response to an operation on the sixth component, the first comment including first content associated with the first component. In this way, the generated component can be embedded in the comment context of the media content, thereby facilitating the dissemination of the component, increasing the chances for other users to discover the component and create derivative works, and enhancing the user's creative enthusiasm.

[0093] Figure 9 A block diagram of a device 900 capable of implementing several examples of this document is shown. Device 900 may be, for example, as... Figure 1 The terminal device 102 shown is an example. Figure 9 As shown, device 900 includes a central processing unit (CPU) and / or a graphics processing unit (GPU) 901, which can perform various appropriate actions and processes according to computer program instructions stored in read-only memory (ROM) 902 or loaded from storage unit 908 into random access memory (RAM) 903. Various programs and data required for the operation of device 900 can also be stored in RAM 903. CPU / GPU 901, ROM 902, and RAM 903 are interconnected via bus 904. Input / output (I / O) interface 905 is also connected to bus 904. Although not shown in... Figure 9 As shown, device 900 may also include a coprocessor.

[0094] Multiple components in device 900 are connected to I / O interface 905, including: input unit 906, such as keyboard, mouse, etc.; output unit 907, such as various types of monitors, speakers, etc.; storage unit 908, such as disk, optical disk, etc.; and communication unit 909, such as network card, modem, wireless transceiver, etc. Communication unit 909 allows device 900 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0095] The various methods or processes described above can be executed by CPU / GPU 901. For example, in some cases, the methods can be implemented as computer software programs tangibly contained in a machine-readable medium, such as storage unit 908. In some cases, part or all of the computer program can be loaded and / or installed on device 900 via ROM 902 and / or communication unit 909. When the computer program is loaded into RAM 903 and executed by CPU / GPU 901, one or more steps or actions in the methods or processes described above can be performed.

[0096] In some cases, the methods and processes described above can be implemented as a computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for performing the various aspects of this document.

[0097] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example, but not limited to, electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0098] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, a local area network (LAN), a wide area network (WAN), and / or a wireless network, to an external computer or external storage device. The network may include copper cables, fiber optic cables, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0099] The computer program instructions used to perform the operations described herein can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​and conventional procedural programming languages. The computer-readable program instructions can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider). In some cases, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be customized using the status information from the computer-readable program instructions to implement various aspects of this document.

[0100] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0101] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0102] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to several examples herein. In this regard, each box in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the boxes may occur in a different order than those marked in the figures. For example, two consecutive boxes may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0103] The examples described above are exemplary and not exhaustive, nor are they limited to the disclosed examples. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described examples. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to technology in the market, or to enable others skilled in the art to understand the examples disclosed herein.

Claims

1. A method for displaying a component, comprising: The first component, published by the first user, is displayed on the first interface. The first component is generated based on the first media content. In response to user input from a second user, a second component is displayed, which is generated based on the user input and the first component, and is associated with the first media content; as well as In response to the first operation, the second component is published as the work of the second user.

2. The method according to claim 1, further comprising: Display the third component on the first interface; In response to an operation on the third component, the first input component is displayed; as well as The user input, including natural language text, is received through the first input component.

3. The method according to claim 2, further comprising: A first prompt message is displayed on the first interface. The first prompt message is associated with the third component and includes an example of the user input.

4. The method of claim 1, wherein the first media content corresponds to the first work, the second component corresponds to the second work, and the method further comprises: In response to the release of the second component, at least a portion of a plurality of works, including the first work and the second work, are displayed on a second interface.

5. The method of claim 4, wherein displaying at least a portion of the works among the plurality of works on the second interface in response to the publication of the second component comprises: The second interface displays a first interface element corresponding to the second work. The first interface element includes first information, which is associated with the second component.

6. The method of claim 5, wherein the first interface element further includes second information, the second information indicating that the second work was generated by the second user using a model.

7. The method of claim 1, wherein the first component includes first interactive content, and the method further includes: In response to an operation on the first interactive content, a second interactive content is displayed on the first component.

8. The method according to claim 7, wherein the first interactive content includes a first relationship graph, the first relationship graph being associated with the first media content, and the first relationship graph including a first group of nodes and the relationships between the first group of nodes.

9. The method of claim 8, wherein displaying the second interactive content on the first component in response to an operation on the first interactive content comprises: In response to an operation on a first node in the first group of nodes, the second interactive content is displayed, the second interactive content including a second relationship graph, the second relationship graph including at least some of the nodes in the first group of nodes and the relationships between the at least some of the nodes.

10. The method of claim 8, wherein the first interactive content has a first style, and the user input indicates the generation of interactive content with a second style, the second style being different from the first style.

11. The method of claim 8, wherein the second interactive content includes a second group of nodes, the nodes in the second group of nodes corresponding to the nodes in the first group of nodes, and the relationship between the nodes in the second group of nodes is the same as the relationship between the nodes in the first group of nodes.

12. The method according to claim 1, further comprising: The first media content and the fourth component are displayed on the third interface; as well as In response to an operation on the fourth component, the generation of the first component is triggered.

13. The method of claim 12, further comprising: In response to an operation on the fourth component, a second prompt message is displayed, indicating that the generation process of the first component includes summarizing media content and constructing an interactive interface.

14. The method of claim 12, further comprising: The fifth component is displayed in association with the first component; as well as In response to the operation on the fifth component, the first component is published as the work of the first user.

15. The method of claim 12, further comprising: The sixth component is displayed in association with the first component; as well as In response to an operation on the sixth component, a first comment is published on the first media content, the first comment including first content associated with the first component.

16. An apparatus for displaying a component, comprising: The first component display module is configured to display a first component published by a first user on a first interface, the first component being generated based on first media content; The second component display module is configured to display a second component in response to user input from a second user. The second component is generated based on the user input and the first component and is associated with the first media content. as well as The second component publishing module is configured to publish the second component as the work of the second user in response to the first operation.

17. An electronic device comprising: processor; as well as A memory coupled to the processor, the memory having instructions stored therein, which, when executed by the processor, cause the electronic device to perform the method according to any one of claims 1 to 15.

18. A computer program product tangibly stored on a non-transitory computer-readable medium and comprising machine-executable instructions that, when executed, cause a machine to perform the method according to any one of claims 1 to 15.

Images