Method, device, equipment and program product for interface interaction

Abstract

Provided are an interface interaction method, device, equipment and program product. The method proposed herein includes: presenting a first interface, the first interface displaying first media content, the first media content being associated with second media content, the first media content and the second media content having different work types; and presenting first interactive content in the first interface, the first interactive content corresponding to second interactive content, the second interactive content being associated with the second media content publication. In this way, the efficiency of a user obtaining information can be improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, and program products for user interface interaction. Background Technology

[0002] Different types of media content may describe the same or similar plots, but related solutions typically present their interactive content separately on the interface of each media content. There is still room for improvement in how to ensure that electronic devices accurately display interactive content related to another type of media content according to the current playback position during the playback of one type of media content. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: presenting a first interface displaying first media content, the first media content being associated with second media content, the first media content and the second media content having different work types; and presenting first interactive content on the first interface, the first interactive content corresponding to second interactive content, the second interactive content being published in association with the second media content.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present a first interface displaying first media content associated with second media content, the first media content and the second media content having different work types; and a second presentation module configured to present first interactive content on the first interface, the first interactive content corresponding to the second interactive content, the second interactive content being published in association with the second media content.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0007] In this way, electronic devices can reuse interactive data associated with media content of another type of work during the playback of media content of one type of work, so that interactive content across different types of work can be accurately presented according to media association, and the amount of processing required to repeatedly generate data to display the same semantic interactive content can be reduced.

[0008] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2H Example interfaces for some scenarios are shown; Figure 3 The flowcharts show example processes of interface interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0013] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0014] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0015] As used in this article, "interface" can refer to a visual interactive container organized and output by an electronic device. An interface can be a page, panel, overlay, split-screen area, or a display state formed by a combination of multiple areas.

[0016] As used herein, "media content" can refer to content that can be presented, played, or viewed by an electronic device. Media content can include video, audio, images, textual works (such as novels), or other suitable forms of content. Video can include live video, long-form video, short-form video, or animated video; audio can include music, speech, podcasts, or audio works; images can include a single image or a collection of images; and textual works can include chapters, paragraphs, or other textual content. A piece of media content can include only one form of content or multiple forms of video, audio, images, and text. Media content can also refer to a complete work or at least a part of a complete work.

[0017] As used in this article, "textual work" can refer to a collection of textual data organized in a readable order. A textual work can include chapters, paragraphs, sentences, or other units of textual content at different granularities.

[0018] As used herein, the term "work type" can refer to at least one of the following: the presentation format, content carrier, production method, playback method, or dissemination method of media content. Work types can include live broadcasts, long-form video works, short-form video works, graphic works, text works, image works, audio works, animated works, or other appropriate types. For example, live broadcasts and short-form video works can have different work types, as can short-form video works and graphic works, and graphic works and audio works. Two media contents describing the same characters, events, themes, or plots can still have different work types due to differences in their presentation format or content carrier. Work types are not limited to the file format or data format corresponding to the media content; the first and second work types are only used to distinguish the work types of the corresponding media content and are not used to limit the priority, generation order, or release time order of work types.

[0019] As used herein, the term "content unit" can refer to a portion of media content, which may include video clips, audio clips, portions of images, text fragments, or other suitable forms of content. For example, a video clip may be a continuous sequence of images within a specific playback timeframe in a video; an audio clip may be a segment of sound within an audio recording within a specific playback timeframe; a text fragment may be a sentence, a paragraph, multiple consecutive paragraphs, or portions of text from a novel, article, or other textual work. Media clips can be identified from the corresponding media content based on at least one of the following: playback timeframe, content theme, scene changes, character dialogue, event phase, chapter structure, or content location. The terms "first clip" and "second clip" are used only to distinguish different media clips and are not used to define the order or position of the corresponding media clips within the media content.

[0020] As used in this article, a "segment" can refer to a range of media content defined by a start time and an end time. A segment can include one or more shots, or it can be defined by event boundaries or dialogue boundaries.

[0021] As used in this article, "storyboard" can refer to a frame segment within a media clip. This frame segment can consist of consecutive frames or adjacent frames with shared narrative semantics.

[0022] As used in this article, "interactive content" can refer to content objects that can be presented and associated with an interactive state. Secondary interactive content can be comments associated with a textual work or a content unit within a textual work, while primary interactive content can be the presentation of secondary interactive content in a media interface.

[0023] The term "regular bullet screen content" used in this article refers to the bullet screen content displayed on the media playback interface. First-person interactive content can be distinguished from regular bullet screen content through different styles, or through a content structure that differentiates it from regular bullet screen content by its source and content components.

[0024] As used in this article, "interactive content set" can refer to a group of interactive content associated with content units in a textual work. The server can select a second interactive content from this set based on interaction information, or it can organize the interactive content in the set according to time or interaction information.

[0025] As used herein, "interaction information" refers to information describing the interaction status, result, or relationship of interactive content. Interaction information may include the number of favorites, replies, comments, shares, favorite rate, reply rate, interaction time, interaction type, interaction status, comment content, reply relationship between interactive content, or a combination of the above. For example, after a user favorites a piece of first interactive content, the interaction information corresponding to the second interactive content may include the updated number of favorites; after a user comments on the first interactive content, the interaction information may include the comment content and the comment relationship between that comment and the second interactive content. Interaction information may correspond to one or more pieces of interactive content and may be created, updated, or deleted by an electronic device or server in response to a user's interaction. Interaction information and interactive content may be stored separately or may be correlated through interaction content identifiers, media content identifiers, or other associated information.

[0026] As used in this article, the term "correspondence" indicates a resolvable association between two objects. There can be a first association between the first media content and the textual work, a second association between the second interactive content and the textual work, and a third association between the first interactive content and the second interactive content.

[0027] As used in this article, "style" can refer to a set of attributes that control the visual presentation of interactive content. Styles can include color, font, background, border, transparency, size, motion tracking, or a combination of these attributes.

[0028] As used in this document, "action" can refer to an input event generated by an input device that can trigger interface processing. Actions can include clicks, touches, key presses, drags, scrolling, or other inputs targeting an operable area.

[0029] As used in this article, "pre-defined position" refers to a position that can be determined according to rules before interactive content is presented. A pre-defined position can be the top of a list, a fixed position within the visible area, a position relative to text content, or a specified position within a list.

[0030] As used in this article, "playback component" refers to a UI component that can output media content and receive playback controls. Playback components can be embedded in a page, float at the top of the page, or docked to the edge of the page.

[0031] As used in this article, "history browsing progress" can refer to the previous browsing position of a text work. This position can be represented by content unit identifiers, character offsets, page positions, or a combination of these data.

[0032] As used herein, the terms "source portion" and "content portion" can refer to two distinguishable parts of the first interactive content. The source portion indicates that the second interactive content is associated with the textual work, while the content portion carries at least a part of or a summary of the second interactive content. Ordinary bullet screen content may not include a source portion, thus allowing it to be structurally distinguished from the first interactive content.

[0033] As mentioned above, different types of media content may describe the same or similar plots, but related solutions typically present their interactive content separately on the interface of each type of media content. There is still room for improvement in how to ensure that electronic devices accurately present interactive content related to another type of media content according to the current playback position during the playback of one type of media content.

[0034] A user interface interaction scheme is proposed. The scheme includes: presenting a first interface that displays first media content, which is associated with second media content, and the first and second media content have different work types; and presenting first interactive content on the first interface, which corresponds to second interactive content, and the second interactive content is related to the publication of the second media content.

[0035] Through the above solution, interactive data associated with media content of different types can be reused in the first interface according to the content correspondence, thereby alleviating the difficulty of accurately presenting the interactive data of different media content at the current playback position due to their separation, and improving the efficiency of users obtaining information. Since the electronic device 110 can reuse the second interactive content to form the first interactive content, the application 120 does not need to repeatedly generate interactive data with the same semantics for the first interface, thereby reducing the amount of related data generation and processing and storage occupation, and improving the accuracy of the association between the first interactive content and the current media content.

[0036] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0037] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1As shown, example environment 100 may include electronic device 110.

[0038] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: content sharing applications, reading applications, video playback applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0039] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0040] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0041] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and basic cloud computing services. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0042] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0043] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0044] The following description of the example will continue with reference to the accompanying drawings.

[0045] Example Interaction Figures 2A to 2H Example interfaces 200A to 200H are shown, illustrating interface interactions under various scenarios. Interfaces 200A to 200H can be... Figure 1 The electronic device 110 shown is provided through application 120. Server 130 can provide electronic device 110 with first media content, second media content, the correspondence between media segments and content units, interactive content, and interactive information. The following mainly uses the example of the first media content being TV series content, the second media content being a novel, and the first interactive content being the original text excerpts and commentaries presented in the TV series playback interface; this example is for illustration only and does not constitute a limitation on the work type, content form, or association method of the first and second media content.

[0046] In some cases, primary media content may have a primary work type, while secondary media content may have a secondary work type different from the primary work type. Work type can indicate at least one of the following: presentation format, content carrier, production method, or dissemination method of media content. The work type of media content can include live broadcast, long-form video, short-form video, graphic / textual work, textual work, audio work, animation, or other appropriate work types. For example, live broadcast and short-form video can have different work types, short-form video and graphic / textual work can have different work types, and graphic / textual work and audio work can also have different work types. The primary and secondary work types are used only to distinguish the respective work types of the primary and secondary media content and are not used to limit the priority of work types or the order of publication of the works.

[0047] In some cases, the association between primary and secondary media content can refer to a direct or indirect connection in terms of content, source, publication, adaptation, or identifier. For example, primary media content may be generated, produced, adapted, or published based on all or at least part of secondary media content; similarly, secondary media content may be generated, produced, adapted, or published based on all or at least part of primary media content. Primary and secondary media content may also describe the same or related characters, scenes, objects, events, themes, or plots, or share the same work identifier, series identifier, content source identifier, or associated publication identifier. The relationship between primary and secondary media content can be one-to-one, one-to-many, many-to-one, or many-to-many.

[0048] In some cases, electronic device 110 presents a first interface that displays first media content associated with second media content. The first media content and the second media content can have different types of works. The first interface can be an interface for presenting media content streaming, a media playback interface, a media details interface, or other interface capable of displaying the first media content. For example, such as... Figure 2A As shown, the first interface may include interface 200A, which can be used to present at least one piece of media content in a media content stream. The electronic device 110 can present the first media content included in the media content stream in interface 200A, that is, present scenes from a TV series generated or adapted from at least a portion of a corresponding novel in interface 200A. This TV series content may correspond to a first work type, which may include video works. The novel may correspond to a second work type, which may include textual works.

[0049] In some cases, electronic device 110 presents first interactive content on a first interface, which corresponds to second interactive content, and the second interactive content is associated with the publication of second media content. As an example, such as... Figure 2A As shown, the electronic device 110 can display first interactive content 202-1 and sixth interactive content on interface 200A. The sixth interactive content may include interactive content 202-2 and 202-3. The second interactive content may be a comment posted in connection with a corresponding paragraph of the novel, which may also be called a paragraph comment; the first interactive content 202-1 may be interactive content obtained based on the paragraph comment and presented in the drama screen. The sixth interactive content 202-2 and 202-3 may originate from ordinary bullet comments posted by users watching the drama content.

[0050] The above solution enables media content of different types to share interconnected interactive information and reduces the need for users to repeatedly search between multiple content interfaces to view interactive content related to a work.

[0051] In some cases, the electronic device 110 may present the first interactive content in a second style and the sixth interactive content in a third style, different from the second style. For example, the second style may be a highlight style, where the electronic device 110 can highlight the first interactive content 202-1 using a highlighted background, border, color, transparency, icon, or a combination thereof; the third style may be a regular bullet screen style without the aforementioned highlighting. The second and third styles may also differ in arrangement, display duration, font size, or animation when entering the playback area.

[0052] The above solution enables users to distinguish between the first interactive content 202-1 from the second media content and the sixth interactive content from the first media content consumption scenario in the interface, thereby reducing the possibility that users may mistake interactive content from different sources for the same source.

[0053] In some cases, the first and sixth interactive content can correspond to different content structures. Specifically, the first interactive content includes a first part and a second part. The first part describes the source of the first interactive content, and the second part is derived from the second interactive content. As an example, such as... Figure 2A As shown, the first interactive content 202-1 may include a first part 204-1 and a second part 204-2. The first part 204-1 may display identifiers such as "Original Text Commentary" to describe the source of the first interactive content, and the second part 204-2 may display comment text obtained based on the second interactive content; the sixth interactive content 202-2 and 202-3 may include bullet screen text but not the first part used to describe the source of the original text commentary. It should be noted that the second and third styles used here to distinguish interactive content may differ from the first style used below to highlight the corresponding parts of the second media content.

[0054] The above solution eliminates the need for electronic device 110 to rely solely on visual attributes such as color to express the source of content; even if different display devices present colors or transparency differently, users can still distinguish between the first interactive content and the sixth interactive content based on the content structure.

[0055] In some cases, the second part includes at least a portion of the second interactive content. For example, the second interactive content could be a quote from the original text, such as "I read the novel because of this sentence." The second part 204-2 could present the complete quote, or, if the available display length of the first interface is limited, present a continuous portion of the text, indicating the presence of undisplayed content through ellipsis markers. In some cases, when the number of characters contained in the second interactive content exceeds a first threshold, the second part 204-2 may include only at least a portion of the second interactive content. In other cases, when the number of bullet comments to be presented on the first interface within a predetermined time frame exceeds a second threshold, or the number of bullet comments to be presented within the same bullet comment track exceeds a third threshold, the electronic device 110 may shorten the content presented in the second part 204-2. The first, second, and third thresholds can be preset or determined based on the display size of the first interface, the number of bullet comment tracks, the font size, or the duration of the bullet comment display.

[0056] Through the above scheme, the electronic device 110 can retain the key text of the second interactive content in a limited bullet screen display area, and retain the source information through the first part 204-1, thereby maintaining an identifiable correspondence between the first interactive content and the second interactive content while controlling the display length of the first interactive content.

[0057] In some cases, the electronic device 110 can present first interactive content based on animation effects in a first area of ​​a first interface, whereby the first area is used to play first media content. The first area can be a media playback area, video frame area, player window, or other area used to dynamically present the first media content within the first interface. For example, if the first interface is a media playback interface, the first area can be a playback area within that interface used to play episode frames; if the first interface is a media content stream interface, the first area can be an area within a media content card used to play or preview the first media content. The first area can occupy all or part of the first interface and can be presented as a full-screen playback area, a windowed playback area, or a floating playback area depending on the playback mode of the first media content. Animation effects include the movement of the first interactive content within the first area. The first interactive content can be a bullet screen (or danmaku), and animation effects can be used to indicate that the first interactive content is presented in the form of bullet screens. As an example, the first interactive content 202-1 can be superimposed on the TV series screen played in the first area and move along the horizontal, vertical or preset trajectory of the interface 200A; the first interactive content 202-1 can also change its transparency, movement speed, border style or display position when entering the first area, moving out of the first area or being triggered.

[0058] The above solution enables interactive content from the second media content to be added to the dynamic interactive content stream corresponding to the first media content, without requiring the interactive content to continuously occupy a fixed interface area.

[0059] In some cases, the first interactive content is overlaid on the first media content. For example, the electronic device 110 can draw the first interactive content 202-1 on top of the first media content (e.g., a scene from a TV series) and adjust the movement trajectory of the first interactive content 202-1 according to the position of the character area, subtitle area, existing bullet screen track, or other interface elements. Users can also choose to show, hide, or reduce the transparency of the first interactive content 202-1 through bullet screen settings.

[0060] With the above solution, the first interactive content can be presented simultaneously with the corresponding episode screen without stopping or shrinking the first media content, and the existing bullet screen track can be used to avoid subtitles or other interface elements, thereby reducing the obstruction of the main screen area of ​​the first media content by the first interactive content.

[0061] In some cases, secondary media content can be divided into multiple content units. Taking a textual work as an example, electronic device 110 or server 130 can first divide the textual work into sentences or paragraphs based on paragraph marks, line breaks, punctuation, chapter structure, or text layout information; then, based on at least one of the following: subject, character, time, space, event, and plot stage described in the continuous text, a sentence, a paragraph, or multiple consecutive paragraphs can be identified as a content unit. As an example, multiple paragraphs describing the same character completing a series of events in the same scene can be divided into a content unit; when the character, scene, time, or main event changes, subsequent content units can be formed. Different content units can have different text lengths, and a content unit can also include some of the same contextual text as adjacent content units. In the case of video or audio content, the secondary media content can also be divided into multiple content units based on camera transitions, voice pauses, subtitle ranges, audio chapters, playback time ranges, or changes in content theme.

[0062] In some cases, the first media content includes a first segment, which corresponds to a first content unit of the second media content, and the second interactive content is interactive content for the first content unit. As an example, the second media content can be a textual work (e.g., a novel), the first content unit can be a paragraph or multiple consecutive paragraphs describing a first plot point in the novel, and the first segment can be used to depict the plot represented by the first content unit. This segment can, for example, include scene sequences generated or adapted based on at least one of the characters, dialogue, objects, setting, sequence of events, and plot outcome in the first content unit. The second interactive content can be comments posted by users reading the first content unit regarding that paragraph or the first plot point.

[0063] In some cases, hierarchical relationships can be formed between first media content and second media content, first segment and first content unit, second interactive content and first content unit, and first interactive content and second interactive content. Specifically, first media content can interpret at least a part of second media content, thus associating the first media content with the second media content; a first segment can interpret a first content unit, thus corresponding the first segment to the first content unit. The interpretation of second media content by first media content or first segment can include presenting the characters, scenes, objects, events, or plots described in the second media content through visuals, sound, dialogue, character actions, or a combination of the above. For example, a first segment can be a scene from a TV series adapted from a paragraph or plot described in a first content unit.

[0064] In some cases, the first media content can be media content generated based on at least a portion of the second media content, and the first segment can be a media segment generated based on the first content unit. For example, the first segment can be generated or produced based on at least one of the characters, dialogue, scenes, event sequence, and plot outcome described in the first content unit. It should be noted that the association between the first media content and the second media content, and the correspondence between the first segment and the first content unit, does not require that the first media content or the first segment must be generated based on the corresponding content; associations formed through adaptation, citation, related publication, or description of the same content are also acceptable.

[0065] The second interactive content can comment on paragraphs or plots contained in the first content unit, thus associating the second interactive content with the first content unit; the first interactive content is derived from the second interactive content and is presented when the first segment is played, thus corresponding the first interactive content with the second interactive content. The above association or correspondence can be direct or indirect, and can include one-to-one, one-to-many, or many-to-one relationships.

[0066] The above approach can limit the first interactive content to the second media content and its interactive content that correspond to the semantics of the current first segment, thereby reducing the probability of content mismatch caused by distributing interactive content only by work title or a large content range.

[0067] In some cases, the first segment includes at least one storyboard, which is derived from the first content unit. As an example, at least one storyboard can be determined based on the sequence of events, character dialogue, and scene changes described in the first content unit, and a correspondence between the first segment and the first content unit can be established based on the time frame of the storyboard within the first media content. In other cases, this correspondence can also be determined based on script annotations, adaptation and production information, subtitle text, visual content, audio content, or a combination of the above.

[0068] The above solution enables the electronic device 110 to present the first interactive content when the specific scene corresponding to the first content unit is played, thereby improving the consistency between the timing of the presentation of the first interactive content and the current scene plot.

[0069] In some cases, electronic device 110 presents first interactive content in response to playing a first segment of first media content. For example, when the playback progress of the first media content enters a preset playback time, playback time range, or corresponding scene corresponding to the first segment, the first interactive content 202-1 can enter interface 200A; after the first segment finishes playing or the display duration of the first interactive content is reached, the first interactive content 202-1 can be removed from interface 200A. When the playback progress has not yet entered the first segment, electronic device 110 may not present the first interactive content 202-1.

[0070] In some cases, server 130 or application 120 may store the mapping relationship between the first media content identifier, the playback time range of the first segment, the second media content identifier, the first content unit identifier, and the interactive content identifier. For example, server 130 may associate the start and end playback times of the first segment with the identifier of the first content unit, and associate the identifier of the first content unit with the set of interactive content published for the first content unit. When electronic device 110 plays the first media content, it can determine the first segment currently playing based on the current playback progress, then obtain the second interactive content via the identifier of the first content unit, and present the first interactive content obtained based on the second interactive content.

[0071] Through the above scheme, the electronic device 110 can trigger the presentation of the first interactive content by utilizing the playback state of the first segment, and determine the first interactive content to be presented through the mapping relationship between the segment, content unit and interactive content, thereby avoiding the continuous presentation of the first interactive content in media segments unrelated to the first content unit.

[0072] In some cases, the first media content also includes a second segment, which corresponds to a second content unit of the second media content. This second segment can, for example, be used to depict the plot represented by the second content unit. The fifth interactive content is interactive content specific to the second content unit; for example, it can be a user's comment on a paragraph, character dialogue, event, or plot point within the second content unit. The fourth interactive content is derived from and corresponds to the fifth interactive content. For example, the fourth interactive content may include all or at least part of the fifth interactive content, and may also include a source identifier indicating that the fifth interactive content originates from the second media content. The fourth and fifth interactive content may differ in presentation, but they may share the same interactive content identifier or correspond to each other through a pre-established association.

[0073] Electronic device 110 can respond to the playback of the second segment by presenting fourth interactive content. As an example, when the playback progress of the first media content transitions from the first segment to the second segment, electronic device 110 can stop presenting the first interactive content 202-1 and present the fourth interactive content based on the fifth interactive content for the second content unit. The fourth interactive content can be superimposed on the first media content in the form of bullet comments, and will present comment text and source identifiers such as "original text commentary" contained in the fifth interactive content. The first and fourth interactive contents can also coexist briefly before their respective display durations have ended.

[0074] The above solution enables the dynamic interactive content stream to update with the changes in the content of the first media content, and reduces the semantic disconnect caused by the long dwell time of the interactive content of the previous content unit.

[0075] In some cases, the second interactive content is selected from a set of interactive content associated with the first content unit based on interactive information. Interactive information may include the number of favorites, the number of replies, the favorite rate, the reply rate, the publication time, the content length, the content format, content quality information, or a combination of the above. As an example, server 130 may first filter out interactive content containing images or videos from the interactive content published for the first content unit, as this would result in a lack of context if only text was presented. Then, it may sort the remaining interactive content and select at least one of the top-ranked interactive content as the second interactive content.

[0076] In some cases, server 130 can also filter the second interactive content based on the maximum number of characters in the interactive content on the first interface. The second part 204-2 can present the full text of the second interactive content, or it can present a sentence, a continuous text segment, or a portion truncated with ellipses without changing the original meaning of the presented text. Server 130 can limit the number of second interactive contents presented at the same time or on the same screen, for example, presenting one or two, and replacing them with interactive content corresponding to the subsequent content unit as the playback progresses to a later segment.

[0077] The above solution can utilize interactive information, content format, and display capacity to select a second interactive content suitable for presentation on the first interface from the set of interactive content associated with the first content unit. This reduces the amount of long content, multimedia content, or content with low interactivity occupying the limited bullet screen display area and reduces the transmission and rendering overhead of the electronic device 110 for the unselected interactive content.

[0078] In some cases, electronic device 110 receives a first operation, the first operation including a triggering operation on first interactive content, and in response to the first operation, presents a second interface, the second interface displaying at least one interactive piece of content, the at least one interactive piece of content including second interactive content, and the at least one interactive piece of content being associated with second media content. As an example, such as... Figure 2A and Figure 2B As shown, the first interactive content 202-1 may include a "view" trigger entry 206-1. After the user triggers the first interactive content 202-1, the electronic device 110 can display an operation menu as shown in interface 200B, including the paragraph comment entry 206-2; after the user triggers the paragraph comment entry 206-2, the electronic device 110 can display... Figure 2C The second interface 200C is shown. In other cases, the electronic device 110 may directly present the second interface 200C in response to a trigger operation on the first interactive content 202-1 or the trigger entry 206-1.

[0079] In some cases, the operation menu may also include an entry point for viewing second media content and other entries for processing the first interactive content. Once the user triggers the entry point for viewing second media content, the electronic device 110 can directly display... Figure 2D The second media content reading interface is shown; other entry points can be used to hide the first interactive content, reduce the presentation of interactive content from the same source, or perform other operations applicable to interactive content. Entry points for viewing the second media content and other entry points can be presented alongside the commentary entry point 206-2, and do not constitute a necessary step to enter the second interface 200C.

[0080] The above solution allows users to transition from the playback scene of the first media content to the interactive scene of the second media content, reducing the need to repeatedly search for the second media content and its interactive elements.

[0081] In some cases, the electronic device 110 presents an interactive content display component 208 on a second interface. The interactive content display component 208 includes at least one interactive content item, which is interactive content relating to at least a portion of the second media content, and the second interactive content 212 is presented at a predetermined position on the interactive content display component 208. As an example, such as... Figure 2C As shown, the electronic device 110 can display an interface 200C. The interface 200C displays an interactive content display component 208. The electronic device 110 can display second interactive content 212 at the top or the first visible position of the interactive content display component 208, and display other original text commentaries on the same novel passage after the second interactive content 212.

[0082] The above solution avoids users having to search for the source interactive content again among multiple interactive content, and shortens the interaction path from the interactive content in the first media content to the interactive details in the second media content.

[0083] In some cases, electronic device 110 presents first content on a second interface, the first content corresponding to at least a portion of second media content, and second interactive content is published in association with that at least portion. As an example, such as... Figure 2C As shown, the electronic device 110 can present an interface 200C and display first content 210 above the interactive content display component 208. The second media content can be a novel, and the first content 210 can be an excerpt from the novel passage commented on by the second interactive content 212, or it can include contextual text before or after that passage.

[0084] When the second media content is an audio work, the first content 210 may include the audio segment associated with the second interactive content 212, or a playback control for playing the audio segment. The first content 210 may also include the waveform range, playback time range, subtitle text, or speech-to-text corresponding to the audio segment. For example, the second interactive content 212 may be a comment posted by a user during a first time range of playing the audio work, and the first content 210 may include the audio segment within that first time range and its playback entry point.

[0085] When the second media content is an image work, the first content 210 may include the image associated with the second interactive content 212, at least a portion of the image, or a magnified view of the corresponding image area. For example, the second interactive content 212 may be a comment posted on a target area in an image, and the first content 210 may include the target area cropped from the image, or may mark the target area in the image using borders, highlights, masks, or other styles. For second media content that includes multiple images, the first content 210 may also include one or more images associated with the second interactive content 212.

[0086] The above solution allows users to confirm the scope of the second media content associated with the second interactive content without leaving the second interface, thereby reducing the need to repeatedly switch and search between interactive content and media content.

[0087] In some cases, electronic device 110 receives a second operation, which includes triggering the first content 210 and, in response to the second operation, presenting second media content and presenting at least a portion corresponding to the first content 210 in a first style. As an example, such as Figure 2C and Figure 2D As shown, after the user triggers the first content 210 or collapses the interactive content display component 208, the electronic device 110 can present an interface 200D associated with the second media content and locate the first content unit 216. The interface 200D can be a browsing interface for the second media content; for example, when the second media content is a textual work (e.g., a novel), the interface 200D can be a novel reading interface. When the second media content is audio, the interface 200D can be an audio playback interface. The electronic device 110 can present the first content unit 216 in a first style, such as highlighting the first content unit 216 through a highlighted background, border, font, color, transparency, animation, or a combination of the above. This approach reduces the need for users to manually search for the corresponding content location within the second media content based on excerpted content.

[0088] In some cases, such as Figure 2E As shown, interface 200E can present a first entry point 220. The first entry point 220 can display a message such as "Return to original progress" or a similar message. The first entry point 220 can be triggered when a user changes the browsing position of the second media content in order to view the first content unit 216. In response to the triggering operation of the first entry point 220, electronic device 110 can present interface 200F, and within interface 200F, a third content unit 222 is presented, corresponding to the user's historical browsing progress of the second media content. As an example, such as... Figure 2E and Figure 2FAs shown, the first content unit 216 can be located in the first chapter of the novel, and the third content unit 222 can be located in the fifth chapter that the user previously viewed, or other content locations. This approach avoids overwriting the user's original content location when jumping across different genres and reduces the need for users to relocate to previously viewed locations.

[0089] In some cases, electronic device 110 receives a third operation, which is used to acquire third interactive content. For example, such as... Figure 2G As shown, the electronic device 110 can present an input component 224 in the second interface 200G. The input component 224 may include a text input area and a posting control. The user can input comment content through the input component 224 and trigger the posting control. The third operation may include inputting comment content and / or triggering the posting control. In response to the third operation, the electronic device 110 obtains the comment content input by the user and presents the comment content as third interactive content 226 in the second interface 200G.

[0090] In some cases, the second interface 200G can also be associated with the third interactive content 226 to present the first element 228, which indicates that the third interactive content 226 is associated with the first media content. For example, the first media content could be TV series content, and the interface 200G could be a reader interface for presenting novel content. A user can first trigger the first interactive content from the first interface presenting the TV series content to enter the reader interface, and then publish the third interactive content 226 in the reader interface via the input component 224. The electronic device 110 can save the media identifier, playback position, or interface jump source of the first media content from which the user enters the reader interface, and associate this information with the third interactive content 226. The first element 228 can include "from TV series" or a text description with the same meaning, and may also include a TV series icon, a source label, or a triggerable jump entry.

[0091] In some cases, electronic device 110 receives a fourth operation, which includes triggering the first element 228, and in response to the fourth operation, presents the first interface. For example, after a user triggers the first element 228 near the third interactive content 226, electronic device 110 can return from interface 200G to the first interface used to present the episode content, and present the corresponding episode content according to the media identifier associated with the third interactive content 226. If the playback position is saved, electronic device 110 can also continue playing the first media content from the playback position before the user entered the reader interface, or locate the media segment corresponding to the currently read content.

[0092] The above solution enables users to identify the relationship between the third interactive content 226 and the first media content; at the same time, users can return to the first media content by triggering the first element 228, thereby reducing the need to search for the corresponding episodes and restore the playback position.

[0093] In some cases, the electronic device 110 presents a playback component on a second interface and plays the first media content within the playback component. For example, such as... Figure 2E As shown, the electronic device 110 can present an interface 200E, and a playback component 218 is presented in the interface 200E. The playback component 218 can continue playing the episode while displaying the second media content; in other cases, when entering the second interface 200C from the interface 200A, the electronic device 110 can first pause the first media content, and resume playback through the playback component 218 after the user selects to continue playback.

[0094] The above solution enables users to select the appropriate media delivery method based on their current content consumption needs, and reduces the need to switch back and forth between separate first and second media content pages.

[0095] In some cases, the electronic device 110 receives a fifth operation, which is associated with the playback component 218, and moves or stops displaying the playback component 218 based on the fifth operation. The playback component 218 can be implemented as a floating component, thereby supporting the user to move the playback component 218 by dragging. As an example, the user can drag the playback component 218 from the position that obscures the first content unit 216 to another area of ​​the interface 200E, or trigger the close entry of the playback component 218 to stop displaying the playback component 218; after closing, the electronic device 110 can continue to retain the playback progress of the first media content.

[0096] The above solution allows users to adjust the position of the playback component according to the current content layout, while reducing the obstruction of the playback component on the first content unit 216 and the surrounding content.

[0097] In some scenarios, electronic device 110 receives interactive operations on a first interface. These operations are associated with first interactive content, and the device updates the interactive information corresponding to second interactive content based on these operations. For example, electronic device 110 may present an interactive component associated with the first interactive content 202-1 on the first interface. Such an interactive component can be used to comment on, favorite, or forward the first interactive content 202-1. Electronic device 110 can receive interactive operations through such an interactive component. Interactive operations can include commenting on, favoriteing, or forwarding the first interactive content 202-1. Taking favorited content 202-1 as an example, after receiving an interactive operation to favorite the first interactive content 202-1, electronic device 110 can send a favorite request to server 130. Upon receiving the favorite request, server 130 can determine the corresponding second interactive content 212 based on the identification information corresponding to the first interactive content 202-1. Further, server 130 can update the interactive information of the second interactive content 212 based on the favorite request. For example, update the number of favorites for the second interactive content 212 and provide the updated interactive information to the electronic device 110. Further, such as... Figure 2C and Figure 2H As shown, the electronic device 110 can present an interface 200H and display updated interactive information 230 in the interface 200H. For example, the electronic device 110 can update the number of favorites from "99" shown in interactive information 214 to "100" shown in the updated interactive information 230 in the interface 200H.

[0098] The above solution reduces the number of operations users need to access different interfaces to update the interactive information of the source interactive content, and avoids data inconsistencies caused by the first and second interactive content maintaining their interactive states separately.

[0099] In some scenarios, interactive operations are used to retrieve comment content, and updating interactive information includes displaying comment content associated with second interactive content, where the comment content serves as a comment on the second interactive content. Users can perform comment operations on first interactive content 202-1 in interface 200A. Electronic device 110 can retrieve the comment content and cause server 130 to associate the comment content with the interactive content identifier of second interactive content 212. As an example, such as Figure 2C and Figure 2H As shown, electronic device 110 can display interface 200H. Electronic device 110 can display comment content 232 "You are right" in conjunction with second interactive content 212, and comment content 232 serves as a comment on second interactive content 212.

[0100] The above solution enables comments generated in the first media content consumption scenario to be incorporated into the comment relationship of the second interactive content without the need to establish a separate comment thread from the second interactive content.

[0101] In some cases, the aforementioned cross-work type interactive information synchronization can be implemented bidirectionally. For example, when short videos are associated with text and image works, interactive content based on text and image comments can be presented within the short video. Alternatively, the corresponding video segment can be determined based on the release time of the short video interactive content, and then, based on the correspondence between the video segment and one or more content units of the text and image work, the short video interactive content that meets the criteria can be presented near the corresponding text and image content. In cases where one media position corresponds to multiple candidate content units, candidate content can be presented to the user, and the corresponding content unit can be determined based on the user's selection.

[0102] In some scenarios, the primary media content can be video, and the secondary media content can be audio. Video can be published based on audio; for example, when a user publishes a video, they can select existing audio as the associated audio or background music, establishing a publishing association between the video identifier and the audio identifier. Video can also be generated based on audio; for example, a visual video including subtitles, images, animations, or waveforms can be generated based on at least one of the audio's speech content, rhythm, playback time, or waveform. In both scenarios, video and audio can be associated, but the stages at which this association is formed can differ: the former can be established during the video publishing stage, while the latter can be established during the video generation or production stage.

[0103] As an example of synchronized interactive content between video and audio, the first media content can be a visualized video generated from an audio clip, and the second media content can be that audio clip. The second interactive content can be a comment posted by a user when the first audio segment is played. When the electronic device 110 plays the video segment in the visualized video corresponding to the first audio segment, it can present the first interactive content derived from the second interactive content. For example, if a user posts a comment "The transition here is very natural" at the first playback point of the audio, the electronic device 110 can present this comment as a bullet screen or other interactive content when the video plays to the scene corresponding to the first playback point.

[0104] In another scenario, the first media content can be live streaming content, and the second media content can be a short video. The live streaming content and the short video can be associated by playing, explaining, or referencing the short video during the live stream, or by sharing the same content source identifier. When the live stream plays or explains the corresponding content described in the short video, the electronic device 110 can present first interactive content based on comments on the short video on the live streaming interface. In yet another scenario, the first media content can be a short video, and the second media content can be a text-based work; the short video can be adapted or generated from the text-based work, and when playing a video clip used to interpret a specific segment of the text-based work, first interactive content based on comments posted on that segment is presented.

[0105] In another scenario, the first media content can be a text / image work, and the second media content can be an audio work. The text / image work can be a transcript, summary, illustrated version, or related content of the audio work. The second interactive content can be user comments on corresponding audio segments of the audio work, and the first interactive content can be displayed in the text / image work near the corresponding text paragraph or image. Users can also trigger the first interactive content to enter the interactive content interface of the audio work or play the corresponding audio segment. This approach improves the semantic relevance of interactive content presented across different work types to the current content.

[0106] The above solution alleviates the difficulty of accurately presenting the separate interactive data of different media content at the current playback position, and improves the efficiency of users obtaining information. Furthermore, application 120 does not need to repeatedly generate the same semantic interactive data for the first interface, thereby reducing the amount of data generation, processing, and storage, and improving the accuracy of the association between the first interactive content and the current media content.

[0107] Example process Figure 3 A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0108] like Figure 3 As shown, in box 310, electronic device 110 presents a first interface, which displays first media content. The first media content is associated with second media content, and the first media content and second media content have different work types.

[0109] In frame 320, electronic device 110 presents first interactive content on the first interface. The first interactive content corresponds to second interactive content, and the second interactive content is associated with the release of second media content.

[0110] In some cases, process 300 further includes: receiving a first operation, the first operation including a triggering operation on first interactive content; and presenting a second interface, the second interface displaying at least one interactive content, the at least one interactive content including second interactive content, the at least one interactive content being associated with second media content.

[0111] In some cases, process 300 further includes: presenting first content on a second interface, the first content corresponding to at least a portion of the second media content, the second interactive content being associated with at least a portion of the publication.

[0112] In some cases, process 300 further includes: receiving a second operation, the second operation including a triggering operation on the first content; and presenting the second media content, and presenting at least a portion of it in a first style.

[0113] In some cases, process 300 further includes: presenting an interactive content display component on a second interface, the interactive content display component including at least one interactive content, the at least one interactive content being interactive content for at least a portion; and presenting second interactive content at a predetermined position on the interactive content display component.

[0114] In some cases, process 300 further includes: receiving a third operation for acquiring third interactive content; presenting the third interactive content and a first element on a second interface, the first element indicating that the third interactive content is associated with first media content; and presenting a first interface in response to receiving a fourth operation, the fourth operation including a triggering operation on the first element.

[0115] In some cases, process 300 also includes: presenting a playback component on a second interface; and playing the first media content in the playback component.

[0116] In some cases, process 300 further includes: receiving a fifth operation, the fifth operation being associated with the playback component; and based on the fifth operation, moving the playback component or stopping the presentation of the playback component.

[0117] In some cases, the first media content includes a first segment, which corresponds to the first content unit of the second media content, and the second interactive content is interactive content for the first content unit.

[0118] In some cases, presenting the first interactive content includes: presenting the first interactive content in response to playing the first segment.

[0119] In some cases, the first media content also includes a second segment, which corresponds to a second content unit of the second media content. The process 300 also includes: in response to playing the second segment, presenting fourth interactive content, which corresponds to a fifth interactive content of the second media content, and the fifth interactive content is interactive content for the second content unit.

[0120] In some cases, the second interactive content is selected from a set of interactive content based on interactive information, and the set of interactive content is associated with the first content unit.

[0121] In some cases, the first segment includes at least one storyboard, which is derived from the first content unit.

[0122] In some cases, presenting the first interactive content includes: presenting the first interactive content in a second style on a first interface, and presenting the sixth interactive content in a third style, wherein the second style is different from the third style, and the first interactive content and the sixth interactive content correspond to different sources.

[0123] In some cases, the first interactive content includes a first part and a second part, where the first part describes the source of the first interactive content and the second part is derived from the second interactive content.

[0124] In some cases, the second part includes at least a portion of the second interactive content.

[0125] In some cases, process 300 further includes: receiving an interactive operation on a first interface, the interactive operation being associated with first interactive content; and updating interactive information based on the interactive operation, the interactive information corresponding to second interactive content.

[0126] In some cases, interactive actions are used to retrieve comment content, and updating interactive information includes: associating with second interactive content, presenting comment content, wherein the comment content serves as a comment on the second interactive content.

[0127] In some cases, presenting the first interactive content includes: presenting the first interactive content based on motion effects in a first area of ​​a first interface, the motion effects including the movement of the first interactive content in the first area, the first area being used to play the first media content.

[0128] In some cases, the first interactive content is superimposed on the first media content.

[0129] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A schematic structural block diagram of an example device 400 for interface interaction is shown, according to some scenarios. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0130] like Figure 4As shown, the device 400 includes: a first presentation module 410 configured to present a first interface, the first interface displaying first media content, the first media content being associated with second media content, the first media content and the second media content having different work types; and a second presentation module 420 configured to present first interactive content on the first interface, the first interactive content corresponding to the second interactive content, the second interactive content being associated with the publication of the second media content.

[0131] In some cases, device 400 further includes a third presentation module configured to receive a first operation, the first operation including a triggering operation on first interactive content; and to present a second interface displaying at least one interactive content, the at least one interactive content including second interactive content, the at least one interactive content being associated with second media content.

[0132] In some cases, device 400 also includes a fourth presentation module configured to present first content on a second interface, the first content corresponding to at least a portion of second media content, the second interactive content being associated with at least a portion of the publication.

[0133] In some cases, device 400 also includes a fifth presentation module configured to receive a second operation, the second operation including a triggering operation on the first content; and to present the second media content and present at least a portion of it in a first style.

[0134] In some cases, device 400 also includes a sixth presentation module configured to present an interactive content display component on a second interface, the interactive content display component including at least one interactive content, the at least one interactive content being interactive content for at least a portion; and to present second interactive content at a predetermined position on the interactive content display component.

[0135] In some cases, device 400 further includes a first receiving module configured to receive a third operation for acquiring third interactive content; present the third interactive content and a first element on a second interface, the first element indicating that the third interactive content is associated with first media content; and, in response to receiving a fourth operation, present the first interface, the fourth operation including a triggering operation on the first element.

[0136] In some cases, device 400 also includes a playback module configured to present a playback component on a second interface; and to play first media content in the playback component.

[0137] In some cases, device 400 also includes a movement module configured to receive a fifth operation associated with the playback component; and based on the fifth operation, to move the playback component or stop displaying the playback component.

[0138] In some cases, the first media content includes a first segment, which corresponds to the first content unit of the second media content, and the second interactive content is interactive content for the first content unit.

[0139] In some cases, the second presentation module 420 is also configured to present first interactive content in response to playing a first segment of the first media content.

[0140] In some cases, the first media content also includes a second segment, which corresponds to a second content unit of the second media content. The device 400 also includes a seventh presentation module configured to present a fourth interactive content in response to playing the second segment of the first media content. The fourth interactive content corresponds to a fifth interactive content of the second media content, which is interactive content for the second content unit.

[0141] In some cases, the second interactive content is selected from a set of interactive content based on interactive information, and the set of interactive content is associated with the first content unit.

[0142] In some cases, the first segment includes at least one storyboard, which is derived from the first content unit.

[0143] In some cases, the second presentation module 420 is also configured to: present the first interactive content in a second style and the sixth interactive content in a third style on the first interface, wherein the second style is different from the third style and the first and sixth interactive contents correspond to different sources.

[0144] In some cases, the first interactive content includes a first part and a second part, where the first part describes the source of the first interactive content and the second part is derived from the second interactive content.

[0145] In some cases, the second part includes at least a portion of the second interactive content.

[0146] In some cases, the device 400 also includes an update module configured to receive an interactive operation on a first interface, the interactive operation being associated with first interactive content; and to update interactive information based on the interactive operation, the interactive information corresponding to second interactive content.

[0147] In some cases, the interactive action is used to retrieve comment content, and the update module is also configured to: associate with the second interactive content and present the comment content, where the comment content serves as a comment on the second interactive content.

[0148] In some cases, the second presentation module 420 is also configured to: present first interactive content based on motion effects in a first area of ​​a first interface, the motion effects including the movement of the first interactive content in the first area, the first area being used to play first media content.

[0149] In some cases, the first interactive content is superimposed on the first media content.

[0150] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0151] Figure 5 A block diagram of an electronic device 500 in which one or more examples can be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0152] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0153] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0154] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0155] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0156] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0157] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0158] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0159] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0160] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0161] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0162] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: A first interface is presented, which displays first media content. The first media content is associated with second media content, and the first media content and the second media content have different work types. as well as On the first interface, first interactive content is presented, which corresponds to second interactive content, and the second interactive content is associated with the publication of second media content.

2. The method according to claim 1, further comprising: Receive a first operation, the first operation including a trigger operation on the first interactive content; as well as A second interface is presented, which displays at least one interactive content, including the second interactive content, and the at least one interactive content is associated with the second media content.

3. The method according to claim 2, further comprising: On the second interface, first content is presented, which corresponds to at least a portion of the second media content, and the second interactive content is associated with the publication of the at least a portion.

4. The method according to claim 3, further comprising: Receive a second operation, the second operation including a trigger operation on the first content; as well as The second media content is presented, and at least a portion thereof is presented in the first style.

5. The method according to claim 3, further comprising: On the second interface, an interactive content display component is presented, which includes the at least one interactive content, and the at least one interactive content is interactive content for the at least part of the content. as well as The second interactive content is presented at a predetermined position in the interactive content display component.

6. The method according to claim 2, further comprising: Receive a third operation, the third operation being used to obtain third interactive content; On the second interface, the third interactive content and the first element are presented, and the first element indicates that the third interactive content is associated with the first media content; as well as In response to receiving a fourth operation, the first interface is presented, the fourth operation including a trigger operation on the first element.

7. The method according to claim 2, further comprising: The playback component is displayed on the second interface; as well as The playback component plays the first media content.

8. The method of claim 7, further comprising: Receive a fifth operation, which is associated with the playback component; as well as Based on the fifth operation, the playback component is moved or the playback component is stopped from being displayed.

9. The method according to claim 1, wherein the first media content includes a first segment, the first segment corresponds to a first content unit of the second media content, and the second interactive content is interactive content for the first content unit.

10. The method of claim 9, wherein presenting the first interactive content comprises: In response to playing the first segment, the first interactive content is presented.

11. The method of claim 10, wherein the first media content further includes a second segment, the second segment corresponding to a second content unit of the second media content, and the method further includes: In response to the playback of the second segment, a fourth interactive content is presented, which corresponds to the fifth interactive content of the second media content, and the fifth interactive content is interactive content for the second content unit.

12. The method of claim 1, wherein presenting the first interactive content comprises: On the first interface, the first interactive content is presented in a second style, and the sixth interactive content is presented in a third style. The second style is different from the third style, and the first interactive content and the sixth interactive content correspond to different sources.

13. The method of claim 1, wherein the first interactive content comprises a first part and a second part, the first part describing the source of the first interactive content, and the second part being derived based on the second interactive content.

14. The method of claim 13, wherein the second portion comprises at least a portion of the second interactive content.

15. The method of claim 1, further comprising: On the first interface, an interactive operation is received, and the interactive operation is associated with the first interactive content; as well as Based on the interactive operation, the interactive information is updated, and the interactive information corresponds to the second interactive content.

16. The method of claim 15, wherein the interactive operation is used to obtain comment content, and the updating interactive information includes: The comment content is presented in relation to the second interactive content, wherein the comment content serves as a comment on the second interactive content.

17. The method of claim 1, wherein presenting the first interactive content comprises: In a first area of ​​the first interface, the first interactive content is presented based on animation effects, the animation effects including the movement of the first interactive content in the first area, and the first area is used to play the first media content.

18. A device for user interface interaction, comprising: The first presentation module is configured to present a first interface, which displays first media content. The first media content is associated with second media content, and the first media content and the second media content have different work types. as well as The second presentation module is configured to present first interactive content on the first interface. The first interactive content corresponds to the second interactive content, and the second interactive content is associated with the second media content publication.

19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.

Images